Many types of real-world information systems, including social media and e-commerce platforms, can be modelled by means of attribute-rich, connected networks. The goal of anomaly detection in artificial intelligence i...Many types of real-world information systems, including social media and e-commerce platforms, can be modelled by means of attribute-rich, connected networks. The goal of anomaly detection in artificial intelligence is to identify illustrations that deviate significantly from the main distribution of data or that differ from known cases. Anomalous nodes in node-attributed networks can be identified with greater precision if both graph and node attributes are taken into account. Almost all of the studies in this area focus on supervised techniques for spotting outliers. While supervised algorithms for anomaly detection work well in theory, they cannot be applied to real-world applications owing to a lack of labelled data. Considering the possible data distribution, our model employs a dual variational autoencoder (VAE), while a generative adversarial network (GAN) assures that the model is robust to adversarial training. The dual VAEs are used in another capacity: as a fake-node generator. Adversarial training is used to ensure that our latent codes have a Gaussian or uniform distribution. To provide a fair presentation of the graph, the discriminator instructs the generator to generate latent variables with distributions that are more consistent with the actual distribution of the data. Once the model has been learned, the discriminator is used for anomaly detection via reconstruction loss which has been trained to distinguish between the normal and artificial distributions of data. First, using a dual VAE, our model simultaneously captures cross-modality interactions between topological structure and node characteristics and overcomes the problem of unlabeled anomalies, allowing us to better understand the network sparsity and nonlinearity. Second, the proposed model considers the regularization of the latent codes while solving the issue of unregularized embedding techniques that can quickly lead to unsatisfactory representation. Finally, we use the discriminator reconstruction loss for anomaly detection as the discriminator is well-trained to separate the normal and generated data distributions because reconstruction-based loss does not include the adversarial component. Experiments conducted on attributed networks demonstrate the effectiveness of the proposed model and show that it greatly surpasses the previous methods. The area under the curve scores of our proposed model for the BlogCatalog, Flickr, and Enron datasets are 0.83680, 0.82020, and 0.71180, respectively, proving the effectiveness of the proposed model. The result of the proposed model on the Enron dataset is slightly worse than other models;we attribute this to the dataset’s low dimensionality as the most probable explanation.展开更多
The health status of aero engines is very important to the flight safety.However,it is difficult for aero engines to make an effective fault diagnosis due to its complex structure and poor working environment.Therefor...The health status of aero engines is very important to the flight safety.However,it is difficult for aero engines to make an effective fault diagnosis due to its complex structure and poor working environment.Therefore,an effective fault diagnosis method for aero engines based on the gravitational search algorithm and the stack autoencoder(GSA-SAE)is proposed,and the fault diagnosis technology of a turbofan engine is studied.Firstly,the data of 17 parameters,including total inlet air temperature,high-pressure rotor speed,low-pressure rotor speed,turbine pressure ratio,total inlet air temperature of high-pressure compressor and outlet air pressure of high-pressure compressor and so on,are preprocessed,and the fault diagnosis model architecture of SAE is constructed.In order to solve the problem that the best diagnosis effect cannot be obtained due to manually setting the number of neurons in each hidden layer of SAE network,a GSA optimization algorithm for the SAE network is proposed to find and obtain the optimal number of neurons in each hidden layer of SAE network.Furthermore,an optimal fault diagnosis model based on GSA-SAE is established for aero engines.Finally,the effectiveness of the optimal GSA-SAE fault diagnosis model is demonstrated using the practical data of aero engines.The results illustrate that the proposed fault diagnosis method effectively solves the problem of the poor fault diagnosis result because of manually setting the number of neurons in each hidden layer of SAE network,and has good fault diagnosis efficiency.The fault diagnosis accuracy of the GSA-SAE model reaches 98.222%,which is significantly higher than that of SAE,the general regression neural network(GRNN)and the back propagation(BP)network fault diagnosis models.展开更多
In this article,we use a convolutional autoencoder neural network to reduce data dimensioning and rebuild soliton dynamics in a passively mode-locked fiber laser.Based on the particle characteristic in double solitons...In this article,we use a convolutional autoencoder neural network to reduce data dimensioning and rebuild soliton dynamics in a passively mode-locked fiber laser.Based on the particle characteristic in double solitons and triple solitons interactions,we found that there is a strict correspondence between the number of minimum compression parameters and the number of independent parameters of soliton interaction.This shows that our network effectively coarsens the high-dimensional data in nonlinear systems.Our work not only introduces new prospects for the laser self-optimization algorithm,but also brings new insights into the modeling of nonlinear systems and description of soliton interactions.展开更多
Similarity measurement has been a prevailing research topic geographic information science.Geometric similarity measurement inin scaling transformation(GSM_ST)is critical to ensure spatial data quality while balancing...Similarity measurement has been a prevailing research topic geographic information science.Geometric similarity measurement inin scaling transformation(GSM_ST)is critical to ensure spatial data quality while balancing detailed information with distinctive features.However,GSM_ST is an uncertain problem due to subjective spatial cognition,global and local concerns,and geometric complexity.Traditional rule-based methods considering multiple consistent conditions require subjective adjustments to characteristics and weights,leading to poor robustness in addressing GSM_ST.This study proposes an unsupervised representation learning framework for automated GSM_ST,using a Graph Autoencoder Network(GAE)and drainage networks as an example.The framework involves constructing a drainage graph,designing the GAE architecture for GSM_ST,and using Cosine similarity to measure similarity based on the GAE-derived drainage embeddings in different scales.We perform extensive experiments and compare methods across 71 drainage networks duringfive scaling transformations.The results show that the proposed GAE method outperforms other methods with a satisfaction ratio of around 88%and has strong robustness.Moreover,our proposed method also can be applied to other scenarios,such as measuring similarity between geographical entities at different times and data from different datasets.展开更多
Background Cumulus clouds are important elements in creating virtual outdoor scenes.Modeling cumulus clouds that have a specific shape is difficult owing to the fluid nature of the cloud.Image-based modeling is an eff...Background Cumulus clouds are important elements in creating virtual outdoor scenes.Modeling cumulus clouds that have a specific shape is difficult owing to the fluid nature of the cloud.Image-based modeling is an efficient method to solve this problem.Because of the complexity of cloud shapes,the task of modeling the cloud from a single image remains in the development phase.Methods In this study,a deep learning-based method was developed to address the problem of modeling 3D cumulus clouds from a single image.The method employs a three-dimensional autoencoder network that combines the variational autoencoder and the generative adversarial network.First,a 3D cloud shape is mapped into a unique hidden space using the proposed autoencoder.Then,the parameters of the decoder are fixed.A shape reconstruction network is proposed for use instead of the encoder part,and it is trained with rendered images.To train the presented models,we constructed a 3D cumulus dataset that included 2003D cumulus models.These cumulus clouds were rendered under different lighting parameters.Results The qualitative experiments showed that the proposed autoencoder method can learn more structural details of 3D cumulus shapes than existing approaches.Furthermore,some modeling experiments on rendering images demonstrated the effectiveness of the reconstruction model.Conclusion The proposed autoencoder network learns the latent space of 3D cumulus cloud shapes.The presented reconstruction architecture models a cloud from a single image.Experiments demonstrated the effectiveness of the two models.展开更多
Monitoring and classifying disturbed forests can provide information support for not only sustainable forest management but also global carbon sequestration assessments.In this study,we propose an autoencoder-based mo...Monitoring and classifying disturbed forests can provide information support for not only sustainable forest management but also global carbon sequestration assessments.In this study,we propose an autoencoder-based model for forest disturbance detection,which considers disturbances as anomalous events in forest temporal trajectories.The autoencoder network is established and trained to reconstruct intact forest trajectories.Then,the disturbance detection threshold is derived by Tukey’s method based on the reconstruction error of the intact forest trajectory.The assessment result shows that the model using the NBR time series performs better than the NDVIbased model,with an overall accuracy of 90.3%.The omission and commission errors of disturbed forest are 7%and 12%,respectively.Additionally,the trained NBR-based model is implemented in two test areas,with overall accuracies of 87.2%and 86.1%,indicating the robustness and scalability of the model.Moreover,comparing three common methods,the proposed model performs better,especially for intact forest detection accuracy.This study provides a novel and robust approach with acceptable accuracy for forest disturbance detection,enabling forest disturbance to be identified in regions with limited disturbance reference data.展开更多
文摘Many types of real-world information systems, including social media and e-commerce platforms, can be modelled by means of attribute-rich, connected networks. The goal of anomaly detection in artificial intelligence is to identify illustrations that deviate significantly from the main distribution of data or that differ from known cases. Anomalous nodes in node-attributed networks can be identified with greater precision if both graph and node attributes are taken into account. Almost all of the studies in this area focus on supervised techniques for spotting outliers. While supervised algorithms for anomaly detection work well in theory, they cannot be applied to real-world applications owing to a lack of labelled data. Considering the possible data distribution, our model employs a dual variational autoencoder (VAE), while a generative adversarial network (GAN) assures that the model is robust to adversarial training. The dual VAEs are used in another capacity: as a fake-node generator. Adversarial training is used to ensure that our latent codes have a Gaussian or uniform distribution. To provide a fair presentation of the graph, the discriminator instructs the generator to generate latent variables with distributions that are more consistent with the actual distribution of the data. Once the model has been learned, the discriminator is used for anomaly detection via reconstruction loss which has been trained to distinguish between the normal and artificial distributions of data. First, using a dual VAE, our model simultaneously captures cross-modality interactions between topological structure and node characteristics and overcomes the problem of unlabeled anomalies, allowing us to better understand the network sparsity and nonlinearity. Second, the proposed model considers the regularization of the latent codes while solving the issue of unregularized embedding techniques that can quickly lead to unsatisfactory representation. Finally, we use the discriminator reconstruction loss for anomaly detection as the discriminator is well-trained to separate the normal and generated data distributions because reconstruction-based loss does not include the adversarial component. Experiments conducted on attributed networks demonstrate the effectiveness of the proposed model and show that it greatly surpasses the previous methods. The area under the curve scores of our proposed model for the BlogCatalog, Flickr, and Enron datasets are 0.83680, 0.82020, and 0.71180, respectively, proving the effectiveness of the proposed model. The result of the proposed model on the Enron dataset is slightly worse than other models;we attribute this to the dataset’s low dimensionality as the most probable explanation.
基金supported by the National Natural Science Foundation of China(No.51605309)the Aeronautical Science Foundation of China(Nos.201933054002,20163354004)。
文摘The health status of aero engines is very important to the flight safety.However,it is difficult for aero engines to make an effective fault diagnosis due to its complex structure and poor working environment.Therefore,an effective fault diagnosis method for aero engines based on the gravitational search algorithm and the stack autoencoder(GSA-SAE)is proposed,and the fault diagnosis technology of a turbofan engine is studied.Firstly,the data of 17 parameters,including total inlet air temperature,high-pressure rotor speed,low-pressure rotor speed,turbine pressure ratio,total inlet air temperature of high-pressure compressor and outlet air pressure of high-pressure compressor and so on,are preprocessed,and the fault diagnosis model architecture of SAE is constructed.In order to solve the problem that the best diagnosis effect cannot be obtained due to manually setting the number of neurons in each hidden layer of SAE network,a GSA optimization algorithm for the SAE network is proposed to find and obtain the optimal number of neurons in each hidden layer of SAE network.Furthermore,an optimal fault diagnosis model based on GSA-SAE is established for aero engines.Finally,the effectiveness of the optimal GSA-SAE fault diagnosis model is demonstrated using the practical data of aero engines.The results illustrate that the proposed fault diagnosis method effectively solves the problem of the poor fault diagnosis result because of manually setting the number of neurons in each hidden layer of SAE network,and has good fault diagnosis efficiency.The fault diagnosis accuracy of the GSA-SAE model reaches 98.222%,which is significantly higher than that of SAE,the general regression neural network(GRNN)and the back propagation(BP)network fault diagnosis models.
基金supported by the National Natural Science Foundation of China(Nos.12274238 and 61835006)the National Key Research and Development Program of China(No.2018YFB1801802)+2 种基金the Beijing-Tianjin-Hebei Basic Research Cooperation Project(No.21JCZXJC00010)the Natural Science Foundation of Tianjin City(No.19JCZDJC31200)the Tianjin Research Innovation Project for Postgraduate Students(No.2021YJSB083)。
文摘In this article,we use a convolutional autoencoder neural network to reduce data dimensioning and rebuild soliton dynamics in a passively mode-locked fiber laser.Based on the particle characteristic in double solitons and triple solitons interactions,we found that there is a strict correspondence between the number of minimum compression parameters and the number of independent parameters of soliton interaction.This shows that our network effectively coarsens the high-dimensional data in nonlinear systems.Our work not only introduces new prospects for the laser self-optimization algorithm,but also brings new insights into the modeling of nonlinear systems and description of soliton interactions.
基金supported by the National Natural Science Foundation of China[grant number 41531180]the National Natural Science Foundation of China[grant number 42071450]the China Scholarship Council(CSC)[grant number 202206270076].
文摘Similarity measurement has been a prevailing research topic geographic information science.Geometric similarity measurement inin scaling transformation(GSM_ST)is critical to ensure spatial data quality while balancing detailed information with distinctive features.However,GSM_ST is an uncertain problem due to subjective spatial cognition,global and local concerns,and geometric complexity.Traditional rule-based methods considering multiple consistent conditions require subjective adjustments to characteristics and weights,leading to poor robustness in addressing GSM_ST.This study proposes an unsupervised representation learning framework for automated GSM_ST,using a Graph Autoencoder Network(GAE)and drainage networks as an example.The framework involves constructing a drainage graph,designing the GAE architecture for GSM_ST,and using Cosine similarity to measure similarity based on the GAE-derived drainage embeddings in different scales.We perform extensive experiments and compare methods across 71 drainage networks duringfive scaling transformations.The results show that the proposed GAE method outperforms other methods with a satisfaction ratio of around 88%and has strong robustness.Moreover,our proposed method also can be applied to other scenarios,such as measuring similarity between geographical entities at different times and data from different datasets.
基金the National Key R&D Program of China(2017YFB1002702).
文摘Background Cumulus clouds are important elements in creating virtual outdoor scenes.Modeling cumulus clouds that have a specific shape is difficult owing to the fluid nature of the cloud.Image-based modeling is an efficient method to solve this problem.Because of the complexity of cloud shapes,the task of modeling the cloud from a single image remains in the development phase.Methods In this study,a deep learning-based method was developed to address the problem of modeling 3D cumulus clouds from a single image.The method employs a three-dimensional autoencoder network that combines the variational autoencoder and the generative adversarial network.First,a 3D cloud shape is mapped into a unique hidden space using the proposed autoencoder.Then,the parameters of the decoder are fixed.A shape reconstruction network is proposed for use instead of the encoder part,and it is trained with rendered images.To train the presented models,we constructed a 3D cumulus dataset that included 2003D cumulus models.These cumulus clouds were rendered under different lighting parameters.Results The qualitative experiments showed that the proposed autoencoder method can learn more structural details of 3D cumulus shapes than existing approaches.Furthermore,some modeling experiments on rendering images demonstrated the effectiveness of the reconstruction model.Conclusion The proposed autoencoder network learns the latent space of 3D cumulus cloud shapes.The presented reconstruction architecture models a cloud from a single image.Experiments demonstrated the effectiveness of the two models.
基金funded by the National Natural Science Foundation of China under Grant 41871223the China Scholarship Council(CSC)(No.201806400048)for doctoral scholarship support.
文摘Monitoring and classifying disturbed forests can provide information support for not only sustainable forest management but also global carbon sequestration assessments.In this study,we propose an autoencoder-based model for forest disturbance detection,which considers disturbances as anomalous events in forest temporal trajectories.The autoencoder network is established and trained to reconstruct intact forest trajectories.Then,the disturbance detection threshold is derived by Tukey’s method based on the reconstruction error of the intact forest trajectory.The assessment result shows that the model using the NBR time series performs better than the NDVIbased model,with an overall accuracy of 90.3%.The omission and commission errors of disturbed forest are 7%and 12%,respectively.Additionally,the trained NBR-based model is implemented in two test areas,with overall accuracies of 87.2%and 86.1%,indicating the robustness and scalability of the model.Moreover,comparing three common methods,the proposed model performs better,especially for intact forest detection accuracy.This study provides a novel and robust approach with acceptable accuracy for forest disturbance detection,enabling forest disturbance to be identified in regions with limited disturbance reference data.