Geometric prior guided hybrid deep neural network for facial beauty analysis

Facial beauty analysis is an important topic in human society.It may be used as a guidance for face beautification applications such as cosmetic surgery.Deep neural networks(DNNs)have recently been adopted for facial beauty analysis and have achieved remarkable performance.However,most existing DNN-based models regard facial beauty analysis as a normal classification task.They ignore important prior knowledge in traditional machine learning models which illustrate the significant contribution of the geometric features in facial beauty analysis.To be specific,landmarks of the whole face and facial organs are introduced to extract geometric features to make the decision.Inspired by this,we introduce a novel dual-branch network for facial beauty analysis:one branch takes the Swin Transformer as the backbone to model the full face and global patterns,and another branch focuses on the masked facial organs with the residual network to model the local patterns of certain facial parts.Additionally,the designed multi-scale feature fusion module can further facilitate our network to learn complementary semantic information between the two branches.In model optimisation,we propose a hybrid loss function,where especially geometric regulation is introduced by regressing the facial landmarks and it can force the extracted features to convey facial geometric features.Experiments performed on the SCUT-FBP5500 dataset and the SCUT-FBP dataset demonstrate that our model outperforms the state-of-the-art convolutional neural networks models,which proves the effectiveness of the proposed geometric regularisation and dual-branch structure with the hybrid network.To the best of our knowledge,this is the first study to introduce a Vision Transformer into the facial beauty analysis task.

Using deep neural networks coupled with principal component analysis for ore production forecasting at open-pit mines

Ore production is usually affected by multiple influencing inputs at open-pit mines.Nevertheless,the complex nonlinear relationships between these inputs and ore production remain unclear.This becomes even more challenging when training data(e.g.truck haulage information and weather conditions)are massive.In machine learning(ML)algorithms,deep neural network(DNN)is a superior method for processing nonlinear and massive data by adjusting the amount of neurons and hidden layers.This study adopted DNN to forecast ore production using truck haulage information and weather conditions at open-pit mines as training data.Before the prediction models were built,principal component analysis(PCA)was employed to reduce the data dimensionality and eliminate the multicollinearity among highly correlated input variables.To verify the superiority of DNN,three ANNs containing only one hidden layer and six traditional ML models were established as benchmark models.The DNN model with multiple hidden layers performed better than the ANN models with a single hidden layer.The DNN model outperformed the extensively applied benchmark models in predicting ore production.This can provide engineers and researchers with an accurate method to forecast ore production,which helps make sound budgetary decisions and mine planning at open-pit mines.

Comparative Analysis of the Factors Influencing Metro Passenger Arrival Volumes in Wuhan, China, and Lagos, Nigeria: An Application of Association Rule Mining and Neural Network Models

This study explores the factors influencing metro passengers’ arrival volume in Wuhan, China, and Lagos, Nigeria, by examining weather, time of day, waiting time, travel behavior, arrival patterns, and metro satisfaction. It addresses a significant research gap in understanding metro passengers’ dynamics across cultural and geographical contexts. It employs questionnaires, field observations, and advanced data analysis techniques like association rule mining and neural network modeling. Key findings include a correlation between rainy weather, shorter waiting times, and higher arrival volumes. Neural network models showed high predictive accuracy, with waiting time, metro satisfaction, and weather being significant factors in Lagos Light Rail Blue Line Metro. In contrast, arrival patterns, weather, and time of day were more influential in Wuhan Metro Line 5. Results suggest that improving metro satisfaction and reducing waiting times could increase arrival volumes in Lagos Metro while adjusting schedules for weather and peak times could optimize flow in Wuhan Metro. These insights are valuable for transportation planning, passenger arrival volume management, and enhancing user experiences, potentially benefiting urban transportation sustainability and development goals.

Application of Bayesian Analysis Based on Neural Network and Deep Learning in Data Visualization

This study aims to explore the application of Bayesian analysis based on neural networks and deep learning in data visualization.The research background is that with the increasing amount and complexity of data,traditional data analysis methods have been unable to meet the needs.Research methods include building neural networks and deep learning models,optimizing and improving them through Bayesian analysis,and applying them to the visualization of large-scale data sets.The results show that the neural network combined with Bayesian analysis and deep learning method can effectively improve the accuracy and efficiency of data visualization,and enhance the intuitiveness and depth of data interpretation.The significance of the research is that it provides a new solution for data visualization in the big data environment and helps to further promote the development and application of data science.

Research on runoff variations based on wavelet analysis and wavelet neural network model： A case study of the Heihe River drainage basin （1944-2005）

The Heihe River drainage basin is one of the endangered ecological regions of China. The shortage of water resources is the bottleneck, which constrains the sustainable development of the region. Many scholars in China have done researches concerning this problem. Based on previous researches, this paper analyzed characteristics, tendencies, and causes of annual runoff variations in the Yingluo Gorge （1944-2005） and the Zhengyi Gorge （1954-2005）, which are the boundaries of the upper reaches, the middle reaches, and the lower reaches of the Heihe River drainage basin, by wavelet analysis, wavelet neural network model, and GIS spatial analysis. The results show that： （1） annual runoff variations of the Yingluo Gorge have principal periods of 7 years and 25 years, and its increasing rate is 1.04 m^3/s.10y; （2） annual runoff variations of the Zhengyi Gorge have principal periods of 6 years and 27 years, and its decreasing rate is 2.25 m^3/s.10y; （3） prediction results show that： during 2006-2015, annual runoff variations of the Yingluo and Zhengyi gorges have ascending tendencies, and the increasing rates are respectively 2.04 m^3/s.10y and 1.61 m^3/s.10y; （4） the increase of annual runoff in the Yingluo Gorge has causal relationship with increased temperature and precipitation in the upper reaches, and the decrease of annual runoff in the Zhengyi Gorge in the past decades was mainly caused by the increased human consumption of water resources in the middle researches. The study results will provide scientific basis for making rational use and allocation schemes of water resources in the Heihe River drainage basin.

Tide Forecasting of Tides Around Taiwan by Artificial Neural Network Method and Wavelet Analysis

In maltiresolution analysis （MRA） by wavelet function Daubechies （db）, we decompose the signal to two parts, the low and high frequency content. The high-frequency content of the data is removed first and a new ＂de-noise＂ signal is reconstructed by using inverse wavelet transform. The wavelet spectrum and harmonic analysis were used to analyze the characteristics of tidal data before constructing the input and output structure of ANN model. That is, the concept of tidal constituent phase-lags was introduced and the new ＂de-noise＂ signal was used as the input data set of ANN and the forecasting accuracy of ANN model is significantly improved.

Application of neural network merging model in dam deformation analysis

In order to improve the prediction accuracy and test the generalization ability of the dam deformation analysis model, the back-propagation（BP） neural network model for dam deformation analysis is studied, and the merging model is built based on the neural network BP algorithm and the traditional statistical model. The three models mentioned above are calculated and analyzed according to the long-term deformation observation data in Chencun Dam. The analytical results show that the average prediction accuracies of the statistical model and the BP neural network model are ~ 0.477 and ＋- 0.390 mm, respectively, while the prediction accuracy of the merging model is ~0. 318 mm, which is improved by 33% and 18% compared to the other two models, respectively. And the merging model has a better generalization ability and broad applicability.

Function chain neural network prediction on heat transfer performance of oscillating heat pipe based on grey relational analysis

As for the factors affecting the heat transfer performance of complex and nonlinear oscillating heat pipe (OHP),grey relational analysis (GRA) was used to deal with the relationship between heat transfer rate of a looped copper-water OHP and charging ratio,inner diameter,inclination angel,heat input,number of turns,and the main influencing factors were defined.Then,forecasting model was obtained by using main influencing factors (such as charging ratio,interior diameter,and inclination angel) as the inputs of function chain neural network.The results show that the relative average error between the predicted and actual value is 4%,which illustrates that the function chain neural network can be applied to predict the performance of OHP accurately.

Investigation on the Chinese Text Sentiment Analysis Based on Convolutional Neural Networks in Deep Learning

Nowadays,the amount of wed data is increasing at a rapid speed,which presents a serious challenge to the web monitoring.Text sentiment analysis,an important research topic in the area of natural language processing,is a crucial task in the web monitoring area.The accuracy of traditional text sentiment analysis methods might be degraded in dealing with mass data.Deep learning is a hot research topic of the artificial intelligence in the recent years.By now,several research groups have studied the sentiment analysis of English texts using deep learning methods.In contrary,relatively few works have so far considered the Chinese text sentiment analysis toward this direction.In this paper,a method for analyzing the Chinese text sentiment is proposed based on the convolutional neural network(CNN)in deep learning in order to improve the analysis accuracy.The feature values of the CNN after the training process are nonuniformly distributed.In order to overcome this problem,a method for normalizing the feature values is proposed.Moreover,the dimensions of the text features are optimized through simulations.Finally,a method for updating the learning rate in the training process of the CNN is presented in order to achieve better performances.Experiment results on the typical datasets indicate that the accuracy of the proposed method can be improved compared with that of the traditional supervised machine learning methods,e.g.,the support vector machine method.

Predicting the alloying element yield in a ladle furnace using principal component analysis and deep neural network

The composition control of molten steel is one of the main functions in the ladle furnace(LF)refining process.In this study,a feasible model was established to predict the alloying element yield using principal component analysis(PCA)and deep neural network(DNN).The PCA was used to eliminate collinearity and reduce the dimension of the input variables,and then the data processed by PCA were used to establish the DNN model.The prediction hit ratios for the Si element yield in the error ranges of±1%,±3%,and±5%are 54.0%,93.8%,and98.8%,respectively,whereas those of the Mn element yield in the error ranges of±1%,±2%,and±3%are 77.0%,96.3%,and 99.5%,respectively,in the PCA-DNN model.The results demonstrate that the PCA-DNN model performs better than the known models,such as the reference heat method,multiple linear regression,modified backpropagation,and DNN model.Meanwhile,the accurate prediction of the alloying element yield can greatly contribute to realizing a“narrow window”control of composition in molten steel.The construction of the prediction model for the element yield can also provide a reference for the development of an alloying control model in LF intelligent refining in the modern iron and steel industry.

Earth slope reliability analysis under seismic loadings using neural network

A new method was proposed to cope with the earth slope reliability problem under seismic loadings. The algorithm integrates the concepts of artificial neural network, the first order second moment reliability method and the deterministic stability analysis method of earth slope. The performance function and its derivatives in slope stability analysis under seismic loadings were approximated by a trained multi-layer feed-forward neural network with differentiable transfer functions. The statistical moments calculated from the performance function values and the corresponding gradients using neural network were then used in the first order second moment method for the calculation of the reliability index in slope safety analysis. Two earth slope examples were presented for illustrating the applicability of the proposed approach. The new method is effective in slope reliability analysis. And it has potential application to other reliability problems of complicated engineering structure with a considerably large number of random variables.

A Precise Algorithm for Non-Integer Harmonics Analysis Based on FFT and Neural Network

By means of an arificial neural network (ANN) model, higher measurement accuracy of integer harmonics can be obtained. Combining the windowed fast Fourier transform (FFT) algorithm with the improved ANN model, we present a new precise algorithm for non-integer harmonics analysis. According to the result obtained from the Hanning-windowed FFT algorithm, we choose the initial values of orders of harmonics for the neural network. Through such processing, the time of iterations is shortened and the convergence rate of neural network is raised thereby. The simulation results show that close non-integer harmonics can be separated from a signal with higher accuracy and better real-time by using the algorithm presented in the paper. Key words fast Fourier transform (FFT) - artificial neural network (ANN) - Hanning-window - harmonics analysis CLC number TM 935 Foundation item: Supported by the Teaching and Research Award Program for Outstanding Young Teachers in Higher Education Institutions of China (2001-182) and the Science Foundation of Naval University of Engineering(HGDJJ03001).Biography: WANG Gong-bao (1962-), male, Professor, research direction: artificial neural network, wavelet analysis and their applications to signal processing in electric power systems.

A hybrid particle swarm optimization approach with neural network and set pair analysis for transmission network planning

Transmission network planning (TNP) is a large-scale, complex, with more non-linear discrete variables and the multi-objective constrained optimization problem. In the optimization process, the line investment, network reliability and the network loss are the main objective of transmission network planning. Combined with set pair analysis (SPA), particle swarm optimization (PSO), neural network (NN), a hybrid particle swarm optimization model was established with neural network and set pair analysis for transmission network planning (HPNS). Firstly, the contact degree of set pair analysis was introduced, the traditional goal set was converted into the collection of the three indicators including the identity degree, difference agree and contrary degree. On this bases, using shi(H), the three objective optimization problem was converted into single objective optimization problem. Secondly, using the fast and efficient search capabilities of PSO, the transmission network planning model based on set pair analysis was optimized. In the process of optimization, by improving the BP neural network constantly training so that the value of the fitness function of PSO becomes smaller in order to obtain the optimization program fitting the three objectives better. Finally, compared HPNS with PSO algorithm and the classic genetic algorithm, HPNS increased about 23% efficiency than THA, raised about 3.7% than PSO and improved about 2.96% than GA.

Fetal distress prediction using discriminant analysis, decision tree, and artificial neural network

Fetal distress is one of the main factors to cesarean section in obstetrics and gynecology. If the fetus lack of oxygen in uterus, threat to the fetal health and fetal death could happen. Cardiotocography (CTG) is the most widely used technique to monitor the fetal health and fetal heart rate (FHR) is an important index to identify occurs of fetal distress. This study is to propose discriminant analysis (DA), decision tree (DT), and artificial neural network (ANN) to evaluate fetal distress. The results show that the accuracies of DA, DT and ANN are 82.1%, 86.36% and 97.78%, respectively.

MULTIRESOLUTION ANALYSIS, SELF-SIMILAR TILINGS AND HAAR WAVELETS ON THE HEISENBERG GROUP

In this article, the properties of multiresolution analysis and self-similar tilings on the Heisenberg group are studied. Moreover, we establish a theory to construct an orthonormal Haar wavelet base in L^2（H^d） by using self-similar tilings for the acceptable dilations on the Heisenberg group.

Intelligent direct analysis of physical and mechanical parameters of tunnel surrounding rock based on adaptive immunity algorithm and BP neural network

Because of complexity and non-predictability of the tunnel surrounding rock, the problem with the determination of the physical and mechanical parameters of the surrounding rock has become a main obstacle to theoretical research and numerical analysis in tunnel engineering. During design, it is a frequent practice, therefore, to give recommended values by analog based on experience. It is a key point in current research to make use of the displacement back analytic method to comparatively accurately determine the parameters of the surrounding rock whereas artificial intelligence possesses an exceptionally strong capability of identifying, expressing and coping with such complex non-linear relationships. The parameters can be verified by searching the optimal network structure, using back analysis on measured data to search optimal parameters and performing direct computation of the obtained results. In the current paper, the direct analysis is performed with the biological emulation system and the software of Fast Lagrangian Analysis of Continua (FLAC3D. The high non-linearity, network reasoning and coupling ability of the neural network are employed. The output vector required of the training of the neural network is obtained with the numerical analysis software. And the overall space search is conducted by employing the Adaptive Immunity Algorithm. As a result, we are able to avoid the shortcoming that multiple parameters and optimized parameters are easy to fall into a local extremum. At the same time, the computing speed and efficiency are increased as well. Further, in the paper satisfactory conclusions are arrived at through the intelligent direct-back analysis on the monitored and measured data at the Erdaoya tunneling project. The results show that the physical and mechanical parameters obtained by the intelligent direct-back analysis proposed in the current paper have effectively improved the recommended values in the original prospecting data. This is of practical significance to the appraisal of stability and informationization design of the surrounding rock.

Study on spillover effect of copper futures between LME and SHFE using wavelet multiresolution analysis

Research on information spillover effects between financial markets remains active in the economic community. A Granger-type model has recently been used to investigate the spillover between London Metal Exchange(LME) and Shanghai Futures Exchange(SHFE) ,however,possible correlation between the future price and return on different time scales have been ignored. In this paper,wavelet multiresolution decomposition is used to investigate the spillover effects of copper future returns between the two markets. The daily return time series are decomposed on 2n(n=1,…,6) frequency bands through wavelet mul-tiresolution analysis. The correlation between the two markets is studied with decomposed data. It is shown that high frequency detail components represent much more energy than low-frequency smooth components. The relation between copper future daily returns in LME and that in SHFE are different on different time scales. The fluctuations of the copper future daily returns in LME have large effect on that in SHFE in 32-day scale,but small effect in high frequency scales. It also has evidence that strong effects exist between LME and SHFE for monthly responses of the copper futures but not for daily responses.

Fault Detection and Diagnosis of a Gearbox in Marine Propulsion Systems Using Bispectrum Analysis and Artificial Neural Networks

A marine propulsion system is a very complicated system composed of many mechanical components.As a result,the vibration signal of a gearbox in the system is strongly coupled with the vibration signatures of other components including a diesel engine and main shaft.It is therefore imperative to assess the coupling effect on diagnostic reliability in the process of gear fault diagnosis.For this reason,a fault detection and diagnosis method based on bispectrum analysis and artificial neural networks (ANNs) was proposed for the gearbox with consideration given to the impact of the other components in marine propulsion systems.To monitor the gear conditions,the bispectrum analysis was first employed to detect gear faults.The amplitude-frequency plots containing gear characteristic signals were then attained based on the bispectrum technique,which could be regarded as an index actualizing forepart gear faults diagnosis.Both the back propagation neural network (BPNN) and the radial-basis function neural network (RBFNN) were applied to identify the states of the gearbox.The numeric and experimental test results show the bispectral patterns of varying gear fault severities are different so that distinct fault features of the vibrant signal of a marine gearbox can be extracted effectively using the bispectrum,and the ANN classification method has achieved high detection accuracy.Hence,the proposed diagnostic techniques have the capability of diagnosing marine gear faults in the earlier phases,and thus have application importance.

Electricity price forecasting using generalized regression neural network based on principal components analysis

A combined model based on principal components analysis (PCA) and generalized regression neural network (GRNN) was adopted to forecast electricity price in day-ahead electricity market. PCA was applied to mine the main influence on day-ahead price, avoiding the strong correlation between the input factors that might influence electricity price, such as the load of the forecasting hour, other history loads and prices, weather and temperature; then GRNN was employed to forecast electricity price according to the main information extracted by PCA. To prove the efficiency of the combined model, a case from PJM (Pennsylvania-New Jersey-Maryland) day-ahead electricity market was evaluated. Compared to back-propagation (BP) neural network and standard GRNN, the combined method reduces the mean absolute percentage error about 3%.

Remaining Useful Life Prediction of Aeroengine Based on Principal Component Analysis and One-Dimensional Convolutional Neural Network

In order to directly construct the mapping between multiple state parameters and remaining useful life(RUL),and reduce the interference of random error on prediction accuracy,a RUL prediction model of aeroengine based on principal component analysis(PCA)and one-dimensional convolution neural network(1D-CNN)is proposed in this paper.Firstly,multiple state parameters corresponding to massive cycles of aeroengine are collected and brought into PCA for dimensionality reduction,and principal components are extracted for further time series prediction.Secondly,the 1D-CNN model is constructed to directly study the mapping between principal components and RUL.Multiple convolution and pooling operations are applied for deep feature extraction,and the end-to-end RUL prediction of aeroengine can be realized.Experimental results show that the most effective principal component from the multiple state parameters can be obtained by PCA,and the long time series of multiple state parameters can be directly mapped to RUL by 1D-CNN,so as to improve the efficiency and accuracy of RUL prediction.Compared with other traditional models,the proposed method also has lower prediction error and better robustness.