Attention-Based Multi-Scale Prediction Network for Time-Series Data

Time series data is a kind of data accumulated over time,which can describe the change of phenomenon.This kind of data reflects the degree of change of a certain thing or phenomenon.The existing technologies such as LSTM and ARIMA are better than convolutional neural network in time series prediction,but they are not enough to mine the periodicity of data.In this article,we perform periodic analysis on two types of time series data,select time metrics with high periodic characteristics,and propose a multi-scale prediction model based on the attention mechanism for the periodic trend of the data.A loss calculation method for traffic time series characteristics is proposed as well.Multiple experiments have been conducted on actual data sets.The experiments show that the method proposed in this paper has better performance than commonly used traffic prediction methods(ARIMA,LSTM,etc.)and 3%-5%increase on MAPE.

NeurstrucEnergy:A bi-directional GNN model for energy prediction of neural networks in IoT

A significant demand rises for energy-efficient deep neural networks to support power-limited embedding devices with successful deep learning applications in IoT and edge computing fields.An accurate energy prediction approach is critical to provide measurement and lead optimization direction.However,the current energy prediction approaches lack accuracy and generalization ability due to the lack of research on the neural network structure and the excessive reliance on customized training dataset.This paper presents a novel energy prediction model,NeurstrucEnergy.NeurstrucEnergy treats neural networks as directed graphs and applies a bi-directional graph neural network training on a randomly generated dataset to extract structural features for energy prediction.NeurstrucEnergy has advantages over linear approaches because the bi-directional graph neural network collects structural features from each layer's parents and children.Experimental results show that NeurstrucEnergy establishes state-of-the-art results with mean absolute percentage error of 2.60%.We also evaluate NeurstrucEnergy in a randomly generated dataset,achieving the mean absolute percentage error of 4.83%over 10 typical convolutional neural networks in recent years and 7 efficient convolutional neural networks created by neural architecture search.Our code is available at https://github.com/NEUSoftGreenAI/NeurstrucEnergy.git.

Prediction Method for Network Traffic Based on Maximum Correntropy Criterion

This paper proposes a method for improving the precision of Network Traffic Prediction based on the Maximum Correntropy Criterion(NTPMCC),where the nonlinear characteristics of network traffic are considered.This method utilizes the MCC as a new error evaluation criterion or named the cost function(CF)to train neural networks(NN).MCC is based on a new similarity function(Generalized correlation entropy function,Correntropy),which has as its foundation the Parzen window evaluation and Renyi entropy of error probability density function.At the same time,by combining the MCC with the Mean Square Error(MSE),a mixed evaluation criterion with MCC and MSE is proposed as a cost function of NN training.According to the traffic network characteristics including the nonlinear,non-Gaussian,and mutation,the Elman neural network is trained by MCC and MCC-MSE,and then the trained neural network is used as the model for predicting network traffic.The simulation results based on the evaluation by Mean Absolute Error(MAE),MSE,and Sum Squared Error(SSE)show that the accuracy of the prediction based on MCC is superior to the results of the Elman neural network with MSE.The overall performance is improved by about 0.0131.

An overview of intelligent selection and prediction method in heterogeneous wireless networks

Heterogeneous wireless access technologies will coexist in next generation wireless networks.These technologies form integrated networks,and these networks support multiple services with high quality level.Various access technologies allow users to select the best available access network to meet the requirements of each type of communication service.Being always best connected anytime and anywhere is a major concern in a heterogeneous wireless networks environment.Always best connected enables network selection mechanisms to keep mobile users always connected to the best network.We present an overview of the network selection and prediction problems and challenges.In addition,we discuss a comprehensive classification of related theoretic approaches,and also study the integration between these methods,finding the best solution of network selection and prediction problems.The optimal solution can fulfill the requirements of the next generation wireless networks.

Network traffic prediction by a wavelet-based combined model

Network traffic prediction models can be grouped into two types, single models and combined ones. Combined models integrate several single models and thus can improve prediction accuracy. Based on wavelet transform, grey theory, and chaos theory, this paper proposes a novel combined model, wavelet-grey-chaos （WGC）, for network traffic prediction. In the WGC model, we develop a time series decomposition method without the boundary problem by modifying the standard à trous algorithm, decompose the network traffic into two parts, the residual part and the burst part to alleviate the accumulated error problem, and employ the grey model GM（1,1） and chaos model to predict the residual part and the burst part respectively. Simulation results on real network traffic show that the WGC model does improve prediction accuracy.

Neural network prediction of solar cycle 24

The ability to predict the future behavior of solar activity has become extremely import due to its effect on the environment near the Earth. Predictions of both the amplitude and timing of the next solar cycle will assist in estimating the various consequences of space weather. The level of solar activity is usually expressed by in- ternational sunspot number （Rz）. Several prediction techniques have been applied and have achieved varying degrees of success in the domain of solar activity prediction. We predict a solar index （Rz） in solar cycle 24 by using a neural network method. The neural network technique is used to analyze the time series of solar activity. According to our predictions of yearly sunspot number, the maximum of cycle 24 will occur in the year 2013 and will have an annual mean sunspot number of 65. Finally, we discuss our results in order to compare them with other suggested predictions.

Performance prediction of gravity concentrator by using artificial neural network-a case study

In conventional chromite beneficiation plant, huge quantity of chromite is used to loss in the form of tailing. For recovery these valuable mineral, a gravity concentrator viz. wet shaking table was used.Optimisation along with performance prediction of the unit operation is necessary for efficient recovery.So, in this present study, an artificial neural network(ANN) modeling approach was attempted for predicting the performance of wet shaking table in terms of grade(%) and recovery(%). A three layer feed forward neural network(3:3–11–2:2) was developed by varying the major operating parameters such as wash water flow rate(L/min), deck tilt angle(degree) and slurry feed rate(L/h). The predicted value obtained by the neural network model shows excellent agreement with the experimental values.

A Network Traffic Prediction Algorithm Based on Prophet-EALSTM-GPR

Huge networks and increasing network traffic will consume more and more resources.It is critical to predict network traffic accurately and timely for network planning,and resource allocation,etc.In this paper,a combined network traffic prediction model is proposed,which is based on Prophet,evolutionary attention-based LSTM(EALSTM)network,and Gaussian process regression(GPR).According to the non-smooth,sudden,periodic,and long correlation characteristics of network traffic,the prediction procedure is divided into three steps to predict network traffic accurately.In the first step,the Prophetmodel decomposes network traffic data into periodic and non-periodic parts.The periodic term is predicted by the Prophet model for different granularity periods.In the second step,the non-periodic term is fed to an EALSTM network to extract the importance of the different features in the sequence and learn their long correlation,which effectively avoids the long-term dependence problem caused by long step length.Finally,GPR is used to predict the residual term to boost the predictability even further.Experimental results indicate that the proposed scheme is more applicable and can significantly improve prediction accuracy compared with traditional linear and nonlinear models.

Preparation of ZrB_2-SiC Powders via Carbothermal Reduction of Zircon and Prediction of Product Composition by Back-Propagation Artificial Neural Network

Phase pure ZrB2-SiC composite powders were prepared after 1 450℃/3 h via carbothermal reduction route,by using ZrSiO4,B2O3 and carbon as the raw materials.The influences of firing temperature as well as the type and amount of additive on the phase composition of final products were detailedly investigated.The results indicated that the onset formation temperature of ZrB2-SiC was reduced to 1 400℃by the present conditions,and oxide additive（including CoSO4·7H2O,Y2O3 and TiO2）was effective in enhancing the decomposition of raw ZrSiO4,therefore accelerating the synthesis of ZrB2-SiC.Moreover,microstructural observation showed that the as-prepared ZrB2 and SiC respectively had well-defined hexagonal columnar and fibrous morphology.Furthermore,the methodology of back-propagation artificial neural networks（BP-ANNs）was adopted to establish a model for predicting the reaction extent（e g,the content of ZrB2-SiC in final product）in terms of various processing conditions.The results predicted by the as-established BP-ANNs model matched well with that of testing experiment（with a mean square error in 10^（-3） degree）,verifying good effectiveness of the proposed strategy.

The application of neural networks to comprehensive prediction by seismology prediction method

BP neural networks is used to mid-term earthquake prediction in this paper. Some usual prediction parameters of seismology are used as the import units of neural networks. And the export units of neural networks is called as the character parameter W_0 describing enhancement of seismicity. We applied this method to space scanning of North China. The result shows that the mid-term anomalous zone of W_0-value usually appeared obviously around the future epicenter 1~3 years before earthquake. It is effective to mid-term prediction.

Network Traffic Prediction Using Radial Kernelized-Tversky Indexes-Based Multilayer Classifier

Accurate cellular network traffic prediction is a crucial task to access Internet services for various devices at any time.With the use of mobile devices,communication services generate numerous data for every moment.Given the increasing dense population of data,traffic learning and prediction are the main components to substantially enhance the effectiveness of demand-aware resource allocation.A novel deep learning technique called radial kernelized LSTM-based connectionist Tversky multilayer deep structure learning(RKLSTM-CTMDSL)model is introduced for traffic prediction with superior accuracy and minimal time consumption.The RKLSTM-CTMDSL model performs attribute selection and classification processes for cellular traffic prediction.In this model,the connectionist Tversky multilayer deep structure learning includes multiple layers for traffic prediction.A large volume of spatial-temporal data are considered as an input-to-input layer.Thereafter,input data are transmitted to hidden layer 1,where a radial kernelized long short-term memory architecture is designed for the relevant attribute selection using activation function results.After obtaining the relevant attributes,the selected attributes are given to the next layer.Tversky index function is used in this layer to compute similarities among the training and testing traffic patterns.Tversky similarity index outcomes are given to the output layer.Similarity value is used as basis to classify data as heavy network or normal traffic.Thus,cellular network traffic prediction is presented with minimal error rate using the RKLSTM-CTMDSL model.Comparative evaluation proved that the RKLSTM-CTMDSL model outperforms conventional methods.

Stock Price Prediction Using Predictive Error Compensation Wavelet Neural Networks

:Machine Learning(ML)algorithms have been widely used for financial time series prediction and trading through bots.In this work,we propose a Predictive Error Compensated Wavelet Neural Network(PEC-WNN)ML model that improves the prediction of next day closing prices.In the proposed model we use multiple neural networks where the first one uses the closing stock prices from multiple-scale time-domain inputs.An additional network is used for error estimation to compensate and reduce the prediction error of the main network instead of using recurrence.The performance of the proposed model is evaluated using six different stock data samples in the New York stock exchange.The results have demonstrated significant improvement in forecasting accuracy in all cases when the second network is used in accordance with the first one by adding the outputs.The RMSE error is 33%improved when the proposed PEC-WNN model is used compared to the Long ShortTerm Memory(LSTM)model.Furthermore,through the analysis of training mechanisms,we found that using the updated training the performance of the proposed model is improved.The contribution of this study is the applicability of simultaneously different time frames as inputs.Cascading the predictive error compensation not only reduces the error rate but also helps in avoiding overfitting problems.

The Prediction of Stock Prices Based on PCA and BP Neural Networks

There are many factors to influence stock prices indeed. The research method combining models and examples is applied to study how the factors affect stock prices here. Firstly, the principal component analysis is used to deal with a set of variables as the input of a BP Neural Network. Therefore, not only is the number of variables less, but also most of the information of original variables is kept. Then, the BP Neural Network is established to analyze and predict stock prices. Finally, the analysis of Chinese stock market illustrates that the method predicting stock prices is satisfying and feasible.

Prediction Model of Soil Nutrients Loss Based on Artificial Neural Network

On the basis of Artificial Neural Network theory, a back propagation neural network with one middle layer is building in this paper, and its algorithms is also given, Using this BP network model, study the case of Malian-River basin. The results by calculating show that the solution based on BP algorithms are consis- tent with those based multiple - variables linear regression model. They also indicate that BP model in this paper is reasonable and BP algorithms are feasible.

Storm surge disaster evaluation model based on an artificial neural network

Back propagation is employed to forecast the current of a storm with various characteristics of storm surge; the technique is thus important in disaster forecasting. One of the most fuzzy types of information in the prediction of geological calamity is handled employing the information diffusion method. First, a single-step prediction model and neural network prediction model are employed to collect influential information used to predict the extreme tide level. Second, information is obtained using the information diffusion method, which improves the precision of risk recognition when there is insufficient information. Experiments demonstrate that the method proposed in this paper is simple and effective and provides better forecast results than other methods. Future work will focus on a more precise forecast model.

System Architecture and Key Technologies of Network Security Situation Awareness System YHSAS

Network Security Situation Awareness System YHSAS acquires,understands and displays the security factors which cause changes of network situation,and predicts the future development trend of these security factors.YHSAS is developed for national backbone network,large network operators,large enterprises and other large-scale network.This paper describes its architecture and key technologies:Network Security Oriented Total Factor Information Collection and High-Dimensional Vector Space Analysis,Knowledge Representation and Management of Super Large-Scale Network Security,Multi-Level,Multi-Granularity and Multi-Dimensional Network Security Index Construction Method,Multi-Mode and Multi-Granularity Network Security Situation Prediction Technology,and so on.The performance tests show that YHSAS has high real-time performance and accuracy in security situation analysis and trend prediction.The system meets the demands of analysis and prediction for large-scale network security situation.

Recovery and grade prediction of pilot plant flotation column concentrate by a hybrid neural genetic algorithm

Today flotation column has become an acceptable means of froth flotation for a fairly broad range of applications, in particular the cleaning of sulfides. Even after having been used for several years in mineral processing plants, the full potential of the flotation column process is still not fully exploited. There is no prediction of process performance for the complete use of available control capabilities. The on-line estimation of grade usually requires a significant amount of work in maintenance and calibration of on-stream analyzers, in order to maintain good accuracy and high availability. These difficulties and the high cost of investment and maintenance of these devices have encouraged the approach of prediction of metal grade and recovery. In this paper, a new approach has been proposed for metallurgical performance prediction in flotation columns using Artificial Neural Network (ANN). Despite of the wide range of applications and flexibility of NNs, there is still no general framework or procedure through which the appropriate network for a specific task can be designed. Design and structural optimization of NNs is still strongly dependent upon the designer's experience. To mitigate this problem, a new method for the auto-design of NNs was used, based on Genetic Algorithm (GA). The new proposed method was evaluated by a case study in pilot plant flotation column at Sarcheshmeh copper plant. The chemical reagents dosage, froth height, air, wash water flow rates, gas holdup, Cu grade in the rougher feed, flotation column feed, column tail and final concentrate streams were used to the simulation by GANN. In this work, multi-layer NNs with Back Propagation (BP) algorithm with 8-17-10-2 and 8- 13-6-2 arrangements have been applied to predict the Cu and Mo grades and recoveries, respectively. The correlation coefficient (R) values for the testing sets for Cu and Mo grades were 0.93, 0.94 and for their recoveries were 0.93, 0.92, respectively. The results discussed in this paper indicate that the proposed model can be used to predict the Cu and Mo grades and recoveries with a reasonable error.

Nonlinear chaotic characteristic in leaching process and prediction of leaching cycle period

A laboratory leaching experiment with samples of different grades was carried out, and an analytical method of concentration of leaching solution was put forward. For each sample, respectively, by applying phase space reconstruction for time series of monitoring data, the saturated embedding dimension and the correlation dimension were obtained, and the evolution laws between neighboring points in the reconstructed phase space were revealed. With BP neural network, a prediction model of concentration of leaching solution was set up and the maximum error of which was less than 2%. The results show that there exist chaotic characteristics in leaching system, and samples of different grades have different nonlinear dynamic features; the higher the grade of sample, the smaller the correlation dimension; furthermore, the maximum Lyapunov index, energy dissipation and chaotic extent of the leaching system increase with grade of the sample; by phase space reconstruction, the subtle change features of concentration of leaching solution can be magnified and the inherent laws can be fully demonstrated. According to the laws, a prediction model of leaching cycle period has been established to provide a theoretical foundation for solution mining.

Model-based predictive controller design for a class of nonlinear networked systems with communication delays and data loss

This paper discusses the model-based predictive controller design of networked nonlinear systems with communica- tion delay and data loss. Based on the analysis of the closed-loop networked predictive control systems, the model-based networked predictive control strategy can compensate for communication delay and data loss in an active way. The designed model-based predictive controller can also guarantee the stability of the closed-loop networked system. The simulation re- suits demonstrate the feasibility and efficacy of the proposed model-based predictive controller design scheme.