Improving the spaceborne GNSS-R altimetric precision based on the novel multilayer feedforward neural network weighted joint prediction model

Global navigation satellite system-reflection(GNSS-R)sea surface altimetry based on satellite constellation platforms has become a new research direction and inevitable trend,which can meet the altimetric precision at the global scale required for underwater navigation.At present,there are still research gaps for GNSS-R altimetry under this mode,and its altimetric capability cannot be specifically assessed.Therefore,GNSS-R satellite constellations that meet the global altimetry needs to be designed.Meanwhile,the matching precision prediction model needs to be established to quantitatively predict the GNSS-R constellation altimetric capability.Firstly,the GNSS-R constellations altimetric precision under different configuration parameters is calculated,and the mechanism of the influence of orbital altitude,orbital inclination,number of satellites and simulation period on the precision is analyzed,and a new multilayer feedforward neural network weighted joint prediction model is established.Secondly,the fit of the prediction model is verified and the performance capability of the model is tested by calculating the R2 value of the model as 0.9972 and the root mean square error(RMSE)as 0.0022,which indicates that the prediction capability of the model is excellent.Finally,using the novel multilayer feedforward neural network weighted joint prediction model,and considering the research results and realistic costs,it is proposed that when the constellation is set to an orbital altitude of 500 km,orbital inclination of 75and the number of satellites is 6,the altimetry precision can reach 0.0732 m within one year simulation period,which can meet the requirements of underwater navigation precision,and thus can provide a reference basis for subsequent research on spaceborne GNSS-R sea surface altimetry.

Mechanism for propagation of rate signals through a 10-layer feedforward neuronal network

Using numerical simulations, we explore the mechanism for propagation of rate signals through a 10-layer feed-forward network composed of Hodgkin-Huxley （HH） neurons with sparse connectivity. When white noise is afferent to the input layer, neuronal firing becomes progressively more synchronous in successive layers and synchrony is well developed in deeper layers owing to the feedforward connections between neighboring layers. The synchrony ensures the successful propagation of rate signals through the network when the synaptic conductance is weak. As the synaptic time constant Tsyn varies, coherence resonance is observed in the network activity due to the intrinsic property of HH neurons. This makes the output firing rate single-peaked as a function of Tsyn, suggesting that the signal propagation can be modulated by the synaptic time constant. These results are consistent with experimental results and advance our understanding of how information is processed in feedforward networks.

ENTROPY IMMUNITY OF FEEDFORWARD NETWORKS

Siegenthaler’s“Correlation Immunity”concept has been improved in this paper.From practical points of view,the new concept is more powerful than the original one in avoid-ing the trade-off between“the order of correlation immunity”and“the linear complexity”of keystreams in cipher system.Bent functions are also introduced into the studies of linear approxima-tion and entropy immunity for feedforward networks.New results and new methods are presentedalso.

Development of a Novel Feedforward Neural Network Model Based on Controllable Parameters for Predicting Effluent Total Nitrogen

The problem of effluent total nitrogen(TN)at most of the wastewater treatment plants(WWTPs)in China is important for meeting the related water quality standards,even under the condition of high energy consumption.To achieve better prediction and control of effluent TN concentration,an efficient prediction model,based on controllable operation parameters,was constructed in a sequencing batch reactor process.Compared with previous models,this model has two main characteristics:①Superficial gas velocity and anoxic time are controllable operation parameters and are selected as the main input parameters instead of dissolved oxygen to improve the model controllability,and②the model prediction accuracy is improved on the basis of a feedforward neural network(FFNN)with algorithm optimization.The results demonstrated that the FFNN model was efficiently optimized by scaled conjugate gradient,and the performance was excellent compared with other models in terms of the correlation coefficient(R).The optimized FFNN model could provide an accurate prediction of effluent TN based on influent water parameters and key control parameters.This study revealed the possible application of the optimized FFNN model for the efficient removal of pollutants and lower energy consumption at most of the WWTPs.

Relations Between Wavelet Network and Feedforward Neural Network

A comparison of construction forms and base functions is made between feedforward neural network and wavelet network. The relations between them are studied from the constructions of wavelet functions or dilation functions in wavelet network by different activation functions in feedforward neural network. It is concluded that some wavelet function is equal to the linear combination of several neurons in feedforward neural network.

Fully Connected Feedforward Neural Networks Based CSI Feedback Algorithm

In modern wireless communication systems,the accurate acquisition of channel state information(CSI)is critical to the performance of beamforming,non-orthogonal multiple access(NOMA),etc.However,with the application of massive MIMO in 5G,the number of antennas increases by hundreds or even thousands times,which leads to excessive feedback overhead and poses a huge challenge to the conventional channel state information feedback scheme.In this paper,by using deep learning technology,we develop a system framework for CSI feedback based on fully connected feedforward neural networks(FCFNN),named CF-FCFNN.Through learning the training set composed of CSI,CF-FCFNN is able to recover the original CSI from the compressed CSI more accurately compared with the existing method based on deep learning without increasing the algorithm complexity.

CONVERGENCE OF ONLINE GRADIENT METHOD WITH A PENALTY TERM FOR FEEDFORWARD NEURAL NETWORKS WITH STOCHASTIC INPUTS

Online gradient algorithm has been widely used as a learning algorithm for feedforward neural network training. In this paper, we prove a weak convergence theorem of an online gradient algorithm with a penalty term, assuming that the training examples are input in a stochastic way. The monotonicity of the error function in the iteration and the boundedness of the weight are both guaranteed. We also present a numerical experiment to support our results.

Two Criteria for Learning in Feedforward Neural Networks

ＴｗｏＣｒｉｔｅｒｉａｆｏｒＬｅａｒｎｉｎｇｉｎＦｅｅｄｆｏｒｗａｒｄＮｅｕｒａｌＮｅｔｗｏｒｋｓＰｅｎｇＨａｎｃｈｕａｎ（彭汉川）１，２ＧａｎＱｉａｎｇ（甘强）１ＷｅｉＹｕ（韦钰）１１，２（ＤｅｐａｒｔｍｅｎｔｏｆＢｉｏｍｅｄｉｃａｌＥｎｇｉｎｅ...

A Second Order Training Algorithm for Multilayer Feedforward Neural Networks

ＡＳｅｃｏｎｄＯｒｄｅｒＴｒａｉｎｉｎｇＡｌｇｏｒｉｔｈｍｆｏｒＭｕｌｔｉｌａｙｅｒＦｅｅｄｆｏｒｗａｒｄＮｅｕｒａｌＮｅｔｗｏｒｋｓＴａｎＹｉｎｇ（谭营）ＨｅＺｈｅｎｙａ（何振亚）（ＤｅｐａｒｔｍｅｎｔｏｆＲａｄｉｏＥｎｇｉｎｅｅｒｉｎｇ，Ｓｏｕ...

THE APPLICATION OF MULTILAYER FEEDFORWARD NETWORK FOR IMAGE SEGMENTATION

The multilayer feedforward network is used for image segmentation. This paper deals with the procedure of achieving the learning patterns and the method of improving the learning rate. The experiment shows that the image segmentation can get better result from using the multilayer feedforward network.

Feedforward Neural Network for joint inversion of geophysical data to identify geothermal sweet spots in Gandhar,Gujarat,India

Artificial Neural Networks(ANNs)are used in numerous engineering and scientific disciplines as an automated approach to resolve a number of problems.However,to build an artificial neural network that is prudent enough to rely on,vast quantities of relevant data have to be fed.In this study,we analysed the scope of artificial neural networks in geothermal reservoir architecture.In particular,we attempted to solve joint inversion problem through Feedforward Neural Network(FNN)technique.In order to identify geothermal sweet spots in the subsurface,an extensive geophysical studies were conducted in Gandhar area of Gujarat,India.The data were acquired along six profile lines for gravity,magnetics and magnetotellurics.Initially low velocity zone was identified using refraction seismic technique in order to set a common datum level for other potential data.The depth of low velocity zone in Gandhar was identified at 11 m.The FNN backpropagation method was applied to gain the global minima of the data space and model space as desired.The input dataset fed to the inversion algorithm in the form of gravity,magnetic susceptibility and resistivity helped to predict the suitable model after network training in multiple steps.The joint inversion of data is conducive to understanding the subsurface geological and lithological features along with probable geothermal sweet spots.The results of this study show the geothermal sweet spots at depth ranging from 200 m to 300 m.The results from our study can be used for targeted zones for geothermal water exploitation.

A Novel Evolutionary Feedforward Neural Network with Artificial Immunology

A hybrid algorithm to design the multi layer feedforward neural network was proposed. Evolutionary programming is used to design the network that makes the training process tending to global optima. Artificial immunology combined with simulated annealing algorithm is used to specify the initial weight vectors, therefore improves the probabiligy of training algorithm to converge to global optima. The applications of the neural network in the modulation style recognition of analog modulated rader signals demonstrate the good performance of the network.

A Modified Algorithm for Feedforward Neural Networks

As a most popular learning algorithm for the feedforward neural networks, the classic BP algorithm has its many shortages. To overcome some of the shortages, a modified learning algorithm is proposed in the article. And the simulation result illustrate the modified algorithm is more effective and practicable.

Multi-component quantitative and feed-forward neural network for pattern classification of raw and wine-processed Corni Fructus

Background:To promote the quality evaluation,clarify the processing mechanism and distinguish origins of Corni Fructus(cornus)from different regions.Methods:This study developed a high performance liquid chromatography method for simultaneous determination of 5-hydroxymethylfurfural,2 phenolic acids and 4 iridoid glycosides and the reference fingerprint of cornus from different regions.In addition,the feedforward neural network model provided a pattern classification of sample regions.Results:The content of morroniside and loganin were the highest in all raw cornus samples ranging from 9.45μg/mg to 16.3μg/mg and 6.64μg/mg to 13.7μg/mg,respectively.The level of sweroside in raw cornus from Henan(0.83μg/mg^(-1).39μg/mg)and Zhejiang(0.64μg/mg^(-1).17μg/mg)were greater than other origins.After wine-processing,the glucose or fructose were dehydrated to increase the levels of 5-hydroxymethylfurfural.The C-4 position of-COOCH3 of hot-sensitive iridoid glycosides was hydrolyzed to generate-COOH as stable components.Polyphenol derivatives may be degraded to increase the content of phenolic acid.Subsequently,an excellent feedforward neural network model for identification of raw cornus and wine-prepared cornus was established which could distinguish the sample origins.Conclusion:This work provided a trustworthy method to evaluate the quality and distinguish the sources of cornus.Meanwhile,the clear processing mechanism provided a scientific foundation for controlling the cornus quality during wine-processing.

Hybrid Deep Learning-Based Adaptive Multiple Access Schemes Underwater Wireless Networks

Achieving sound communication systems in Under Water Acoustic(UWA)environment remains challenging for researchers.The communication scheme is complex since these acoustic channels exhibit uneven characteristics such as long propagation delay and irregular Doppler shifts.The development of machine and deep learning algorithms has reduced the burden of achieving reli-able and good communication schemes in the underwater acoustic environment.This paper proposes a novel intelligent selection method between the different modulation schemes such as Code Division Multiple Access(CDMA),Time Divi-sion Multiple Access(TDMA),and Orthogonal Frequency Division Multiplexing(OFDM)techniques using the hybrid combination of the convolutional neural net-works(CNN)and ensemble single feedforward layers(SFL).The convolutional neural networks are used for channel feature extraction,and boosted ensembled feedforward layers are used for modulation selection based on the CNN outputs.The extensive experimentation is carried out and compared with other hybrid learning models and conventional methods.Simulation results demonstrate that the performance of the proposed hybrid learning model has achieved nearly 98%accuracy and a 30%increase in BER performance which outperformed the other learning models in achieving the communication schemes under dynamic underwater environments.

混沌自适应非洲秃鹫优化算法训练多层感知器

针对训练多层感知器(MLP)时,算法对初始值敏感、易陷入局部最优和收敛速度慢等问题,对新型启发式算法非洲秃鹫优化算法提出改进算法IAVOA。在初始化种群时引入Logistic混沌映射,增加种群的多样性;对最优秃鹫和次优秃鹫增加自适应权重系数,自动调整这两类秃鹫对普通秃鹫的引导作用;IAVOA用于MLP的训练,采用均方误差的平均值作为适应度函数寻找MLP的连接权重和偏差的最佳组合。选取4个不同复杂度的分类数据集,比较IAVOA算法与现有启发式算法对MLP训练后,MLP对数据分类的性能,仿真结果表明,IAVOA算法训练的MLP在数据分类准确率、全局搜索能力、收敛速度和稳定性方面均具有良好的性能。

燃煤机组过热汽温宽负荷模型前馈控制

为了对燃煤机组过热汽温宽负荷运行时进行更精确地前馈控制,提出一种基于物理引导神经网络(PGNN)的预测前馈信号模型,并基于间隙度量法确定了多模型的负荷段分配。多模型间隙度量PGNN预测方法采用多模型间隙度量方法对负荷区段进行合理划分,结合过热器机理引导的长短期记忆神经网络,可以对强耦合、大惯性的过热汽温宽负荷前馈信号进行精准预测。结果表明:在机组宽负荷运行时,随着负荷降低控制对象的非线性程度逐渐增强,需要更多的模型数量,采用多模型间隙度量PGNN前馈控制方法可以在不同工况下采用与当前工况相适应的前馈信号,有效提升过热汽温的调节精度和稳定性。

顾及PWV的广西地区多尺度PM_(2.5)浓度预测

针对现有的雾霾预测方法较少考虑可降水量的影响,且大部分预测方法都没有对模型回归残差进行有效处理因而预测精度不是很高的问题,利用广西南宁、桂林、梧州和百色四市2017年的PM_(2.5)日均值数据,结合大气污染物、气象因子和大气可降水量PWV等因素,分别建立全年和分季度的ARIMA模型对该地区PM_(2.5)日均浓度进行短期预测,并将ARIMA模型预测残差分别用前馈神经网络径向基函数RBF和多层感知器MLP进行拟合,以达到优化ARIMA模型的目的。结果表明,除桂林外,分季度ARIMA模型预测效果优于全年ARIMA模型,季度ARIMA-MLP神经网络预测精度优于分季度ARIMA模型,表明该类模型可以用于区域PM_(2.5)浓度预测。

基于前馈神经网络的多模式集成降水预报研究

为提高山东定量降水预报准确率,采用深度前馈神经网络(Deep Forword Neural Networks,DFNN)和降水分级最优TS(Threat Score)权重集成方法对多模式集成降水预报进行研究。对2019年4—9月欧洲中期天气预报中心(European Centre for Medium-Range Weather Forecasting,ECMWF)全球数值预报系统、中国气象局上海数值预报模式系统(China Meteorological Administration Shanghai 9 km,CMA-SH9)和中国气象局中尺度天气数值预报系统(China Meteorological Administration Meso⁃scale,CMA-MESO)逐24 h累积降水量预报进行有监督训练,得到4组DFNN(ES、EM、SM、ESM)深度学习模型,并利用多模式降水分级最优TS权重集成方法建立Mul-OTS(Multi-mode Optimal Threat Score)集成模型。用2020年4—9月各模式逐24 h累积降水量进行降尺度格点预报,对5种集成方案对比检验、个例分析应用。结果表明:不同起报时间、不同预报时效,5组集成方案均降低了平均相对误差,ESM方案最好,Mul-OTS方案最差;4组DFNN方案均提高了晴雨准确率,ESM方案最好,Mul-OTS方案低于模式预报;4组DFNN方案均提高了各降水等级TS、ETS评分,对弱降水的提高幅度大于强降水,Mul-OTS方案对小量级降水等级订正是负技巧,对大量级降水等级的订正效果较好,但仍不如ESM方案;个例分析发现降水强度和落区预报ESM方案均优于其他集成方案。因此业务上采用最优的ESM方案建立了定量降水格点预报系统,为智能网格预报提供重要支撑。

储能VSG并联组网系统的有功振荡特性分析及其改进策略

储能虚拟同步机(VSG)通过模拟同步发电机的转子运动方程,使得储能变换器具备一定的惯量支撑能力,但不可避免地引入有功动态振荡等问题,特别是在储能VSG并联组网系统(ESVPNS)中该问题更为突出。为此提出一种抑制ESVPNS有功动态振荡的有功前馈补偿改进控制策略,利用包含虚拟惯量与一次调频参数的一阶低通滤波环节构造有功前馈项,通过调节前馈参数提升ESVPNS抑制有功动态振荡的能力,在既不依赖通信又无需微分运算的前提下,不影响ESVPNS有功的稳态均分效果。建立包含有功前馈环节的ESVPNS小信号数学模型,并详细给出前馈参数的设计过程。MATLAB/Simulink仿真对比结果验证了所提控制策略的有效性与优越性。