Fully Distributed Learning for Deep Random Vector Functional-Link Networks

In the contemporary era, the proliferation of information technology has led to an unprecedented surge in data generation, with this data being dispersed across a multitude of mobile devices. Facing these situations and the training of deep learning model that needs great computing power support, the distributed algorithm that can carry out multi-party joint modeling has attracted everyone’s attention. The distributed training mode relieves the huge pressure of centralized model on computer computing power and communication. However, most distributed algorithms currently work in a master-slave mode, often including a central server for coordination, which to some extent will cause communication pressure, data leakage, privacy violations and other issues. To solve these problems, a decentralized fully distributed algorithm based on deep random weight neural network is proposed. The algorithm decomposes the original objective function into several sub-problems under consistency constraints, combines the decentralized average consensus (DAC) and alternating direction method of multipliers (ADMM), and achieves the goal of joint modeling and training through local calculation and communication of each node. Finally, we compare the proposed decentralized algorithm with several centralized deep neural networks with random weights, and experimental results demonstrate the effectiveness of the proposed algorithm.

Underwater Image Classification Based on EfficientnetB0 and Two-Hidden-Layer Random Vector Functional Link

The ocean plays an important role in maintaining the equilibrium of Earth’s ecology and providing humans access to a wealth of resources.To obtain a high-precision underwater image classification model,we propose a classification model that combines an EfficientnetB0 neural network and a two-hidden-layer random vector functional link network(EfficientnetB0-TRVFL).The features of underwater images were extracted using the EfficientnetB0 neural network pretrained via ImageNet,and a new fully connected layer was trained on the underwater image dataset using the transfer learning method.Transfer learning ensures the initial performance of the network and helps in the development of a high-precision classification model.Subsequently,a TRVFL was proposed to improve the classification property of the model.Net construction of the two hidden layers exhibited a high accuracy when the same hidden layer nodes were used.The parameters of the second hidden layer were obtained using a novel calculation method,which reduced the outcome error to improve the performance instability caused by the random generation of parameters of RVFL.Finally,the TRVFL classifier was used to classify features and obtain classification results.The proposed EfficientnetB0-TRVFL classification model achieved 87.28%,74.06%,and 99.59%accuracy on the MLC2008,MLC2009,and Fish-gres datasets,respectively.The best convolutional neural networks and existing methods were stacked up through box plots and Kolmogorov-Smirnov tests,respectively.The increases imply improved systematization properties in underwater image classification tasks.The image classification model offers important performance advantages and better stability compared with existing methods.

Optimized functional linked neural network for predicting diaphragm wall deflection induced by braced excavations in clays

Deep excavation during the construction of underground systems can cause movement on the ground,especially in soft clay layers.At high levels,excessive ground movements can lead to severe damage to adjacent structures.In this study,finite element analyses(FEM)and the hardening small strain(HSS)model were performed to investigate the deflection of the diaphragm wall in the soft clay layer induced by braced excavations.Different geometric and mechanical properties of the wall were investigated to study the deflection behavior of the wall in soft clays.Accordingly,1090 hypothetical cases were surveyed and simulated based on the HSS model and FEM to evaluate the wall deflection behavior.The results were then used to develop an intelligent model for predicting wall deflection using the functional linked neural network(FLNN)with different functional expansions and activation functions.Although the FLNN is a novel approach to predict wall deflection;however,in order to improve the accuracy of the FLNN model in predicting wall deflection,three swarm-based optimization algorithms,such as artificial bee colony(ABC),Harris’s hawk’s optimization(HHO),and hunger games search(HGS),were hybridized to the FLNN model to generate three novel intelligent models,namely ABC-FLNN,HHO-FLNN,HGS-FLNN.The results of the hybrid models were then compared with the basic FLNN and MLP models.They revealed that FLNN is a good solution for predicting wall deflection,and the application of different functional expansions and activation functions has a significant effect on the outcome predictions of the wall deflection.It is remarkably interesting that the performance of the FLNN model was better than the MLP model with a mean absolute error(MAE)of 19.971,root-mean-squared error(RMSE)of 24.574,and determination coefficient(R^(2))of 0.878.Meanwhile,the performance of the MLP model only obtained an MAE of 20.321,RMSE of 27.091,and R^(2)of 0.851.Furthermore,the results also indicated that the proposed hybrid models,i.e.,ABC-FLNN,HHO-FLNN,HGS-FLNN,yielded more superior performances than those of the FLNN and MLP models in terms of the prediction of deflection behavior of diaphragm walls with an MAE in the range of 11.877 to 12.239,RMSE in the range of 15.821 to 16.045,and R^(2)in the range of 0.949 to 0.951.They can be used as an alternative tool to simulate diaphragm wall deflections under different conditions with a high degree of accuracy.

Functional Link Neural Network for Predicting Crystallization Temperature of Ammonium Chloride in Air Cooler System

The air cooler is an important equipment in the petroleum refining industry.Ammonium chloride(NH4 Cl)deposition-induced corrosion is one of its main failure forms.In this study,the ammonium salt crystallization temperature is chosen as the key decision variable of NH4 Cl deposition-induced corrosion through in-depth mechanism research and experimental analysis.The functional link neural network(FLNN)is adopted as the basic algorithm for modeling because of its advantages in dealing with non-linear problems and its fast-computational ability.A hybrid FLNN attached to a small norm is built to improve the generalization performance of the model.Then,the trained model is used to predict the NH4 Cl salt crystallization temperature in the air cooler of a sour water stripper plant.Experimental results show the proposed improved FLNN algorithm can achieve better generalization performance than the PLS,the back propagation neural network,and the conventional FLNN models.

Application of functional-link neural network in evaluation of sublayer suspension based on FWD test

Several methods for evaluating the sublayer suspension beneath old pavement with falling weight deflectormeter(FWD), were summarized and the respective advantages and disadvantages were analyzed. Based on these methods, the evaluation principles were improved and a new type of the neural network, functional-link neural network was proposed to evaluate the sublayer suspension with FWD test results. The concept of function link, learning method of functional-link neural network and the establishment process of neural network model were studied in detail. Based on the old pavement over-repairing engineering of Kaiping section, Guangdong Province in G325 National Highway, the application of functional-link neural network in evaluation of sublayer suspension beneath old pavement based on FWD test data on the spot was investigated. When learning rate is 0.1 and training cycles are 405, the functional-link network error is less than 0.000 1, while the optimum chosen 4-8-1 BP needs over 10 000 training cycles to reach the same accuracy with less precise evaluation results. Therefore, in contrast to common BP neural network,the functional-link neural network adopts single layer structure to learn and calculate, which simplifies the network, accelerates the convergence speed and improves the accuracy. Moreover the trained functional-link neural network can be (adopted) to directly evaluate the sublayer suspension based on FWD test data on the site. Engineering practice indicates that the functional-link neural model gains very excellent results and effectively guides the pavement over-repairing construction.

Numeral eddy current sensor modelling based on genetic neural network

This paper presents a method used to the numeral eddy current sensor modelling based on the genetic neural network to settle its nonlinear problem. The principle and algorithms of genetic neural network are introduced. In this method, the nonlinear model parameters of the numeral eddy current sensor are optimized by genetic neural network （GNN） according to measurement data. So the method remains both the global searching ability of genetic algorithm and the good local searching ability of neural network. The nonlinear model has the advantages of strong robustness, on-line modelling and high precision. The maximum nonlinearity error can be reduced to 0.037% by using GNN. However, the maximum nonlinearity error is 0.075% using the least square method.

A New Modeling Method Based on Genetic Neural Network for Numeral Eddy Current Sensor

In this paper,we present a method used to the numeral eddy current sensor modeling based on genetic neural network to settle its nonlinear problem.The principle and algorithms of genetic neural network are introduced.In this method, the nonlinear model parameters of the numeral eddy current sensor are optimized by genetic neural network (GNN) according to measurement data.So the method remains both the global searching ability of genetic algorithm and the good local searching ability of neural network.The nonlinear model has the advantages of strong robustness,on-line scaling and high precision.The maximum nonlinearity error can be reduced to 0.037% using GNN.However,the maximum nonlinearity error is 0.075% using least square method (LMS).

基于FLANN的三轴磁强计误差校正研究

提出一种基于函数链接型神经网络(FLANN)的三轴磁强计误差修正方法。由于三轴非正交、灵敏度不一致及零点漂移所引起的误差降低了三轴磁强计的测量精度,因此有必要进行校正。本文先对与三轴磁强计系统参数有关的测量进行详细分析和理论计算;然后,设计矩阵形式的数学模型对该误差进行修正。通过构造相应的FLANN网络结构,实现对模型参数矩阵的辨识。用实际地磁场测量数据进行测试,结果表明,三轴磁强计的转向误差由800 nT修正到12 nT以下。因此,该研究为提高三轴磁强计性能提供了一种可行方法。

传感器动态建模FLANN方法改进研究

提出一种改进的函数连接型神经网络(FLANN),并将其应用于传感器动态建模。首先,将单输入单输出(SISO)的传感器系统表达为动态差分方程模型;再充分考虑动态模型输出的历史值与参数之间的关系,对模型输出与参数的偏导数进行重新推导,得到了对权值参数偏导数的更高精度估计;最后,利用该模型梯度进行迭代训练,加快了网络收敛速度并提高了收敛的稳定性。实验结果表明,改进FLANN具有更快的收敛速度和更强的鲁棒性,十分适合传感器动态系统的建模。

改进PSO算法结合FLANN在传感器动态建模中的应用

将改进的粒子群优化(PSO)算法和函数联接型神经网络(FLANN)相结合,实现传感器的动态线性建模。利用传感器的动态标定实验数据,首先训练FLANN神经网络,网络训练结束后的权值作为粒子群中某个粒子的初始值,而后利用改进的PSO算法继续寻优,得到的全局最优值即为所求的传感器动态模型的系数。实验结果表明,该方法结合了PSO和FLANN两者的优点,建模精度高。

Multilayer perceptron and Chebyshev polynomials-based functional link artificial neural network for solving differential equations

This paper discusses the issues of computational efforts and the accuracy of solutions of differential equations using multilayer perceptron and Chebyshev polynomials-based functional link artificial neural networks.Some ordinary and partial differential equations have been solved by both these techniques and pros and cons of both these type of feedforward networks have been discussed in detail.Apart from that,various factors that affect the accuracy of the solution have also been analyzed.

Pan evaporation modeling in different agroclimatic zones using functional link artificial neural network

Pan evaporation is an important climatic variable for developing efficient water resource management strategies.In the past,many machine learning models are reported in the literature for pan evaporation modeling using the different combinationof available climatic variables.In order to develop a novel model with improved accuracy and reduced computational complexity,the functional link artificial neural network(FLANN)is chosen as an architecture to estimate daily pan evaporation in three agro-climatic zones(ACZs)of Chhattisgarh state in east-central India.Single neuron and single layer in its structure make it less complex as compared to other multilayer neural networks and neuro-fuzzy based hybrid models.Estimation results obtained with the FLANN model are compared with those obtained by multi-layer artificial neural networks(MLANN)and two empirical methods using the same raw data and corresponding features.Statistical indices like root mean square error(RMSE),mean absolute error(MAE)and efficiency factor(EF)is also computed to evaluate the model performance.It is demonstrated that pan evaporation estimates obtained with the proposed FLANN models provide an improved estimation of pan evaporation(RMSE=0.85 to 1.27 mm d^(-1),MAE=0.63 to 0.95 mm d^(-1) and EF=0.70 to 0.89)as compared to MLANN(RMSE=0.94 to 1.58 mm d^(-1),MAE=0.73 to 1.14 mm d^(-1) and EF=0.62 to 0.88)and empirical(RMSE=1.19 to 2.19 mm d^(-1),MAE=0.91 to 1.62 mm d^(-1) and EF=0.49 to 0.88)models in different ACZs.

基于FLANN和最小二乘的磁梯度计误差校正

在基于偶极子磁场分量梯度的水下磁异常定位方法中,三轴磁力计自身误差及两磁场坐标系配准误差等是限制水下定位精度的主要因素,因此有必要对其进行校正,补偿磁场分量梯度计测量值。建立了磁场分量梯度计的测量误差模型,提出了基于函数链接型神经网络(functional link artificial neural network,FLANN)和最小二乘法的磁场分量梯度计误差校正方法,给出了误差参数辨识及校正算法,数值仿真和实测数据证明了校正算法具有良好的收敛性,能显著地抑制磁场分量梯度测量误差,该校正方法为提高磁场分量梯度计性能提供了一种可行途径。

电容压力传感器的FLANN建模方法

旨在开发一种计算简单的电容压力传感器的模型 ,以便经济、可靠地应用。分析表明采用新型函数链接型神经网络建立的电容压力传感器模型能够精确读出应用压力 ,它是一种能实现输入到输出的高度非线性映射并且运算高效的非线性网络 。

基于FLANN的腕力传感器动态补偿方法

根据“逆模型”的思想,利用神经元网络良好的逼近能力,提出了基于函数联接型神经网络的传感器动态补偿方法。该方法设计的动态补偿器实现简单,实时性好;不依赖于传感器的模型,鲁棒性强;可以优化补偿器的参数。该方法的补偿效果比零极点配置方法的好,是一种非常有效的新方法。

基于FLANN的腕力传感器动态建模方法

本文将函数联接型神经网络 (FL ANN)引入传感器动态特性的研究。利用神经元网络良好的逼近能力 ,建立腕力传感器的动态数学模型。该方法所建模型阶次低 ,准确度高 ,对数据个数和采样频率无特殊要求 ,比其它方法更为有效和实用。

一种基于LS-SVM构造FLANN的热电偶非线性校正方法

提出一种基于最小二乘支持向量机(LS-SVM)构造函数链接型神经网络(FLANN)的方法,并根据正反馈原理将该FLANN应用於热电偶传感器非线性校正.讨论LS-SVM构造FLANN的基本原理和具体算法,给出了非线性补偿器的数学模型.与常规BP迭代算法构造的FLANN比较,该方法构造的FLANN补偿器具有如下优点:①利用LS-SVM将迭代逼近问题转化为直接求解多元线性方程,因此具有更快的速度;②整个训练过程中有且仅有一个全局极值点,确定了所构造FLANN补偿器的唯一性,提高了补偿精度.最后以Pt-Rh30-Pt-Rh6热电偶(B型)为例进行非线性校正实验,结果验证了上述结论.

基于FLANN的传感器动态特性研究方法

将函数联接型神经网络引入传感器动态特性的研究，利用神经元网络良好的逼近能力，建立腕力传感器的动态数学模型，该方法所建模型阶次低，精度 数据个数和采样频率无特殊要求。

基于SVM构造的FLANN数据融合方法在CPS修正中的应用

在对常规函数链接型神经网络(FLANN)构造方法的认识基础上,讨论了一种基于支持向量机(SVM)技术的FLANN构造新方法,并利用该方法对实际的电容压力传感器(CPS)系统进行非线性修正及温度补偿。先将SVM的拓扑结构与常规FLANN结构进行比较,确定两者的等价性。因此,可通过SVM求解二次规划问题来实现FLANN结构的唯一优化。用常规FLANN方法在同样条件下进行对比实验,实验结果表明用该方法构造的FLANN具有结果唯一、结构简单、全局优化等特点,特别是在实验数据较少的小样本条件下仍然具有更高的鲁棒性和修正精度。

改进遗传算法结合FLANN在加速度传感器动态建模中的应用

对遗传算法(GA)的交叉和变异操作进行改进,提出利用改进遗传算法(IGA)和函数连接型人工神经网络(FLANN)相结合实现加速度传感器的动态建模的新方法。该方法利用加速度传感器的动态标定数据,采用IGA和FLANN相结合搜索和优化动态模型参数。文中介绍动态建模原理以及算法,给出用IGA和FLANN相结合建立的加速度传感器动态数学模型。结果表明:上面提出的动态建模方法既保留了GA的全局搜索能力和FLANN结构简单的特点,又具有网络训练速度快、实时性好、建模精度高等优点,在动态测试领域具有重要应用价值。