Grid Side Distributed Energy Storage Cloud Group End Region Hierarchical Time-Sharing Configuration Algorithm Based onMulti-Scale and Multi Feature Convolution Neural Network

There is instability in the distributed energy storage cloud group end region on the power grid side.In order to avoid large-scale fluctuating charging and discharging in the power grid environment and make the capacitor components showa continuous and stable charging and discharging state,a hierarchical time-sharing configuration algorithm of distributed energy storage cloud group end region on the power grid side based on multi-scale and multi feature convolution neural network is proposed.Firstly,a voltage stability analysis model based onmulti-scale and multi feature convolution neural network is constructed,and the multi-scale and multi feature convolution neural network is optimized based on Self-OrganizingMaps(SOM)algorithm to analyze the voltage stability of the cloud group end region of distributed energy storage on the grid side under the framework of credibility.According to the optimal scheduling objectives and network size,the distributed robust optimal configuration control model is solved under the framework of coordinated optimal scheduling at multiple time scales;Finally,the time series characteristics of regional power grid load and distributed generation are analyzed.According to the regional hierarchical time-sharing configuration model of“cloud”,“group”and“end”layer,the grid side distributed energy storage cloud group end regional hierarchical time-sharing configuration algorithm is realized.The experimental results show that after applying this algorithm,the best grid side distributed energy storage configuration scheme can be determined,and the stability of grid side distributed energy storage cloud group end region layered timesharing configuration can be improved.

Adaptive Optimal Capacity Perception and Control for Wireless Multi-Hop Networks

In wireless multimedia communications, it is extremely difficult to derive general end-to-end capacity results because of decentralized packet scheduling and the interference between communicating nodes. In this paper, we present a state-based channel capacity perception scheme to provide statistical Quality-of-Service (QoS) guarantees under a medium or high traffic load for IEEE 802.11 wireless multi-hop networks. The proposed scheme first perceives the state of the wireless link from the MAC retransmission information and extends this information to calculate the wireless channel capacity, particularly under a saturated traffic load, on the basis of the interference among flows and the link state in the wireless multi-hop networks. Finally, the adaptive optimal control algorithm allocates a network resource and forwards the data packet by taking into consideration the channel capacity deployments in multi-terminal or multi-hop mesh networks. Extensive computer simulations demonstrate that the proposed scheme can achieve better performance in terms of packet delivery ratio and network throughput compared to the existing capacity prediction schemes.

A Kind of Second-Order Learning Algorithm Based on Generalized Cost Criteria in Multi-Layer Feed-Forward Neural Networks

A kind of second order algorithm--recursive approximate Newton algorithm was given by Karayiannis. The algorithm was simplified when it was formulated. Especially, the simplification to matrix Hessian was very reluctant, which led to the loss of valuable information and affected performance of the algorithm to certain extent. For multi layer feed forward neural networks, the second order back propagation recursive algorithm based generalized cost criteria was proposed. It is proved that it is equivalent to Newton recursive algorithm and has a second order convergent rate. The performance and application prospect are analyzed. Lots of simulation experiments indicate that the calculation of the new algorithm is almost equivalent to the recursive least square multiple algorithm. The algorithm and selection of networks parameters are significant and the performance is more excellent than BP algorithm and the second order learning algorithm that was given by Karayiannis.

Hausdorff Dimension of Multi-Layer Neural Networks

This elucidation investigates the Hausdorff dimension of the output space of multi-layer neural networks. When the factor map from the covering space of the output space to the output space has a synchronizing word, the Hausdorff dimension of the output space relates to its topological entropy. This clarifies the geometrical structure of the output space in more details.

SSA-MLP模型在岩质边坡稳定性预测中的应用

岩质边坡的力学参数量化及稳定性分析对岩质边坡灾害的防治具有重要意义。Hoek-Brown(H B)准则是一种用于确定岩体力学参数的经典方法,能反映出边坡岩体变形和位移的非线性破坏特征。在此基础上,首先,提出一种麻雀搜索算法(Sparrow Search Algorithm,SSA)改进多层感知器(Multi-Layer Perceptron,MLP)的神经网络模型,并用于边坡稳定性预测、指标敏感性分析及参数反演。其次,将收集的1085组岩质边坡的几何参数和H B准则参数等作为输入变量,极限平衡理论Bishop法求解的安全系数作为输出变量,对SSA MLP模型进行训练学习和性能评估。最后,将该模型运用于25个边坡实例,验证模型的有效性。结果显示,该模型收敛速度快、精度高,为边坡稳定性分析和参数量化提供了一种新思路。

Comparative Appraisal of Response Surface Methodology and Artificial Neural Network Method for Stabilized Turbulent Confined Jet Diffusion Flames Using Bluff-Body Burners

The present study was conducted to present the comparative modeling, predictive and generalization abilities of response surface methodology (RSM) and artificial neural network (ANN) for the thermal structure of stabilized confined jet diffusion flames in the presence of different geometries of bluff-body burners. Two stabilizer disc burners tapered at 30° and 60° and another frustum cone of 60°/30° inclination angle were employed all having the same diameter of 80 (mm) acting as flame holders. The measured radial mean temperature profiles of the developed stabilized flames at different normalized axial distances (x/dj) were considered as the model example of the physical process. The RSM and ANN methods analyze the effect of the two operating parameters namely (r), the radial distance from the center line of the flame, and (x/dj) on the measured temperature of the flames, to find the predicted maximum temperature and the corresponding process variables. A three-layered Feed Forward Neural Network in conjugation with the hyperbolic tangent sigmoid (tansig) as transfer function and the optimized topology of 2:10:1 (input neurons: hidden neurons: output neurons) was developed. Also the ANN method has been employed to illustrate such effects in the three and two dimensions and shows the location of the predicted maximum temperature. The results indicated the superiority of ANN in the prediction capability as the ranges of R2 and F Ratio are 0.868 - 0.947 and 231.7 - 864.1 for RSM method compared to 0.964 - 0.987 and 2878.8 7580.7 for ANN method beside lower values for error analysis terms.

A CNN-Based Single-Stage Occlusion Real-Time Target Detection Method

Aiming at the problem of low accuracy of traditional target detection methods for target detection in endoscopes in substation environments, a CNN-based real-time detection method for masked targets is proposed. The method adopts the overall design of backbone network, detection network and algorithmic parameter optimisation method, completes the model training on the self-constructed occlusion target dataset, and adopts the multi-scale perception method for target detection. The HNM algorithm is used to screen positive and negative samples during the training process, and the NMS algorithm is used to post-process the prediction results during the detection process to improve the detection efficiency. After experimental validation, the obtained model has the multi-class average predicted value (mAP) of the dataset. It has general advantages over traditional target detection methods. The detection time of a single target on FDDB dataset is 39 ms, which can meet the need of real-time target detection. In addition, the project team has successfully deployed the method into substations and put it into use in many places in Beijing, which is important for achieving the anomaly of occlusion target detection.

融合CNN-SAM与GAT的多标签文本分类模型

现有基于神经网络的多标签文本分类研究方法存在两方面不足,一是不能全面提取文本信息特征,二是很少从图结构数据中挖掘全局标签之间的关联性。针对以上两个问题,提出融合卷积神经网络-自注意力机制(CNNSAM)与图注意力网络(GAT)的多标签文本分类模型(CS-GAT)。该模型利用多层卷积神经网络与自注意力机制充分提取文本局部与全局信息并进行融合,得到更为全面的特征向量表示;同时将不同文本标签之间的关联性转变为具有全局信息的边加权图,利用多层图注意力机制自动学习不同标签之间的关联程度,将其与文本上下文语义信息进行交互,获取具有文本语义联系的全局标签信息表示;使用自适应融合策略进一步提取两者特征信息,提高模型的泛化能力。在AAPD、RCV1-V2与EUR-Lex三个公开英文数据集上的实验结果表明,该模型所达到的多标签分类效果明显优于其他主流基线模型。

Performance Comparison of Neural Networks for HRTFs Approximation

0 ＩｎｔｒｏｄｕｃｔｉｏｎＨｅａｄｒｅｌａｔｅｄｔｒａｎｓｆｅｒｆｕｎｃｔｉｏｎｓ(ＨＲＴＦｓ)ｒｅｆｅｒｔｏｔｈｅｓｐｅｃｔｒａｌｆｉｌｔｅｒｉｎｇｆｒｏｍｓｏｕｎｄｓｏｕｒｃｅｓｔｏｌｉｓｔｅｎｅｒｓ’ｅａｒｄｒｕｍｓ.ＳｉｎｃｅＨＲＴＦｓ(ｎｏｎ?..

融合Multi-scale CNN和Bi-LSTM的人脸表情识别研究

为了有效改善现有人脸表情识别模型中存在信息丢失严重、特征信息之间联系不密切的问题,提出一种融合多尺度卷积神经网络(Multi-scale CNN)和双向长短期记忆(Bi-LSTM)的模型。Bi-LSTM可以增强特征信息间的联系与信息的维持,在Multi-scale CNN中通过不同尺度的卷积核可以提取到更加丰富的特征信息,并通过加入批标准化(BN)层与特征融合处理,从而加快网络的收敛速度,有利于特征信息的重利用,再将两者提取到的特征信息进行融合,最后将改进的正则化方法应用到目标函数中,减小网络复杂度和过拟合。在JAFFE和FER-2013公开数据集上进行实验,准确率分别达到了95.455%和74.115%,由此证明所提算法的有效性和先进性。

Identification and Prediction of Internet Traffic Using Artificial Neural Networks

This paper presents the development of an artificial neural network (ANN) model based on the multi-layer perceptron (MLP) for analyzing internet traffic data over IP networks. We applied the ANN to analyze a time series of measured data for network response evaluation. For this reason, we used the input and output data of an internet traffic over IP networks to identify the ANN model, and we studied the performance of some training algorithms used to estimate the weights of the neuron. The comparison between some training algorithms demonstrates the efficiency and the accu-racy of the Levenberg-Marquardt (LM) and the Resilient back propagation (Rp) algorithms in term of statistical crite-ria. Consequently, the obtained results show that the developed models, using the LM and the Rp algorithms, can successfully be used for analyzing internet traffic over IP networks, and can be applied as an excellent and fundamental tool for the management of the internet traffic at different times.

Applying Neural Network Architecture for Inverse Kinematics Problem in Robotics

One of the most important problems in robot kinematics and control is, finding the solution of Inverse Kinematics. Inverse kinematics computation has been one of the main problems in robotics research. As the Complexity of robot increases, obtaining the inverse kinematics is difficult and computationally expensive. Traditional methods such as geometric, iterative and algebraic are inadequate if the joint structure of the manipulator is more complex. As alternative approaches, neural networks and optimal search methods have been widely used for inverse kinematics modeling and control in robotics This paper proposes neural network architecture that consists of 6 sub-neural networks to solve the inverse kinematics problem for robotics manipulators with 2 or higher degrees of freedom. The neural networks utilized are multi-layered perceptron (MLP) with a back-propagation training algorithm. This approach will reduce the complexity of the algorithm and calculation (matrix inversion) faced when using the Inverse Geometric Models implementation (IGM) in robotics. The obtained results are presented and analyzed in order to prove the efficiency of the proposed approach.

An Improved SPSA Algorithm for System Identification Using Fuzzy Rules for Training Neural Networks

Simultaneous perturbation stochastic approximation （SPSA） belongs to the class of gradient-free optimization methods that extract gradient information from successive objective function evaluation. This paper describes an improved SPSA algorithm, which entails fuzzy adaptive gain sequences, gradient smoothing, and a step rejection procedure to enhance convergence and stability. The proposed fuzzy adaptive simultaneous perturbation approximation （FASPA） algorithm is particularly well suited to problems involving a large number of parameters such as those encountered in nonlinear system identification using neural networks （NNs）. Accordingly, a multilayer perceptron （MLP） network with popular training algorithms was used to predicate the system response. We found that an MLP trained by FASPSA had the desired accuracy that was comparable to results obtained by traditional system identification algorithms. Simulation results for typical nonlinear systems demonstrate that the proposed NN architecture trained with FASPSA yields improved system identification as measured by reduced time of convergence and a smaller identification error.

融合GRU-Attention与鲸鱼算法的流程制造工艺参数云边联动优化

为解决流程制造工艺参数优化面临的多工序耦合模型构建复杂、多目标冲突分析困难、实时和准确性难以保障等问题,提出一种融合GRU-Attention与鲸鱼算法的流程制造工艺参数云边联动优化方法。设计了适用于多工序耦合生产的训练计算云边协同架构,通过设备边缘节点与云平台的高效协同,完成了预测模型和优化模型的云端训练,边缘端数据收集、模型下载和调用计算。在此基础上,建立了基于GRU-Attention多层神经网络的生产工艺质量预测模型,将输出质量指标作为适应度,调用鲸鱼算法对生产工艺参数进行全局寻优,获得不同工序最优工艺参数组合,实现流程生产不同工序加工质量的实时预测和综合优化。最后,以某流程制丝生产线为例进行了实验验证,结果表明,所提基于深度学习的云边联动方法可实现生产质量的综合动态优化,同时可降低工艺参数调控任务的完成时间。

Effective prediction of DEA model by neural network

In this paper,a fast neural network model for the forecasting of effective points by DEA model is proposed,which is based on the SPDS training algorithm.The SPDS training algorithm overcomes the drawbacks of slow convergent speed and partially minimum result for BP algorithm.Its training speed is much faster and its forecasting precision is much better than those of BP algorithm.By numeric examples,it is showed that adopting the neural network model in the forecasting of effective points by DEA model is valid.

A Condition States Assessment System for Concrete Bridges Using Neural Networks

Due to continuing aging and heavy utilization of many bridges and the limited available funds, the importance of proper bridge condition state assessment has risen recently, which is the crucial point for rational decision-making on MR&R activities. This paper presents a prototype of the concrete bridge condition state assessment system (CBCSAS) with the following sub-modules: inspection, parameter recognition, structural assessment, main cause identification and priority-to-action. And multi-layer neural networks, which may combine with fuzzy set theory or not, are performed to realize the structural assessment with embedding expert knowledge into the assessment system.

CNN-MCF-ELM模型识别面部表情

为了更好地解决传统神经网络提取特征不够全面导致表情识别准确率低,以及表情识别中参数调整计算量大、耗时长、模型泛化能力弱等问题,这里提出一种将卷积神经网络多层特征融合与极限学习机(ELM)结合的表情识别方法。该方法是利用卷积神经网络(CNN)提取多层面部表情特征图,再将CNN提取出的后三层特征图采用多尺度池化操作,将这三个特征向量级联融合成一个面部表情特征向量,该特征向量具有多尺度多属性的性质能够很好的表达表情特征;最后,把融合后的面部表情特征向量输入到ELM分类器进行表情识别。实验结果表明,该方法能够有效地提高面部表情识别的准确率,在CK+、FER2013数据集上的平均识别准确率分别达到了98.72%和78.97%,并且缩短了识别时间。同时通过设计实验验证了模型具有较强的泛化能力。