Neural Network Based on GA-BP Algorithm and its Application in the Protein Secondary Structure Prediction

The advantages and disadvantages of genetic algorithm and BP algorithm are introduced. A neural network based on GA-BP algorithm is proposed and applied in the prediction of protein secondary structure, which combines the advantages of BP and GA. The prediction and training on the neural network are made respectively based on 4 structure classifications of protein so as to get higher rate of predication---the highest prediction rate 75.65%,the average prediction rate 65.04%.

NeurstrucEnergy:A bi-directional GNN model for energy prediction of neural networks in IoT

A significant demand rises for energy-efficient deep neural networks to support power-limited embedding devices with successful deep learning applications in IoT and edge computing fields.An accurate energy prediction approach is critical to provide measurement and lead optimization direction.However,the current energy prediction approaches lack accuracy and generalization ability due to the lack of research on the neural network structure and the excessive reliance on customized training dataset.This paper presents a novel energy prediction model,NeurstrucEnergy.NeurstrucEnergy treats neural networks as directed graphs and applies a bi-directional graph neural network training on a randomly generated dataset to extract structural features for energy prediction.NeurstrucEnergy has advantages over linear approaches because the bi-directional graph neural network collects structural features from each layer's parents and children.Experimental results show that NeurstrucEnergy establishes state-of-the-art results with mean absolute percentage error of 2.60%.We also evaluate NeurstrucEnergy in a randomly generated dataset,achieving the mean absolute percentage error of 4.83%over 10 typical convolutional neural networks in recent years and 7 efficient convolutional neural networks created by neural architecture search.Our code is available at https://github.com/NEUSoftGreenAI/NeurstrucEnergy.git.

Using Neural Networks to Predict Secondary Structure for Protein Folding

Protein Secondary Structure Prediction (PSSP) is considered as one of the major challenging tasks in bioinformatics, so many solutions have been proposed to solve that problem via trying to achieve more accurate prediction results. The goal of this paper is to develop and implement an intelligent based system to predict secondary structure of a protein from its primary amino acid sequence by using five models of Neural Network (NN). These models are Feed Forward Neural Network (FNN), Learning Vector Quantization (LVQ), Probabilistic Neural Network (PNN), Convolutional Neural Network (CNN), and CNN Fine Tuning for PSSP. To evaluate our approaches two datasets have been used. The first one contains 114 protein samples, and the second one contains 1845 protein samples.

Biological Neural Network Structure and Spike Activity Prediction Based on Multi-Neuron Spike Train Data

The micro-scale neural network structure for the brain is essential for the investigation on the brain and mind. Most of the previous studies typically acquired the neural network structure through brain slicing and reconstruction via nanoscale imaging. Nevertheless, this method still cannot scale well, and the observation on the neural activities based on the reconstructed neural network is not possible. Neuron activities are based on the neural network of the brain. In this paper, we propose that multi-neuron spike train data can be used as an alternative source to predict the neural network structure. And two concrete strategies for neural network structure prediction based on such kind of data are introduced, namely, the time-ordered strategy and the spike co-occurrence strategy. The proposed methods can even be applied to in vivo studies since it only requires neural spike activities. Based on the predicted neural network structure and the spreading activation theory, we propose a spike prediction method. For neural network structure reconstruction, the experimental results reveal a significantly improved accuracy compared to previous network reconstruction strategies, such as Cross-correlation, Pearson, and the Spearman method. Experiments on the spikes prediction results show that the proposed spreading activation based strategy is potentially effective for predicting neural spikes in the biological neural network. The predictions on the neural network structure and the neuron activities serve as foundations for large scale brain simulation and explorations of human intelligence.

The Application of Neural Network in Lifetime Prediction of Concrete

There are many difficulties in concrete endurance prediction, especially in accurate predicting service life of concrete engineering. It is determined by the concentration of S042-/ Mg2+ / Cl- /Ca2+ , reactionareas , the cycles of freezing and dissolving, alternatives of dry and wet state, the kind of cement, etc. . In general , because of complexity itself and cognitive limitation, endurance prediction under sulphate erosion is still illegible and uncertain, so this paper adopts neural network technology to research this problem. Through analyzing , the paper sets up a 3 - levels neural network and a 4 - levels neural network to predict the endurance undersulphate erosion. The 3 - levels neural network includes 13 inputting nodes, 7 outputting nodes and 34 hidden nodes. The 4 - levels neural network also has 13 inputting nodes and 7 outputting nodes with two hidden levels which has 1 nodes and 8 nodes separately. In the end the paper give a example with laboratorial data and discussion the result and deviation. The paper shows that deviation results from some faults of training specimens; such as few training specimens and few distinctions among training specimens. So the more specimens should be collected to reduce data redundancy and improve the reliability of network analysis conclusion.

Prediction of Superconductivity for Oxides Based on Structural Parameters and Artificial Neural Network Method

Superconductive properties for oxides were predicted by artificial neural network (ANN) method with structural and chemical parameters as inputs. The predicted properties include superconductivity for oxides, distributed ranges of the superconductive transition temperature (Tc) for complex oxides, and Tc values for cuprate superconductors. The calculated results indicated that the adjusted ANN can be used to predict superconductive properties for unknown oxides.

A Deep Learning Approach for Prediction of Protein Secondary Structure

The secondary structure of a protein is critical for establishing a link between the protein primary and tertiary structures.For this reason,it is important to design methods for accurate protein secondary structure prediction.Most of the existing computational techniques for protein structural and functional prediction are based onmachine learning with shallowframeworks.Different deep learning architectures have already been applied to tackle protein secondary structure prediction problem.In this study,deep learning based models,i.e.,convolutional neural network and long short-term memory for protein secondary structure prediction were proposed.The input to proposed models is amino acid sequences which were derived from CulledPDB dataset.Hyperparameter tuning with cross validation was employed to attain best parameters for the proposed models.The proposed models enables effective processing of amino acids and attain approximately 87.05%and 87.47%Q3 accuracy of protein secondary structure prediction for convolutional neural network and long short-term memory models,respectively.

Uncertainty quantification of predicting stable structures for high-entropy alloys using Bayesian neural networks

High entropy alloys(HEAs)have excellent application prospects in catalysis because of their rich components and configuration space.In this work,we develop a Bayesian neural network(BNN)based on energies calculated with density functional theory to search the configuration space of the CoNiRhRu HEA system.The BNN model was developed by considering six independent features of Co-Ni,Co-Rh,CoRu,Ni-Rh,Ni-Ru,and Rh-Ru in different shells and energies of structures as the labels.The root mean squared error of the energy predicted by BNN is 1.37 me V/atom.Moreover,the influence of feature periodicity on the energy of HEA in theoretical calculations is discussed.We found that when the neural network is optimized to a certain extent,only using the accuracy indicator of root mean square error to evaluate model performance is no longer accurate in some scenarios.More importantly,we reveal the importance of uncertainty quantification for neural networks to predict new structures of HEAs with proper confidence based on BNN.

Compensation for secondary uncertainty in electro-hydraulic servo system by gain adaptive sliding mode variable structure control

Based on consideration of the differential relations between the immeasurable variables and measurable variables in electro-hydraulic servo system,adaptive dynamic recurrent fuzzy neural networks(ADRFNNs) were employed to identify the primary uncertainty and the mathematic model of the system was turned into an equivalent linear model with terms of secondary uncertainty.At the same time,gain adaptive sliding mode variable structure control(GASMVSC) was employed to synthesize the control effort.The results show that the unrealization problem caused by some system's immeasurable state variables in traditional fuzzy neural networks(TFNN) taking all state variables as its inputs is overcome.On the other hand,the identification by the ADRFNNs online with high accuracy and the adaptive function of the correction term's gain in the GASMVSC make the system possess strong robustness and improved steady accuracy,and the chattering phenomenon of the control effort is also suppressed effectively.

Computational prediction of RNA tertiary structures using machine learning methods

RNAs play crucial and versatile roles in biological processes. Computational prediction approaches can help to understand RNA structures and their stabilizing factors, thus providing information on their functions, and facilitating the design of new RNAs. Machine learning (ML) techniques have made tremendous progress in many fields in the past few years. Although their usage in protein-related fields has a long history, the use of ML methods in predicting RNA tertiary structures is new and rare. Here, we review the recent advances of using ML methods on RNA structure predictions and discuss the advantages and limitation, the difficulties and potentials of these approaches when applied in the field.

Deformation,structure and potential hazard of a landslide based on InSAR in Banbar county,Xizang(Tibet)

The Tibetan Plateau is characterized by complex geological conditions and a relatively fragile ecological environment.In recent years,there has been continuous development and increased human activity in the Tibetan Plateau region,leading to a rising risk of landslides.The landslide in Banbar County,Xizang(Tibet),have been perturbed by ongoing disturbances from human engineering activities,making it susceptible to instability and displaying distinct features.In this study,small baseline subset synthetic aperture radar interferometry(SBAS-InSAR)technology is used to obtain the Line of Sight(LOS)deformation velocity field in the study area,and then the slope-orientation deformation field of the landslide is obtained according to the spatial geometric relationship between the satellite’s LOS direction and the landslide.Subsequently,the landslide thickness is inverted by applying the mass conservation criterion.The results show that the movement area of the landslide is about 6.57×10^(4)m^(2),and the landslide volume is about 1.45×10^(6)m^(3).The maximum estimated thickness and average thickness of the landslide are 39 m and 22 m,respectively.The thickness estimation results align with the findings from on-site investigation,indicating the applicability of this method to large-scale earth slides.The deformation rate of the landslide exhibits a notable correlation with temperature variations,with rainfall playing a supportive role in the deformation process and displaying a certain lag.Human activities exert the most substantial influence on the spatial heterogeneity of landslide deformation,leading to the direct impact of several prominent deformation areas due to human interventions.Simultaneously,utilizing the long short-term memory(LSTM)model to predict landslide displacement,and the forecast results demonstrate the effectiveness of the LSTM model in predicting landslides that are in a continuous development and movement phase.The landslide is still active,and based on the spatial heterogeneity of landslide deformation,new recommendations have been proposed for the future management of the landslide in order to mitigate potential hazards associated with landslide instability.

基于改进的BRNN网络的二级结构预测

针对双向反馈神经网络(BRNN)的结构复杂、收敛速度慢的特点,本文提出了一种改进的BRNN网络。将BRNN左、右子网络的隐层删除,直接将输入连接到状态层,并且采用BP改进算法中的弹性算法进行训练。以90条序列共15377个氨基酸进行交叉验证。仿真结果表明,改进网络以及采用的弹性算法可以有效地缩短网络收敛时间。

Brain networks modeling for studying the mechanism underlying the development of Alzheimer’s disease

Alzheimer’s disease is a primary age-related neurodegenerative disorder that can result in impaired cognitive and memory functions.Although connections between changes in brain networks of Alzheimer’s disease patients have been established,the mechanisms that drive these alterations remain incompletely understood.This study,which was conducted in 2018 at Northeastern University in China,included data from 97 participants of the Alzheimer’s Disease Neuroimaging Initiative(ADNI)dataset covering genetics,imaging,and clinical data.All participants were divided into two groups:normal control(n=52;20 males and 32 females;mean age 73.90±4.72 years)and Alzheimer’s disease(n=45,23 males and 22 females;mean age 74.85±5.66).To uncover the wiring mechanisms that shaped changes in the topology of human brain networks of Alzheimer’s disease patients,we proposed a local naive Bayes brain network model based on graph theory.Our results showed that the proposed model provided an excellent fit to observe networks in all properties examined,including clustering coefficient,modularity,characteristic path length,network efficiency,betweenness,and degree distribution compared with empirical methods.This proposed model simulated the wiring changes in human brain networks between controls and Alzheimer’s disease patients.Our results demonstrate its utility in understanding relationships between brain tissue structure and cognitive or behavioral functions.The ADNI was performed in accordance with the Good Clinical Practice guidelines,US 21 CFR Part 50-Protection of Human Subjects,and Part 56-Institutional Review Boards(IRBs)/Research Good Clinical Practice guidelines Institutional Review Boards(IRBs)/Research Ethics Boards(REBs).

Yarn Properties Prediction Based on Machine Learning Method

Although many works have been done to construct prediction models on yarn processing quality,the relation between spinning variables and yarn properties has not been established conclusively so far.Support vector machines(SVMs),based on statistical learning theory,are gaining applications in the areas of machine learning and pattern recognition because of the high accuracy and good generalization capability.This study briefly introduces the SVM regression algorithms,and presents the SVM based system architecture for predicting yarn properties.Model selection which amounts to search in hyper-parameter space is performed for study of suitable parameters with grid-research method.Experimental results have been compared with those of artificial neural network(ANN)models.The investigation indicates that in the small data sets and real-life production,SVM models are capable of remaining the stability of predictive accuracy,and more suitable for noisy and dynamic spinning process.

新冠疫情背景下梅州市商品房价格预测——基于BRNN模型的分析

引入系统动力学理论思想,运用LR模型与BRNN模型构建疫情背景下梅州市商品房市场价格系统的预测模型。研究结果表明:城市人口的总量对城市商品房价格有显著的正向影响;新冠疫情对三四线城市商品房市场的影响是全方位且具有传递性;新冠疫情防控进入稳定状态时城市商品房价格会逐步回归上涨趋势,相比较人口因素而言,疫情防控对未来商品房价格的影响更加显著;三四线城市地区生产总值对商品房销售价格具有显著影响,显示房地产业占城市经济总量的比重较大。

基于神经网络的跨越地裂缝框架结构地震损伤及预测研究

为开展特殊地质环境下结构的损伤分析,以一跨越西安f4地裂缝的五层框架结构为研究对象,基于振动台试验和ABAQUS有限元分析结果,进行了BP神经网络模型的模型训练,选取变形和能量组合形式的双参数损伤模型计算结构损伤指标,采用加权系数法,开展了构件、楼层、结构三个层面的损伤预测分析,给出了不同地震作用下结构损伤程度评估。结果表明:地裂缝场地结构表现出明显上下盘效应,结构首层为薄弱层。BP神经网络损伤预测值与有限元计算值在不同工况下均较为一致,其对于构件、层间、整体结构损伤指数预测最大误差分别为8.86%、5.66%、7.57%,该研究成果为跨越地裂缝结构的性能评估提供一种准确且高效的研究方法。

基于BP神经网络的集中供热二次网回水温度预测控制研究

针对集中供热系统二次管网存在的水力失调问题,设计了二次网水力平衡调节及回水温度预测模型,并实施智能控制策略,以实现二次网回水温度的精准控制。首先,构建BP神经网络预测模型,将此模型的输出视为二次网回水温度给定值;其次,在整个系统控制中,实施BP神经网络与PID控制器相结合的策略,进行二次网回水温度的控制。以高邑县某小区换热站数据为基础,通过阶跃响应曲线法建立二次网回水温度控制系统的数学模型,并通过BP-PID控制进行仿真实验。实验结果表明,与传统PID控制器相比,BP-PID控制器具有调节时间短、超调量小的优点,能够快速达到平稳状态。

基于二次分解的不同太阳辐射下光伏功率预测

考虑不同太阳辐射对光伏功率的影响,提出一种基于二次分解和改进粒子群算法的光伏功率预测模型。通过Spearman和Kendall对影响光伏功率的各气象因素进行相关性分析,发现总倾斜辐射、总水平辐射、漫射倾斜辐射、漫射水平辐射与光伏功率的相关系数较大。然后利用CLARANS将样本数据按太阳辐射强度分为强辐射、中辐射和弱辐射,针对3类数据采用自适应噪声完备集合经验模态分解(CEEMDAN)对关键气象因素和功率进行二次分解,充分挖掘时序信息并降低数据的不稳定性。提出一种改进粒子群算法(GWCPSO)用于优化卷积神经网络和双向长短期记忆网络的超参数,提高调参效率,最后构建预测模型进行光伏功率预测。分析3种太阳辐射类型下不同分解方法与网络模型的预测误差,结果表明,所的预测模型可有效提高不同太阳辐射下光伏功率的预测精度。

二氧化氮浓度时空预测:一种区间二型直觉模糊神经网络方法

空气中二氧化氮浓度的高低对环境保护和公共健康具有重要影响。目前二氧化氮浓度预测方法在表征时空关联性方面存在不足。鉴于此,提出了新的使用区间二型直觉模糊神经网络时空预测二氧化氮浓度的方法。首先,阐述了该区间二型直觉模糊神经网络框架,引入可变系数加权其隶属部分和非隶属部分的输出,并采用随机向量泛函链接神经网络作为规则后件;然后,为确定网络结构和参数,采用分层聚类算法得到模糊规则库,并通过最小二乘法优化网络后件的输出权值;最后,使用2018年1月至3月采集的北京市二氧化氮浓度真实数据进行数值验证。实验结果表明,与现有方法相比,该方法在短期和长期时空预测方面均取得了较高的预测精度和效率。

基于GA-BP神经网络的CDC减振器电磁阀优化研究

针对CDC减振器电磁阀研究中,只针对单一参数对电磁特性进行影响分析,且获得电磁阀最优结构参数组合速度较慢的不足,本文提出了基于GA-BP神经网络的电磁阀特性优化方法。首先,利用ANSYS Maxwell仿真分析,得到不同参数组合下的电磁力,然后训练样本集建立BP神经网络电磁力预测模型,再采用遗传算法优化,寻得最优的参数组合,建立GA-BP神经网络模型。结果表明,将GA-BP神经网络算法应用于电磁力的预测,能有效提高电磁阀的设计效率。