NeurstrucEnergy:A bi-directional GNN model for energy prediction of neural networks in IoT

A significant demand rises for energy-efficient deep neural networks to support power-limited embedding devices with successful deep learning applications in IoT and edge computing fields.An accurate energy prediction approach is critical to provide measurement and lead optimization direction.However,the current energy prediction approaches lack accuracy and generalization ability due to the lack of research on the neural network structure and the excessive reliance on customized training dataset.This paper presents a novel energy prediction model,NeurstrucEnergy.NeurstrucEnergy treats neural networks as directed graphs and applies a bi-directional graph neural network training on a randomly generated dataset to extract structural features for energy prediction.NeurstrucEnergy has advantages over linear approaches because the bi-directional graph neural network collects structural features from each layer's parents and children.Experimental results show that NeurstrucEnergy establishes state-of-the-art results with mean absolute percentage error of 2.60%.We also evaluate NeurstrucEnergy in a randomly generated dataset,achieving the mean absolute percentage error of 4.83%over 10 typical convolutional neural networks in recent years and 7 efficient convolutional neural networks created by neural architecture search.Our code is available at https://github.com/NEUSoftGreenAI/NeurstrucEnergy.git.

Energy Prediction in IoT Systems Using Machine Learning Models

The Internet of Things (IoT) technology has been developed fordirecting and maintaining the atmosphere in smart buildings in real time. Inorder to optimise the power generation sector and schedule routine maintenance,it is crucial to predict future energy demand. Electricity demandforecasting is difficult because of the complexity of the available demandpatterns. Establishing a perfect prediction of energy consumption at thebuilding’s level is vital and significant to efficiently managing the consumedenergy by utilising a strong predictive model. Low forecast accuracy is justone of the reasons why energy consumption and prediction models havefailed to advance. Therefore, the purpose of this study is to create an IoTbasedenergy prediction (IoT-EP) model that can reliably estimate the energyconsumption of smart buildings. A real-world test case on power predictionsis conducted on a local electricity grid to test the practicality of the approach.The proposed (IoT-EP) model selects the significant features as input neurons,the predictable data is selected as output nodes, and a multi-layer perceptronis constructed along with the features of the Convolution Neural Network(CNN) algorithm. The analysis of the proposed IoT-EP model has higheraccuracy of 90%, correlation of 89%, and variance of 16% in less training timeof 29.2 s, and with a higher prediction speed of 396 (observation/sec). Whencompared to existing models, the results showed that the proposed (IoT-EP)model outperforms with a satisfactory level of accuracy in predicting energyconsumption in smart buildings.

An improved transfer learning strategy for short-term cross-building energy prediction usingdata incremental

The available modelling data shortage issue makes it difficult to guarantee the performance of data-driven building energy prediction(BEP)models for both the newly built buildings and existing information-poor buildings.Both knowledge transfer learning(KTL)and data incremental learning(DIL)can address the data shortage issue of such buildings.For new building scenarios with continuous data accumulation,the performance of BEP models has not been fully investigated considering the data accumulation dynamics.DIL,which can learn dynamic features from accumulated data adapting to the developing trend of new building time-series data and extend BEP model's knowledge,has been rarely studied.Previous studies have shown that the performance of KTL models trained with fixed data can be further improved in scenarios with dynamically changing data.Hence,this study proposes an improved transfer learning cross-BEP strategy continuously updated using the coarse data incremental(CDI)manner.The hybrid KTL-DIL strategy(LSTM-DANN-CDI)uses domain adversarial neural network(DANN)for KLT and long short-term memory(LSTM)as the Baseline BEP model.Performance evaluation is conducted to systematically qualify the effectiveness and applicability of KTL and improved KTL-DIL.Real-world data from six-type 36 buildings of six types are adopted to evaluate the performance of KTL and KTL-DIL in data-driven BEP tasks considering factors like the model increment time interval,the available target and source building data volumes.Compared with LSTM,results indicate that KTL(LSTM-DANN)and the proposed KTL-DIL(LSTM-DANN-CDI)can significantly improve the BEP performance for new buildings with limited data.Compared with the pure KTL strategy LSTM-DANN,the improved KTL-DIL strategy LSTM-DANN-CDI has better prediction performance with an average performance improvement ratio of 60%.

A novel deep generative modeling-based data augmentation strategy for improving short-term building energy predictions

Short-term building energy predictions serve as one of the fundamental tasks in building operation management.While large numbers of studies have explored the value of various supervised machine learning techniques in energy predictions,few studies have addressed the potential data shortage problem in developing data-driven models.One promising solution is data augmentation,which aims to enrich existing building data resources for reliable predictive modeling.This study proposes a deep generative modeling-based data augmentation strategy for improving short-term building energy predictions.Two types of conditional variational autoencoders have been designed for synthetic energy data generation using fully connected and one-dimensional convolutional layers respectively.Data experiments have been designed to evaluate the value of data augmentation using actual measurements from 52 buildings.The results indicate that conditional variational autoencoders are capable of generating high-quality synthetic data samples,which in turns helps to enhance the accuracy in short-term building energy predictions.The average performance enhancement ratios in terms of CV-RMSE range between 12%and 18%.Practical guidelines have been obtained to ensure the validity and quality of synthetic building energy data.The research outcomes are valuable for enhancing the robustness and reliability of data-driven models for smart building operation management.

Secure coverage-preserving node scheduling scheme using energy prediction for wireless sensor networks

With the fast development of the micro-electro-mechanical systems （MEMS）,wireless sensor networks （WSNs） have been extensively studied.Most of the studies focus on saving energy consumption because of restricted energy supply in WSNs.Cluster-based node scheduling scheme is commonly considered as one of the most energy-efficient approaches.However,it is not always so efficient especially when there exist hot spot and network attacks in WSNs.In this article,a secure coverage-preserved node scheduling scheme for WSNs based on energy prediction is proposed in an uneven deployment environment.The scheme is comprised of an uneven clustering algorithm based on arithmetic progression,a cover set partition algorithm based on trust and a node scheduling algorithm based on energy prediction.Simulation results show that network lifetime of the scheme is 350 rounds longer than that of other scheduling algorithms.Furthermore,the scheme can keep a high network coverage ratio during the network lifetime and achieve the designed objective which makes energy dissipation of most nodes in WSNs balanced.

A Review of Energy-Related Cost Issues and Prediction Models in Cloud Computing Environments

With the expansion of cloud computing,optimizing the energy efficiency and cost of the cloud paradigm is considered significantly important,since it directly affects providers’revenue and customers’payment.Thus,providing prediction information of the cloud services can be very beneficial for the service providers,as they need to carefully predict their business growths and efficiently manage their resources.To optimize the use of cloud services,predictive mechanisms can be applied to improve resource utilization and reduce energy-related costs.However,such mechanisms need to be provided with energy awareness not only at the level of the Physical Machine(PM)but also at the level of the Virtual Machine(VM)in order to make improved cost decisions.Therefore,this paper presents a comprehensive literature review on the subject of energy-related cost issues and prediction models in cloud computing environments,along with an overall discussion of the closely related works.The outcomes of this research can be used and incorporated by predictive resource management techniques to make improved cost decisions assisted with energy awareness and leverage cloud resources efficiently.

A Hybrid Approach for Performance and Energy-Based Cost Prediction in Clouds

With the striking rise in penetration of Cloud Computing,energy consumption is considered as one of the key cost factors that need to be managed within cloud providers’infrastructures.Subsequently,recent approaches and strategies based on reactive and proactive methods have been developed for managing cloud computing resources,where the energy consumption and the operational costs are minimized.However,to make better cost decisions in these strategies,the performance and energy awareness should be supported at both Physical Machine(PM)and Virtual Machine(VM)levels.Therefore,in this paper,a novel hybrid approach is proposed,which jointly considered the prediction of performance variation,energy consumption and cost of heterogeneous VMs.This approach aims to integrate auto-scaling with live migration as well as maintain the expected level of service performance,in which the power consumption and resource usage are utilized for estimating the VMs’total cost.Specifically,the service performance variation is handled by detecting the underloaded and overloaded PMs;thereby,the decision(s)is made in a cost-effective manner.Detailed testbed evaluation demonstrates that the proposed approach not only predicts the VMs workload and consumption of power but also estimates the overall cost of live migration and auto-scaling during service operation,with a high prediction accuracy on the basis of historical workload patterns.

Application of four machine-learning methods to predict short-horizon wind energy

Renewable energy has garnered attention due to the need for sustainable energy sources.Wind power has emerged as an alternative that has contributed to the transition towards cleaner energy.As the importance of wind energy grows,it can be crucial to provide forecasts that optimize its performance potential.Artificial intelligence(AI)methods have risen in prominence due to how well they can handle complicated systems while enhancing the accuracy of prediction.This study explored the area of AI to predict wind-energy production at a wind farm in Yalova,Turkey,using four different AI approaches:support vector machines(SVMs),decision trees,adaptive neuro-fuzzy inference systems(ANFIS)and artificial neural networks(ANNs).Wind speed and direction were considered as essential input parameters,with wind energy as the target parameter,and models are thoroughly evaluated using metrics such as the mean absolute percentage error(MAPE),coefficient of determination(R~2),and mean absolute error(MAE).The findings accentuate the superior performance of the SVM,which delivered the lowest MAPE(2.42%),the highest R~2(0.95),and the lowest MAE(71.21%)compared with actual values,while ANFIS was less effective in this context.The main aim of this comparative analysis was to rank the models to move to the next step in improving the least efficient methods by combining them with optimization algorithms,such as metaheuristic algorithms.

Assessing the Efficacy of Improved Learning in Hourly Global Irradiance Prediction

Increasing global energy consumption has become an urgent problem as natural energy sources such as oil,gas,and uranium are rapidly running out.Research into renewable energy sources such as solar energy is being pursued to counter this.Solar energy is one of the most promising renewable energy sources,as it has the potential to meet the world’s energy needs indefinitely.This study aims to develop and evaluate artificial intelligence(AI)models for predicting hourly global irradiation.The hyperparameters were optimized using the Broyden-FletcherGoldfarb-Shanno(BFGS)quasi-Newton training algorithm and STATISTICA software.Data from two stations in Algeria with different climatic zones were used to develop the model.Various error measurements were used to determine the accuracy of the prediction models,including the correlation coefficient,the mean absolute error,and the root mean square error(RMSE).The optimal support vector machine(SVM)model showed exceptional efficiency during the training phase,with a high correlation coefficient(R=0.99)and a low mean absolute error(MAE=26.5741 Wh/m^(2)),as well as an RMSE of 38.7045 Wh/m^(2) across all phases.Overall,this study highlights the importance of accurate prediction models in the renewable energy,which can contribute to better energy management and planning.

Predictive Multimodal Deep Learning-Based Sustainable Renewable and Non-Renewable Energy Utilization

Recently,renewable energy(RE)has become popular due to its benefits,such as being inexpensive,low-carbon,ecologically friendly,steady,and reliable.The RE sources are gradually combined with non-renewable energy(NRE)sources into electric grids to satisfy energy demands.Since energy utilization is highly related to national energy policy,energy prediction using artificial intelligence(AI)and deep learning(DL)based models can be employed for energy prediction on RE and NRE power resources.Predicting energy consumption of RE and NRE sources using effective models becomes necessary.With this motivation,this study presents a new multimodal fusionbased predictive tool for energy consumption prediction(MDLFM-ECP)of RE and NRE power sources.Actual data may influence the prediction performance of the results in prediction approaches.The proposed MDLFMECP technique involves pre-processing,fusion-based prediction,and hyperparameter optimization.In addition,the MDLFM-ECP technique involves the fusion of four deep learning(DL)models,namely long short-termmemory(LSTM),bidirectional LSTM(Bi-LSTM),deep belief network(DBN),and gated recurrent unit(GRU).Moreover,the chaotic cat swarm optimization(CCSO)algorithm is applied to tune the hyperparameters of the DL models.The design of the CCSO algorithm for optimal hyperparameter tuning of the DL models,showing the novelty of the work.A series of simulations took place to validate the superior performance of the proposed method,and the simulation outcome emphasized the improved results of the MDLFM-ECP technique over the recent approaches with minimum overall mean absolute percentage error of 3.58%.

Long-Term Energy Forecasting System Based on LSTM and Deep Extreme Machine Learning

Due to the development of diversified and flexible building energy resources,the balancing energy supply and demand especially in smart build-ings caused an increasing problem.Energy forecasting is necessary to address building energy issues and comfort challenges that drive urbanization and consequent increases in energy consumption.Recently,their management has a great significance as resources become scarcer and their emissions increase.In this article,we propose an intelligent energy forecasting method based on hybrid deep learning,in which the data collected by the smart home through meters is put into the pre-evaluation step.Next,the refined data is the input of a Long Short-Term Memory(LSTM)network,which captures the spatio-temporal correlations from the sequence and generates the feature maps.The output feature map is passed into a Deep Extreme Machine Learning network(with seven hidden layers)for learning,which provides the final prediction.Compared to existing techniques,the LSTM-DELM model offers better prediction results.The simulation values demonstrate the superior performance of the proposed model.

Energy Consumption Prediction of a CNC Machining Process With Incomplete Data

Energy consumption prediction of a CNC machining process is important for energy efficiency optimization strategies.To improve the generalization abilities,more and more parameters are acquired for energy prediction modeling.While the data collected from workshops may be incomplete because of misoperation,unstable network connections,and frequent transfers,etc.This work proposes a framework for energy modeling based on incomplete data to address this issue.First,some necessary preliminary operations are used for incomplete data sets.Then,missing values are estimated to generate a new complete data set based on generative adversarial imputation nets(GAIN).Next,the gene expression programming(GEP)algorithm is utilized to train the energy model based on the generated data sets.Finally,we test the predictive accuracy of the obtained model.Computational experiments are designed to investigate the performance of the proposed framework with different rates of missing data.Experimental results demonstrate that even when the missing data rate increases to 30%,the proposed framework can still make efficient predictions,with the corresponding RMSE and MAE 0.903 k J and 0.739 k J,respectively.

Energy Balance-related Behaviors Are Related to Cardiometabolic Parameters and Predict Adiposity in 8-14-year-old Overweight Chinese Children One Year Later

To identify target energy balance-related behaviors（ERBs）,baseline data from 141overweight or obese schoolchildren（aged 8-14years old）was used to predict adiposity[body mass index（BMI）and fat percentage]one year later.The ERBs included a modified Dietary Approach to Stop Hypertension diet score（DASH score）,leisure-time physical activity（PA,days/week）,and leisure screen time（minutes/day）.Several cardiometabolic variables were measured in the fasting state, including systolic blood pressure （SBP）, diastolic blood pressure （DBP）, blood glucose （GLU）, total cholesterol （TC）, triglycerides （TG）, low-density lipoprotein （LDL-C）, and high-density lipoprotein （HDL-C）.

A Prediction of the Excess Partial Molar Free Energies of MgCl_2 in the KCI-MgCl_2-LiCl Molten Salt System Containing MgCl_2 below 0.5 from Thermodynamic Properties of Binary Systems

The thermodynamical properties of MgCl_2 in KCI-MgCl_2-LiCl molten electrolytes containing MgCl_2 below 0.5 (mole fraction, the same below) have been determined from the interchange energies of two binary systems KCI-MgCl_2 and LiCI-MgCl_2, by means of a model on the assumptions that the electrolytes in the solution are treated as independent particles instead of their ion forms and the interchange energy between the component pair KCI-LiCl is ignored when compared with those of component pairs KCl-MgCl_2 and MgCl_2-LiCl. The interchange energies, wKCl-MgCl_2 and wMgcCl_2-Licl, are obtained as-70000 and -13800 J.mol-1, from the corresponding binary solutions, respectively.

Uncertainty quantification of predicting stable structures for high-entropy alloys using Bayesian neural networks

High entropy alloys(HEAs)have excellent application prospects in catalysis because of their rich components and configuration space.In this work,we develop a Bayesian neural network(BNN)based on energies calculated with density functional theory to search the configuration space of the CoNiRhRu HEA system.The BNN model was developed by considering six independent features of Co-Ni,Co-Rh,CoRu,Ni-Rh,Ni-Ru,and Rh-Ru in different shells and energies of structures as the labels.The root mean squared error of the energy predicted by BNN is 1.37 me V/atom.Moreover,the influence of feature periodicity on the energy of HEA in theoretical calculations is discussed.We found that when the neural network is optimized to a certain extent,only using the accuracy indicator of root mean square error to evaluate model performance is no longer accurate in some scenarios.More importantly,we reveal the importance of uncertainty quantification for neural networks to predict new structures of HEAs with proper confidence based on BNN.

Explainable deep transfer learning for energy efficiency prediction based on uncertainty detection and identification

Energy efficiency is an important aspect of increasing production capacity, minimizing environmental impact, and reducing energy usage in the petrochemical industries. However, in practice, data quality can be degraded by measurement malfunction throughout the operation, leading to unreliable and inaccurate prediction results. Therefore, this paper presents a transfer learning fault detection and identification-energy efficiency predictor (TFDI-EEP) model formulated using long short-term memory. The model aims to predict the energy efficiency of the petrochemical process under uncertainty by using the knowledge gained from the uncertainty detection task to improve prediction performance. The transfer procedure resolves weight initialization by applying partial layer freezing before fine-tuning the additional part of the model. The performance of the proposed model is verified on a wide range of fault variations to thoroughly examine the maximum contribution of faults that the model can tolerate. The results indicate that the TFDI-EEP achieved the highest r-squared and lowest error in the testing step for both the 10% and 20% fault variation datasets compared to other conventional methods. Furthermore, the revelation of interconnection between domains shows that the proposed model can also identify strong fault-correlated features, enhancing monitoring ability and strengthening the robustness and reliability of the model observed by the number of outliers. The transfer parameter improves the prediction performance by 9.86% based on detection accuracy and achieves an r-squared greater than 0.95 on the 40% testing fault variation.

Improved artificial neural network method for predicting photovoltaic output performance

To ensure the safety and stability of power grids with photovoltaic(PV)gen eration integrati on,it is necessary to predict the output perform a nee of PV modules un der varyi ng operating con ditions.In this paper,an improved artificial neural network(ANN)method is proposed to predict the electrical characteristics of a PV module by combining several neural networks under different environmental conditions.To study the dependenee of the output performance on the solar irradianee and temperature,the proposed neural network model is composed of four neural networks,it called multineural network(MANN).Each neural network consists of three layers,in which the input is solar radiation,and the module temperature and output are five physical parameters of the single diode model.The experimental data were divided into four groups and used for training the neural networks.The electrical properties of PV modules,including l-V curves,PV curves,and normalized root mean square error,were obtained and discussed.The effectiveness and accuracy of this method is verified by the experimental data for d iff ere nt types of PV modules.Compared with the traditional single-ANN(SANN)method,the proposed method shows be社er accuracy under different operating conditions.

Federated learning-based short-term building energy consumption prediction method for solving the data silos problem

Transfer learning is an effective method to predict the energy consumption of information-poor buildings by learning transferable knowledge from operational data of information-rich buildings.However,it is not recommended to directly use the operational data without protection due to the risk of leaking occupants’privacy.To address this problem,this study proposes a federated learning-based method to learn transferable knowledge from building operational data without privacy leaking.It trains a transferable federated model based on the operational data from the buildings similar to the target building with limited data.An advanced secure aggregation algorithm is adopted in the training process to ensure that no one can infer private information from the training data.The federated model obtained is evaluated by comparing it with the standalone model without federated learning based on 13 similar office buildings from the Building Data Genome Project.The results show that the federated model outperforms the standalone model concerning the prediction accuracy and training time.On average,the federated model achieves a 25.4%decrease in CV-RMSE when the target building has limited operational data.Even if the target building has no operational data,the federated model still achieves acceptable accuracy(CV-RMSE is 22.2%).Meanwhile,the training time of the federated model is 90%less than that of the standalone model.The research insights can help develop federated learning-based methods for solving the data silos problem in building energy management.The methodology and analysis procedures are reproducible and all codes and data sets are available on Github.

An energy consumption prediction approach of die casting machines driven by product parameters

Die casting machines,which are the core equipment of the machinery manufacturing industry,consume great amounts of energy.The energy consumption prediction of die casting machines can support energy consumption quota,process parameter energy-saving optimization,energy-saving design,and energy efficiency evaluation;thus,it is of great significance for Industry 4.0 and green manufacturing.Nevertheless,due to the uncertainty and complexity of the energy consumption in die casting machines,there is still a lack of an approach for energy consumption prediction that can provide support for process parameter optimization and product design taking energy efficiency into consideration.To fill this gap,this paper proposes an energy consumption prediction approach for die casting machines driven by product parameters.Firstly,the system boundary of energy consumption prediction is defined,and subsequently,based on the energy consumption characteristics analysis,a theoretical energy consumption model is established.Consequently,a systematic energy consumption prediction approach for die casting machines,involving product,die,equipment,and process parameters,is proposed.Finally,the feasibility and reliability of the proposed energy consumption prediction approach are verified with the help of three die casting machines and six types of products.The results show that the prediction accuracy of production time and energy consumption reached 91.64%and 85.55%,respectively.Overall,the proposed approach can be used for the energy consumption prediction of different die casting machines with different products.

An Overview to the Concept of Smart Coupling and Battery Management for Grid Connected Photovoltaic Battery System

The paper gives an overview on the need for smart coupling for battery management in grid integrated renewable energy system （RES）. Grid integrated photovoltaic （PV） battery system, as being popular and extensively used has been discussed in the paper. Smart coupling refers to intelligent grid integration such that it can foresee local network conditions and issue battery power flow management strategy accordingly to shave the peak PV and peak load. Therefore, a need for predictive energy management arises for smart integration to the grid and supervision of the power flow in accordance to the grid conditions. This is also a running project at the Institute of Energy Systems （INES）, Offenburg University of Applied Science, Germany since January, 2015. The paper should provide insights to the motivation, need and gives an outlook to the features of desired predictive energy management system （PEMS）.