Accurate load forecasting forms a crucial foundation for implementing household demand response plans andoptimizing load scheduling. When dealing with short-term load data characterized by substantial fluctuations,a s...Accurate load forecasting forms a crucial foundation for implementing household demand response plans andoptimizing load scheduling. When dealing with short-term load data characterized by substantial fluctuations,a single prediction model is hard to capture temporal features effectively, resulting in diminished predictionaccuracy. In this study, a hybrid deep learning framework that integrates attention mechanism, convolution neuralnetwork (CNN), improved chaotic particle swarm optimization (ICPSO), and long short-term memory (LSTM), isproposed for short-term household load forecasting. Firstly, the CNN model is employed to extract features fromthe original data, enhancing the quality of data features. Subsequently, the moving average method is used for datapreprocessing, followed by the application of the LSTM network to predict the processed data. Moreover, the ICPSOalgorithm is introduced to optimize the parameters of LSTM, aimed at boosting the model’s running speed andaccuracy. Finally, the attention mechanism is employed to optimize the output value of LSTM, effectively addressinginformation loss in LSTM induced by lengthy sequences and further elevating prediction accuracy. According tothe numerical analysis, the accuracy and effectiveness of the proposed hybrid model have been verified. It canexplore data features adeptly, achieving superior prediction accuracy compared to other forecasting methods forthe household load exhibiting significant fluctuations across different seasons.展开更多
As the increasing demand for mobile communications and the shrinking of the coverage of cells, handover mechanism will play an important role in future wireless networks to provide users with seamless mobile communica...As the increasing demand for mobile communications and the shrinking of the coverage of cells, handover mechanism will play an important role in future wireless networks to provide users with seamless mobile communication services. In order to guarantee the user experience, the handover decision should be made timely and reasonably. To achieve this goal, this paper presents a hybrid handover forecasting mechanism, which contains long-term and short-term forecasting models. The proposed mechanism could cooperate with the standard mechanisms, and improve the performance of standard handover decision mechanisms. Since most of the parameters involved are imprecise, fuzzy forecasting model is applied for dealing with predictions of them. The numerical results indicate that the mechanism could significantly decrease the rate of ping-pong handover and the rate of handover failure.展开更多
The data of pre-seismic subsurface fluid anomalies of such earthquakes as Datong-YanggaoM_s6.1 event on Oct.19,1989,western Baotou M_s6.4 event on May 3,1996 and Zhangbei-Shangyi M_s6.2 event on Jan.10,1998 are system...The data of pre-seismic subsurface fluid anomalies of such earthquakes as Datong-YanggaoM_s6.1 event on Oct.19,1989,western Baotou M_s6.4 event on May 3,1996 and Zhangbei-Shangyi M_s6.2 event on Jan.10,1998 are systematically collected and arranged.Then thefeatures of patterns,spatial distribution,time variation and time-spatial evolution of theseanomalies are compared and comprehensively analyzed.Then the formation and evolutionmechanism of medium-and short-term anomaly field of subsurface fluids in the northernNorth China area is proposed.The results show that the medium-term anomaly field is causedby regional tectonic activities,which further strengthen the local tectonic activities andpromote the formation and evolution of the seismic source body.The enhancement of loealtectonic activities causes the formation of anomaly field of short-term subsurface fluids,andthe evolution of source body engenders the source-precursor anomalies of subsurface fluids inthe epicenters at imminent stage.展开更多
Purpose-To optimize train operations,dispatchers currently rely on experience for quick adjustments when delays occur.However,delay predictions often involve imprecise shifts based on known delay times.Real-time and a...Purpose-To optimize train operations,dispatchers currently rely on experience for quick adjustments when delays occur.However,delay predictions often involve imprecise shifts based on known delay times.Real-time and accurate train delay predictions,facilitated by data-driven neural network models,can significantly reduce dispatcher stress and improve adjustment plans.Leveraging current train operation data,these models enable swift and precise predictions,addressing challenges posed by train delays in high-speed rail networks during unforeseen events.Design/methodology/approach-This paper proposes CBLA-net,a neural network architecture for predicting late arrival times.It combines CNN,Bi-LSTM,and attention mechanisms to extract features,handle time series data,and enhance information utilization.Trained on operational data from the Beijing-Tianjin line,it predicts the late arrival time of a target train at the next station using multidimensional input data from the target and preceding trains.Findings-This study evaluates our model’s predictive performance using two data approaches:one considering full data and another focusing only on late arrivals.Results show precise and rapid predictions.Training with full data achieves aMAEof approximately 0.54 minutes and a RMSEof 0.65 minutes,surpassing the model trained solely on delay data(MAE:is about 1.02 min,RMSE:is about 1.52 min).Despite superior overall performance with full data,the model excels at predicting delays exceeding 15 minutes when trained exclusively on late arrivals.For enhanced adaptability to real-world train operations,training with full data is recommended.Originality/value-This paper introduces a novel neural network model,CBLA-net,for predicting train delay times.It innovatively compares and analyzes the model’s performance using both full data and delay data formats.Additionally,the evaluation of the network’s predictive capabilities considers different scenarios,providing a comprehensive demonstration of the model’s predictive performance.展开更多
A correct and timely fault diagnosis is important for improving the safety and reliability of chemical processes. With the advancement of big data technology, data-driven fault diagnosis methods are being extensively ...A correct and timely fault diagnosis is important for improving the safety and reliability of chemical processes. With the advancement of big data technology, data-driven fault diagnosis methods are being extensively used and still have considerable potential. In recent years, methods based on deep neural networks have made significant breakthroughs, and fault diagnosis methods for industrial processes based on deep learning have attracted considerable research attention. Therefore, we propose a fusion deeplearning algorithm based on a fully convolutional neural network(FCN) to extract features and build models to correctly diagnose all types of faults. We use long short-term memory(LSTM) units to expand our proposed FCN so that our proposed deep learning model can better extract the time-domain features of chemical process data. We also introduce the attention mechanism into the model, aimed at highlighting the importance of features, which is significant for the fault diagnosis of chemical processes with many features. When applied to the benchmark Tennessee Eastman process, our proposed model exhibits impressive performance, demonstrating the effectiveness of the attention-based LSTM FCN in chemical process fault diagnosis.展开更多
Physician payment system (PPS) is a principal incentive system to motivate doctors to provide excellent care for patients. During the past decade, physician remuneration in China has not been in proportional to phys...Physician payment system (PPS) is a principal incentive system to motivate doctors to provide excellent care for patients. During the past decade, physician remuneration in China has not been in proportional to physician's average work load and massive responsibilities. This paper reviewed the constitution of the PPS in China, and further discussed the problems and issues to be addressed with respect to pay for performance. Our study indicated that the lower basic salary and bonus distribution tied to "profits" was the major contributor to the physician's profit-driven incentive and the potential cause for the speedy growth of health expenditures. We recommend that government funding to hospitals should be increased to fully cover physicians' basic salary, a flexible human resource and talent management mechanism needs to be established that severs personal interest between physicians and hospitals, and modern performance assessment and multiplexed payment systems should be piloted to encourage physicians to get the more legitimate compensation.展开更多
To fully make use of information from different representation subspaces,a multi-head attention-based long short-term memory(LSTM)model is proposed in this study for speech emotion recognition(SER).The proposed model ...To fully make use of information from different representation subspaces,a multi-head attention-based long short-term memory(LSTM)model is proposed in this study for speech emotion recognition(SER).The proposed model uses frame-level features and takes the temporal information of emotion speech as the input of the LSTM layer.Here,a multi-head time-dimension attention(MHTA)layer was employed to linearly project the output of the LSTM layer into different subspaces for the reduced-dimension context vectors.To provide relative vital information from other dimensions,the output of MHTA,the output of feature-dimension attention,and the last time-step output of LSTM were utilized to form multiple context vectors as the input of the fully connected layer.To improve the performance of multiple vectors,feature-dimension attention was employed for the all-time output of the first LSTM layer.The proposed model was evaluated on the eNTERFACE and GEMEP corpora,respectively.The results indicate that the proposed model outperforms LSTM by 14.6%and 10.5%for eNTERFACE and GEMEP,respectively,proving the effectiveness of the proposed model in SER tasks.展开更多
We in this paper exploit time series algorithm based deep learning in forecasting damage mechanics problems.The methodologies that are able to work accurately for less computational and resolving attempts are a signif...We in this paper exploit time series algorithm based deep learning in forecasting damage mechanics problems.The methodologies that are able to work accurately for less computational and resolving attempts are a significant demand nowadays.Relied on learning an amount of information from given data,the long short-term memory(LSTM)method and multi-layer neural networks(MNN)method are applied to predict solutions.Numerical examples are implemented for predicting fracture growth rates of L-shape concrete specimen under load ratio,single-edge-notched beam forced by 4-point shear and hydraulic fracturing in permeable porous media problems such as storage-toughness fracture regime and fracture-height growth in Marcellus shale.The predicted results by deep learning algorithms are well-agreed with experimental data.展开更多
Three recent breakthroughs due to AI in arts and science serve as motivation:An award winning digital image,protein folding,fast matrix multiplication.Many recent developments in artificial neural networks,particularl...Three recent breakthroughs due to AI in arts and science serve as motivation:An award winning digital image,protein folding,fast matrix multiplication.Many recent developments in artificial neural networks,particularly deep learning(DL),applied and relevant to computational mechanics(solid,fluids,finite-element technology)are reviewed in detail.Both hybrid and pure machine learning(ML)methods are discussed.Hybrid methods combine traditional PDE discretizations with ML methods either(1)to help model complex nonlinear constitutive relations,(2)to nonlinearly reduce the model order for efficient simulation(turbulence),or(3)to accelerate the simulation by predicting certain components in the traditional integration methods.Here,methods(1)and(2)relied on Long-Short-Term Memory(LSTM)architecture,with method(3)relying on convolutional neural networks.Pure ML methods to solve(nonlinear)PDEs are represented by Physics-Informed Neural network(PINN)methods,which could be combined with attention mechanism to address discontinuous solutions.Both LSTM and attention architectures,together with modern and generalized classic optimizers to include stochasticity for DL networks,are extensively reviewed.Kernel machines,including Gaussian processes,are provided to sufficient depth for more advanced works such as shallow networks with infinite width.Not only addressing experts,readers are assumed familiar with computational mechanics,but not with DL,whose concepts and applications are built up from the basics,aiming at bringing first-time learners quickly to the forefront of research.History and limitations of AI are recounted and discussed,with particular attention at pointing out misstatements or misconceptions of the classics,even in well-known references.Positioning and pointing control of a large-deformable beam is given as an example.展开更多
Payment for ecosystem services is a concept of environmental protection and method of environmental management that has "purchasing conservation" as a major feature and has grown around the world since the 1990 s. I...Payment for ecosystem services is a concept of environmental protection and method of environmental management that has "purchasing conservation" as a major feature and has grown around the world since the 1990 s. It is stressed by the school of environmental economics that as a voluntary mechanism of exchange between ecological service providers and demanders, payments for ecosystem services can help to increase inputs and improve efficiency. Ecological economics holds that the ecological system and the complexity of the policy environment restrict the functional space of market mechanisms. The negative influence of the objective of giving priority to efficiency on environmental protection and social fairness cannot be neglected; therefore, the exchange mechanism is just one type of eco-compensation models. Here, we posit that payments for ecosystem services is a good tool for environmental protection and increases inputs and efficiency. Although payment for ecosystem services is confronted with challenges in application, it is playing an increasingly important role in the field of ecological services with a relatively high degree of commodification. Payments for ecosystem services can also increase the cost effectiveness of publicly managed environmental projects with the cooperation of other policy tools.展开更多
基金the Shanghai Rising-Star Program(No.22QA1403900)the National Natural Science Foundation of China(No.71804106)the Noncarbon Energy Conversion and Utilization Institute under the Shanghai Class IV Peak Disciplinary Development Program.
文摘Accurate load forecasting forms a crucial foundation for implementing household demand response plans andoptimizing load scheduling. When dealing with short-term load data characterized by substantial fluctuations,a single prediction model is hard to capture temporal features effectively, resulting in diminished predictionaccuracy. In this study, a hybrid deep learning framework that integrates attention mechanism, convolution neuralnetwork (CNN), improved chaotic particle swarm optimization (ICPSO), and long short-term memory (LSTM), isproposed for short-term household load forecasting. Firstly, the CNN model is employed to extract features fromthe original data, enhancing the quality of data features. Subsequently, the moving average method is used for datapreprocessing, followed by the application of the LSTM network to predict the processed data. Moreover, the ICPSOalgorithm is introduced to optimize the parameters of LSTM, aimed at boosting the model’s running speed andaccuracy. Finally, the attention mechanism is employed to optimize the output value of LSTM, effectively addressinginformation loss in LSTM induced by lengthy sequences and further elevating prediction accuracy. According tothe numerical analysis, the accuracy and effectiveness of the proposed hybrid model have been verified. It canexplore data features adeptly, achieving superior prediction accuracy compared to other forecasting methods forthe household load exhibiting significant fluctuations across different seasons.
基金supported in part by the National Major Project under Grant No.2018ZX030001016the National Natural Science Foundation of China under Grant No.61371092the China Mobile Program of Ministry of Education under Grants No.MCM20150102
文摘As the increasing demand for mobile communications and the shrinking of the coverage of cells, handover mechanism will play an important role in future wireless networks to provide users with seamless mobile communication services. In order to guarantee the user experience, the handover decision should be made timely and reasonably. To achieve this goal, this paper presents a hybrid handover forecasting mechanism, which contains long-term and short-term forecasting models. The proposed mechanism could cooperate with the standard mechanisms, and improve the performance of standard handover decision mechanisms. Since most of the parameters involved are imprecise, fuzzy forecasting model is applied for dealing with predictions of them. The numerical results indicate that the mechanism could significantly decrease the rate of ping-pong handover and the rate of handover failure.
基金This project was sponsored by the"Ninth Five-year Plan" of China SeismologicalBureau(95-04-01-04-1),China
文摘The data of pre-seismic subsurface fluid anomalies of such earthquakes as Datong-YanggaoM_s6.1 event on Oct.19,1989,western Baotou M_s6.4 event on May 3,1996 and Zhangbei-Shangyi M_s6.2 event on Jan.10,1998 are systematically collected and arranged.Then thefeatures of patterns,spatial distribution,time variation and time-spatial evolution of theseanomalies are compared and comprehensively analyzed.Then the formation and evolutionmechanism of medium-and short-term anomaly field of subsurface fluids in the northernNorth China area is proposed.The results show that the medium-term anomaly field is causedby regional tectonic activities,which further strengthen the local tectonic activities andpromote the formation and evolution of the seismic source body.The enhancement of loealtectonic activities causes the formation of anomaly field of short-term subsurface fluids,andthe evolution of source body engenders the source-precursor anomalies of subsurface fluids inthe epicenters at imminent stage.
基金supported in part by the National Natural Science Foundation of China under Grant 62203468in part by the Technological Research and Development Program of China State Railway Group Co.,Ltd.under Grant Q2023X011+1 种基金in part by the Young Elite Scientist Sponsorship Program by China Association for Science and Technology(CAST)under Grant 2022QNRC001in part by the Youth Talent Program Supported by China Railway Society,and in part by the Research Program of China Academy of Railway Sciences Corporation Limited under Grant 2023YJ112.
文摘Purpose-To optimize train operations,dispatchers currently rely on experience for quick adjustments when delays occur.However,delay predictions often involve imprecise shifts based on known delay times.Real-time and accurate train delay predictions,facilitated by data-driven neural network models,can significantly reduce dispatcher stress and improve adjustment plans.Leveraging current train operation data,these models enable swift and precise predictions,addressing challenges posed by train delays in high-speed rail networks during unforeseen events.Design/methodology/approach-This paper proposes CBLA-net,a neural network architecture for predicting late arrival times.It combines CNN,Bi-LSTM,and attention mechanisms to extract features,handle time series data,and enhance information utilization.Trained on operational data from the Beijing-Tianjin line,it predicts the late arrival time of a target train at the next station using multidimensional input data from the target and preceding trains.Findings-This study evaluates our model’s predictive performance using two data approaches:one considering full data and another focusing only on late arrivals.Results show precise and rapid predictions.Training with full data achieves aMAEof approximately 0.54 minutes and a RMSEof 0.65 minutes,surpassing the model trained solely on delay data(MAE:is about 1.02 min,RMSE:is about 1.52 min).Despite superior overall performance with full data,the model excels at predicting delays exceeding 15 minutes when trained exclusively on late arrivals.For enhanced adaptability to real-world train operations,training with full data is recommended.Originality/value-This paper introduces a novel neural network model,CBLA-net,for predicting train delay times.It innovatively compares and analyzes the model’s performance using both full data and delay data formats.Additionally,the evaluation of the network’s predictive capabilities considers different scenarios,providing a comprehensive demonstration of the model’s predictive performance.
文摘A correct and timely fault diagnosis is important for improving the safety and reliability of chemical processes. With the advancement of big data technology, data-driven fault diagnosis methods are being extensively used and still have considerable potential. In recent years, methods based on deep neural networks have made significant breakthroughs, and fault diagnosis methods for industrial processes based on deep learning have attracted considerable research attention. Therefore, we propose a fusion deeplearning algorithm based on a fully convolutional neural network(FCN) to extract features and build models to correctly diagnose all types of faults. We use long short-term memory(LSTM) units to expand our proposed FCN so that our proposed deep learning model can better extract the time-domain features of chemical process data. We also introduce the attention mechanism into the model, aimed at highlighting the importance of features, which is significant for the fault diagnosis of chemical processes with many features. When applied to the benchmark Tennessee Eastman process, our proposed model exhibits impressive performance, demonstrating the effectiveness of the attention-based LSTM FCN in chemical process fault diagnosis.
基金supported by Guiyang Science and Technology Correspondent Program of China(No.2012207)
文摘Physician payment system (PPS) is a principal incentive system to motivate doctors to provide excellent care for patients. During the past decade, physician remuneration in China has not been in proportional to physician's average work load and massive responsibilities. This paper reviewed the constitution of the PPS in China, and further discussed the problems and issues to be addressed with respect to pay for performance. Our study indicated that the lower basic salary and bonus distribution tied to "profits" was the major contributor to the physician's profit-driven incentive and the potential cause for the speedy growth of health expenditures. We recommend that government funding to hospitals should be increased to fully cover physicians' basic salary, a flexible human resource and talent management mechanism needs to be established that severs personal interest between physicians and hospitals, and modern performance assessment and multiplexed payment systems should be piloted to encourage physicians to get the more legitimate compensation.
基金The National Natural Science Foundation of China(No.61571106,61633013,61673108,81871444).
文摘To fully make use of information from different representation subspaces,a multi-head attention-based long short-term memory(LSTM)model is proposed in this study for speech emotion recognition(SER).The proposed model uses frame-level features and takes the temporal information of emotion speech as the input of the LSTM layer.Here,a multi-head time-dimension attention(MHTA)layer was employed to linearly project the output of the LSTM layer into different subspaces for the reduced-dimension context vectors.To provide relative vital information from other dimensions,the output of MHTA,the output of feature-dimension attention,and the last time-step output of LSTM were utilized to form multiple context vectors as the input of the fully connected layer.To improve the performance of multiple vectors,feature-dimension attention was employed for the all-time output of the first LSTM layer.The proposed model was evaluated on the eNTERFACE and GEMEP corpora,respectively.The results indicate that the proposed model outperforms LSTM by 14.6%and 10.5%for eNTERFACE and GEMEP,respectively,proving the effectiveness of the proposed model in SER tasks.
基金The author would like to thank European Commission H2020-MSCA-RISE BESTOFRAC project for research funding.
文摘We in this paper exploit time series algorithm based deep learning in forecasting damage mechanics problems.The methodologies that are able to work accurately for less computational and resolving attempts are a significant demand nowadays.Relied on learning an amount of information from given data,the long short-term memory(LSTM)method and multi-layer neural networks(MNN)method are applied to predict solutions.Numerical examples are implemented for predicting fracture growth rates of L-shape concrete specimen under load ratio,single-edge-notched beam forced by 4-point shear and hydraulic fracturing in permeable porous media problems such as storage-toughness fracture regime and fracture-height growth in Marcellus shale.The predicted results by deep learning algorithms are well-agreed with experimental data.
文摘Three recent breakthroughs due to AI in arts and science serve as motivation:An award winning digital image,protein folding,fast matrix multiplication.Many recent developments in artificial neural networks,particularly deep learning(DL),applied and relevant to computational mechanics(solid,fluids,finite-element technology)are reviewed in detail.Both hybrid and pure machine learning(ML)methods are discussed.Hybrid methods combine traditional PDE discretizations with ML methods either(1)to help model complex nonlinear constitutive relations,(2)to nonlinearly reduce the model order for efficient simulation(turbulence),or(3)to accelerate the simulation by predicting certain components in the traditional integration methods.Here,methods(1)and(2)relied on Long-Short-Term Memory(LSTM)architecture,with method(3)relying on convolutional neural networks.Pure ML methods to solve(nonlinear)PDEs are represented by Physics-Informed Neural network(PINN)methods,which could be combined with attention mechanism to address discontinuous solutions.Both LSTM and attention architectures,together with modern and generalized classic optimizers to include stochasticity for DL networks,are extensively reviewed.Kernel machines,including Gaussian processes,are provided to sufficient depth for more advanced works such as shallow networks with infinite width.Not only addressing experts,readers are assumed familiar with computational mechanics,but not with DL,whose concepts and applications are built up from the basics,aiming at bringing first-time learners quickly to the forefront of research.History and limitations of AI are recounted and discussed,with particular attention at pointing out misstatements or misconceptions of the classics,even in well-known references.Positioning and pointing control of a large-deformable beam is given as an example.
基金the National Science and Technology Support Program(2013BAC03B05)Monographic study of Graduate School of Chinese Academy of Social Sciences"Research of Eco-Compensation Experience in Developed Countries"
文摘Payment for ecosystem services is a concept of environmental protection and method of environmental management that has "purchasing conservation" as a major feature and has grown around the world since the 1990 s. It is stressed by the school of environmental economics that as a voluntary mechanism of exchange between ecological service providers and demanders, payments for ecosystem services can help to increase inputs and improve efficiency. Ecological economics holds that the ecological system and the complexity of the policy environment restrict the functional space of market mechanisms. The negative influence of the objective of giving priority to efficiency on environmental protection and social fairness cannot be neglected; therefore, the exchange mechanism is just one type of eco-compensation models. Here, we posit that payments for ecosystem services is a good tool for environmental protection and increases inputs and efficiency. Although payment for ecosystem services is confronted with challenges in application, it is playing an increasingly important role in the field of ecological services with a relatively high degree of commodification. Payments for ecosystem services can also increase the cost effectiveness of publicly managed environmental projects with the cooperation of other policy tools.