The noise that comes from finite element simulation often causes the model to fall into the local optimal solution and over fitting during optimization of generator.Thus,this paper proposes a Gaussian Process Regressi...The noise that comes from finite element simulation often causes the model to fall into the local optimal solution and over fitting during optimization of generator.Thus,this paper proposes a Gaussian Process Regression(GPR)model based on Conditional Likelihood Lower Bound Search(CLLBS)to optimize the design of the generator,which can filter the noise in the data and search for global optimization by combining the Conditional Likelihood Lower Bound Search method.Taking the efficiency optimization of 15 kW Permanent Magnet Synchronous Motor as an example.Firstly,this method uses the elementary effect analysis to choose the sensitive variables,combining the evolutionary algorithm to design the super Latin cube sampling plan;Then the generator-converter system is simulated by establishing a co-simulation platform to obtain data.A Gaussian process regression model combing the method of the conditional likelihood lower bound search is established,which combined the chi-square test to optimize the accuracy of the model globally.Secondly,after the model reaches the accuracy,the Pareto frontier is obtained through the NSGA-II algorithm by considering the maximum output torque as a constraint.Last,the constrained optimization is transformed into an unconstrained optimizing problem by introducing maximum constrained improvement expectation(CEI)optimization method based on the re-interpolation model,which cross-validated the optimization results of the Gaussian process regression model.The above method increase the efficiency of generator by 0.76%and 0.5%respectively;And this method can be used for rapid modeling and multi-objective optimization of generator systems.展开更多
In polyester fiber industrial processes,the prediction of key performance indicators is vital for product quality.The esterification process is an indispensable step in the polyester polymerization process.It has the ...In polyester fiber industrial processes,the prediction of key performance indicators is vital for product quality.The esterification process is an indispensable step in the polyester polymerization process.It has the characteristics of strong coupling,nonlinearity and complex mechanism.To solve these problems,we put forward a multi-output Gaussian process regression(MGPR)model based on the combined kernel function for the polyester esterification process.Since the seasonal and trend decomposition using loess(STL)can extract the periodic and trend characteristics of time series,a combined kernel function based on the STL and the kernel function analysis is constructed for the MGPR.The effectiveness of the proposed model is verified by the actual polyester esterification process data collected from fiber production.展开更多
The conventional single model strategy may be ill- suited due to the multiplicity of operation phases and system uncertainty. A novel global-local discriminant analysis (GLDA) based Gaussian process regression (GPR...The conventional single model strategy may be ill- suited due to the multiplicity of operation phases and system uncertainty. A novel global-local discriminant analysis (GLDA) based Gaussian process regression (GPR) approach is developed for the quality prediction of nonlinear and multiphase batch processes. After the collected data is preprocessed through batchwise unfolding, the hidden Markov model (HMM) is applied to identify different operation phases. A GLDA algorithm is also presented to extract the appropriate process variables highly correlated with the quality variables, decreasing the complexity of modeling. Besides, the multiple local GPR models are built in the reduced- dimensional space for all the identified operation phases. Furthermore, the HMM-based state estimation is used to classify each measurement sample of a test batch into a corresponding phase with the maximal likelihood estimation. Therefore, the local GPR model with respect to specific phase is selected for online prediction. The effectiveness of the proposed prediction approach is demonstrated through the multiphase penicillin fermentation process. The comparison results show that the proposed GLDA-GPR approach is superior to the regular GPR model and the GPR based on HMM (HMM-GPR) model.展开更多
Gaussian process(GP)has fewer parameters,simple model and output of probabilistic sense,when compared with the methods such as support vector machines.Selection of the hyper-parameters is critical to the performance o...Gaussian process(GP)has fewer parameters,simple model and output of probabilistic sense,when compared with the methods such as support vector machines.Selection of the hyper-parameters is critical to the performance of Gaussian process model.However,the common-used algorithm has the disadvantages of difficult determination of iteration steps,over-dependence of optimization effect on initial values,and easily falling into local optimum.To solve this problem,a method combining the Gaussian process with memetic algorithm was proposed.Based on this method,memetic algorithm was used to search the optimal hyper parameters of Gaussian process regression(GPR)model in the training process and form MA-GPR algorithms,and then the model was used to predict and test the results.When used in the marine long-range precision strike system(LPSS)battle effectiveness evaluation,the proposed MA-GPR model significantly improved the prediction accuracy,compared with the conjugate gradient method and the genetic algorithm optimization process.展开更多
The dynamic soft sensor based on a single Gaussian process regression(GPR) model has been developed in fermentation processes.However,limitations of single regression models,for multiphase/multimode fermentation proce...The dynamic soft sensor based on a single Gaussian process regression(GPR) model has been developed in fermentation processes.However,limitations of single regression models,for multiphase/multimode fermentation processes,may result in large prediction errors and complexity of the soft sensor.Therefore,a dynamic soft sensor based on Gaussian mixture regression(GMR) was proposed to overcome the problems.Two structure parameters,the number of Gaussian components and the order of the model,are crucial to the soft sensor model.To achieve a simple and effective soft sensor,an iterative strategy was proposed to optimize the two structure parameters synchronously.For the aim of comparisons,the proposed dynamic GMR soft sensor and the existing dynamic GPR soft sensor were both investigated to estimate biomass concentration in a Penicillin simulation process and an industrial Erythromycin fermentation process.Results show that the proposed dynamic GMR soft sensor has higher prediction accuracy and is more suitable for dynamic multiphase/multimode fermentation processes.展开更多
Lithium-ion batteries(LIBs)are widely used in transportation,energy storage,and other fields.The prediction of the remaining useful life(RUL)of lithium batteries not only provides a reference for health management but...Lithium-ion batteries(LIBs)are widely used in transportation,energy storage,and other fields.The prediction of the remaining useful life(RUL)of lithium batteries not only provides a reference for health management but also serves as a basis for assessing the residual value of the battery.In order to improve the prediction accuracy of the RUL of LIBs,a two-phase RUL early prediction method combining neural network and Gaussian process regression(GPR)is proposed.In the initial phase,the features related to the capacity degradation of LIBs are utilized to train the neural network model,which is used to predict the initial cycle lifetime of 124 LIBs.The Pearson coefficient’s two most significant characteristic factors and the predicted normalized lifetime form a 3D space.The Euclidean distance between the test dataset and each cell in the training dataset and validation dataset is calculated,and the shortest distance is considered to have a similar degradation pattern,which is used to determine the initial Dual Exponential Model(DEM).In the second phase,GPR uses the DEM as the initial parameter to predict each test set’s early RUL(ERUL).By testing four batteries under different working conditions,the RMSE of all capacity estimation is less than 1.2%,and the accuracy percentage(AP)of remaining life prediction is more than 98%.Experiments show that the method does not need human intervention and has high prediction accuracy.展开更多
Detection of fruit traits by using near-infrared(NIR)spectroscopy may encounter out-of-distribution samples that exceed the generalization ability of a constructed calibration model.Therefore,confidence analysis for a...Detection of fruit traits by using near-infrared(NIR)spectroscopy may encounter out-of-distribution samples that exceed the generalization ability of a constructed calibration model.Therefore,confidence analysis for a given prediction is required,but this cannot be done using common calibration models of NIR spectroscopy.To address this issue,this paper studied the Gaussian process regression(GPR)for fruit traits detection using NIR spectroscopy.The mean and variance of the GPR were used as the predicted value and confidence,respectively.To show this,a real NIR data set related to dry matter content measurements in mango was used.Compared to partial least squares regression(PLSR),GPR showed approximately 14%lower root mean squared error(RMSE)for the in-distribution test set.Compared with no confidence analysis,using the variance of GPR to remove abnormal samples made GPR and PLSR showed approximately 58%and 10%lower RMSE on the mixed distribution test set,respectively(when the type 1 error rate was set to 0.1).Compared with traditional one-class classification methods,the variance of the GPR can be used to effectively eliminate poorly predicted samples.展开更多
Forecasting solar radiation is fundamental to several domains related to renewable energy where several methods have been used to predict daily solar radiation,such as artificial intelligence and hybrid models.Recentl...Forecasting solar radiation is fundamental to several domains related to renewable energy where several methods have been used to predict daily solar radiation,such as artificial intelligence and hybrid models.Recently,the Gaussian process regression(GPR)algorithm has been used successfully in remote sensing and Earth sciences.In this paper,a wavelet-coupled Gaussian process regression(W-GPR)model was proposed to predict the daily solar radiation received on a horizontal surface in Ghardaia(Algeria).For this purpose,3 years of data(2013-15)have been used in model training while the data of 2016 were used to validate the model.In this work,different types of mother wavelets and different combinations of input data were evaluated based on the minimum air temperature,relative humidity and extraterrestrial solar radiation on a horizontal surface.The results demonstrated the effectiveness of the new hybrid W-GPR model compared with the classical GPR model in terms of root mean square error(RMSE),relative root mean square error(rRMSE),mean absolute error(MAE)and determination coefficient(R^(2)).展开更多
Prediction of the coupled conduction-radiation heat transfer in composite materials with periodic structure is important in high-temperature applications of the materials. The temperature dependence of thermal propert...Prediction of the coupled conduction-radiation heat transfer in composite materials with periodic structure is important in high-temperature applications of the materials. The temperature dependence of thermal properties complicates the problem. In this work, a multiscale model is proposed for the conduction-radiation heat transfer in periodic composite materials with temperature-dependent thermal properties. Homogenization analysis of the coupled conduction and radiative transfer equations is conducted, in which the temperature dependence of thermal properties is considered. Both the macroscopic homogenized equations and the local unit cell problems are derived. It is proved that the macroscopic average temperature can be used in the unit cell problems for the first-order corrections of the temperature and radiative intensity, and the calculations of effective thermal properties. The temperature dependence of thermal properties only influences the higher-order corrections. A multiscale numerical method is proposed based on the analysis. The Gaussian process (GP) regression is coupled into the multiscale algorithm to build a correlation between thermal properties and temperature for the macroscale iterations and prevent the repetitive solving of unit cell problems. The GP model is updated by additional solutions of unit cell problems during the iteration according to a variance threshold. Numerical simulations of conduction-radiation heat transfer in composite with isotropic and anisotropic periodic structures are used to validate the proposed multiscale model. It is found that the accuracy and efficiency of the multiscale method can be guaranteed by using a proper variance threshold for the GP model. The multiscale model can provide both the average temperature and radiative intensity fields and their detailed fluctuations due to the local structures.展开更多
聚焦绿色高性能混凝土(Green High Performance Concrete,GHPC)的最佳配合比,旨在实现保持卓越性能的同时最大限度地利用工业废渣,如粉煤灰、超细矿渣、硅灰等。通过深入研究最佳配合比,能够精确调控GHPC的工作性能、强度和耐久性,以满...聚焦绿色高性能混凝土(Green High Performance Concrete,GHPC)的最佳配合比,旨在实现保持卓越性能的同时最大限度地利用工业废渣,如粉煤灰、超细矿渣、硅灰等。通过深入研究最佳配合比,能够精确调控GHPC的工作性能、强度和耐久性,以满足可持续建筑的标准。研究采用了贝叶斯算法优化后的高斯过程回归模型,通过125组试验结果进行训练,最终确定了FL 11%、SF 0%、SL 16%的最佳混合比。通过对比预测与试验结果,验证了模型的可靠性,误差控制在2%以内。该研究为GHPC的配合比提供了科学依据,为推动环保建筑材料的可持续发展提供了实用的指导。展开更多
基金supported in part by the National Key Research and Development Program of China(2019YFB1503700)the Hunan Natural Science Foundation-Science and Education Joint Project(2019JJ70063)。
文摘The noise that comes from finite element simulation often causes the model to fall into the local optimal solution and over fitting during optimization of generator.Thus,this paper proposes a Gaussian Process Regression(GPR)model based on Conditional Likelihood Lower Bound Search(CLLBS)to optimize the design of the generator,which can filter the noise in the data and search for global optimization by combining the Conditional Likelihood Lower Bound Search method.Taking the efficiency optimization of 15 kW Permanent Magnet Synchronous Motor as an example.Firstly,this method uses the elementary effect analysis to choose the sensitive variables,combining the evolutionary algorithm to design the super Latin cube sampling plan;Then the generator-converter system is simulated by establishing a co-simulation platform to obtain data.A Gaussian process regression model combing the method of the conditional likelihood lower bound search is established,which combined the chi-square test to optimize the accuracy of the model globally.Secondly,after the model reaches the accuracy,the Pareto frontier is obtained through the NSGA-II algorithm by considering the maximum output torque as a constraint.Last,the constrained optimization is transformed into an unconstrained optimizing problem by introducing maximum constrained improvement expectation(CEI)optimization method based on the re-interpolation model,which cross-validated the optimization results of the Gaussian process regression model.The above method increase the efficiency of generator by 0.76%and 0.5%respectively;And this method can be used for rapid modeling and multi-objective optimization of generator systems.
基金Natural Science Foundation of Shanghai,China(No.19ZR1402300)。
文摘In polyester fiber industrial processes,the prediction of key performance indicators is vital for product quality.The esterification process is an indispensable step in the polyester polymerization process.It has the characteristics of strong coupling,nonlinearity and complex mechanism.To solve these problems,we put forward a multi-output Gaussian process regression(MGPR)model based on the combined kernel function for the polyester esterification process.Since the seasonal and trend decomposition using loess(STL)can extract the periodic and trend characteristics of time series,a combined kernel function based on the STL and the kernel function analysis is constructed for the MGPR.The effectiveness of the proposed model is verified by the actual polyester esterification process data collected from fiber production.
基金The Fundamental Research Funds for the Central Universities(No.JUDCF12027,JUSRP51323B)the Scientific Innovation Research of College Graduates in Jiangsu Province(No.CXLX12_0734)
文摘The conventional single model strategy may be ill- suited due to the multiplicity of operation phases and system uncertainty. A novel global-local discriminant analysis (GLDA) based Gaussian process regression (GPR) approach is developed for the quality prediction of nonlinear and multiphase batch processes. After the collected data is preprocessed through batchwise unfolding, the hidden Markov model (HMM) is applied to identify different operation phases. A GLDA algorithm is also presented to extract the appropriate process variables highly correlated with the quality variables, decreasing the complexity of modeling. Besides, the multiple local GPR models are built in the reduced- dimensional space for all the identified operation phases. Furthermore, the HMM-based state estimation is used to classify each measurement sample of a test batch into a corresponding phase with the maximal likelihood estimation. Therefore, the local GPR model with respect to specific phase is selected for online prediction. The effectiveness of the proposed prediction approach is demonstrated through the multiphase penicillin fermentation process. The comparison results show that the proposed GLDA-GPR approach is superior to the regular GPR model and the GPR based on HMM (HMM-GPR) model.
基金Project(513300303)supported by the General Armament Department,China
文摘Gaussian process(GP)has fewer parameters,simple model and output of probabilistic sense,when compared with the methods such as support vector machines.Selection of the hyper-parameters is critical to the performance of Gaussian process model.However,the common-used algorithm has the disadvantages of difficult determination of iteration steps,over-dependence of optimization effect on initial values,and easily falling into local optimum.To solve this problem,a method combining the Gaussian process with memetic algorithm was proposed.Based on this method,memetic algorithm was used to search the optimal hyper parameters of Gaussian process regression(GPR)model in the training process and form MA-GPR algorithms,and then the model was used to predict and test the results.When used in the marine long-range precision strike system(LPSS)battle effectiveness evaluation,the proposed MA-GPR model significantly improved the prediction accuracy,compared with the conjugate gradient method and the genetic algorithm optimization process.
基金Supported by the Natural Science Foundation of Jiangsu Province of China(BK20130531)the Priority Academic Program Development of Jiangsu Higher Education Institutions(PAPD[2011]6)Jiangsu Government Scholarship
文摘The dynamic soft sensor based on a single Gaussian process regression(GPR) model has been developed in fermentation processes.However,limitations of single regression models,for multiphase/multimode fermentation processes,may result in large prediction errors and complexity of the soft sensor.Therefore,a dynamic soft sensor based on Gaussian mixture regression(GMR) was proposed to overcome the problems.Two structure parameters,the number of Gaussian components and the order of the model,are crucial to the soft sensor model.To achieve a simple and effective soft sensor,an iterative strategy was proposed to optimize the two structure parameters synchronously.For the aim of comparisons,the proposed dynamic GMR soft sensor and the existing dynamic GPR soft sensor were both investigated to estimate biomass concentration in a Penicillin simulation process and an industrial Erythromycin fermentation process.Results show that the proposed dynamic GMR soft sensor has higher prediction accuracy and is more suitable for dynamic multiphase/multimode fermentation processes.
基金supported by the Major Science and Technology Projects for Independent Innovation of China FAW Group Co.,Ltd.(Grant Nos.20220301018GX and 20220301019GX).
文摘Lithium-ion batteries(LIBs)are widely used in transportation,energy storage,and other fields.The prediction of the remaining useful life(RUL)of lithium batteries not only provides a reference for health management but also serves as a basis for assessing the residual value of the battery.In order to improve the prediction accuracy of the RUL of LIBs,a two-phase RUL early prediction method combining neural network and Gaussian process regression(GPR)is proposed.In the initial phase,the features related to the capacity degradation of LIBs are utilized to train the neural network model,which is used to predict the initial cycle lifetime of 124 LIBs.The Pearson coefficient’s two most significant characteristic factors and the predicted normalized lifetime form a 3D space.The Euclidean distance between the test dataset and each cell in the training dataset and validation dataset is calculated,and the shortest distance is considered to have a similar degradation pattern,which is used to determine the initial Dual Exponential Model(DEM).In the second phase,GPR uses the DEM as the initial parameter to predict each test set’s early RUL(ERUL).By testing four batteries under different working conditions,the RMSE of all capacity estimation is less than 1.2%,and the accuracy percentage(AP)of remaining life prediction is more than 98%.Experiments show that the method does not need human intervention and has high prediction accuracy.
基金the National Natural Science Foundation of China(62105245)the Zhejiang Natural Science Foundation of China(LQ20F030059,and LY21C200001)the Wenzhou Science and Technology Bureau General Project(S2020011),China.
文摘Detection of fruit traits by using near-infrared(NIR)spectroscopy may encounter out-of-distribution samples that exceed the generalization ability of a constructed calibration model.Therefore,confidence analysis for a given prediction is required,but this cannot be done using common calibration models of NIR spectroscopy.To address this issue,this paper studied the Gaussian process regression(GPR)for fruit traits detection using NIR spectroscopy.The mean and variance of the GPR were used as the predicted value and confidence,respectively.To show this,a real NIR data set related to dry matter content measurements in mango was used.Compared to partial least squares regression(PLSR),GPR showed approximately 14%lower root mean squared error(RMSE)for the in-distribution test set.Compared with no confidence analysis,using the variance of GPR to remove abnormal samples made GPR and PLSR showed approximately 58%and 10%lower RMSE on the mixed distribution test set,respectively(when the type 1 error rate was set to 0.1).Compared with traditional one-class classification methods,the variance of the GPR can be used to effectively eliminate poorly predicted samples.
文摘Forecasting solar radiation is fundamental to several domains related to renewable energy where several methods have been used to predict daily solar radiation,such as artificial intelligence and hybrid models.Recently,the Gaussian process regression(GPR)algorithm has been used successfully in remote sensing and Earth sciences.In this paper,a wavelet-coupled Gaussian process regression(W-GPR)model was proposed to predict the daily solar radiation received on a horizontal surface in Ghardaia(Algeria).For this purpose,3 years of data(2013-15)have been used in model training while the data of 2016 were used to validate the model.In this work,different types of mother wavelets and different combinations of input data were evaluated based on the minimum air temperature,relative humidity and extraterrestrial solar radiation on a horizontal surface.The results demonstrated the effectiveness of the new hybrid W-GPR model compared with the classical GPR model in terms of root mean square error(RMSE),relative root mean square error(rRMSE),mean absolute error(MAE)and determination coefficient(R^(2)).
基金National Numerical Windtunnel Project of China(NNW2018ZT2-A04,NNW2020ZT3-A22)National Natural Science Foundation of China(No.51906186).
文摘Prediction of the coupled conduction-radiation heat transfer in composite materials with periodic structure is important in high-temperature applications of the materials. The temperature dependence of thermal properties complicates the problem. In this work, a multiscale model is proposed for the conduction-radiation heat transfer in periodic composite materials with temperature-dependent thermal properties. Homogenization analysis of the coupled conduction and radiative transfer equations is conducted, in which the temperature dependence of thermal properties is considered. Both the macroscopic homogenized equations and the local unit cell problems are derived. It is proved that the macroscopic average temperature can be used in the unit cell problems for the first-order corrections of the temperature and radiative intensity, and the calculations of effective thermal properties. The temperature dependence of thermal properties only influences the higher-order corrections. A multiscale numerical method is proposed based on the analysis. The Gaussian process (GP) regression is coupled into the multiscale algorithm to build a correlation between thermal properties and temperature for the macroscale iterations and prevent the repetitive solving of unit cell problems. The GP model is updated by additional solutions of unit cell problems during the iteration according to a variance threshold. Numerical simulations of conduction-radiation heat transfer in composite with isotropic and anisotropic periodic structures are used to validate the proposed multiscale model. It is found that the accuracy and efficiency of the multiscale method can be guaranteed by using a proper variance threshold for the GP model. The multiscale model can provide both the average temperature and radiative intensity fields and their detailed fluctuations due to the local structures.