The noise that comes from finite element simulation often causes the model to fall into the local optimal solution and over fitting during optimization of generator.Thus,this paper proposes a Gaussian Process Regressi...The noise that comes from finite element simulation often causes the model to fall into the local optimal solution and over fitting during optimization of generator.Thus,this paper proposes a Gaussian Process Regression(GPR)model based on Conditional Likelihood Lower Bound Search(CLLBS)to optimize the design of the generator,which can filter the noise in the data and search for global optimization by combining the Conditional Likelihood Lower Bound Search method.Taking the efficiency optimization of 15 kW Permanent Magnet Synchronous Motor as an example.Firstly,this method uses the elementary effect analysis to choose the sensitive variables,combining the evolutionary algorithm to design the super Latin cube sampling plan;Then the generator-converter system is simulated by establishing a co-simulation platform to obtain data.A Gaussian process regression model combing the method of the conditional likelihood lower bound search is established,which combined the chi-square test to optimize the accuracy of the model globally.Secondly,after the model reaches the accuracy,the Pareto frontier is obtained through the NSGA-II algorithm by considering the maximum output torque as a constraint.Last,the constrained optimization is transformed into an unconstrained optimizing problem by introducing maximum constrained improvement expectation(CEI)optimization method based on the re-interpolation model,which cross-validated the optimization results of the Gaussian process regression model.The above method increase the efficiency of generator by 0.76%and 0.5%respectively;And this method can be used for rapid modeling and multi-objective optimization of generator systems.展开更多
Gaussian process(GP)has fewer parameters,simple model and output of probabilistic sense,when compared with the methods such as support vector machines.Selection of the hyper-parameters is critical to the performance o...Gaussian process(GP)has fewer parameters,simple model and output of probabilistic sense,when compared with the methods such as support vector machines.Selection of the hyper-parameters is critical to the performance of Gaussian process model.However,the common-used algorithm has the disadvantages of difficult determination of iteration steps,over-dependence of optimization effect on initial values,and easily falling into local optimum.To solve this problem,a method combining the Gaussian process with memetic algorithm was proposed.Based on this method,memetic algorithm was used to search the optimal hyper parameters of Gaussian process regression(GPR)model in the training process and form MA-GPR algorithms,and then the model was used to predict and test the results.When used in the marine long-range precision strike system(LPSS)battle effectiveness evaluation,the proposed MA-GPR model significantly improved the prediction accuracy,compared with the conjugate gradient method and the genetic algorithm optimization process.展开更多
The dynamic soft sensor based on a single Gaussian process regression(GPR) model has been developed in fermentation processes.However,limitations of single regression models,for multiphase/multimode fermentation proce...The dynamic soft sensor based on a single Gaussian process regression(GPR) model has been developed in fermentation processes.However,limitations of single regression models,for multiphase/multimode fermentation processes,may result in large prediction errors and complexity of the soft sensor.Therefore,a dynamic soft sensor based on Gaussian mixture regression(GMR) was proposed to overcome the problems.Two structure parameters,the number of Gaussian components and the order of the model,are crucial to the soft sensor model.To achieve a simple and effective soft sensor,an iterative strategy was proposed to optimize the two structure parameters synchronously.For the aim of comparisons,the proposed dynamic GMR soft sensor and the existing dynamic GPR soft sensor were both investigated to estimate biomass concentration in a Penicillin simulation process and an industrial Erythromycin fermentation process.Results show that the proposed dynamic GMR soft sensor has higher prediction accuracy and is more suitable for dynamic multiphase/multimode fermentation processes.展开更多
High-precision filtering estimation is one of the key techniques for strapdown inertial navigation system/global navigation satellite system(SINS/GNSS)integrated navigation system,and its estimation plays an important...High-precision filtering estimation is one of the key techniques for strapdown inertial navigation system/global navigation satellite system(SINS/GNSS)integrated navigation system,and its estimation plays an important role in the performance evaluation of the navigation system.Traditional filter estimation methods usually assume that the measurement noise conforms to the Gaussian distribution,without considering the influence of the pollution introduced by the GNSS signal,which is susceptible to external interference.To address this problem,a high-precision filter estimation method using Gaussian process regression(GPR)is proposed to enhance the prediction and estimation capability of the unscented quaternion estimator(USQUE)to improve the navigation accuracy.Based on the advantage of the GPR machine learning function,the estimation performance of the sliding window for model training is measured.This method estimates the output of the observation information source through the measurement window and realizes the robust measurement update of the filter.The combination of GPR and the USQUE algorithm establishes a robust mechanism framework,which enhances the robustness and stability of traditional methods.The results of the trajectory simulation experiment and SINS/GNSS car-mounted tests indicate that the strategy has strong robustness and high estimation accuracy,which demonstrates the effectiveness of the proposed method.展开更多
软基水闸底板脱空是水闸在长期服役期间受水流侵蚀等环境因素影响所产生的一种危害极大且难以察觉的病害。由于其病害部位于水下,传统方法难以检测,该研究提出一种基于高斯过程回归(Gaussian process regression,GPR)代理模型和遗传-自...软基水闸底板脱空是水闸在长期服役期间受水流侵蚀等环境因素影响所产生的一种危害极大且难以察觉的病害。由于其病害部位于水下,传统方法难以检测,该研究提出一种基于高斯过程回归(Gaussian process regression,GPR)代理模型和遗传-自适应惯性权重粒子群(genetic algorithm-adaptive particle swarm optimization,GA-APSO)混合优化算法的水闸底板脱空动力学反演方法,用于检测软基水闸底板脱空。首先,构建表征软基水闸底板脱空参数和水闸结构模态参数之间非线性关系的GPR代理模型;其次,基于GPR代理模型与水闸实测模态参数建立脱空反演的最优化数学模型,将反演问题转化为目标函数最优化求解问题;最后,为提高算法寻优计算的精度,提出一种GA-APSO混合优化算法对目标函数进行脱空反演计算,并提出一种更合理判断反演脱空区域面积和实际脱空区域面积相对误差的指标—面积不重合度。为验证所提方法性能,以一室内软基水闸物理模型为例,对两种不同脱空工况开展研究分析,结果表明,反演脱空区域面积和模型实际设置脱空区域面积的相对误差分别为8.47%和10.77%,相对误差值较小,证明所提方法能有效反演出水闸底板脱空情况,可成为软基水闸底板脱空反演检测的一种新方法。展开更多
传统对含缺陷管道失效应力的预测方法存在误差偏大的问题。针对该问题,利用MATLAB软件建立基于PSO–GPR(particle swarm optimization–Gaussian process regression)含缺陷管道失效应力预测模型。通过对60组含缺陷管道的试验数据进行测...传统对含缺陷管道失效应力的预测方法存在误差偏大的问题。针对该问题,利用MATLAB软件建立基于PSO–GPR(particle swarm optimization–Gaussian process regression)含缺陷管道失效应力预测模型。通过对60组含缺陷管道的试验数据进行测试,发现预测结果与实测结果均在95%置信区间内,表明可以将均值作为预测结果。对预测结果进行分析表明:高斯过程回归的预测结果与实测结果的最小相对误差为0.003%,最大相对误差为1.205%,平均相对误差为0.319%,基于预测结果和实测结果的散点均落在曲线y=x的±1.3%误差带中,验证了高斯过程回归预测模型的准确性,为管道的工程实际应用与维修提供较为精准的判断依据。展开更多
In order to reduce the computation of complex problems, a new surrogate-assisted estimation of distribution algorithm with Gaussian process was proposed. Coevolution was used in dual populations which evolved in paral...In order to reduce the computation of complex problems, a new surrogate-assisted estimation of distribution algorithm with Gaussian process was proposed. Coevolution was used in dual populations which evolved in parallel. The search space was projected into multiple subspaces and searched by sub-populations. Also, the whole space was exploited by the other population which exchanges information with the sub-populations. In order to make the evolutionary course efficient, multivariate Gaussian model and Gaussian mixture model were used in both populations separately to estimate the distribution of individuals and reproduce new generations. For the surrogate model, Gaussian process was combined with the algorithm which predicted variance of the predictions. The results on six benchmark functions show that the new algorithm performs better than other surrogate-model based algorithms and the computation complexity is only 10% of the original estimation of distribution algorithm.展开更多
Detection of fruit traits by using near-infrared(NIR)spectroscopy may encounter out-of-distribution samples that exceed the generalization ability of a constructed calibration model.Therefore,confidence analysis for a...Detection of fruit traits by using near-infrared(NIR)spectroscopy may encounter out-of-distribution samples that exceed the generalization ability of a constructed calibration model.Therefore,confidence analysis for a given prediction is required,but this cannot be done using common calibration models of NIR spectroscopy.To address this issue,this paper studied the Gaussian process regression(GPR)for fruit traits detection using NIR spectroscopy.The mean and variance of the GPR were used as the predicted value and confidence,respectively.To show this,a real NIR data set related to dry matter content measurements in mango was used.Compared to partial least squares regression(PLSR),GPR showed approximately 14%lower root mean squared error(RMSE)for the in-distribution test set.Compared with no confidence analysis,using the variance of GPR to remove abnormal samples made GPR and PLSR showed approximately 58%and 10%lower RMSE on the mixed distribution test set,respectively(when the type 1 error rate was set to 0.1).Compared with traditional one-class classification methods,the variance of the GPR can be used to effectively eliminate poorly predicted samples.展开更多
基金supported in part by the National Key Research and Development Program of China(2019YFB1503700)the Hunan Natural Science Foundation-Science and Education Joint Project(2019JJ70063)。
文摘The noise that comes from finite element simulation often causes the model to fall into the local optimal solution and over fitting during optimization of generator.Thus,this paper proposes a Gaussian Process Regression(GPR)model based on Conditional Likelihood Lower Bound Search(CLLBS)to optimize the design of the generator,which can filter the noise in the data and search for global optimization by combining the Conditional Likelihood Lower Bound Search method.Taking the efficiency optimization of 15 kW Permanent Magnet Synchronous Motor as an example.Firstly,this method uses the elementary effect analysis to choose the sensitive variables,combining the evolutionary algorithm to design the super Latin cube sampling plan;Then the generator-converter system is simulated by establishing a co-simulation platform to obtain data.A Gaussian process regression model combing the method of the conditional likelihood lower bound search is established,which combined the chi-square test to optimize the accuracy of the model globally.Secondly,after the model reaches the accuracy,the Pareto frontier is obtained through the NSGA-II algorithm by considering the maximum output torque as a constraint.Last,the constrained optimization is transformed into an unconstrained optimizing problem by introducing maximum constrained improvement expectation(CEI)optimization method based on the re-interpolation model,which cross-validated the optimization results of the Gaussian process regression model.The above method increase the efficiency of generator by 0.76%and 0.5%respectively;And this method can be used for rapid modeling and multi-objective optimization of generator systems.
基金Project(513300303)supported by the General Armament Department,China
文摘Gaussian process(GP)has fewer parameters,simple model and output of probabilistic sense,when compared with the methods such as support vector machines.Selection of the hyper-parameters is critical to the performance of Gaussian process model.However,the common-used algorithm has the disadvantages of difficult determination of iteration steps,over-dependence of optimization effect on initial values,and easily falling into local optimum.To solve this problem,a method combining the Gaussian process with memetic algorithm was proposed.Based on this method,memetic algorithm was used to search the optimal hyper parameters of Gaussian process regression(GPR)model in the training process and form MA-GPR algorithms,and then the model was used to predict and test the results.When used in the marine long-range precision strike system(LPSS)battle effectiveness evaluation,the proposed MA-GPR model significantly improved the prediction accuracy,compared with the conjugate gradient method and the genetic algorithm optimization process.
基金Supported by the Natural Science Foundation of Jiangsu Province of China(BK20130531)the Priority Academic Program Development of Jiangsu Higher Education Institutions(PAPD[2011]6)Jiangsu Government Scholarship
文摘The dynamic soft sensor based on a single Gaussian process regression(GPR) model has been developed in fermentation processes.However,limitations of single regression models,for multiphase/multimode fermentation processes,may result in large prediction errors and complexity of the soft sensor.Therefore,a dynamic soft sensor based on Gaussian mixture regression(GMR) was proposed to overcome the problems.Two structure parameters,the number of Gaussian components and the order of the model,are crucial to the soft sensor model.To achieve a simple and effective soft sensor,an iterative strategy was proposed to optimize the two structure parameters synchronously.For the aim of comparisons,the proposed dynamic GMR soft sensor and the existing dynamic GPR soft sensor were both investigated to estimate biomass concentration in a Penicillin simulation process and an industrial Erythromycin fermentation process.Results show that the proposed dynamic GMR soft sensor has higher prediction accuracy and is more suitable for dynamic multiphase/multimode fermentation processes.
基金supported by the National Natural Science Foundation of China(61873275,61703419,425317829).
文摘High-precision filtering estimation is one of the key techniques for strapdown inertial navigation system/global navigation satellite system(SINS/GNSS)integrated navigation system,and its estimation plays an important role in the performance evaluation of the navigation system.Traditional filter estimation methods usually assume that the measurement noise conforms to the Gaussian distribution,without considering the influence of the pollution introduced by the GNSS signal,which is susceptible to external interference.To address this problem,a high-precision filter estimation method using Gaussian process regression(GPR)is proposed to enhance the prediction and estimation capability of the unscented quaternion estimator(USQUE)to improve the navigation accuracy.Based on the advantage of the GPR machine learning function,the estimation performance of the sliding window for model training is measured.This method estimates the output of the observation information source through the measurement window and realizes the robust measurement update of the filter.The combination of GPR and the USQUE algorithm establishes a robust mechanism framework,which enhances the robustness and stability of traditional methods.The results of the trajectory simulation experiment and SINS/GNSS car-mounted tests indicate that the strategy has strong robustness and high estimation accuracy,which demonstrates the effectiveness of the proposed method.
文摘传统对含缺陷管道失效应力的预测方法存在误差偏大的问题。针对该问题,利用MATLAB软件建立基于PSO–GPR(particle swarm optimization–Gaussian process regression)含缺陷管道失效应力预测模型。通过对60组含缺陷管道的试验数据进行测试,发现预测结果与实测结果均在95%置信区间内,表明可以将均值作为预测结果。对预测结果进行分析表明:高斯过程回归的预测结果与实测结果的最小相对误差为0.003%,最大相对误差为1.205%,平均相对误差为0.319%,基于预测结果和实测结果的散点均落在曲线y=x的±1.3%误差带中,验证了高斯过程回归预测模型的准确性,为管道的工程实际应用与维修提供较为精准的判断依据。
基金Project(2009CB320603)supported by the National Basic Research Program of ChinaProject(IRT0712)supported by Program for Changjiang Scholars and Innovative Research Team in University+1 种基金Project(B504)supported by the Shanghai Leading Academic Discipline ProgramProject(61174118)supported by the National Natural Science Foundation of China
文摘In order to reduce the computation of complex problems, a new surrogate-assisted estimation of distribution algorithm with Gaussian process was proposed. Coevolution was used in dual populations which evolved in parallel. The search space was projected into multiple subspaces and searched by sub-populations. Also, the whole space was exploited by the other population which exchanges information with the sub-populations. In order to make the evolutionary course efficient, multivariate Gaussian model and Gaussian mixture model were used in both populations separately to estimate the distribution of individuals and reproduce new generations. For the surrogate model, Gaussian process was combined with the algorithm which predicted variance of the predictions. The results on six benchmark functions show that the new algorithm performs better than other surrogate-model based algorithms and the computation complexity is only 10% of the original estimation of distribution algorithm.
基金the National Natural Science Foundation of China(62105245)the Zhejiang Natural Science Foundation of China(LQ20F030059,and LY21C200001)the Wenzhou Science and Technology Bureau General Project(S2020011),China.
文摘Detection of fruit traits by using near-infrared(NIR)spectroscopy may encounter out-of-distribution samples that exceed the generalization ability of a constructed calibration model.Therefore,confidence analysis for a given prediction is required,but this cannot be done using common calibration models of NIR spectroscopy.To address this issue,this paper studied the Gaussian process regression(GPR)for fruit traits detection using NIR spectroscopy.The mean and variance of the GPR were used as the predicted value and confidence,respectively.To show this,a real NIR data set related to dry matter content measurements in mango was used.Compared to partial least squares regression(PLSR),GPR showed approximately 14%lower root mean squared error(RMSE)for the in-distribution test set.Compared with no confidence analysis,using the variance of GPR to remove abnormal samples made GPR and PLSR showed approximately 58%and 10%lower RMSE on the mixed distribution test set,respectively(when the type 1 error rate was set to 0.1).Compared with traditional one-class classification methods,the variance of the GPR can be used to effectively eliminate poorly predicted samples.