Concentrate copper grade(CCG)is one of the important production indicators of copper flotation processes,and keeping the CCG at the set value is of great significance to the economic benefit of copper flotation indust...Concentrate copper grade(CCG)is one of the important production indicators of copper flotation processes,and keeping the CCG at the set value is of great significance to the economic benefit of copper flotation industrial processes.This paper addresses the fluctuation problem of CCG through an operational optimization method.Firstly,a density-based affinity propagationalgorithm is proposed so that more ideal working condition categories can be obtained for the complex raw ore properties.Next,a Bayesian network(BN)is applied to explore the relationship between the operational variables and the CCG.Based on the analysis results of BN,a weighted Gaussian process regression model is constructed to predict the CCG that a higher prediction accuracy can be obtained.To ensure the predicted CCG is close to the set value with a smaller magnitude of the operation adjustments and a smaller uncertainty of the prediction results,an index-oriented adaptive differential evolution(IOADE)algorithm is proposed,and the convergence performance of IOADE is superior to the traditional differential evolution and adaptive differential evolution methods.Finally,the effectiveness and feasibility of the proposed methods are verified by the experiments on a copper flotation industrial process.展开更多
The noise that comes from finite element simulation often causes the model to fall into the local optimal solution and over fitting during optimization of generator.Thus,this paper proposes a Gaussian Process Regressi...The noise that comes from finite element simulation often causes the model to fall into the local optimal solution and over fitting during optimization of generator.Thus,this paper proposes a Gaussian Process Regression(GPR)model based on Conditional Likelihood Lower Bound Search(CLLBS)to optimize the design of the generator,which can filter the noise in the data and search for global optimization by combining the Conditional Likelihood Lower Bound Search method.Taking the efficiency optimization of 15 kW Permanent Magnet Synchronous Motor as an example.Firstly,this method uses the elementary effect analysis to choose the sensitive variables,combining the evolutionary algorithm to design the super Latin cube sampling plan;Then the generator-converter system is simulated by establishing a co-simulation platform to obtain data.A Gaussian process regression model combing the method of the conditional likelihood lower bound search is established,which combined the chi-square test to optimize the accuracy of the model globally.Secondly,after the model reaches the accuracy,the Pareto frontier is obtained through the NSGA-II algorithm by considering the maximum output torque as a constraint.Last,the constrained optimization is transformed into an unconstrained optimizing problem by introducing maximum constrained improvement expectation(CEI)optimization method based on the re-interpolation model,which cross-validated the optimization results of the Gaussian process regression model.The above method increase the efficiency of generator by 0.76%and 0.5%respectively;And this method can be used for rapid modeling and multi-objective optimization of generator systems.展开更多
It remains challenging to effectively estimate the remaining capacity of the secondary lithium-ion batteries that have been widely adopted for consumer electronics,energy storage,and electric vehicles.Herein,by integr...It remains challenging to effectively estimate the remaining capacity of the secondary lithium-ion batteries that have been widely adopted for consumer electronics,energy storage,and electric vehicles.Herein,by integrating regular real-time current short pulse tests with data-driven Gaussian process regression algorithm,an efficient battery estimation has been successfully developed and validated for batteries with capacity ranging from 100%of the state of health(SOH)to below 50%,reaching an average accuracy as high as 95%.Interestingly,the proposed pulse test strategy for battery capacity measurement could reduce test time by more than 80%compared with regular long charge/discharge tests.The short-term features of the current pulse test were selected for an optimal training process.Data at different voltage stages and state of charge(SOC)are collected and explored to find the most suitable estimation model.In particular,we explore the validity of five different machine-learning methods for estimating capacity driven by pulse features,whereas Gaussian process regression with Matern kernel performs the best,providing guidance for future exploration.The new strategy of combining short pulse tests with machine-learning algorithms could further open window for efficiently forecasting lithium-ion battery remaining capacity.展开更多
In polyester fiber industrial processes,the prediction of key performance indicators is vital for product quality.The esterification process is an indispensable step in the polyester polymerization process.It has the ...In polyester fiber industrial processes,the prediction of key performance indicators is vital for product quality.The esterification process is an indispensable step in the polyester polymerization process.It has the characteristics of strong coupling,nonlinearity and complex mechanism.To solve these problems,we put forward a multi-output Gaussian process regression(MGPR)model based on the combined kernel function for the polyester esterification process.Since the seasonal and trend decomposition using loess(STL)can extract the periodic and trend characteristics of time series,a combined kernel function based on the STL and the kernel function analysis is constructed for the MGPR.The effectiveness of the proposed model is verified by the actual polyester esterification process data collected from fiber production.展开更多
Many black box functions and datasets have regions of different variability. Models such as the Gaussian process may fall short in giving the best representation of these complex functions. One successful approach for...Many black box functions and datasets have regions of different variability. Models such as the Gaussian process may fall short in giving the best representation of these complex functions. One successful approach for modeling this type of nonstationarity is the Treed Gaussian process <span style="font-family:Verdana;">[1]</span><span></span><span><span></span></span><span style="font-family:Verdana;">, which extended the Gaussian process by dividing the input space into different regions using a binary tree algorithm. Each region became its own Gaussian process. This iterative inference process formed many different trees and thus, many different Gaussian processes. In the end these were combined to get a posterior predictive distribution at each point. The idea was that when the iterations were combined, smoothing would take place for the surface of the predicted points near tree boundaries. We introduce the Improved Treed Gaussian process, which divides the input space into a single main binary tree where the different tree regions have different variability. The parameters for the Gaussian process for each tree region are then determined. These parameters are then smoothed at the region boundaries. This smoothing leads to a set of parameters for each point in the input space that specify the covariance matrix used to predict the point. The advantage is that the prediction and actual errors are estimated better since the standard deviation and range parameters of each point are related to the variation of the region it is in. Further, smoothing between regions is better since each point prediction uses its parameters over the whole input space. Examples are given in this paper which show these advantages for lower-dimensional problems.</span>展开更多
High-precision filtering estimation is one of the key techniques for strapdown inertial navigation system/global navigation satellite system(SINS/GNSS)integrated navigation system,and its estimation plays an important...High-precision filtering estimation is one of the key techniques for strapdown inertial navigation system/global navigation satellite system(SINS/GNSS)integrated navigation system,and its estimation plays an important role in the performance evaluation of the navigation system.Traditional filter estimation methods usually assume that the measurement noise conforms to the Gaussian distribution,without considering the influence of the pollution introduced by the GNSS signal,which is susceptible to external interference.To address this problem,a high-precision filter estimation method using Gaussian process regression(GPR)is proposed to enhance the prediction and estimation capability of the unscented quaternion estimator(USQUE)to improve the navigation accuracy.Based on the advantage of the GPR machine learning function,the estimation performance of the sliding window for model training is measured.This method estimates the output of the observation information source through the measurement window and realizes the robust measurement update of the filter.The combination of GPR and the USQUE algorithm establishes a robust mechanism framework,which enhances the robustness and stability of traditional methods.The results of the trajectory simulation experiment and SINS/GNSS car-mounted tests indicate that the strategy has strong robustness and high estimation accuracy,which demonstrates the effectiveness of the proposed method.展开更多
The resolution of ocean reanalysis datasets is generally low because of the limited resolution of their associated numerical models.Low-resolution ocean reanalysis datasets are therefore usually interpolated to provid...The resolution of ocean reanalysis datasets is generally low because of the limited resolution of their associated numerical models.Low-resolution ocean reanalysis datasets are therefore usually interpolated to provide an initial or boundary field for higher-resolution regional ocean models.However,traditional interpolation methods(nearest neighbor interpolation,bilinear interpolation,and bicubic interpolation)lack physical constraints and can generate significant errors at land-sea boundaries and around islands.In this paper,a machine learning method is used to design an interpolation algorithm based on Gaussian process regression.The method uses a multiscale kernel function to process two-dimensional space meteorological ocean processes and introduces multiscale physical feature information(sea surface wind stress,sea surface heat flux,and ocean current velocity).This greatly improves the spatial resolution of ocean features and the interpolation accuracy.The eff ectiveness of the algorithm was validated through interpolation experiments relating to sea surface temperature(SST).The root mean square error(RMSE)of the interpolation algorithm was 38.9%,43.7%,and 62.4%lower than that of bilinear interpolation,bicubic interpolation,and nearest neighbor interpolation,respectively.The interpolation accuracy was also significantly better in off shore area and around islands.The algorithm has an acceptable runtime cost and good temporal and spatial generalizability.展开更多
In material modeling,the calculation speed using the empirical potentials is fast compared to the first principle calculations,but the results are not as accurate as of the first principle calculations.First principle...In material modeling,the calculation speed using the empirical potentials is fast compared to the first principle calculations,but the results are not as accurate as of the first principle calculations.First principle calculations are accurate but slow and very expensive to calculate.In this work,first,the H-H binding energy and H2-H2 interaction energy are calculated using the first principle calculations which can be applied to the Tersoff empirical potential.Second,the H-H parameters are estimated.After fitting H-H parameters,the mechanical properties are obtained.Finally,to integrate both the low-fidelity empirical potential data and the data from the high-fidelity firstprinciple calculations,the multi-fidelity Gaussian process regression is employed to predict the HH binding energy and the H2-H2 interaction energy.Numerical results demonstrate the accuracy of the developed empirical potentials.展开更多
The contribution of this work is twofold: (1) a multimodality prediction method of chaotic time series with the Gaussian process mixture (GPM) model is proposed, which employs a divide and conquer strategy. It au...The contribution of this work is twofold: (1) a multimodality prediction method of chaotic time series with the Gaussian process mixture (GPM) model is proposed, which employs a divide and conquer strategy. It automatically divides the chaotic time series into multiple modalities with different extrinsic patterns and intrinsic characteristics, and thus can more precisely fit the chaotic time series. (2) An effective sparse hard-cut expec- tation maximization (SHC-EM) learning algorithm for the GPM model is proposed to improve the prediction performance. SHO-EM replaces a large learning sample set with fewer pseudo inputs, accelerating model learning based on these pseudo inputs. Experiments on Lorenz and Chua time series demonstrate that the proposed method yields not only accurate multimodality prediction, but also the prediction confidence interval SHC-EM outperforms the traditional variational 1earning in terms of both prediction accuracy and speed. In addition, SHC-EM is more robust and insusceptible to noise than variational learning.展开更多
Gaussian process(GP)regression is a flexible non-parametric approach to approximate complex models.In many cases,these models correspond to processes with bounded physical properties.Standard GP regression typically r...Gaussian process(GP)regression is a flexible non-parametric approach to approximate complex models.In many cases,these models correspond to processes with bounded physical properties.Standard GP regression typically results in a proxy model which is unbounded for all temporal or spacial points,and thus leaves the possibility of taking on infeasible values.We propose an approach to enforce the physical constraints in a probabilistic way under the GP regression framework.In addition,this new approach reduces the variance in the resulting GP model.展开更多
Data-driven paradigms are well-known and salient demands of future wireless communication. Empowered by big data and machine learning techniques,next-generation data-driven communication systems will be intelligent wi...Data-driven paradigms are well-known and salient demands of future wireless communication. Empowered by big data and machine learning techniques,next-generation data-driven communication systems will be intelligent with unique characteristics of expressiveness, scalability, interpretability, and uncertainty awareness, which can confidently involve diversified latent demands and personalized services in the foreseeable future. In this paper, we review a promising family of nonparametric Bayesian machine learning models,i.e., Gaussian processes(GPs), and their applications in wireless communication. Since GP models demonstrate outstanding expressive and interpretable learning ability with uncertainty, they are particularly suitable for wireless communication. Moreover, they provide a natural framework for collaborating data and empirical models(DEM). Specifically, we first envision three-level motivations of data-driven wireless communication using GP models. Then, we present the background of the GPs in terms of covariance structure and model inference. The expressiveness of the GP model using various interpretable kernels, including stationary, non-stationary, deep and multi-task kernels,is showcased. Furthermore, we review the distributed GP models with promising scalability, which is suitable for applications in wireless networks with a large number of distributed edge devices. Finally, we list representative solutions and promising techniques that adopt GP models in various wireless communication applications.展开更多
Let {X(t), t ≥ 0} be a centered stationary Gaussian process with correlation r(t)such that 1-r(t) is asymptotic to a regularly varying function. With T being a nonnegative random variable and independent of X(t), the...Let {X(t), t ≥ 0} be a centered stationary Gaussian process with correlation r(t)such that 1-r(t) is asymptotic to a regularly varying function. With T being a nonnegative random variable and independent of X(t), the exact asymptotics of P(sup_(t∈[0,T])X(t) > x) is considered, as x → ∞.展开更多
This work presents the Gaussian process tomography(GPT)based on Bayesian data analysis and its applications in soft x-ray(SXR)and absolute extreme ultraviolet spectroscopy(AXUV)diagnostics on experimental advanced sup...This work presents the Gaussian process tomography(GPT)based on Bayesian data analysis and its applications in soft x-ray(SXR)and absolute extreme ultraviolet spectroscopy(AXUV)diagnostics on experimental advanced superconducting tokamak(EAST).This is the first application of the GPT method in the AXUV diagnostic system in fusion devices.It is found that even if only horizontal detector arrays are used to reconstruct the two-dimensional(2D)distribution of SXR and AXUV emissivity fields,the GPT method performs robustly and extremely fast,which enables the GPT method to provide real-time feedback on impurity transport and fast magnetohydrodynamics(MHD)events.By reconstructing SXR emissivity in the poloidal cross section on EAST,an m/n=1/1 internal kink mode has been observed,and the plasma redistribution due to the kink mode is clearly visible in the reconstructions,where m is the poloidal mode number and n is the toroidal mode number.Sawtooth-like internal disruptions extended throughout the entire plasma core and mainly driven by the m/n=2/1 mode have been acquired.During the sawtooth-like internal disruption crash phase,the conversion from an m=2 mode to an m=1 mode is observed.Using the reconstructed AXUV emissivity field we were able to observe the process of impurity accumulated in the plasma core and the mitigation of core impurity due to neon injection in the plasma edge.The data from all other diagnostics involved in the analysis shows that the reconstructions from AXUV measurements are reliable.展开更多
We show in this work that the limit in law of the cross-variation of processes having the form of Young integral with respect to a general self-similar centered Gaussian process of orderβ∈(1/2,3/4]is normal accordin...We show in this work that the limit in law of the cross-variation of processes having the form of Young integral with respect to a general self-similar centered Gaussian process of orderβ∈(1/2,3/4]is normal according to the values ofβ.We apply our results to two self-similar Gaussian processes:the subfractional Brownian motion and the bifractional Brownian motion.展开更多
A single-channel electroencephalography(EEG)device,despite being widely accepted due to convenience,ease of deployment and suitability for use in complex environments,typically poses a great challenge for reactive bra...A single-channel electroencephalography(EEG)device,despite being widely accepted due to convenience,ease of deployment and suitability for use in complex environments,typically poses a great challenge for reactive brain-computer interface(BCI)applications particularly when a continuous command from users is desired to run a motorized actuator with different speed profiles.In this study,a combination of an inconspicuous visual stimulus and voluntary eyeblinks along with a machine learning-based decoder is considered as a new reactive BCI paradigm to increase the degree of freedom and minimize mismatches between the intended dynamic command and transmitted control signal.The proposed decoder is constructed based on Gaussian Process model(GPM)which is a nonparametric Bayesian approach that has the advantages of being able to operate on small datasets and providing measurements of uncertainty on predictions.To evaluate the effectiveness of the proposed method,the GPM is compared against other competitive techniques which include k-Nearest Neighbors,linear discriminant analysis,support vector machine,ensemble learning and neural network.Results demonstrate that a significant improvement can be achieved via the GPM approach with average accuracy reaching over 96%and mean absolute error of no greater than 0.8 cm/s.In addition,the analysis reveals that while the performances of other existing methods deteriorate with a certain type of stimulus due to signal drifts resulting from the voluntary eyeblinks,the proposed GPM exhibits consistent performance across all stimuli considered,thereby manifesting its generalization capability and making it a more suitable option for dynamic commands with a single-channel EEG-controlled actuator.展开更多
Gaussian Process Regression (GPR) can be applied to the problem of estimating a spatially-varying field on a regular grid, based on noisy observations made at irregular positions. In cases where the field has a weak t...Gaussian Process Regression (GPR) can be applied to the problem of estimating a spatially-varying field on a regular grid, based on noisy observations made at irregular positions. In cases where the field has a weak time dependence, one may desire to estimate the present-time value of the field using a time window of data that rolls forward as new data become available, leading to a sequence of solution updates. We introduce “rolling GPR” (or moving window GPR) and present a procedure for implementing that is more computationally efficient than solving the full GPR problem at each update. Furthermore, regime shifts (sudden large changes in the field) can be detected by monitoring the change in posterior covariance of the predicted data during the updates, and their detrimental effect is mitigated by shortening the time window as the variance rises, and then decreasing it as it falls (but within prior bounds). A set of numerical experiments is provided that demonstrates the viability of the procedure.展开更多
Stochastic simulation is an important means of acquiring fluctuating wind pressures for wind induced response analyses in structural engineering. The wind pressure acting on a large-span space structure can be charact...Stochastic simulation is an important means of acquiring fluctuating wind pressures for wind induced response analyses in structural engineering. The wind pressure acting on a large-span space structure can be characterized as a stationary non-Gaussian field. This paper reviews several simulation algorithms related to the Spectral Representation Method (SRM) and the Static Transformation Method (STM). Polynomial and Exponential transformation functions (PSTM and ESTM) are discussed. Deficiencies in current algorithms, with respect to accuracy, stability and efficiency, are analyzed, and the algorithms are improved for better practical application. In order to verify the improved algorithm, wind pressure fields on a large-span roof are simulated and compared with wind tunnel data. The simulation results fit well with the wind tunnel data, and the algorithm accuracy, stability and efficiency are shown to be better than those of current algorithms.展开更多
基金supported in part by the National Key Research and Development Program of China(2021YFC2902703)the National Natural Science Foundation of China(62173078,61773105,61533007,61873049,61873053,61703085,61374147)。
文摘Concentrate copper grade(CCG)is one of the important production indicators of copper flotation processes,and keeping the CCG at the set value is of great significance to the economic benefit of copper flotation industrial processes.This paper addresses the fluctuation problem of CCG through an operational optimization method.Firstly,a density-based affinity propagationalgorithm is proposed so that more ideal working condition categories can be obtained for the complex raw ore properties.Next,a Bayesian network(BN)is applied to explore the relationship between the operational variables and the CCG.Based on the analysis results of BN,a weighted Gaussian process regression model is constructed to predict the CCG that a higher prediction accuracy can be obtained.To ensure the predicted CCG is close to the set value with a smaller magnitude of the operation adjustments and a smaller uncertainty of the prediction results,an index-oriented adaptive differential evolution(IOADE)algorithm is proposed,and the convergence performance of IOADE is superior to the traditional differential evolution and adaptive differential evolution methods.Finally,the effectiveness and feasibility of the proposed methods are verified by the experiments on a copper flotation industrial process.
基金supported in part by the National Key Research and Development Program of China(2019YFB1503700)the Hunan Natural Science Foundation-Science and Education Joint Project(2019JJ70063)。
文摘The noise that comes from finite element simulation often causes the model to fall into the local optimal solution and over fitting during optimization of generator.Thus,this paper proposes a Gaussian Process Regression(GPR)model based on Conditional Likelihood Lower Bound Search(CLLBS)to optimize the design of the generator,which can filter the noise in the data and search for global optimization by combining the Conditional Likelihood Lower Bound Search method.Taking the efficiency optimization of 15 kW Permanent Magnet Synchronous Motor as an example.Firstly,this method uses the elementary effect analysis to choose the sensitive variables,combining the evolutionary algorithm to design the super Latin cube sampling plan;Then the generator-converter system is simulated by establishing a co-simulation platform to obtain data.A Gaussian process regression model combing the method of the conditional likelihood lower bound search is established,which combined the chi-square test to optimize the accuracy of the model globally.Secondly,after the model reaches the accuracy,the Pareto frontier is obtained through the NSGA-II algorithm by considering the maximum output torque as a constraint.Last,the constrained optimization is transformed into an unconstrained optimizing problem by introducing maximum constrained improvement expectation(CEI)optimization method based on the re-interpolation model,which cross-validated the optimization results of the Gaussian process regression model.The above method increase the efficiency of generator by 0.76%and 0.5%respectively;And this method can be used for rapid modeling and multi-objective optimization of generator systems.
基金support from Shenzhen Municipal Development and Reform Commission(Grant Number:SDRC[2016]172)Shenzhen Science and Technology Program(Grant No.KQTD20170810150821146)Interdisciplinary Research and Innovation Fund of Tsinghua Shenzhen International Graduate School,and Shanghai Shun Feng Machinery Co.,Ltd.
文摘It remains challenging to effectively estimate the remaining capacity of the secondary lithium-ion batteries that have been widely adopted for consumer electronics,energy storage,and electric vehicles.Herein,by integrating regular real-time current short pulse tests with data-driven Gaussian process regression algorithm,an efficient battery estimation has been successfully developed and validated for batteries with capacity ranging from 100%of the state of health(SOH)to below 50%,reaching an average accuracy as high as 95%.Interestingly,the proposed pulse test strategy for battery capacity measurement could reduce test time by more than 80%compared with regular long charge/discharge tests.The short-term features of the current pulse test were selected for an optimal training process.Data at different voltage stages and state of charge(SOC)are collected and explored to find the most suitable estimation model.In particular,we explore the validity of five different machine-learning methods for estimating capacity driven by pulse features,whereas Gaussian process regression with Matern kernel performs the best,providing guidance for future exploration.The new strategy of combining short pulse tests with machine-learning algorithms could further open window for efficiently forecasting lithium-ion battery remaining capacity.
基金Natural Science Foundation of Shanghai,China(No.19ZR1402300)。
文摘In polyester fiber industrial processes,the prediction of key performance indicators is vital for product quality.The esterification process is an indispensable step in the polyester polymerization process.It has the characteristics of strong coupling,nonlinearity and complex mechanism.To solve these problems,we put forward a multi-output Gaussian process regression(MGPR)model based on the combined kernel function for the polyester esterification process.Since the seasonal and trend decomposition using loess(STL)can extract the periodic and trend characteristics of time series,a combined kernel function based on the STL and the kernel function analysis is constructed for the MGPR.The effectiveness of the proposed model is verified by the actual polyester esterification process data collected from fiber production.
文摘Many black box functions and datasets have regions of different variability. Models such as the Gaussian process may fall short in giving the best representation of these complex functions. One successful approach for modeling this type of nonstationarity is the Treed Gaussian process <span style="font-family:Verdana;">[1]</span><span></span><span><span></span></span><span style="font-family:Verdana;">, which extended the Gaussian process by dividing the input space into different regions using a binary tree algorithm. Each region became its own Gaussian process. This iterative inference process formed many different trees and thus, many different Gaussian processes. In the end these were combined to get a posterior predictive distribution at each point. The idea was that when the iterations were combined, smoothing would take place for the surface of the predicted points near tree boundaries. We introduce the Improved Treed Gaussian process, which divides the input space into a single main binary tree where the different tree regions have different variability. The parameters for the Gaussian process for each tree region are then determined. These parameters are then smoothed at the region boundaries. This smoothing leads to a set of parameters for each point in the input space that specify the covariance matrix used to predict the point. The advantage is that the prediction and actual errors are estimated better since the standard deviation and range parameters of each point are related to the variation of the region it is in. Further, smoothing between regions is better since each point prediction uses its parameters over the whole input space. Examples are given in this paper which show these advantages for lower-dimensional problems.</span>
基金supported by the National Natural Science Foundation of China(61873275,61703419,425317829).
文摘High-precision filtering estimation is one of the key techniques for strapdown inertial navigation system/global navigation satellite system(SINS/GNSS)integrated navigation system,and its estimation plays an important role in the performance evaluation of the navigation system.Traditional filter estimation methods usually assume that the measurement noise conforms to the Gaussian distribution,without considering the influence of the pollution introduced by the GNSS signal,which is susceptible to external interference.To address this problem,a high-precision filter estimation method using Gaussian process regression(GPR)is proposed to enhance the prediction and estimation capability of the unscented quaternion estimator(USQUE)to improve the navigation accuracy.Based on the advantage of the GPR machine learning function,the estimation performance of the sliding window for model training is measured.This method estimates the output of the observation information source through the measurement window and realizes the robust measurement update of the filter.The combination of GPR and the USQUE algorithm establishes a robust mechanism framework,which enhances the robustness and stability of traditional methods.The results of the trajectory simulation experiment and SINS/GNSS car-mounted tests indicate that the strategy has strong robustness and high estimation accuracy,which demonstrates the effectiveness of the proposed method.
基金Supported by the National Natural Science Foundation of China(Nos.41675097,41375113)。
文摘The resolution of ocean reanalysis datasets is generally low because of the limited resolution of their associated numerical models.Low-resolution ocean reanalysis datasets are therefore usually interpolated to provide an initial or boundary field for higher-resolution regional ocean models.However,traditional interpolation methods(nearest neighbor interpolation,bilinear interpolation,and bicubic interpolation)lack physical constraints and can generate significant errors at land-sea boundaries and around islands.In this paper,a machine learning method is used to design an interpolation algorithm based on Gaussian process regression.The method uses a multiscale kernel function to process two-dimensional space meteorological ocean processes and introduces multiscale physical feature information(sea surface wind stress,sea surface heat flux,and ocean current velocity).This greatly improves the spatial resolution of ocean features and the interpolation accuracy.The eff ectiveness of the algorithm was validated through interpolation experiments relating to sea surface temperature(SST).The root mean square error(RMSE)of the interpolation algorithm was 38.9%,43.7%,and 62.4%lower than that of bilinear interpolation,bicubic interpolation,and nearest neighbor interpolation,respectively.The interpolation accuracy was also significantly better in off shore area and around islands.The algorithm has an acceptable runtime cost and good temporal and spatial generalizability.
基金We gratefully acknowledge the support from the National Science Foundation of USA(Grants DMS-1555072 and DMS-1736364).
文摘In material modeling,the calculation speed using the empirical potentials is fast compared to the first principle calculations,but the results are not as accurate as of the first principle calculations.First principle calculations are accurate but slow and very expensive to calculate.In this work,first,the H-H binding energy and H2-H2 interaction energy are calculated using the first principle calculations which can be applied to the Tersoff empirical potential.Second,the H-H parameters are estimated.After fitting H-H parameters,the mechanical properties are obtained.Finally,to integrate both the low-fidelity empirical potential data and the data from the high-fidelity firstprinciple calculations,the multi-fidelity Gaussian process regression is employed to predict the HH binding energy and the H2-H2 interaction energy.Numerical results demonstrate the accuracy of the developed empirical potentials.
基金Supported by the National Natural Science Foundation of China under Grant No 60972106the China Postdoctoral Science Foundation under Grant No 2014M561053+1 种基金the Humanity and Social Science Foundation of Ministry of Education of China under Grant No 15YJA630108the Hebei Province Natural Science Foundation under Grant No E2016202341
文摘The contribution of this work is twofold: (1) a multimodality prediction method of chaotic time series with the Gaussian process mixture (GPM) model is proposed, which employs a divide and conquer strategy. It automatically divides the chaotic time series into multiple modalities with different extrinsic patterns and intrinsic characteristics, and thus can more precisely fit the chaotic time series. (2) An effective sparse hard-cut expec- tation maximization (SHC-EM) learning algorithm for the GPM model is proposed to improve the prediction performance. SHO-EM replaces a large learning sample set with fewer pseudo inputs, accelerating model learning based on these pseudo inputs. Experiments on Lorenz and Chua time series demonstrate that the proposed method yields not only accurate multimodality prediction, but also the prediction confidence interval SHC-EM outperforms the traditional variational 1earning in terms of both prediction accuracy and speed. In addition, SHC-EM is more robust and insusceptible to noise than variational learning.
基金supported by Simons Foundationsupported by the U.S. Department of Energy Office of Science, Office of Advanced Scientific Computing Research as part of Physics-Informed Learning Machines for Multiscale and Multiphysics Problems (PhILMs)
文摘Gaussian process(GP)regression is a flexible non-parametric approach to approximate complex models.In many cases,these models correspond to processes with bounded physical properties.Standard GP regression typically results in a proxy model which is unbounded for all temporal or spacial points,and thus leaves the possibility of taking on infeasible values.We propose an approach to enforce the physical constraints in a probabilistic way under the GP regression framework.In addition,this new approach reduces the variance in the resulting GP model.
基金supported in part by the National Key R&D Program of China with grant No. 2018YFB1800800by the Basic Research Project No. HZQB-KCZYZ-2021067 of Hetao Shenzhen-HK S&T Cooperation Zone+3 种基金by Natural Science Foundation of China (NSFC) with grants No. 92067202 and No. 62106212by Shenzhen Outstanding Talents Training Fund 202002by Guangdong Research Projects No. 2017ZT07X152 and No. 2019CX01X104by China Postdoctoral Science Foundation with grant No. 2020M671899。
文摘Data-driven paradigms are well-known and salient demands of future wireless communication. Empowered by big data and machine learning techniques,next-generation data-driven communication systems will be intelligent with unique characteristics of expressiveness, scalability, interpretability, and uncertainty awareness, which can confidently involve diversified latent demands and personalized services in the foreseeable future. In this paper, we review a promising family of nonparametric Bayesian machine learning models,i.e., Gaussian processes(GPs), and their applications in wireless communication. Since GP models demonstrate outstanding expressive and interpretable learning ability with uncertainty, they are particularly suitable for wireless communication. Moreover, they provide a natural framework for collaborating data and empirical models(DEM). Specifically, we first envision three-level motivations of data-driven wireless communication using GP models. Then, we present the background of the GPs in terms of covariance structure and model inference. The expressiveness of the GP model using various interpretable kernels, including stationary, non-stationary, deep and multi-task kernels,is showcased. Furthermore, we review the distributed GP models with promising scalability, which is suitable for applications in wireless networks with a large number of distributed edge devices. Finally, we list representative solutions and promising techniques that adopt GP models in various wireless communication applications.
基金Supported by the Scientific Research Fund of Sichuan Provincial Education Department(12ZB082)the Scientific research cultivation project of Sichuan University of Science&Engineering(2013PY07)+1 种基金the Scientific Research Fund of Shanghai University of Finance and Economics(2017110080)the Opening Project of Sichuan Province University Key Laboratory of Bridge Non-destruction Detecting and Engineering Computing(2018QZJ01)
文摘Let {X(t), t ≥ 0} be a centered stationary Gaussian process with correlation r(t)such that 1-r(t) is asymptotic to a regularly varying function. With T being a nonnegative random variable and independent of X(t), the exact asymptotics of P(sup_(t∈[0,T])X(t) > x) is considered, as x → ∞.
基金Project supported by the National Magnetic Confinement Fusion Science Program of China(Grant No.11505226)the National Natural Science Foundation of China(Grant No.11975273).
文摘This work presents the Gaussian process tomography(GPT)based on Bayesian data analysis and its applications in soft x-ray(SXR)and absolute extreme ultraviolet spectroscopy(AXUV)diagnostics on experimental advanced superconducting tokamak(EAST).This is the first application of the GPT method in the AXUV diagnostic system in fusion devices.It is found that even if only horizontal detector arrays are used to reconstruct the two-dimensional(2D)distribution of SXR and AXUV emissivity fields,the GPT method performs robustly and extremely fast,which enables the GPT method to provide real-time feedback on impurity transport and fast magnetohydrodynamics(MHD)events.By reconstructing SXR emissivity in the poloidal cross section on EAST,an m/n=1/1 internal kink mode has been observed,and the plasma redistribution due to the kink mode is clearly visible in the reconstructions,where m is the poloidal mode number and n is the toroidal mode number.Sawtooth-like internal disruptions extended throughout the entire plasma core and mainly driven by the m/n=2/1 mode have been acquired.During the sawtooth-like internal disruption crash phase,the conversion from an m=2 mode to an m=1 mode is observed.Using the reconstructed AXUV emissivity field we were able to observe the process of impurity accumulated in the plasma core and the mitigation of core impurity due to neon injection in the plasma edge.The data from all other diagnostics involved in the analysis shows that the reconstructions from AXUV measurements are reliable.
基金The first author was supported by the Fulbright joint supervision program for PhD students for the academic year 2018-2019 between Cadi Ayyad University and Michigan State University.
文摘We show in this work that the limit in law of the cross-variation of processes having the form of Young integral with respect to a general self-similar centered Gaussian process of orderβ∈(1/2,3/4]is normal according to the values ofβ.We apply our results to two self-similar Gaussian processes:the subfractional Brownian motion and the bifractional Brownian motion.
基金This work was supported by the Ministry of Higher Education Malaysia for Fundamental Research Grant Scheme with Project Code:FRGS/1/2021/TK0/USM/02/18.
文摘A single-channel electroencephalography(EEG)device,despite being widely accepted due to convenience,ease of deployment and suitability for use in complex environments,typically poses a great challenge for reactive brain-computer interface(BCI)applications particularly when a continuous command from users is desired to run a motorized actuator with different speed profiles.In this study,a combination of an inconspicuous visual stimulus and voluntary eyeblinks along with a machine learning-based decoder is considered as a new reactive BCI paradigm to increase the degree of freedom and minimize mismatches between the intended dynamic command and transmitted control signal.The proposed decoder is constructed based on Gaussian Process model(GPM)which is a nonparametric Bayesian approach that has the advantages of being able to operate on small datasets and providing measurements of uncertainty on predictions.To evaluate the effectiveness of the proposed method,the GPM is compared against other competitive techniques which include k-Nearest Neighbors,linear discriminant analysis,support vector machine,ensemble learning and neural network.Results demonstrate that a significant improvement can be achieved via the GPM approach with average accuracy reaching over 96%and mean absolute error of no greater than 0.8 cm/s.In addition,the analysis reveals that while the performances of other existing methods deteriorate with a certain type of stimulus due to signal drifts resulting from the voluntary eyeblinks,the proposed GPM exhibits consistent performance across all stimuli considered,thereby manifesting its generalization capability and making it a more suitable option for dynamic commands with a single-channel EEG-controlled actuator.
文摘Gaussian Process Regression (GPR) can be applied to the problem of estimating a spatially-varying field on a regular grid, based on noisy observations made at irregular positions. In cases where the field has a weak time dependence, one may desire to estimate the present-time value of the field using a time window of data that rolls forward as new data become available, leading to a sequence of solution updates. We introduce “rolling GPR” (or moving window GPR) and present a procedure for implementing that is more computationally efficient than solving the full GPR problem at each update. Furthermore, regime shifts (sudden large changes in the field) can be detected by monitoring the change in posterior covariance of the predicted data during the updates, and their detrimental effect is mitigated by shortening the time window as the variance rises, and then decreasing it as it falls (but within prior bounds). A set of numerical experiments is provided that demonstrates the viability of the procedure.
基金National Natural Science Foundation of China under Grant Nos.51278160,51478155,51378147
文摘Stochastic simulation is an important means of acquiring fluctuating wind pressures for wind induced response analyses in structural engineering. The wind pressure acting on a large-span space structure can be characterized as a stationary non-Gaussian field. This paper reviews several simulation algorithms related to the Spectral Representation Method (SRM) and the Static Transformation Method (STM). Polynomial and Exponential transformation functions (PSTM and ESTM) are discussed. Deficiencies in current algorithms, with respect to accuracy, stability and efficiency, are analyzed, and the algorithms are improved for better practical application. In order to verify the improved algorithm, wind pressure fields on a large-span roof are simulated and compared with wind tunnel data. The simulation results fit well with the wind tunnel data, and the algorithm accuracy, stability and efficiency are shown to be better than those of current algorithms.
基金Supported by the National High Technology Research and Development Program of China (2006AA040309)National BasicResearch Program of China (2007CB714000)