MULTI-SCALE GAUSSIAN PROCESSES MODEL

A novel model named Multi-scale Gaussian Processes (MGP) is proposed. Motivated by the ideas of multi-scale representations in the wavelet theory, in the new model, a Gaussian process is represented at a scale by a linear basis that is composed of a scale function and its different translations. Finally the distribution of the targets of the given samples can be obtained at different scales. Compared with the standard Gaussian Processes (GP) model, the MGP model can control its complexity conveniently just by adjusting the scale pa-rameter. So it can trade-off the generalization ability and the empirical risk rapidly. Experiments verify the fea-sibility of the MGP model, and exhibit that its performance is superior to the GP model if appropriate scales are chosen.

Soft sensor modeling based on Gaussian processes

In order to meet the demand of online optimal running, a novel soft sensor modeling approach based on Gaussian processes was proposed. The approach is moderately simple to implement and use without loss of performance. It is trained by optimizing the hyperparameters using the scaled conjugate gradient algorithm with the squared exponential covariance function employed. Experimental simulations show that the soft sensor modeling approach has the advantage via a real-world example in a refinery. Meanwhile, the method opens new possibilities for application of kernel methods to potential fields.

A NOTE ON SAMPLE PATH PROPERTIES OF l^p-VALUED GAUSSIAN PROCESSES

The a.s. sample path properties for l p valued Gaussian processes with stationary increments under some more general conditions are established.

Recent Advances in Data-Driven Wireless Communication Using Gaussian Processes: A Comprehensive Survey

Data-driven paradigms are well-known and salient demands of future wireless communication. Empowered by big data and machine learning techniques,next-generation data-driven communication systems will be intelligent with unique characteristics of expressiveness, scalability, interpretability, and uncertainty awareness, which can confidently involve diversified latent demands and personalized services in the foreseeable future. In this paper, we review a promising family of nonparametric Bayesian machine learning models,i.e., Gaussian processes(GPs), and their applications in wireless communication. Since GP models demonstrate outstanding expressive and interpretable learning ability with uncertainty, they are particularly suitable for wireless communication. Moreover, they provide a natural framework for collaborating data and empirical models(DEM). Specifically, we first envision three-level motivations of data-driven wireless communication using GP models. Then, we present the background of the GPs in terms of covariance structure and model inference. The expressiveness of the GP model using various interpretable kernels, including stationary, non-stationary, deep and multi-task kernels,is showcased. Furthermore, we review the distributed GP models with promising scalability, which is suitable for applications in wireless networks with a large number of distributed edge devices. Finally, we list representative solutions and promising techniques that adopt GP models in various wireless communication applications.

Limit theorems for supremum of Gaussian processes over a random interval

Let {X(t), t ≥ 0} be a centered stationary Gaussian process with correlation r(t)such that 1-r(t) is asymptotic to a regularly varying function. With T being a nonnegative random variable and independent of X(t), the exact asymptotics of P(sup_(t∈[0,T])X(t) > x) is considered, as x → ∞.

THE LOCAL CONTINUITY MODULI FOR TWO CLASSES OF GAUSSIAN PROCESSES

In this article,local continuity moduli for the fractional Wiener process and l ∞\|valued Gaussian processes is discussed.

Multi-output Gaussian Process Regression Model with Combined Kernel Function for Polyester Esterification Processes

In polyester fiber industrial processes,the prediction of key performance indicators is vital for product quality.The esterification process is an indispensable step in the polyester polymerization process.It has the characteristics of strong coupling,nonlinearity and complex mechanism.To solve these problems,we put forward a multi-output Gaussian process regression(MGPR)model based on the combined kernel function for the polyester esterification process.Since the seasonal and trend decomposition using loess(STL)can extract the periodic and trend characteristics of time series,a combined kernel function based on the STL and the kernel function analysis is constructed for the MGPR.The effectiveness of the proposed model is verified by the actual polyester esterification process data collected from fiber production.

Reliable calculations of nuclear binding energies by the Gaussian process of machine learning

Reliable calculations of nuclear binding energies are crucial for advancing the research of nuclear physics. Machine learning provides an innovative approach to exploring complex physical problems. In this study, the nuclear binding energies are modeled directly using a machine-learning method called the Gaussian process. First, the binding energies for 2238 nuclei with Z > 20 and N > 20 are calculated using the Gaussian process in a physically motivated feature space, yielding an average deviation of 0.046 MeV and a standard deviation of 0.066 MeV. The results show the good learning ability of the Gaussian process in the studies of binding energies. Then, the predictive power of the Gaussian process is studied by calculating the binding energies for 108 nuclei newly included in AME2020. The theoretical results are in good agreement with the experimental data, reflecting the good predictive power of the Gaussian process. Moreover, the α-decay energies for 1169 nuclei with 50 ≤ Z ≤ 110 are derived from the theoretical binding energies calculated using the Gaussian process. The average deviation and the standard deviation are, respectively, 0.047 MeV and 0.070 MeV. Noticeably, the calculated α-decay energies for the two new isotopes ^ (204 )Ac(Huang et al. Phys Lett B 834, 137484(2022)) and ^ (207) Th(Yang et al. Phys Rev C 105, L051302(2022)) agree well with the latest experimental data. These results demonstrate that the Gaussian process is reliable for the calculations of nuclear binding energies. Finally, the α-decay properties of some unknown actinide nuclei are predicted using the Gaussian process. The predicted results can be useful guides for future research on binding energies and α-decay properties.

Operational optimization of copper flotation process based on the weighted Gaussian process regression and index-oriented adaptive differential evolution algorithm

Concentrate copper grade(CCG)is one of the important production indicators of copper flotation processes,and keeping the CCG at the set value is of great significance to the economic benefit of copper flotation industrial processes.This paper addresses the fluctuation problem of CCG through an operational optimization method.Firstly,a density-based affinity propagationalgorithm is proposed so that more ideal working condition categories can be obtained for the complex raw ore properties.Next,a Bayesian network(BN)is applied to explore the relationship between the operational variables and the CCG.Based on the analysis results of BN,a weighted Gaussian process regression model is constructed to predict the CCG that a higher prediction accuracy can be obtained.To ensure the predicted CCG is close to the set value with a smaller magnitude of the operation adjustments and a smaller uncertainty of the prediction results,an index-oriented adaptive differential evolution(IOADE)algorithm is proposed,and the convergence performance of IOADE is superior to the traditional differential evolution and adaptive differential evolution methods.Finally,the effectiveness and feasibility of the proposed methods are verified by the experiments on a copper flotation industrial process.

Optimization of Generator Based on Gaussian Process Regression Model with Conditional Likelihood Lower Bound Search

The noise that comes from finite element simulation often causes the model to fall into the local optimal solution and over fitting during optimization of generator.Thus,this paper proposes a Gaussian Process Regression(GPR)model based on Conditional Likelihood Lower Bound Search(CLLBS)to optimize the design of the generator,which can filter the noise in the data and search for global optimization by combining the Conditional Likelihood Lower Bound Search method.Taking the efficiency optimization of 15 kW Permanent Magnet Synchronous Motor as an example.Firstly,this method uses the elementary effect analysis to choose the sensitive variables,combining the evolutionary algorithm to design the super Latin cube sampling plan;Then the generator-converter system is simulated by establishing a co-simulation platform to obtain data.A Gaussian process regression model combing the method of the conditional likelihood lower bound search is established,which combined the chi-square test to optimize the accuracy of the model globally.Secondly,after the model reaches the accuracy,the Pareto frontier is obtained through the NSGA-II algorithm by considering the maximum output torque as a constraint.Last,the constrained optimization is transformed into an unconstrained optimizing problem by introducing maximum constrained improvement expectation(CEI)optimization method based on the re-interpolation model,which cross-validated the optimization results of the Gaussian process regression model.The above method increase the efficiency of generator by 0.76%and 0.5%respectively;And this method can be used for rapid modeling and multi-objective optimization of generator systems.

Dynamic System Identification of Underwater Vehicles Using Multi-output Gaussian Processes

Non-parametric system identification with Gaussian processes for underwater vehicles is explored in this research with the purpose of modelling autonomous underwater vehicle(AUV) dynamics with a low amount of data. Multi-output Gaussian processes and their aptitude for modelling the dynamic system of an underactuated AUV without losing the relationships between tied outputs are used. The simulation of a first-principle model of a Remus 100 AUV is employed to capture data for the training and validation of the multi-output Gaussian processes. The metric and required procedure to carry out multi-output Gaussian processes for AUV with 6 degrees of freedom(DoF) is also shown in this paper. Multi-output Gaussian processes compared with the popular technique of recurrent neural network show that multi-output Gaussian processes manage to surpass RNN for non-parametric dynamic system identification in underwater vehicles with highly coupled DoF with the added benefit of providing the measurement of confidence.

Extremes of threshold-dependent Gaussian processes

In this paper,we are concerned with the asymptotic behavior,as u→∞,of P{sup_t∈|0,T|X_u(t)>u},where X_u(t),t∈|0,T|,u>0 is a family of centered Gaussian processes with continuous trajectories.A key application of our findings concerns P{sup_t∈|0,T|(X(t)+g(t))>u},as u→∞,for X a centered Gaussian process and g some measurable trend function.Further applications include the approximation of both the ruin time and the ruin probability of the Brownian motion risk model with constant force of interest.

Some Limit Theorems on the Increments of l^p-valued Multi-Parameter Gaussian Processes

In this paper,we establish some limit theorems on the increments of an l^p-valued multi- parameter Gaussian process under weaker conditions than those of Cs(?)rg(?)-Shao theorems published in Ann.Probab.(1993).

Dynamic soft sensor development based on Gaussian mixture regression for fermentation processes

The dynamic soft sensor based on a single Gaussian process regression(GPR) model has been developed in fermentation processes.However,limitations of single regression models,for multiphase/multimode fermentation processes,may result in large prediction errors and complexity of the soft sensor.Therefore,a dynamic soft sensor based on Gaussian mixture regression(GMR) was proposed to overcome the problems.Two structure parameters,the number of Gaussian components and the order of the model,are crucial to the soft sensor model.To achieve a simple and effective soft sensor,an iterative strategy was proposed to optimize the two structure parameters synchronously.For the aim of comparisons,the proposed dynamic GMR soft sensor and the existing dynamic GPR soft sensor were both investigated to estimate biomass concentration in a Penicillin simulation process and an industrial Erythromycin fermentation process.Results show that the proposed dynamic GMR soft sensor has higher prediction accuracy and is more suitable for dynamic multiphase/multimode fermentation processes.

The Limit Theorems for Maxima of Stationary Gaussian Processes with Random Index

Let {X（t）, t ≥ 0} be a standard（zero-mean, unit-variance） stationary Gaussian process with correlation function r（·） and continuous sample paths. In this paper, we consider the maxima M（T） = max{X（t）, t∈ [0, T ]} with random index TT, where TT /T converges to a non-degenerate distribution or to a positive random variable in probability, and show that the limit distribution of M（TT） exists under some additional conditions related to the correlation function r（·）.

Spatial batch optimal design based on self-learning Gaussian process models for LPCVD processes

Low pressure chemical vapor deposition(LPCVD) is one of the most important processes during semiconductor manufacturing.However,the spatial distribution of internal temperature and extremely few samples makes it hard to build a good-quality model of this batch process.Besides,due to the properties of this process,the reliability of the model must be taken into consideration when optimizing the MVs.In this work,an optimal design strategy based on the self-learning Gaussian process model(GPM) is proposed to control this kind of spatial batch process.The GPM is utilized as the internal model to predict the thicknesses of thin films on all spatial-distributed wafers using the limited data.Unlike the conventional model based design,the uncertainties of predictions provided by GPM are taken into consideration to guide the optimal design of manipulated variables so that the designing can be more prudent Besides,the GPM is also actively enhanced using as little data as possible based on the predictive uncertainties.The effectiveness of the proposed strategy is successfully demonstrated in an LPCVD process.

Fast Remaining Capacity Estimation for Lithium-ion Batteries Based on Short-time Pulse Test and Gaussian Process Regression

It remains challenging to effectively estimate the remaining capacity of the secondary lithium-ion batteries that have been widely adopted for consumer electronics,energy storage,and electric vehicles.Herein,by integrating regular real-time current short pulse tests with data-driven Gaussian process regression algorithm,an efficient battery estimation has been successfully developed and validated for batteries with capacity ranging from 100%of the state of health(SOH)to below 50%,reaching an average accuracy as high as 95%.Interestingly,the proposed pulse test strategy for battery capacity measurement could reduce test time by more than 80%compared with regular long charge/discharge tests.The short-term features of the current pulse test were selected for an optimal training process.Data at different voltage stages and state of charge(SOC)are collected and explored to find the most suitable estimation model.In particular,we explore the validity of five different machine-learning methods for estimating capacity driven by pulse features,whereas Gaussian process regression with Matern kernel performs the best,providing guidance for future exploration.The new strategy of combining short pulse tests with machine-learning algorithms could further open window for efficiently forecasting lithium-ion battery remaining capacity.

Moduli of Continuity of a Class of N-parameter Gaussian Processes and Their Fast Points

We study the moduli of continuity of a class of N-parameter Gaussian processes and get some results on＇the packing dimension of the set of their fast points.

Maxima and sum for discrete and continuous time Gaussian processes

We study the asymptotic relation among the maximum of continuous weakly and strongly dependent stationary Gaussian process, the maximum of this process sampled at discrete time points, and the partial sum of this process. It is shown that these two extreme values and the sum are asymptotically independent if the grid of the discrete time points is sufficiently sparse and the Gaussian process is weakly dependent, and asymptotically dependent if the grid points are Pickands grids or dense grids.

Chung-type Law of the Iterated Logarithm on l^p-valued Gaussian Processes

By estimating small ball probabilities for l^P-valued Gaussian processes, a Chung-type law of the iterated logarithm of l^P-valued Gaussian processes is given.