LEAST SQUARES ESTIMATOR FOR PATH-DEPENDENT MCKEAN-VLASOV SDES VIA DISCRETE-TIME OBSERVATIONS

In this article, we are interested in least squares estimator for a class of pathdependent McKean-Vlasov stochastic differential equations (SDEs). More precisely, we investigate the consistency and asymptotic distribution of the least squares estimator for the unknown parameters involved by establishing an appropriate contrast function. Comparing to the existing results in the literature, the innovations of this article lie in three aspects:(i) We adopt a tamed Euler-Maruyama algorithm to establish the contrast function under the monotone condition, under which the Euler-Maruyama scheme no longer works;(ii) We take the advantage of linear interpolation with respect to the discrete-time observations to approximate the functional solution;(iii) Our model is more applicable and practice as we are dealing with SDEs with irregular coefficients (for example, Holder continuous) and pathdistribution dependent.

THE LEAST SQUARES ESTIMATOR FOR AN ORNSTEIN-UHLENBECK PROCESS DRIVEN BY A HERMITE PROCESS WITH A PERIODIC MEAN

We consider the least square estimator for the parameters of Ornstein-Uhlenbeck processes dY_(s)=(∑_(j=1)^(k)μ_(j)φ_(j)(s)-βY_(s))ds+dZ_(s)^(q,H),driven by the Hermite process Z_(s)^(q,H)with order q≥1 and a Hurst index H∈(1/2,1),where the periodic functionsφ_(j)(s),,j=1,...,κare bounded,and the real numbersμ_(j),,j=1,...,κtogether withβ>0 are unknown parameters.We establish the consistency of a least squares estimation and obtain the asymptotic behavior for the estimator.We also introduce alternative estimators,which can be looked upon as an application of the least squares estimator.In terms of the fractional Ornstein-Uhlenbeck processes with periodic mean,our work can be regarded as its non-Gaussian extension.

THEORETIC RESEARCH ON ROBUSTIFIED LEAST SQUARES ESTIMATOR BASED ON EQUIVALENT VARIANCE-COVARIANCE

Depending on analyzing the abuse of equivalent weights,a set of self-contained theory system on robust estimation based on equivalent variance-covariance is established,which includes ρ function, φ function,equivalent variance-covariance function,influence function and breakdown point.And an example is given to verify that the robust models proposed in this paper are reliable and correct.

ON THE SINGULARITY OF LEAST SQUARES ESTIMATOR FOR MEAN-REVERTING α-STABLE MOTIONS

We study the problem of parameter estimation for mean-reverting α-stable motion, dXt = （a0 - θ0Xt）dt ＋ dZt, observed at discrete time instants. A least squares estimator is obtained and its asymptotics is discussed in the singular case （a0, θ0） = （0, 0）. If a0 = 0, then the mean-reverting α-stable motion becomes Ornstein-Uhlenbeck process and is studied in [7] in the ergodic case θ0 〉 0. For the Ornstein-Uhlenbeck process, asymptotics of the least squares estimators for the singular case （θ0 = 0） and for ergodic case （θ0 〉 0） are completely different.

Outliers, inliers and the generalized least trinuned squares estimator in system identification

The least trimmed squares estimator (LTS) is a well known robust estimator in terms of protecting the estimate from the outliers. Its high computational complexity is however a problem in practice. We show that the LTS estimate can be obtained by a simple algorithm with the complexity 0( N In N) for large N, where N is the number of measurements. We also show that though the LTS is robust in terms of the outliers, it is sensitive to the inliers. The concept of the inliers is introduced. Moreover, the Generalized Least Trimmed Squares estimator (GLTS) together with its solution are presented that reduces the effect of both the outliers and the inliers. Keywords Least squares - Least trimmed squares - Outliers - System identification - Parameter estimation - Robust parameter estimation This work was supported in part by NSF ECS — 9710297 and ECS — 0098181.

THE INEFFICIENCY OF THE LEAST SQUARES ESTIMATOR AND ITS BOUND

It was suggested by Pantanen that the mean squared error may be used to measure the inefficiency of the least squares estimator. Styan[2] and Rao[3] et al. discussed this inefficiency and it's bound later. In this paper we propose a new inefficiency of the least squares estimator with the measure of generalized variance and obtain its bound.

Thrust estimator design based on least squares support vector regression machine

In order to realize direct thrust control instead of traditional sensor-based control for aero-engines,it is indispensable to design a thrust estimator with high accuracy,so a scheme for thrust estimator design based on the least square support vector regression machine is proposed to solve this problem. Furthermore,numerical simulations confirm the effectiveness of our presented scheme. During the process of estimator design,a wrapper criterion that can not only reduce the computational complexity but also enhance the generalization performance is proposed to select variables as input variables for estimator.

NOVEL WEIGHTED LEAST SQUARES SUPPORT VECTOR REGRESSION FOR THRUST ESTIMATION ON PERFORMANCE DETERIORATION OF AERO-ENGINE

A thrust estimator with high precision and excellent real-time performance is needed to mitigate perfor- mance deterioration for future aero-engines. A weight least squares support vector regression is proposed using a novel weighting strategy. Then a thrust estimator based on the proposed regression is designed for the perfor- mance deterioration. Compared with the existing weighting strategy, the novel one not only satisfies the require- ment of precision but also enhances the real-time performance. Finally, numerical experiments demonstrate the effectiveness and feasibility of the proposed weighted least squares support vector regression for thrust estimator. Key words ： intelligent engine control; least squares ; support vector machine ; performance deterioration

BOOSTING SPARSE LEAST SQUARES SUPPORT VECTOR REGRESSION (BSLSSVR) AND ITS APPLICATION TO THRUST ESTIMATION

In order to realize direct thrust control instead of conventional sensors-based control for aero-engine, a thrust estimator with high accuracy is designed by using the boosting technique to improve the performance of least squares support vector regression （LSSVR）. There exist two distinct features compared with the conven- tional boosting technique： （1） Sampling without replacement is used to avoid numerical instability for modeling LSSVR. （2） To realize the sparseness of LSSVR and reduce the computational complexity, only a subset of the training samples is used to construct LSSVR. Thus, this boosting method for LSSVR is called the boosting sparse LSSVR （BSLSSVR）. Finally, simulation results show that BSLSSVR-based thrust estimator can satisfy the requirement of direct thrust control, i.e. , maximum absolute value of relative error of thrust estimation is not more than 5‰.

Constrained least squares algorithm for channel vector estimation in 2-D RAKE receiver

Based on the fact that the variation of tile direction of arrival (DOA) isslower than that of the channel fading, the steering vector of the desired signal is estimatedfirstly using a subspace decomposition method and then a constrained condition is configured.Traffic signals are further employed to estimate the channel vector based on the constrained leastsquares criterion. We use the iterative least squares with projection (ILSP) algorithm initializedby the pilot to get the estimation. The accuracy of channel estimation and symbol detection can beprogressively increased through the iteration procedure of the ILSP algorithm. Simulation resultsdemonstrate that the proposed algorithm improves the system performance effectively compared withthe conventional 2-D RAKE receiver.

LEAST SQUARES ESTIMATION FOR ORNSTEIN-UHLENBECK PROCESSES DRIVEN BY THE WEIGHTED FRACTIONAL BROWNIAN MOTION

In this article, we study a least squares estimator （LSE） of θ for the Ornstein- Uhlenbeck process X0=0,dXt=θXtdt＋dBt^ab, t ≥ 0 driven by weighted fractional Brownian motion B^a,b with parameters a, b. We obtain the consistency and the asymptotic distribution of the LSE based on the observation {Xs, s∈[0,t]} as t tends to infinity.

Recursive weighted least squares estimation algorithm based on minimum model error principle

Kalman filter is commonly used in data filtering and parameters estimation of nonlinear system,such as projectile's trajectory estimation and control.While there is a drawback that the prior error covariance matrix and filter parameters are difficult to be determined,which may result in filtering divergence.As to the problem that the accuracy of state estimation for nonlinear ballistic model strongly depends on its mathematical model,we improve the weighted least squares method(WLSM)with minimum model error principle.Invariant embedding method is adopted to solve the cost function including the model error.With the knowledge of measurement data and measurement error covariance matrix,we use gradient descent algorithm to determine the weighting matrix of model error.The uncertainty and linearization error of model are recursively estimated by the proposed method,thus achieving an online filtering estimation of the observations.Simulation results indicate that the proposed recursive estimation algorithm is insensitive to initial conditions and of good robustness.

Properties of the total least squares estimation

Through theoretical derivation, some properties of the total least squares estimation are found. The total least squares estimation is the linear transformation of the least squares estimation, and the total least squares estimation is unbiased. The condition number of the total least squares estimation is greater than the least squares estimation, so the total least squares estimation is easier to be affected by the data error than the least squares estimation. Then through the further derivation, the relationships of solutions, residuals and unit weight variance estimations between the total least squares and the least squares are given.

Estimating Wheat Grain Protein Content Using Multi-Temporal Remote Sensing Data Based on Partial Least Squares Regression

Estimating wheat grain protein content by remote sensing is important for assessing wheat quality at maturity and making grains harvest and purchase policies. However, spatial variability of soil condition, temperature, and precipitation will affect grain protein contents and these factors usually cannot be monitored accurately by remote sensing data from single image. In this research, the relationships between wheat protein content at maturity and wheat agronomic parameters at different growing stages were analyzed and multi-temporal images of Landsat TM were used to estimate grain protein content by partial least squares regression. Experiment data were acquired in the suburb of Beijing during a 2-yr experiment in the period from 2003 to 2004. Determination coefficient, average deviation of self-modeling, and deviation of cross- validation were employed to assess the estimation accuracy of wheat grain protein content. Their values were 0.88, 1.30%, 3.81% and 0.72, 5.22%, 12.36% for 2003 and 2004, respectively. The research laid an agronomic foundation for GPC （grain protein content） estimation by multi-temporal remote sensing. The results showed that it is feasible to estimate GPC of wheat from multi-temporal remote sensing data in large area.

ERRATUM TO： LEAST SQUARES ESTIMATION FOR ORNSTEIN-UHLENBECK PROCESSES DRIVEN BY THE WEIGHTED FRACTIONAL BROWNIAN MOTION （ACTA MATHEMATICA SCIENTIA 2016,36B （2） ：394-408）

We give a correction of Theorem 2.2 of Shen, Yin and Yan （2016）.

LEAST SQUARES TYPE ESTIMATION FOR DISCRETELY OBSERVED NON-ERGODIC GAUSSIAN ORNSTEIN-UHLENBECK PROCESSES

In this article, we consider the drift parameter estimation problem for the nonergodic Ornstein-Uhlenbeck process defined as dXt = OXtdt + dGt, i > 0 with an unknown parameter θ> 0, where G is a Gaussian process. We assume that the process {xt,t≥ 0} is observed at discrete time instants t1=△n,…, tn = n△n, and we construct two least squares type estimators θn and θn for θ on the basis of the discrete observations ,{xti,i= 1,…, n} as →∞. Then, we provide sufficient conditions, based on properties of G, which ensure that θn and θn are strongly consistent and the sequences √n△n(θn-θ) and √n△n(θn-θ) are tight. Our approach offers an elementary proof of [11], which studied the case when G is a fractional Brownian motion with Hurst parameter H∈(1/2, 1). As such, our results extend the recent findings by [11] to the case of general Hurst parameter H∈(0,1). We also apply our approach to study subfractional Ornstein-Uhlenbeck and bifractional Ornstein-Uhlenbeck processes.

Wavelet Density Estimation of Censoring Data and Evaluate of Mean Integral Square Error with Convergence Ratio and Empirical Distribution of Given Estimator

Wavelet has rapid development in the current mathematics new areas. It also has a double meaning of theory and application. In signal and image compression, signal analysis, engineering technology has a wide range of applications. In this paper, we use wavelet method, for estimating the density function for censoring data. We evaluate the mean integrated squared error, convergence ratio of given estimator. Also, we obtain empirical distribution of given estimator and verify the conclusion by two simulation examples.

Algorithms and statistical analysis for linear structured weighted total least squares problem

Weighted total least squares(WTLS)have been regarded as the standard tool for the errors-in-variables(EIV)model in which all the elements in the observation vector and the coefficient matrix are contaminated with random errors.However,in many geodetic applications,some elements are error-free and some random observations appear repeatedly in different positions in the augmented coefficient matrix.It is called the linear structured EIV(LSEIV)model.Two kinds of methods are proposed for the LSEIV model from functional and stochastic modifications.On the one hand,the functional part of the LSEIV model is modified into the errors-in-observations(EIO)model.On the other hand,the stochastic model is modified by applying the Moore-Penrose inverse of the cofactor matrix.The algorithms are derived through the Lagrange multipliers method and linear approximation.The estimation principles and iterative formula of the parameters are proven to be consistent.The first-order approximate variance-covariance matrix(VCM)of the parameters is also derived.A numerical example is given to compare the performances of our proposed three algorithms with the STLS approach.Afterwards,the least squares(LS),total least squares(TLS)and linear structured weighted total least squares(LSWTLS)solutions are compared and the accuracy evaluation formula is proven to be feasible and effective.Finally,the LSWTLS is applied to the field of deformation analysis,which yields a better result than the traditional LS and TLS estimations.

Comparative Study of Probabilistic and Least-Squares Methods for Developing Predictive Models

This article explores the comparison between the probability method and the least squares method in the design of linear predictive models. It points out that these two approaches have distinct theoretical foundations and can lead to varied or similar results in terms of precision and performance under certain assumptions. The article underlines the importance of comparing these two approaches to choose the one best suited to the context, available data and modeling objectives.

Uncertainty and disturbance estimator-based model predictive control for wet flue gas desulphurization system

Wet flue gas desulphurization technology is widely used in the industrial process for its capability of efficient pollution removal.The desulphurization control system,however,is subjected to complex reaction mechanisms and severe disturbances,which make for it difficult to achieve certain practically relevant control goals including emission and economic performances as well as system robustness.To address these challenges,a new robust control scheme based on uncertainty and disturbance estimator(UDE)and model predictive control(MPC)is proposed in this paper.The UDE is used to estimate and dynamically compensate acting disturbances,whereas MPC is deployed for optimal feedback regulation of the resultant dynamics.By viewing the system nonlinearities and unknown dynamics as disturbances,the proposed control framework allows to locally treat the considered nonlinear plant as a linear one.The obtained simulation results confirm that the utilization of UDE makes the tracking error negligibly small,even in the presence of unmodeled dynamics.In the conducted comparison study,the introduced control scheme outperforms both the standard MPC and PID(proportional-integral-derivative)control strategies in terms of transient performance and robustness.Furthermore,the results reveal that a lowpass-filter time constant has a significant effect on the robustness and the convergence range of the tracking error.