Revisiting Akaike’s Final Prediction Error and the Generalized Cross Validation Criteria in Regression from the Same Perspective: From Least Squares to Ridge Regression and Smoothing Splines

In regression, despite being both aimed at estimating the Mean Squared Prediction Error (MSPE), Akaike’s Final Prediction Error (FPE) and the Generalized Cross Validation (GCV) selection criteria are usually derived from two quite different perspectives. Here, settling on the most commonly accepted definition of the MSPE as the expectation of the squared prediction error loss, we provide theoretical expressions for it, valid for any linear model (LM) fitter, be it under random or non random designs. Specializing these MSPE expressions for each of them, we are able to derive closed formulas of the MSPE for some of the most popular LM fitters: Ordinary Least Squares (OLS), with or without a full column rank design matrix;Ordinary and Generalized Ridge regression, the latter embedding smoothing splines fitting. For each of these LM fitters, we then deduce a computable estimate of the MSPE which turns out to coincide with Akaike’s FPE. Using a slight variation, we similarly get a class of MSPE estimates coinciding with the classical GCV formula for those same LM fitters.

Low Complexity Minimum Mean Square Error Channel Estimation for Adaptive Coding and Modulation Systems

Performance of the Adaptive Coding and Modulation(ACM) strongly depends on the retrieved Channel State Information(CSI),which can be obtained using the channel estimation techniques relying on pilot symbol transmission.Earlier analysis of methods of pilot-aided channel estimation for ACM systems were relatively little.In this paper,we investigate the performance of CSI prediction using the Minimum Mean Square Error(MMSE)channel estimator for an ACM system.To solve the two problems of MMSE:high computational operations and oversimplified assumption,we then propose the Low-Complexity schemes(LC-MMSE and Recursion LC-MMSE(R-LC-MMSE)).Computational complexity and Mean Square Error(MSE) are presented to evaluate the efficiency of the proposed algorithm.Both analysis and numerical results show that LC-MMSE performs close to the wellknown MMSE estimator with much lower complexity and R-LC-MMSE improves the application of MMSE estimation to specific circumstances.

Robust state of charge estimation of lithium-ion battery via mixture kernel mean p-power error loss LSTM with heap-based-optimizer

The state of charge(SOC)estimation of lithium-ion battery is an important function in the battery management system(BMS)of electric vehicles.The long short term memory(LSTM)model can be employed for SOC estimation,which is capable of estimating the future changing states of a nonlinear system.Since the BMS usually works under complicated operating conditions,i.e the real measurement data used for model training may be corrupted by non-Gaussian noise,and thus the performance of the original LSTM with the mean square error(MSE)loss may deteriorate.Therefore,a novel LSTM with mixture kernel mean p-power error(MKMPE)loss,called MKMPE-LSTM,is developed by using the MKMPE loss to replace the MSE as the learning criterion in LSTM framework,which can achieve robust SOC estimation under the measurement data contaminated with non-Gaussian noises(or outliers)because of the MKMPE containing the p-order moments of the error distribution.In addition,a meta-heuristic algorithm,called heap-based-optimizer(HBO),is employed to optimize the hyper-parameters(mainly including learning rate,number of hidden layer neuron and value of p in MKMPE)of the proposed MKMPE-LSTM model to further improve its flexibility and generalization performance,and a novel hybrid model(HBO-MKMPE-LSTM)is established for SOC estimation under non-Gaussian noise cases.Finally,several tests are performed under various cases through a benchmark to evaluate the performance of the proposed HBO-MKMPE-LSTM model,and the results demonstrate that the proposed hybrid method can provide a good robustness and accuracy under different non-Gaussian measurement noises,and the SOC estimation results in terms of mean square error(MSE),root MSE(RMSE),mean absolute relative error(MARE),and determination coefficient R2are less than 0.05%,3%,3%,and above 99.8%at 25℃,respectively.

Wavelet Density Estimation of Censoring Data and Evaluate of Mean Integral Square Error with Convergence Ratio and Empirical Distribution of Given Estimator

Wavelet has rapid development in the current mathematics new areas. It also has a double meaning of theory and application. In signal and image compression, signal analysis, engineering technology has a wide range of applications. In this paper, we use wavelet method, for estimating the density function for censoring data. We evaluate the mean integrated squared error, convergence ratio of given estimator. Also, we obtain empirical distribution of given estimator and verify the conclusion by two simulation examples.

Least Squares Evaluations for Form and Profile Errors of Ellipse Using Coordinate Data

To improve the measurement and evaluation of form error of an elliptic section, an evaluation method based on least squares fitting is investigated to analyze the form and profile errors of an ellipse using coordinate data. Two error indicators for defining ellipticity are discussed, namely the form error and the profile error, and the difference between both is considered as the main parameter for evaluating machining quality of surface and profile. Because the form error and the profile error rely on different evaluation benchmarks, the major axis and the foci rather than the centre of an ellipse are used as the evaluation benchmarks and can accurately evaluate a tolerance range with the separated form error and profile error of workpiece. Additionally, an evaluation program based on the LS model is developed to extract the form error and the profile error of the elliptic section, which is well suited for separating the two errors by a standard program. Finally, the evaluation method about the form and profile errors of the ellipse is applied to the measurement of skirt line of the piston, and results indicate the effectiveness of the evaluation. This approach provides the new evaluation indicators for the measurement of form and profile errors of ellipse, which is found to have better accuracy and can thus be used to solve the difficult of the measurement and evaluation of the piston in industrial production.

A novel noise reduction technique for underwater acoustic signals based on complete ensemble empirical mode decomposition with adaptive noise,minimum mean square variance criterion and least mean square adaptive filter

Underwater acoustic signal processing is one of the research hotspots in underwater acoustics.Noise reduction of underwater acoustic signals is the key to underwater acoustic signal processing.Owing to the complexity of marine environment and the particularity of underwater acoustic channel,noise reduction of underwater acoustic signals has always been a difficult challenge in the field of underwater acoustic signal processing.In order to solve the dilemma,we proposed a novel noise reduction technique for underwater acoustic signals based on complete ensemble empirical mode decomposition with adaptive noise(CEEMDAN),minimum mean square variance criterion(MMSVC) and least mean square adaptive filter(LMSAF).This noise reduction technique,named CEEMDAN-MMSVC-LMSAF,has three main advantages:(i) as an improved algorithm of empirical mode decomposition(EMD) and ensemble EMD(EEMD),CEEMDAN can better suppress mode mixing,and can avoid selecting the number of decomposition in variational mode decomposition(VMD);(ii) MMSVC can identify noisy intrinsic mode function(IMF),and can avoid selecting thresholds of different permutation entropies;(iii) for noise reduction of noisy IMFs,LMSAF overcomes the selection of deco mposition number and basis function for wavelet noise reduction.Firstly,CEEMDAN decomposes the original signal into IMFs,which can be divided into noisy IMFs and real IMFs.Then,MMSVC and LMSAF are used to detect identify noisy IMFs and remove noise components from noisy IMFs.Finally,both denoised noisy IMFs and real IMFs are reconstructed and the final denoised signal is obtained.Compared with other noise reduction techniques,the validity of CEEMDAN-MMSVC-LMSAF can be proved by the analysis of simulation signals and real underwater acoustic signals,which has the better noise reduction effect and has practical application value.CEEMDAN-MMSVC-LMSAF also provides a reliable basis for the detection,feature extraction,classification and recognition of underwater acoustic signals.

A modified fractional least mean square algorithm for chaotic and nonstationary time series prediction

A method of modifying the architecture of fractional least mean square （FLMS） algorithm is presented to work with nonlinear time series prediction. Here we incorporate an adjustable gain parameter in the weight adaptation equation of the original FLMS algorithm and absorb the gamma function in the fractional step size parameter. This approach provides an interesting achievement in the performance of the filter in terms of handling the nonlinear problems with less computational burden by avoiding the evaluation of complex gamma function. We call this new algorithm as the modified fractional least mean square （MFLMS） algorithm. The predictive performance for the nonlinear Mackey glass chaotic time series is observed and evaluated using the classical LMS, FLMS, kernel LMS, and proposed MFLMS adaptive filters. The simulation results for the time series with and without noise confirm the superiority and improvement in the prediction capability of the proposed MFLMS predictor over its counterparts.

基于K-Means聚类与灰色关联分析对玻璃文物成分的研究

古代玻璃制品极易受埋藏环境的影响而风化,导致玻璃文物成分比例发生变化,从而影响对其类别的正确判断。文章针对古代玻璃制品的成分分析与鉴别问题,使用卡方检验、K-Means均值聚类、分层聚类、灰色关联等方法,构建卡方模型、BP神经网络模型、K-Means均值聚类模型、灰色关联分析等,运用Matlab、SPSS、Python等软件编程,研究了玻璃类型高钾与铅钡的分类依据,并对不同类别玻璃按照化学成分进行亚分类,分析了其化学成分的统计规律与关联关系。最后利用单因素方差分析法,检验了模型的合理性。

Noise cancellation of a multi-reference full-wave magnetic resonance sounding signal based on a modified sigmoid variable step size least mean square algorithm

Nano-volt magnetic resonance sounding(MRS) signals are sufficiently weak so that during the actual measurement, they are affected by environmental electromagnetic noise, leading to inaccuracy of the extracted characteristic parameters and hindering effective inverse interpretation. Considering the complexity and non-homogeneous spatial distribution of environmental noise and based on the theory of adaptive noise cancellation, a model system for noise cancellation using multi-reference coils was constructed to receive MRS signals. The feasibility of this system with theoretical calculation and experiments was analyzed and a modified sigmoid variable step size least mean square(SVSLMS) algorithm for noise cancellation was presented. The simulation results show that, the multi-reference coil method performs better than the single one on both signal-to-noise ratio(SNR) improvement and signal waveform optimization after filtering, under the condition of different noise correlations in the reference coils and primary detecting coils and different SNRs. In particular, when the noise correlation is poor and the SNR<0, the SNR can be improved by more than 8 dB after filtering with multi-reference coils. And the average fitting errors for initial amplitude and relaxation time are within 5%. Compared with the normalized least mean square(NLMS) algorithm and multichannel Wiener filter and processing field test data, the effectiveness of the proposed method is verified.

Penalized total least squares method for dealing with systematic errors in partial EIV model and its precision estimation

When the total least squares(TLS)solution is used to solve the parameters in the errors-in-variables(EIV)model,the obtained parameter estimations will be unreliable in the observations containing systematic errors.To solve this problem,we propose to add the nonparametric part(systematic errors)to the partial EIV model,and build the partial EIV model to weaken the influence of systematic errors.Then,having rewritten the model as a nonlinear model,we derive the formula of parameter estimations based on the penalized total least squares criterion.Furthermore,based on the second-order approximation method of precision estimation,we derive the second-order bias and covariance of parameter estimations and calculate the mean square error(MSE).Aiming at the selection of the smoothing factor,we propose to use the U curve method.The experiments show that the proposed method can mitigate the influence of systematic errors to a certain extent compared with the traditional method and get more reliable parameter estimations and its precision information,which validates the feasibility and effectiveness of the proposed method.

Recursive weighted least squares estimation algorithm based on minimum model error principle

Kalman filter is commonly used in data filtering and parameters estimation of nonlinear system,such as projectile's trajectory estimation and control.While there is a drawback that the prior error covariance matrix and filter parameters are difficult to be determined,which may result in filtering divergence.As to the problem that the accuracy of state estimation for nonlinear ballistic model strongly depends on its mathematical model,we improve the weighted least squares method(WLSM)with minimum model error principle.Invariant embedding method is adopted to solve the cost function including the model error.With the knowledge of measurement data and measurement error covariance matrix,we use gradient descent algorithm to determine the weighting matrix of model error.The uncertainty and linearization error of model are recursively estimated by the proposed method,thus achieving an online filtering estimation of the observations.Simulation results indicate that the proposed recursive estimation algorithm is insensitive to initial conditions and of good robustness.

Estimation under a Finite Mixture of Exponentiated Exponential Components Model and Balanced Square Error Loss

By exponentiating each of the components of a finite mixture of two exponential components model by a positive parameter, several shapes of hazard rate functions are obtained. Maximum likelihood and Bayes methods, based on square error loss function and objective prior, are used to obtain estimators based on balanced square error loss function for the parameters, survival and hazard rate functions of a mixture of two exponentiated exponential components model. Approximate interval estimators of the parameters of the model are obtained.

Degree Splitting of Root Square Mean Graphs

Let be an injective function. For a vertex labeling f, the induced edge labeling is defined by, or;then, the edge labels are distinct and are from . Then f is called a root square mean labeling of G. In this paper, we prove root square mean labeling of some degree splitting graphs.

Mean Square Heun’s Method Convergent for Solving Random Differential Initial Value Problems of First Order

This paper deals with the construction of Heun’s method of random initial value problems. Sufficient conditions for their mean square convergence are established. Main statistical properties of the approximations processes are computed in several illustrative examples.

A Quantized Kernel Least Mean Square Scheme with Entropy-Guided Learning for Intelligent Data Analysis

Quantized kernel least mean square(QKLMS) algorithm is an effective nonlinear adaptive online learning algorithm with good performance in constraining the growth of network size through the use of quantization for input space. It can serve as a powerful tool to perform complex computing for network service and application. With the purpose of compressing the input to further improve learning performance, this article proposes a novel QKLMS with entropy-guided learning, called EQ-KLMS. Under the consecutive square entropy learning framework, the basic idea of entropy-guided learning technique is to measure the uncertainty of the input vectors used for QKLMS, and delete those data with larger uncertainty, which are insignificant or easy to cause learning errors. Then, the dataset is compressed. Consequently, by using square entropy, the learning performance of proposed EQ-KLMS is improved with high precision and low computational cost. The proposed EQ-KLMS is validated using a weather-related dataset, and the results demonstrate the desirable performance of our scheme.

Separate Least Mean Square Based Equalizer with Joint Optimization for Multi-CAP Visible Light Communication

Visible light communication(VLC) is expected to be a potential candidate of the key technologies in the sixth generation(6G) wireless communication system to support Internet of Things(IoT) applications. In this work, a separate least mean square(S-LMS) equalizer is proposed to compensate lowpass frequency response in VLC system. Joint optimization is employed to realize the proposed S-LMS equalizer with pre-part and post-part by introducing Lagrangian. For verification, the performance of VLC system based on multi-band carrier-less amplitude and phase(m-CAP) modulation with S-LMS equalizer is investigated and compared with that without equalizer,with LMS equalizer and with recursive least squares(RLS)-Volterra equalizer. Results indicate the proposed equalizer shows significant improved bit error ratio(BER) performance under the same conditions. Compared to the RLS-Volterra equalizer, SLMS equalizer achieves better performance under low data rate or high signal noise ratio(SNR) conditions with obviously lower computational complexity.

Mean Square Convergent Finite Difference Scheme for Stochastic Parabolic PDEs

Stochastic partial differential equations (SPDEs) describe the dynamics of stochastic processes depending on space-time continuum. These equations have been widely used to model many applications in engineering and mathematical sciences. In this paper we use three finite difference schemes in order to approximate the solution of stochastic parabolic partial differential equations. The conditions of the mean square convergence of the numerical solution are studied. Some case studies are discussed.

Mean Square Containment Control of Multi-agent Systems with Transmission Noises

为有传播噪音的多代理人系统的抑制控制问题被考虑。由于噪音的存在，腐烂的获得功能被介绍稀释噪音。动态地交换拓扑学并且随机交换拓扑学被考虑。通讯图和控制获得功能上的足够的条件被导出保证吝啬的方形的抑制。一些数字例子被提供验证结果。

Calculation of Significant Wave Height Using the Linear Mean Square Estimation Method

Significant wave height is an important criterion in designing coastal and offshore structures.Based on the orthogonality principle, the linear mean square estimation method is applied to calculate significant wave height in this paper.Twenty-eight-year time series of wave data collected from three ocean buoys near San Francisco along the California coast are analyzed.It is proved theoretically that the computation error will be reduced by using as many measured data as possible for the calculation of significant wave height.Measured significant wave height at one buoy location is compared with the calculated value based on the data from two other adjacent buoys.The results indicate that the linear mean square estimation method can be well applied to the calculation and prediction of significant wave height in coastal regions.

Amplitude phase control for electro-hydraulic servo system based on normalized least-mean-square adaptive filtering algorithm

The electro-hydraulic servo system was studied to cancel the amplitude attenuation and phase delay of its sinusoidal response,by developing a network using normalized least-mean-square (LMS) adaptive filtering algorithm.The command input was corrected by weights to generate the desired input for the algorithm,and the feedback was brought into the feedback correction,whose output was the weighted feedback.The weights of the normalized LMS adaptive filtering algorithm were updated on-line according to the estimation error between the desired input and the weighted feedback.Thus,the updated weights were copied to the input correction.The estimation error was forced to zero by the normalized LMS adaptive filtering algorithm such that the weighted feedback was equal to the desired input,making the feedback track the command.The above concept was used as a basis for the development of amplitude phase control.The method has good real-time performance without estimating the system model.The simulation and experiment results show that the proposed amplitude phase control can efficiently cancel the amplitude attenuation and phase delay with high precision.