Comparative Study of Probabilistic and Least-Squares Methods for Developing Predictive Models

This article explores the comparison between the probability method and the least squares method in the design of linear predictive models. It points out that these two approaches have distinct theoretical foundations and can lead to varied or similar results in terms of precision and performance under certain assumptions. The article underlines the importance of comparing these two approaches to choose the one best suited to the context, available data and modeling objectives.

Numerical Simulation of Oil-Water Two-Phase Flow in Low Permeability Tight Reservoirs Based on Weighted Least Squares Meshless Method

In response to the complex characteristics of actual low-permeability tight reservoirs,this study develops a meshless-based numerical simulation method for oil-water two-phase flow in these reservoirs,considering complex boundary shapes.Utilizing radial basis function point interpolation,the method approximates shape functions for unknown functions within the nodal influence domain.The shape functions constructed by the aforementioned meshless interpolation method haveδ-function properties,which facilitate the handling of essential aspects like the controlled bottom-hole flow pressure in horizontal wells.Moreover,the meshless method offers greater flexibility and freedom compared to grid cell discretization,making it simpler to discretize complex geometries.A variational principle for the flow control equation group is introduced using a weighted least squares meshless method,and the pressure distribution is solved implicitly.Example results demonstrate that the computational outcomes of the meshless point cloud model,which has a relatively small degree of freedom,are in close agreement with those of the Discrete Fracture Model(DFM)employing refined grid partitioning,with pressure calculation accuracy exceeding 98.2%.Compared to high-resolution grid-based computational methods,the meshless method can achieve a better balance between computational efficiency and accuracy.Additionally,the impact of fracture half-length on the productivity of horizontal wells is discussed.The results indicate that increasing the fracture half-length is an effective strategy for enhancing production from the perspective of cumulative oil production.

Least square method based on Haar wavelet to solve multi-dimensional stochastic Ito-Volterra integral equations

This paper proposes a method combining blue the Haar wavelet and the least square to solve the multi-dimensional stochastic Ito-Volterra integral equation.This approach is to transform stochastic integral equations into a system of algebraic equations.Meanwhile,the error analysis is proven.Finally,the effectiveness of the approach is verified by two numerical examples.

APPLICATION OF LEAST MEDIAN OF SQUARED ORTHOGONAL DISTANCE (LMD) AND LMD BASED REWEIGHTED LEAST SQUARES (RLS) METHODS ON THE STOCK RECRUITMENT RELATIONSHIP

Analysis of stock recruitment (SR) data is most often done by fitting various SR relationship curves to the data. Fish population dynamics data often have stochastic variations and measurement errors, which usually result in a biased regression analysis. This paper presents a robust regression method, least median of squared orthogonal distance (LMD), which is insensitive to abnormal values in the dependent and independent variables in a regression analysis. Outliers that have significantly different variance from the rest of the data can be identified in a residual analysis. Then, the least squares (LS) method is applied to the SR data with defined outliers being down weighted. The application of LMD and LMD based Reweighted Least Squares (RLS) method to simulated and real fisheries SR data is explored.

WEIGHTED LEAST SQUARE METHOD FOR S-N CURVE FITTING

An S-N curve fitting approach is proposed based on the weighted least square method, and the weights are inversely proportional to the length of mean confidence intervals of experimental data sets. The assumption coincides with the physical characteristics of the fatigue life scatter. Two examples demonstrate the method. It is shown that the method has better accuracy and reasonableness compared with the usual least square method.

采用改进遗传算法优化LS-SVM逆系统的外转子无铁心无轴承永磁同步发电机解耦控制

为了实现外转子无铁心无轴承永磁同步发电机(outer rotor coreless bearingless permanent magnet synchronous generator,ORC-BPMSG)的精确控制,提出一种基于改进遗传算法(improved genetic algorithm,IGA)优化最小二乘支持向量机(least square support vector machine,LS-SVM)逆系统的解耦控制策略。首先,基于ORC-BPMSG的结构及工作原理,推导其数学模型,并分析其可逆性。其次,建立LS-SVM回归方程,并采用IGA优化LS-SVM的性能参数,从而训练得到逆系统。然后,将逆系统与原系统串接,形成伪线性系统,实现了ORC-BPMSG的线性化和解耦。最后,将提出的控制方法与传统LS-SVM逆系统控制方法进行对比仿真和实验。仿真和实验结果表明:所提出的控制策略可以较好地实现ORC-BPMSG输出电压和悬浮力、以及悬浮力之间的解耦控制。

GPS short-delay multipath estimation and mitigation based on least square method

The GPS multipath signal model is presented, which indicates that the coherent DLL outputs in multipath environment are the convolution between the ideal DLL outputs and the channel responses. So the channel responses can be estimated by a least square method using the observed curve of the DLL discriminator. In terms of the estimated multipath channels, two multipath mitigation methods are discussed, which are equalization filtering and multipath subtracting, respectively. It is shown, by computer simulation, that the least square method has a good performance in channels estimation and the multipath errors can be mitigated almost completely by either of the methods. However, the multipath subtracting method has relative small remnant errors than equalization filtering.

Online Detection of Broken Rotor Bar Fault in Induction Motors by Combining Estimation of Signal Parameters via Min-norm Algorithm and Least Square Method

Current research in broken rotor bar （BRB） fault detection in induction motors is primarily focused on a high-frequency resolution analysis of the stator current. Compared with a discrete Fourier transformation, the parametric spectrum estimation technique has a higher frequency accuracy and resolution. However, the existing detection methods based on parametric spectrum estima- tion cannot realize online detection, owing to the large computational cost. To improve the efficiency of BRB fault detection, a new detection method based on the min-norm algorithm and least square estimation is proposed in this paper. First, the stator current is filtered using a band-pass filter and divided into short overlapped data windows. The min-norm algorithm is then applied to determine the fre- quencies of the fundamental and fault characteristic com- ponents with each overlapped data window. Next, based on the frequency values obtained, a model of the fault current signal is constructed. Subsequently, a linear least squares problem solved through singular value decomposition is designed to estimate the amplitudes and phases of the related components. Finally, the proposed method is applied to a simulated current and an actual motor, the results of which indicate that, not only parametric spectrum estimation technique.

A STUDY ON THE WEIGHT FUNCTION OF THE MOVING LEAST SQUARE APPROXIMATION IN THE LOCAL BOUNDARY INTEGRAL EQUATION METHOD

The meshless method is a new numerical technique presented in recent years.It uses the moving least square(MLS)approximation as a shape function.The smoothness of the MLS approximation is determined by that of the basic function and of the weight function,and is mainly determined by that of the weight function.Therefore,the weight function greatly affects the accuracy of results obtained.Different kinds of weight functions,such as the spline function, the Gauss function and so on,are proposed recently by many researchers.In the present work,the features of various weight functions are illustrated through solving elasto-static problems using the local boundary integral equation method.The effect of various weight functions on the accuracy, convergence and stability of results obtained is also discussed.Examples show that the weight function proposed by Zhou Weiyuan and Gauss and the quartic spline weight function are better than the others if parameters c and α in Gauss and exponential weight functions are in the range of reasonable values,respectively,and the higher the smoothness of the weight function,the better the features of the solutions.

Estimating canopy closure density and above-ground tree biomass using partial least square methods in Chinese boreal forests

Boreal forests play an important role in global environment systems. Understanding boreal forest ecosystem structure and function requires accurate monitoring and estimating of forest canopy and biomass. We used partial least square regression （PLSR） models to relate forest parameters, i.e. canopy closure density and above ground tree biomass, to Landsat ETM＋ data. The established models were optimized according to the variable importance for projection （VIP） criterion and the bootstrap method, and their performance was compared using several statistical indices. All variables selected by the VIP criterion passed the bootstrap test （p〈0.05）. The simplified models without insignificant variables （VIP 〈1） performed as well as the full model but with less computation time. The relative root mean square error （RMSE%） was 29% for canopy closure density, and 58% for above ground tree biomass. We conclude that PLSR can be an effective method for estimating canopy closure density and above ground biomass.

Parameter identification and pressure control of dynamic system in shield tunneling using least squares method

An estimation approach using least squares method was presented for identificationof model parameters of pressure control in shield tunneling.The state equation ofthe pressure control system for shield tunneling was analytically derived based on themass equilibrium principle that the entry mass of the pressure chamber from cutting headwas equal to excluding mass from the screw conveyor.The randomly observed noise wasnumerically simulated and mixed to simulated observation values of system responses.The numerical simulation shows that the state equation of the pressure control system forshield tunneling is reasonable and the proposed estimation approach is effective even ifthe random observation noise exists.The robustness of the controlling procedure is validatedby numerical simulation results.

The least square particle finite element method for simulating large amplitude sloshing flows

Large amplitude sloshing in tanks is simulated by the least square particle finite element method （LSPFEM） in this paper. The least square finite element method （LSFEM） is employed to spatially discrete the Navier-Stokes equations, and to avoid the stabilization issues due to the incompressibility condition for equal-order interpolation of the velocity and the pressure, as usually used in Galerkin method to satisfy the well-known LBB condition. The LSPFEM also uses the Lagrangian description to model the motion of nodes （particles）. A mesh which connects these nodes is constructed by a triangulation algorithm to avoid the mesh distortion. A quasi a-shapes algorithm is used to identify the free surface boundary. The nodes are viewed as particles which can freely move and even separate from the main fluid domain. Finally this method is used to study the large amplitude sloshing evolution in two dimensional tanks. The results are compared with those obtained by Flow-3d with good agreement.

ELASTO-PLASTICITY ANALYSIS BASED ON COLLOCATION WITH THE MOVING LEAST SQUARE METHOD

A meshless approach based on the moving least square method is developed for elasto-plasticity analysis,in which the incremental formulation is used.In this approach,the dis- placement shape functions are constructed by using the moving least square approximation,and the discrete governing equations for elasto-plastic material are constructed with the direct collo- cation method.The boundary conditions are also imposed by collocation.The method established is a truly meshless one,as it does not need any mesh,either for the purpose of interpolation of the solution variables,or for the purpose of construction of the discrete equations.It is simply formu- lated and very efficient,and no post-processing procedure is required to compute the derivatives of the unknown variables,since the solution from this method based on the moving least square approximation is already smooth enough.Numerical examples are given to verify the accuracy of the meshless method proposed for elasto-plasticity analysis.

ADAPTIVE FUSION ALGORITHMS BASED ON WEIGHTED LEAST SQUARE METHOD

Weighted fusion algorithms, which can be applied in the area of multi-sensor data fusion, are advanced based on weighted least square method. A weighted fusion algorithm, in which the relationship between weight coefficients and measurement noise is established, is proposed by giving attention to the correlation of measurement noise. Then a simplified weighted fusion algorithm is deduced on the assumption that measurement noise is uncorrelated. In addition, an algorithm, which can adjust the weight coefficients in the simplified algorithm by making estimations of measurement noise from measurements, is presented. It is proved by emulation and experiment that the precision performance of the multi-sensor system based on these algorithms is better than that of the multi-sensor system based on other algorithms.

Assessing dynamic response of multispan viscoelastic thin beams under a moving mass via generalized moving least square method

Dynamic response of multispan viscoelastic thin beams subjected to a moving mass is studied by an efficient numerical method in some detail. To this end, the unknown parameters of the problem are discretized in spatial domain using generalized moving least square method （GMLSM） and then, discrete equations of motion based on Lagrange＇s equation are obtained. Maximum deflection and bending moments are considered as the important design parameters. The design parameter spectra in terms of mass weight and velocity of the moving mass are presented for multispan viscoelastic beams as well as various values of relaxation rate and beam span number. A reasonable good agreement is achieved between the results of the proposed solution and those obtained by other researchers. The results indicate that, although the load inertia effects in beams with higher span number would be intensified for higher levels of moving mass velocity, the maximum values of design parameters would increase either. Moreover, the possibility of mass separation is shown to be more critical as the span number of the beam increases. This fact also violates the linear relation between the mass weight of the moving load and the associated design parameters, especially for high moving mass velocities. However, as the relaxation rate of the beam material increases, the load inertia effects as well as the possibility of moving mass separation reduces.

Preconditioned iterative methods for solving weighted linear least squares problems

A class of preconditioned iterative methods, i.e., preconditioned generalized accelerated overrelaxation （GAOR） methods, is proposed to solve linear systems based on a class of weighted linear least squares problems. The convergence and comparison results are obtained. The comparison results show that the convergence rate of the preconditioned iterative methods is better than that of the original methods. Furthermore, the effectiveness of the proposed methods is shown in the numerical experiment.

Penalized total least squares method for dealing with systematic errors in partial EIV model and its precision estimation

When the total least squares(TLS)solution is used to solve the parameters in the errors-in-variables(EIV)model,the obtained parameter estimations will be unreliable in the observations containing systematic errors.To solve this problem,we propose to add the nonparametric part(systematic errors)to the partial EIV model,and build the partial EIV model to weaken the influence of systematic errors.Then,having rewritten the model as a nonlinear model,we derive the formula of parameter estimations based on the penalized total least squares criterion.Furthermore,based on the second-order approximation method of precision estimation,we derive the second-order bias and covariance of parameter estimations and calculate the mean square error(MSE).Aiming at the selection of the smoothing factor,we propose to use the U curve method.The experiments show that the proposed method can mitigate the influence of systematic errors to a certain extent compared with the traditional method and get more reliable parameter estimations and its precision information,which validates the feasibility and effectiveness of the proposed method.

Stability of the MGS-like elimination method for equality constrained least squares problems

This paper proves that the weighting method via modified Gram-Schmidt（MGS） for solving the equality constrained least squares problem in the limit is equivalent to the direct elimination method via MGS（MGS-elimination method）. By virtue of this equivalence, the backward and forward roundoff error analysis of the MGS-elimination method is proved. Numerical experiments are provided to verify the results.

Application of neural network model coupling with the partial least-squares method for forecasting watre yield of mine

Scientific forecasting water yield of mine is of great significance to the safety production of mine and the colligated using of water resources. The paper established the forecasting model for water yield of mine, combining neural network with the partial least square method. Dealt with independent variables by the partial least square method, it can not only solve the relationship between independent variables but also reduce the input dimensions in neural network model, and then use the neural network which can solve the non-linear problem better. The result of an example shows that the prediction has higher precision in forecasting and fitting.

Calculation of stratum surface principal curvature based on a moving least square method

With the east section of the Changji sag Zhunger Basin as a case study, both a principal curvature method and a moving least square method are elaborated. The moving least square method is introduced, for the first time, to fit a stratum surface. The results show that, using the same-degree base function, compared with a traditional least square method, the moving least square method can produce lower fitting errors, the fitting surface can describe the morphological characteristics of stratum surfaces more accurately and the principal curvature values vary within a wide range and may be more suitable for the prediction of the distribution of structural fractures. The moving least square method could be useful in curved surface fitting and stratum curvature analysis.