Comparative Study of Probabilistic and Least-Squares Methods for Developing Predictive Models

This article explores the comparison between the probability method and the least squares method in the design of linear predictive models. It points out that these two approaches have distinct theoretical foundations and can lead to varied or similar results in terms of precision and performance under certain assumptions. The article underlines the importance of comparing these two approaches to choose the one best suited to the context, available data and modeling objectives.

LEAST-SQUARES METHOD-BASED FEATURE FITTING AND EXTRACTION IN REVERSE ENGINEERING

The main purpose of reverse engineering is to convert discrete data pointsinto piecewise smooth, continuous surface models. Before carrying out model reconstruction it issignificant to extract geometric features because the quality of modeling greatly depends on therepresentation of features. Some fitting techniques of natural quadric surfaces with least-squaresmethod are described. And these techniques can be directly used to extract quadric surfaces featuresduring the process of segmentation for point cloud.

NEGATIVE NORM LEAST-SQUARES METHODS FOR THE INCOMPRESSIBLE MAGNETOHYDRODYNAMIC EQUATIONS

The purpose of this article is to develop and analyze least-squares approximations for the incompressible magnetohydrodynamic equations. The major advantage of the least-squares finite element method is that it is not subjected to the so-called Ladyzhenskaya-Babuska-Brezzi （LBB） condition. The authors employ least-squares functionals which involve a discrete inner product which is related to the inner product in H^-1（Ω）.

ON THE BREAKDOWNS OF THE GALERKIN AND LEAST-SQUARES METHODS

The Galerkin and least-squares methods are two classes of the most popular Krylov subspace methOds for solving large linear systems of equations. Unfortunately, both the methods may suffer from serious breakdowns of the same type: In a breakdown situation the Galerkin method is unable to calculate an approximate solution, while the least-squares method, although does not really break down, is unsucessful in reducing the norm of its residual. In this paper we first establish a unified theorem which gives a relationship between breakdowns in the two methods. We further illustrate theoretically and experimentally that if the coefficient matrix of a lienar system is of high defectiveness with the associated eigenvalues less than 1, then the restarted Galerkin and least-squares methods will be in great risks of complete breakdowns. It appears that our findings may help to understand phenomena observed practically and to derive treatments for breakdowns of this type.

Application of neural network model coupling with the partial least-squares method for forecasting watre yield of mine

Scientific forecasting water yield of mine is of great significance to the safety production of mine and the colligated using of water resources. The paper established the forecasting model for water yield of mine, combining neural network with the partial least square method. Dealt with independent variables by the partial least square method, it can not only solve the relationship between independent variables but also reduce the input dimensions in neural network model, and then use the neural network which can solve the non-linear problem better. The result of an example shows that the prediction has higher precision in forecasting and fitting.

Initial costates derived by near-optimal reference sequence and least-squares method

In this paper,we present a novel initial costates solver for initializing time-optimal trajectory problems in relative motion with continuous low thrust.The proposed solver consists of two primary components:training a Multilayer Perceptron(MLP)for generating reference sequence and Time of Flight(TOF)to the target,and deriving a system of linear algebraic equations for obtaining the initial costates.To overcome the challenge of generating training samples for the MLP,the backward generation method is proposed to obtain five different training databases.The training database and sample form are determined by analyzing the input and output correlation using the Pearson correlation coefficient.The best-performing MLP is obtained by analyzing the training results with various hyper-parameter combinations.A reference sequence starting from the initial states is obtained by integrating forward with the near-optimal control vector from the output of MLP.Finally,a system of linear algebraic equations for estimating the initial costates is derived using the reference sequence and the necessary conditions for optimality.Simulation results demonstrate that the proposed initial costates solver improves the convergence ratio and reduce the function calls of the shooting function.Furthermore,Monte-Carlo simulation illustrates that the initial costates solver is applicable to different initial velocities,demonstrating excellent generalization ability.

Solution of shallow-water equations using least-squares finite-element method

A least-squares finite-element method （LSFEM） for the non-conservative shallow-water equations is presented. The model is capable of handling complex topography, steady and unsteady flows, subcritical and supercritical flows, and flows with smooth and sharp gradient changes. Advantages of the model include： （1） sources terms, such as the bottom slope, surface stresses and bed frictions, can be treated easily without any special treatment; （2） upwind scheme is no needed; （3） a single approximating space can be used for all variables, and its choice of approximating space is not subject to the Ladyzhenskaya-Babuska-Brezzi （LBB） condition; and （4） the resulting system of equations is symmetric and positive-definite （SPD） which can be solved efficiently with the preconditioned conjugate gradient method. The model is verified with flow over a bump, tide induced flow, and dam-break. Computed results are compared with analytic solutions or other numerical results, and show the model is conservative and accurate. The model is then used to simulate flow past a circular cylinder. Important flow charac-teristics, such as variation of water surface around the cylinder and vortex shedding behind the cylinder are investigated. Computed results compare well with experiment data and other numerical results.

Least-squares finite-element method for shallow-water equations with source terms

Numerical solution of shallow-water equations （SWE） has been a challenging task because of its nonlinear hyperbolic nature, admitting discontinuous solution, and the need to satisfy the C-property. The presence of source terms in momentum equations, such as the bottom slope and friction of bed, compounds the difficulties further. In this paper, a least-squares finite-element method for the space discretization and θ-method for the time integration is developed for the 2D non-conservative SWE including the source terms. Advantages of the method include： the source terms can be approximated easily with interpolation functions, no upwind scheme is needed, as well as the resulting system equations is symmetric and positive-definite, therefore, can be solved efficiently with the conjugate gradient method. The method is applied to steady and unsteady flows, subcritical and transcritical flow over a bump, 1D and 2D circular dam-break, wave past a circular cylinder, as well as wave past a hump. Computed results show good C-property, conservation property and compare well with exact solutions and other numerical results for flows with weak and mild gradient changes, but lead to inaccurate predictions for flows with strong gradient changes and discontinuities.

Meshless Least-Squares Method for Solving the Steady-State Heat Conduction Equation

The meshless weighted least-squares (MWLS) method is a pure meshless method that com- bines the moving least-squares approximation scheme and least-square discretization. Previous studies of the MWLS method for elastostatics and wave propagation problems have shown that the MWLS method possesses several advantages, such as high accuracy, high convergence rate, good stability, and high com- putational efficiency. In this paper, the MWLS method is extended to heat conduction problems. The MWLS computational parameters are chosen based on a thorough numerical study of 1-dimensional problems. Several 2-dimensional examples show that the MWLS method is much faster than the element free Galerkin method (EFGM), while the accuracy of the MWLS method is close to, or even better than the EFGM. These numerical results demonstrate that the MWLS method has good potential for numerical analyses of heat transfer problems.

An experiment-library least-squares method on on-line coal element contents analysis

A new experiment-library least-squares(experiment-LLs) method used in the neutron inelastic-scattering and thermal-capture analysis(NITA) technique for on-line coal analysis was developed,which has significantly decreased the non-linear radiation effects.In this method,sixty samples with preset elemental contents were made,from whose experimental spectra twenty single-element spectrum libraries corresponding to twenty kinds of coal were built using the least-squares method.The spectrum of the unknown sample was analyzed based on these twenty libraries to estimate its element contents.With the initial estimated result,the procedure of developing library and analysis was iterated to build a new library with the closest element contents to the unknown sample.Hence the experiment-LLs method can reduce non-linear radiation effects.The experiment-LLs method was performed on an improved coal analysis system which was equipped with a long-life 14 MeV pulsed-neutron generator,a bulk BGO detector with a temperature controller,a moisture meter and coal-smoothing device.The precisions of this system for ash content,water content,volatile content and calorific value have reached 1.0wt%,0.5wt%,1.0wt%,350 kJ/kg,respectively.

A two-step weighted least-squares method for joint estimation of source and sensor locations: A general framework

It is well known that the Two-step Weighted Least-Squares(TWLS) is a widely used method for source localization and sensor position refinement. For this reason, we propose a unified framework of the TWLS method for joint estimation of multiple disjoint sources and sensor locations in this paper. Unlike some existing works, the presented method is based on more general measurement model, and therefore it can be applied to many different localization scenarios.Besides, it does not have the initialization and local convergence problem. The closed-form expression for the covariance matrix of the proposed TWLS estimator is also derived by exploiting the first-order perturbation analysis. Moreover, the estimation accuracy of the TWLS method is shown analytically to achieve the Cramér-Rao Bound(CRB) before the threshold effect takes place. The theoretical analysis is also performed in a common mathematical framework, rather than aiming at some specific signal metrics. Finally, two numerical experiments are performed to support the theoretical development in this paper.

Modelling of wind power forecasting errors based on kernel recursive least-squares method

Forecasting error amending is a universal solution to improve short-term wind power forecasting accuracy no matter what specific forecasting algorithms are applied. The error correction model should be presented considering not only the nonlinear and non-stationary characteristics of forecasting errors but also the field application adaptability problems. The kernel recursive least-squares(KRLS) model is introduced to meet the requirements of online error correction. An iterative error modification approach is designed in this paper to yield the potential benefits of statistical models, including a set of error forecasting models. The teleconnection in forecasting errors from aggregated wind farms serves as the physical background to choose the hybrid regression variables. A case study based on field data is found to validate the properties of the proposed approach. The results show that our approach could effectively extend the modifying horizon of statistical models and has a better performance than the traditional linear method for amending short-term forecasts.

First-Order System Least-Squares Methods for a Flux Control Problem by the Stokes Flow

This article deals with a first-order least-squares approach to the solution of an optimal control problem governed by Stokes equations.As with our earlier work on a velocity control by the Stokes flow in[S.Ryu,H.-C.Lee and S.D.Kim,SIAM J.Numer.Anal.,47(2009),pp.1524-1545],we recast the objective functional as a H1 seminorm in the velocity control term.By introducing a velocity-flux variable and using the Lagrange multiplier rule,a first-order optimality system is obtained.We show that the least-squares principle based on L2 norms applied to this system yields the optimal discretization error estimates for each variable in H1 norm,including the velocity flux.For numerical tests,multigrid method is employed to the discrete algebraic system,so that the velocity and flux controls are obtained.

Complex derivatives valuation: applying the Least-Squares Monte Carlo Simulation Method with several polynomial basis

Background:This article investigates the Least-Squares Monte Carlo Method by using different polynomial basis in American Asian Options pricing.The standard approach in the option pricing literature is to choose the basis arbitrarily.By comparing four different polynomial basis we show that the choice of basis interferes in the option's price.Methods:We assess Least-Squares Method performance in pricing four different American Asian Options by using four polynomial basis:Power,Laguerre,Legendre and Hermite A.To every American Asian Option priced,three sets of parameters are used in order to evaluate it properly.Results:We show that the choice of the basis interferes in the option's price by showing that one of them converges to the option's value faster than any other by using fewer simulated paths.In the case of an Amerasian call option,for example,we find that the preferable polynomial basis is Hermite A.For an Amerasian put option,the Power polynomial basis is recommended.Such empirical outcome is theoretically unpredictable,since in principle all basis can be indistinctly used when pricing the derivative.Conclusion:In this article The Least-Squares Monte Carlo Method performance is assessed in pricing four different types of American Asian Options by using four different polynomial basis through three different sets of parameters.Our results suggest that one polynomial basis is best suited to perform the method when pricing an American Asian option.Theoretically all basis can be indistinctly used when pricing the derivative.However,our results does not confirm these.We find that when pricing an American Asian put option,Power A is better than the other basis we have studied here whereas when pricing an American Asian call,Hermite A is better.

An Adaptive Least-Squares Mixed Finite Element Method for Fourth Order Parabolic Problems

A least-squares mixed finite element (LSMFE) method for the numerical solution of fourth order parabolic problems analyzed and developed in this paper. The Ciarlet-Raviart mixed finite element space is used to approximate. The a posteriori error estimator which is needed in the adaptive refinement algorithm is proposed. The local evaluation of the least-squares functional serves as a posteriori error estimator. The posteriori errors are effectively estimated. The convergence of the adaptive least-squares mixed finite element method is proved.

LEAST-SQUARES MIXED FINITE ELEMENT METHOD FOR A CLASS OF STOKES EQUATION

A least-squares mixed finite element method was formulated for a class of Stokes equations in two dimensional domains. The steady state and the time-dependent Stokes' equations were considered. For the stationary equation, optimal H-t and L-2-error estimates are derived under the standard regularity assumption on the finite element partition ( the LBB-condition is not required). Far the evolutionary equation, optimal L-2 estimates are derived under the conventional Raviart-Thomas spaces.

Least-Squares Finite Element Method for the Steady Upper-Convected Maxwell Fluid

In this paper, a least-squares finite element method for the upper-convected Maxell (UCM) fluid is proposed. We first linearize the constitutive and momentum equations and then apply a least-squares method to the linearized version of the viscoelastic UCM model. The L2 least-squares functional involves the residuals of each equation multiplied by proper weights. The corresponding homogeneous functional is equivalent to a natural norm. The error estimates of the finite element solution are analyzed when the conforming piecewise polynomial elements are used for the unknowns.

Least-squares reverse time migration method using the factorization of the Hessian matrix

Least-squares reverse time migration(LSRTM)can eliminate imaging artifacts in an iterative way based on the concept of inversion,and it can restore imaging amplitude step by step.LSRTM can provide a high-resolution migration section and can be applied to irregular and poor-quality seismic data and achieve good results.Steeply dipping refl ectors and complex faults are imaged by using wavefi eld extrapolation based on a two-way wave equation.However,the high computational cost limits the method’s application in practice.A fast approach to realize LSRTM in the imaging domain is provided in this paper to reduce the computational cost signifi cantly and enhance its computational effi ciency.The method uses the Kronecker decomposition algorithm to estimate the Hessian matrix.A low-rank matrix can be used to calculate the Kronecker factor,which involves the calculation of Green’s function at the source and receiver point.The approach also avoids the direct construction of the whole Hessian matrix.Factorization-based LSRTM calculates the production of low-rank matrices instead of repeatedly calculating migration and demigration.Unlike traditional LSRTM,factorization-based LSRTM can reduce calculation costs considerably while maintaining comparable imaging quality.While having the same imaging eff ect,factorization-based LSRTM consumes half the running time of conventional LSRTM.In this regard,the application of factorization-based LSRTM has a promising advantage in reducing the computational cost.Ambient noise caused by this method can be removed by applying a commonly used fi ltering method without signifi cantly degrading the imaging quality.

Least-squares reverse time migration in visco-acoustic media based on symplectic stereo-modeling method

The authors proposed a symplectic stereo-modeling method(SSM)in the Birkhoffian dynam-ics and apply it to the visco-acoustic least-squares reverse time migration(LSRTM).The SSM adopts ste-reo-modeling operator in space and symplectic Runge-Kutta scheme in time,resulting in great ability in suppressing numerical dispersion and long-time computing.These advantages are further confirmed by numerical dispersion analysis,long-time computation test and computational efficiency comparison.After these theoretical analyses and experiments,acoustic and visco-acoustic LSRTM are tested and compared between SSM method and the conventional symplectic method(CSM)using the fault and marmousi models.Meanwhile,dynamic source encoding and exponential decay moving average gradients method are adopted to reduce the computation cost and improve the convergence rate.The imaging results show that LSRTM based on visco-acoustic wave equations effectively takes into account the influence of viscosity can therefore compensate for the amplitude attenuation.Besides,SSM method not only has high numerical accuracy and computational efficiency,but also performs effectively in LSRTM.

Structural Modal Parameter Recognition and Related Damage Identification Methods under Environmental Excitations: A Review

Modal parameters can accurately characterize the structural dynamic properties and assess the physical state of the structure.Therefore,it is particularly significant to identify the structural modal parameters according to the monitoring data information in the structural health monitoring(SHM)system,so as to provide a scientific basis for structural damage identification and dynamic model modification.In view of this,this paper reviews methods for identifying structural modal parameters under environmental excitation and briefly describes how to identify structural damages based on the derived modal parameters.The paper primarily introduces data-driven modal parameter recognition methods(e.g.,time-domain,frequency-domain,and time-frequency-domain methods,etc.),briefly describes damage identification methods based on the variations of modal parameters(e.g.,natural frequency,modal shapes,and curvature modal shapes,etc.)and modal validation methods(e.g.,Stability Diagram and Modal Assurance Criterion,etc.).The current status of the application of artificial intelligence(AI)methods in the direction of modal parameter recognition and damage identification is further discussed.Based on the pre-vious analysis,the main development trends of structural modal parameter recognition and damage identification methods are given to provide scientific references for the optimized design and functional upgrading of SHM systems.