Comparative Study of Probabilistic and Least-Squares Methods for Developing Predictive Models

This article explores the comparison between the probability method and the least squares method in the design of linear predictive models. It points out that these two approaches have distinct theoretical foundations and can lead to varied or similar results in terms of precision and performance under certain assumptions. The article underlines the importance of comparing these two approaches to choose the one best suited to the context, available data and modeling objectives.

LEAST-SQUARES METHOD-BASED FEATURE FITTING AND EXTRACTION IN REVERSE ENGINEERING

The main purpose of reverse engineering is to convert discrete data pointsinto piecewise smooth, continuous surface models. Before carrying out model reconstruction it issignificant to extract geometric features because the quality of modeling greatly depends on therepresentation of features. Some fitting techniques of natural quadric surfaces with least-squaresmethod are described. And these techniques can be directly used to extract quadric surfaces featuresduring the process of segmentation for point cloud.

NEGATIVE NORM LEAST-SQUARES METHODS FOR THE INCOMPRESSIBLE MAGNETOHYDRODYNAMIC EQUATIONS

The purpose of this article is to develop and analyze least-squares approximations for the incompressible magnetohydrodynamic equations. The major advantage of the least-squares finite element method is that it is not subjected to the so-called Ladyzhenskaya-Babuska-Brezzi （LBB） condition. The authors employ least-squares functionals which involve a discrete inner product which is related to the inner product in H^-1（Ω）.

ON THE BREAKDOWNS OF THE GALERKIN AND LEAST-SQUARES METHODS

The Galerkin and least-squares methods are two classes of the most popular Krylov subspace methOds for solving large linear systems of equations. Unfortunately, both the methods may suffer from serious breakdowns of the same type: In a breakdown situation the Galerkin method is unable to calculate an approximate solution, while the least-squares method, although does not really break down, is unsucessful in reducing the norm of its residual. In this paper we first establish a unified theorem which gives a relationship between breakdowns in the two methods. We further illustrate theoretically and experimentally that if the coefficient matrix of a lienar system is of high defectiveness with the associated eigenvalues less than 1, then the restarted Galerkin and least-squares methods will be in great risks of complete breakdowns. It appears that our findings may help to understand phenomena observed practically and to derive treatments for breakdowns of this type.

Application of neural network model coupling with the partial least-squares method for forecasting watre yield of mine

Scientific forecasting water yield of mine is of great significance to the safety production of mine and the colligated using of water resources. The paper established the forecasting model for water yield of mine, combining neural network with the partial least square method. Dealt with independent variables by the partial least square method, it can not only solve the relationship between independent variables but also reduce the input dimensions in neural network model, and then use the neural network which can solve the non-linear problem better. The result of an example shows that the prediction has higher precision in forecasting and fitting.

Initial costates derived by near-optimal reference sequence and least-squares method

In this paper,we present a novel initial costates solver for initializing time-optimal trajectory problems in relative motion with continuous low thrust.The proposed solver consists of two primary components:training a Multilayer Perceptron(MLP)for generating reference sequence and Time of Flight(TOF)to the target,and deriving a system of linear algebraic equations for obtaining the initial costates.To overcome the challenge of generating training samples for the MLP,the backward generation method is proposed to obtain five different training databases.The training database and sample form are determined by analyzing the input and output correlation using the Pearson correlation coefficient.The best-performing MLP is obtained by analyzing the training results with various hyper-parameter combinations.A reference sequence starting from the initial states is obtained by integrating forward with the near-optimal control vector from the output of MLP.Finally,a system of linear algebraic equations for estimating the initial costates is derived using the reference sequence and the necessary conditions for optimality.Simulation results demonstrate that the proposed initial costates solver improves the convergence ratio and reduce the function calls of the shooting function.Furthermore,Monte-Carlo simulation illustrates that the initial costates solver is applicable to different initial velocities,demonstrating excellent generalization ability.

Least-squares reverse time migration in visco-acoustic media based on symplectic stereo-modeling method

The authors proposed a symplectic stereo-modeling method(SSM)in the Birkhoffian dynam-ics and apply it to the visco-acoustic least-squares reverse time migration(LSRTM).The SSM adopts ste-reo-modeling operator in space and symplectic Runge-Kutta scheme in time,resulting in great ability in suppressing numerical dispersion and long-time computing.These advantages are further confirmed by numerical dispersion analysis,long-time computation test and computational efficiency comparison.After these theoretical analyses and experiments,acoustic and visco-acoustic LSRTM are tested and compared between SSM method and the conventional symplectic method(CSM)using the fault and marmousi models.Meanwhile,dynamic source encoding and exponential decay moving average gradients method are adopted to reduce the computation cost and improve the convergence rate.The imaging results show that LSRTM based on visco-acoustic wave equations effectively takes into account the influence of viscosity can therefore compensate for the amplitude attenuation.Besides,SSM method not only has high numerical accuracy and computational efficiency,but also performs effectively in LSRTM.

Monte Carlo method for evaluation of surface emission rate measurement uncertainty

The aim of this study is to evaluate the uncertainty of 2πα and 2πβ surface emission rates using the windowless multiwire proportional counter method.This study used the Monte Carlo method (MCM) to validate the conventional Guide to the Expression of Uncertainty in Measurement (GUM) method.A dead time measurement model for the two-source method was established based on the characteristics of a single-channel measurement system,and the voltage threshold correction factor measurement function was indirectly obtained by fitting the threshold correction curve.The uncertainty in the surface emission rate was calculated using the GUM method and the law of propagation of uncertainty.The MCM provided clear definitions for each input quantity and its uncertainty distribution,and the simulation training was realized with a complete and complex mathematical model.The results of the surface emission rate uncertainty evaluation for four radioactive plane sources using both methods showed the uncertainty’s consistency E_(n)<0.070 for the comparison of each source,and the uncertainty results of the GUM were all lower than those of the MCM.However,the MCM has a more objective evaluation process and can serve as a validation tool for GUM results.

Solution of shallow-water equations using least-squares finite-element method

A least-squares finite-element method （LSFEM） for the non-conservative shallow-water equations is presented. The model is capable of handling complex topography, steady and unsteady flows, subcritical and supercritical flows, and flows with smooth and sharp gradient changes. Advantages of the model include： （1） sources terms, such as the bottom slope, surface stresses and bed frictions, can be treated easily without any special treatment; （2） upwind scheme is no needed; （3） a single approximating space can be used for all variables, and its choice of approximating space is not subject to the Ladyzhenskaya-Babuska-Brezzi （LBB） condition; and （4） the resulting system of equations is symmetric and positive-definite （SPD） which can be solved efficiently with the preconditioned conjugate gradient method. The model is verified with flow over a bump, tide induced flow, and dam-break. Computed results are compared with analytic solutions or other numerical results, and show the model is conservative and accurate. The model is then used to simulate flow past a circular cylinder. Important flow charac-teristics, such as variation of water surface around the cylinder and vortex shedding behind the cylinder are investigated. Computed results compare well with experiment data and other numerical results.

Least-squares finite-element method for shallow-water equations with source terms

Numerical solution of shallow-water equations （SWE） has been a challenging task because of its nonlinear hyperbolic nature, admitting discontinuous solution, and the need to satisfy the C-property. The presence of source terms in momentum equations, such as the bottom slope and friction of bed, compounds the difficulties further. In this paper, a least-squares finite-element method for the space discretization and θ-method for the time integration is developed for the 2D non-conservative SWE including the source terms. Advantages of the method include： the source terms can be approximated easily with interpolation functions, no upwind scheme is needed, as well as the resulting system equations is symmetric and positive-definite, therefore, can be solved efficiently with the conjugate gradient method. The method is applied to steady and unsteady flows, subcritical and transcritical flow over a bump, 1D and 2D circular dam-break, wave past a circular cylinder, as well as wave past a hump. Computed results show good C-property, conservation property and compare well with exact solutions and other numerical results for flows with weak and mild gradient changes, but lead to inaccurate predictions for flows with strong gradient changes and discontinuities.

Meshless Least-Squares Method for Solving the Steady-State Heat Conduction Equation

The meshless weighted least-squares (MWLS) method is a pure meshless method that com- bines the moving least-squares approximation scheme and least-square discretization. Previous studies of the MWLS method for elastostatics and wave propagation problems have shown that the MWLS method possesses several advantages, such as high accuracy, high convergence rate, good stability, and high com- putational efficiency. In this paper, the MWLS method is extended to heat conduction problems. The MWLS computational parameters are chosen based on a thorough numerical study of 1-dimensional problems. Several 2-dimensional examples show that the MWLS method is much faster than the element free Galerkin method (EFGM), while the accuracy of the MWLS method is close to, or even better than the EFGM. These numerical results demonstrate that the MWLS method has good potential for numerical analyses of heat transfer problems.

An experiment-library least-squares method on on-line coal element contents analysis

A new experiment-library least-squares(experiment-LLs) method used in the neutron inelastic-scattering and thermal-capture analysis(NITA) technique for on-line coal analysis was developed,which has significantly decreased the non-linear radiation effects.In this method,sixty samples with preset elemental contents were made,from whose experimental spectra twenty single-element spectrum libraries corresponding to twenty kinds of coal were built using the least-squares method.The spectrum of the unknown sample was analyzed based on these twenty libraries to estimate its element contents.With the initial estimated result,the procedure of developing library and analysis was iterated to build a new library with the closest element contents to the unknown sample.Hence the experiment-LLs method can reduce non-linear radiation effects.The experiment-LLs method was performed on an improved coal analysis system which was equipped with a long-life 14 MeV pulsed-neutron generator,a bulk BGO detector with a temperature controller,a moisture meter and coal-smoothing device.The precisions of this system for ash content,water content,volatile content and calorific value have reached 1.0wt%,0.5wt%,1.0wt%,350 kJ/kg,respectively.

A two-step weighted least-squares method for joint estimation of source and sensor locations: A general framework

It is well known that the Two-step Weighted Least-Squares(TWLS) is a widely used method for source localization and sensor position refinement. For this reason, we propose a unified framework of the TWLS method for joint estimation of multiple disjoint sources and sensor locations in this paper. Unlike some existing works, the presented method is based on more general measurement model, and therefore it can be applied to many different localization scenarios.Besides, it does not have the initialization and local convergence problem. The closed-form expression for the covariance matrix of the proposed TWLS estimator is also derived by exploiting the first-order perturbation analysis. Moreover, the estimation accuracy of the TWLS method is shown analytically to achieve the Cramér-Rao Bound(CRB) before the threshold effect takes place. The theoretical analysis is also performed in a common mathematical framework, rather than aiming at some specific signal metrics. Finally, two numerical experiments are performed to support the theoretical development in this paper.

Modelling of wind power forecasting errors based on kernel recursive least-squares method

Forecasting error amending is a universal solution to improve short-term wind power forecasting accuracy no matter what specific forecasting algorithms are applied. The error correction model should be presented considering not only the nonlinear and non-stationary characteristics of forecasting errors but also the field application adaptability problems. The kernel recursive least-squares(KRLS) model is introduced to meet the requirements of online error correction. An iterative error modification approach is designed in this paper to yield the potential benefits of statistical models, including a set of error forecasting models. The teleconnection in forecasting errors from aggregated wind farms serves as the physical background to choose the hybrid regression variables. A case study based on field data is found to validate the properties of the proposed approach. The results show that our approach could effectively extend the modifying horizon of statistical models and has a better performance than the traditional linear method for amending short-term forecasts.

A Review on Sources,Extractions and Analysis Methods of a Sustainable Biomaterial:Tannins

Condensed and hydrolysable tannins are non-toxic natural polyphenols that are a commercial commodity industrialized for tanning hides to obtain leather and for a growing number of other industrial applications mainly to substitute petroleum-based products.They are a definite class of sustainable materials of the forestry industry.They have been in operation for hundreds of years to manufacture leather and now for a growing number of applications in a variety of other industries,such as wood adhesives,metal coating,pharmaceutical/medical applications and several others.This review presents the main sources,either already or potentially commercial of this forestry by-materials,their industrial and laboratory extraction systems,their systems of analysis with their advantages and drawbacks,be these methods so simple to even appear primitive but nonetheless of proven effectiveness,or very modern and instrumental.It constitutes a basic but essential summary of what is necessary to know of these sustainable materials.In doing so,the review highlights some of the main challenges that remain to be addressed to deliver the quality and economics of tannin supply necessary to fulfill the industrial production requirements for some materials-based uses.

Drilling-based measuring method for the c-φ parameter of rock and its field application

The technology of drilling tests makes it possible to obtain the strength parameter of rock accurately in situ. In this paper, a new rock cutting analysis model that considers the influence of the rock crushing zone(RCZ) is built. The formula for an ultimate cutting force is established based on the limit equilibrium principle. The relationship between digital drilling parameters(DDP) and the c-φ parameter(DDP-cφ formula, where c refers to the cohesion and φ refers to the internal friction angle) is derived, and the response of drilling parameters and cutting ratio to the strength parameters is analyzed. The drillingbased measuring method for the c-φ parameter of rock is constructed. The laboratory verification test is then completed, and the difference in results between the drilling test and the compression test is less than 6%. On this basis, in-situ rock drilling tests in a traffic tunnel and a coal mine roadway are carried out, and the strength parameters of the surrounding rock are effectively tested. The average difference ratio of the results is less than 11%, which verifies the effectiveness of the proposed method for obtaining the strength parameters based on digital drilling. This study provides methodological support for field testing of rock strength parameters.

A comparison study on structure-function relationship of polysaccharides obtained from sea buckthorn berries using different methods:antioxidant and bile acid-binding capacity

In this study,the structural characters,antioxidant activities and bile acid-binding ability of sea buckthorn polysaccharides(HRPs)obtained by the commonly used hot water(HRP-W),pressurized hot water(HRP-H),ultrasonic(HRP-U),acid(HRP-C)and alkali(HRP-A)assisted extraction methods were investigated.The results demonstrated that extraction methods had significant effects on extraction yield,monosaccharide composition,molecular weight,particle size,triple-helical structure,and surface morphology of HRPs except for the major linkage bands.Thermogravimetric analysis showed that HRP-U with filamentous reticular microstructure exhibited better thermal stability.The HRP-A with the lowest molecular weight and highest arabinose content possessed the best antioxidant activities.Moreover,the rheological analysis indicated that HRPs with higher galacturonic acid content and molecular weight showed higher viscosity and stronger crosslinking network(HRP-C,HRP-W and HRP-U),which exhibited stronger bile acid binding capacity.The present findings provide scientific evidence in the preparation technology of sea buckthorn polysaccharides with good antioxidant and bile acid binding capacity which are related to the structure affected by the extraction methods.

Optimization of Random Feature Method in the High-Precision Regime

Machine learning has been widely used for solving partial differential equations(PDEs)in recent years,among which the random feature method(RFM)exhibits spectral accuracy and can compete with traditional solvers in terms of both accuracy and efficiency.Potentially,the optimization problem in the RFM is more difficult to solve than those that arise in traditional methods.Unlike the broader machine-learning research,which frequently targets tasks within the low-precision regime,our study focuses on the high-precision regime crucial for solving PDEs.In this work,we study this problem from the following aspects:(i)we analyze the coeffcient matrix that arises in the RFM by studying the distribution of singular values;(ii)we investigate whether the continuous training causes the overfitting issue;(ii)we test direct and iterative methods as well as randomized methods for solving the optimization problem.Based on these results,we find that direct methods are superior to other methods if memory is not an issue,while iterative methods typically have low accuracy and can be improved by preconditioning to some extent.

Volumetric lattice Boltzmann method for pore-scale mass diffusionadvection process in geopolymer porous structures

Porous materials present significant advantages for absorbing radioactive isotopes in nuclear waste streams.To improve absorption efficiency in nuclear waste treatment,a thorough understanding of the diffusion-advection process within porous structures is essential for material design.In this study,we present advancements in the volumetric lattice Boltzmann method(VLBM)for modeling and simulating pore-scale diffusion-advection of radioactive isotopes within geopolymer porous structures.These structures are created using the phase field method(PFM)to precisely control pore architectures.In our VLBM approach,we introduce a concentration field of an isotope seamlessly coupled with the velocity field and solve it by the time evolution of its particle population function.To address the computational intensity inherent in the coupled lattice Boltzmann equations for velocity and concentration fields,we implement graphics processing unit(GPU)parallelization.Validation of the developed model involves examining the flow and diffusion fields in porous structures.Remarkably,good agreement is observed for both the velocity field from VLBM and multiphysics object-oriented simulation environment(MOOSE),and the concentration field from VLBM and the finite difference method(FDM).Furthermore,we investigate the effects of background flow,species diffusivity,and porosity on the diffusion-advection behavior by varying the background flow velocity,diffusion coefficient,and pore volume fraction,respectively.Notably,all three parameters exert an influence on the diffusion-advection process.Increased background flow and diffusivity markedly accelerate the process due to increased advection intensity and enhanced diffusion capability,respectively.Conversely,increasing the porosity has a less significant effect,causing a slight slowdown of the diffusion-advection process due to the expanded pore volume.This comprehensive parametric study provides valuable insights into the kinetics of isotope uptake in porous structures,facilitating the development of porous materials for nuclear waste treatment applications.

Material point method simulation of hydro-mechanical behaviour in twophase porous geomaterials: A state-of-the-art review

The material point method(MPM)has been gaining increasing popularity as an appropriate approach to the solution of coupled hydro-mechanical problems involving large deformation.In this paper,we survey the current state-of-the-art in the MPM simulation of hydro-mechanical behaviour in two-phase porous geomaterials.The review covers the recent advances and developments in the MPM and their extensions to capture the coupled hydro-mechanical problems involving large deformations.The focus of this review is aiming at providing a clear picture of what has or has not been developed or implemented for simulating two-phase coupled large deformation problems,which will provide some direct reference for both practitioners and researchers.