Algorithms and statistical analysis for linear structured weighted total least squares problem

Weighted total least squares(WTLS)have been regarded as the standard tool for the errors-in-variables(EIV)model in which all the elements in the observation vector and the coefficient matrix are contaminated with random errors.However,in many geodetic applications,some elements are error-free and some random observations appear repeatedly in different positions in the augmented coefficient matrix.It is called the linear structured EIV(LSEIV)model.Two kinds of methods are proposed for the LSEIV model from functional and stochastic modifications.On the one hand,the functional part of the LSEIV model is modified into the errors-in-observations(EIO)model.On the other hand,the stochastic model is modified by applying the Moore-Penrose inverse of the cofactor matrix.The algorithms are derived through the Lagrange multipliers method and linear approximation.The estimation principles and iterative formula of the parameters are proven to be consistent.The first-order approximate variance-covariance matrix(VCM)of the parameters is also derived.A numerical example is given to compare the performances of our proposed three algorithms with the STLS approach.Afterwards,the least squares(LS),total least squares(TLS)and linear structured weighted total least squares(LSWTLS)solutions are compared and the accuracy evaluation formula is proven to be feasible and effective.Finally,the LSWTLS is applied to the field of deformation analysis,which yields a better result than the traditional LS and TLS estimations.

Least Squares One-Class Support Tensor Machine

One-class classification problem has become a popular problem in many fields, with a wide range of applications in anomaly detection, fault diagnosis, and face recognition. We investigate the one-class classification problem for second-order tensor data. Traditional vector-based one-class classification methods such as one-class support vector machine (OCSVM) and least squares one-class support vector machine (LSOCSVM) have limitations when tensor is used as input data, so we propose a new tensor one-class classification method, LSOCSTM, which directly uses tensor as input data. On one hand, using tensor as input data not only enables to classify tensor data, but also for vector data, classifying it after high dimensionalizing it into tensor still improves the classification accuracy and overcomes the over-fitting problem. On the other hand, different from one-class support tensor machine (OCSTM), we use squared loss instead of the original loss function so that we solve a series of linear equations instead of quadratic programming problems. Therefore, we use the distance to the hyperplane as a metric for classification, and the proposed method is more accurate and faster compared to existing methods. The experimental results show the high efficiency of the proposed method compared with several state-of-the-art methods.

Numerical Simulation of Oil-Water Two-Phase Flow in Low Permeability Tight Reservoirs Based on Weighted Least Squares Meshless Method

In response to the complex characteristics of actual low-permeability tight reservoirs,this study develops a meshless-based numerical simulation method for oil-water two-phase flow in these reservoirs,considering complex boundary shapes.Utilizing radial basis function point interpolation,the method approximates shape functions for unknown functions within the nodal influence domain.The shape functions constructed by the aforementioned meshless interpolation method haveδ-function properties,which facilitate the handling of essential aspects like the controlled bottom-hole flow pressure in horizontal wells.Moreover,the meshless method offers greater flexibility and freedom compared to grid cell discretization,making it simpler to discretize complex geometries.A variational principle for the flow control equation group is introduced using a weighted least squares meshless method,and the pressure distribution is solved implicitly.Example results demonstrate that the computational outcomes of the meshless point cloud model,which has a relatively small degree of freedom,are in close agreement with those of the Discrete Fracture Model(DFM)employing refined grid partitioning,with pressure calculation accuracy exceeding 98.2%.Compared to high-resolution grid-based computational methods,the meshless method can achieve a better balance between computational efficiency and accuracy.Additionally,the impact of fracture half-length on the productivity of horizontal wells is discussed.The results indicate that increasing the fracture half-length is an effective strategy for enhancing production from the perspective of cumulative oil production.

Comparative Study of Probabilistic and Least-Squares Methods for Developing Predictive Models

This article explores the comparison between the probability method and the least squares method in the design of linear predictive models. It points out that these two approaches have distinct theoretical foundations and can lead to varied or similar results in terms of precision and performance under certain assumptions. The article underlines the importance of comparing these two approaches to choose the one best suited to the context, available data and modeling objectives.

Quantity of plant leaf area on three major public squares in Kunming City, China

Regressive formulae to calculate the quantity of plant leaf area for 13 species of ornamental plants were set up based on investigation data of 30 species on 3 major public squares (Dongfeng square, Shengli square and Guandu square) in Kun-ming City, China, which were applied to calculate quantities of plant leaf area of these 13 species. The quantities of plant leaf area for the other 17 ornamental plant species on these squares were directly measured, and the total quantity of plant leaf area of each studied square was obtained individually. The results showed that the quantity of plant leaf area on Shengli square with ornamental plants structure composed of arbor tree species, shrub tree species and turf grass was highest among the three squares. It is believed that the design model of multi-storied vertical structure and proper tending of plant community could not only increase the quantity of plant leaf area, but also play an important role in generating ecological and landscaping benefits. Some corresponding suggestions were put forward on the basis of comprehensive analyses on the plant leaf area quantity of the three representative squares in Kunming urban area.

Expression of Indigenous Landscapes in the Design of Modern Urban Squares

Modern urban square landscapes have been evolved to be with more regional and cultural features, yet the phenomenon of duplication is serious in urban square landscapes in China. In this study, the connotation of indigenous landscape is analyzed from the perspectives of local culture, integration of Chinese and western cultures, folk cultures and modern marketing, the causes of duplicated urban square landscapes are thoroughly elaborated. In view of the deficiencies of modern urban square landscapes, it is proposed that local plants, local ornamental materials and patterns should be fully applied in square designs, and the expression of detail landscapes should be attached sufficient importance, to completely demonstrate regional features of landscapes and better apply indigenous landscapes into the design of modern urban squares.

ONLINE PARSIMONIOUS LEAST SQUARES SUPPORT VECTOR REGRESSION AND ITS APPLICATION

A simple and effective mechanism is proposed to realize the parsimoniousness of the online least squares support vector regression （LS-SVR）, and the approach is called the OPLS-SVR for short. Hence, the response time is curtailed. Besides, an OPLS-SVR based analytical redundancy technique is presented to cope with the sensor failure and drift problems to guarantee that the provided signals for the aeroengine controller are correct and acceptable. Experiments on the sensor failure and drift show the effectiveness and the validity of the proposed analytical redundancy.

Landscape Design Practices for Urban Squares

Urban squares are significant nodes of urban spaces, which should be able to improve urban ecological environment and provide residents with outdoor activity spaces. The authors studied some excellent square designs in Inner Mongolia, China and even overseas countries, summarized the standards of "best urban squares" in vision, culture, craft, human-concerned design, science and technology, and then applied such standards in the landscape design of Central Plaza in Zhungeer Banner. Through analyzing surrounding environment and constructions, design schemes with regional and cultural features were created to provide references for designing better green square landscapes which can demonstrate local cultural context and regional cultures, are moderate in size, diversified in spatial form and closely integrated with the social life of citizens.

NOVEL WEIGHTED LEAST SQUARES SUPPORT VECTOR REGRESSION FOR THRUST ESTIMATION ON PERFORMANCE DETERIORATION OF AERO-ENGINE

A thrust estimator with high precision and excellent real-time performance is needed to mitigate perfor- mance deterioration for future aero-engines. A weight least squares support vector regression is proposed using a novel weighting strategy. Then a thrust estimator based on the proposed regression is designed for the perfor- mance deterioration. Compared with the existing weighting strategy, the novel one not only satisfies the require- ment of precision but also enhances the real-time performance. Finally, numerical experiments demonstrate the effectiveness and feasibility of the proposed weighted least squares support vector regression for thrust estimator. Key words ： intelligent engine control; least squares ; support vector machine ; performance deterioration

BOOSTING SPARSE LEAST SQUARES SUPPORT VECTOR REGRESSION (BSLSSVR) AND ITS APPLICATION TO THRUST ESTIMATION

In order to realize direct thrust control instead of conventional sensors-based control for aero-engine, a thrust estimator with high accuracy is designed by using the boosting technique to improve the performance of least squares support vector regression （LSSVR）. There exist two distinct features compared with the conven- tional boosting technique： （1） Sampling without replacement is used to avoid numerical instability for modeling LSSVR. （2） To realize the sparseness of LSSVR and reduce the computational complexity, only a subset of the training samples is used to construct LSSVR. Thus, this boosting method for LSSVR is called the boosting sparse LSSVR （BSLSSVR）. Finally, simulation results show that BSLSSVR-based thrust estimator can satisfy the requirement of direct thrust control, i.e. , maximum absolute value of relative error of thrust estimation is not more than 5‰.

An Effective Multiple Model Least Squares Method in Tracking of a Maneuvering Target

A polynomial model, time origin shifting model(TOSM, is used to describe the trajectory of a moving target .Based on TOSM, a recursive laeast squares(RLS) algorithm with varied forgetting factor is derived for tracking of a non-maneuvering target. In order to apply this algorithm to maneuvering targets tracking ,a tracking signal is performed on-line to determine what kind of TOSm will be in effect to track a target with different dynamics. An effective multiple model least squares filtering and forecasting method dadpted to real tracking of a maneuvering target is formulated. The algorithm is computationally more effcient than Kalman filter and the percentage improvement from simulations show both of them are considerably alike to some extent.

Semi-supervised least squares support vector machine algorithm:application to offshore oil reservoir

At the early stages of deep-water oil exploration and development, fewer and further apart wells are drilled than in onshore oilfields. Supervised least squares support vector machine algorithms are used to predict the reservoir parameters but the prediction accuracy is low. We combined the least squares support vector machine （LSSVM） algorithm with semi-supervised learning and established a semi-supervised regression model, which we call the semi-supervised least squares support vector machine （SLSSVM） model. The iterative matrix inversion is also introduced to improve the training ability and training time of the model. We use the UCI data to test the generalization of a semi-supervised and a supervised LSSVM models. The test results suggest that the generalization performance of the LSSVM model greatly improves and with decreasing training samples the generalization performance is better. Moreover, for small-sample models, the SLSSVM method has higher precision than the semi-supervised K-nearest neighbor （SKNN） method. The new semi- supervised LSSVM algorithm was used to predict the distribution of porosity and sandstone in the Jingzhou study area.

Analysis of Current Situation and Countermeasures of Plant Landscapes on Tianjin Urban Squares of China

Through the survey of plant landscapes on eight representative squares in Tianjin City,the paper had pointed out that plant landscapes on Tianjin squares were improper in terms of plants richness,cultivation layer and color change.It had suggested selecting regional characteristic tree species,applying salt-tolerant plants,emphasizing the diversity of plants species,highlighting the application of towering arbors,stressing the use of color-leaved plants,and creating abundant plant communities,so as to provide citizens with a more practical and ornamental square landscape environment through improving plant landscapes on squares in Tianjin City.

A stabilized least-squares imaging condition with structure constraints

Conventional shot-gather migration uses a cross-correlation imaging condition proposed by Clarebout （1971）, which cannot preserve imaging amplitudes. The deconvolution imaging condition can improve the imaging amplitude and compensate for illumination. However, the deconvolution imaging condition introduces instability issues. The least-squares imaging condition first computes the sum of the cross-correlation of the forward and backward wavefields over all frequencies and sources, and then divides the result by the total energy of the forward wavefield. Therefore, the least-squares imaging condition is more stable than the classic imaging condition. However, the least-squares imaging condition cannot provide accurate results in areas where the illumination is very poor and unbalanced. To stabilize the least-squares imaging condition and balance the imaging amplitude, we propose a novel imaging condition with structure constraints that is based on the least-squares imaging condition. Our novel imaging condition uses a plane wave construction that constrains the imaging result to be smooth along geological structure boundaries in the inversion frame. The proposed imaging condition improves the stability of the imaging condition and balances the imaging amplitude. The proposed condition is applied to two examples, the horizontal layered model and the Sigsbee 2A model. These tests show that, in comparison to the damped least-squares imaging condition, the stabilized least-squares imaging condition with structure constraints improves illumination stability and balance, makes events more consecutive, adjusts the amplitude of the depth layers where the illumination is poor and unbalanced, suppresses imaging artifacts, and is conducive to amplitude preserving imaging of deep layers.

Application of Eastern River Culture on Squares of Yuncheng City

Taking South-wind Square in Yuncheng City for an example,the application of Eastern River Culture as a kind of regional culture in the construction of urban squares were analyzed in this study,to provide references for the future construction of squares in this city.

PSR-SQUARES:基于程序空间约简器的SQL逆向合成系统

针对SQUARES程序空间增长过快,导致程序合成效率偏低的问题,在SQUARES的基础上,增加了以深度神经网络为核心的程序空间约简器,将给定的<被查询表,查询结果>示例表示成二维张量,作为深度神经网络的输入,网络的输出是关于目标SQL语句合成规则的相关性标记向量。约简器根据神经网络的输出结果,采用末N位淘汰策略,删除与目标SQL语句相关性弱的合成规则,以减少候选SQL语句的生成和验证,提升系统合成效率。对约简器中深度神经网络的结构设计、训练样本集的生成方法和网络训练过程进行了详细描述。同时将PSR-SQUARES与当前有代表性SQL逆向合成系统进行实验对比,实验结果表明,PSR-SQUARES的综合性能不同程度地优于其他合成系统,平均合成时间由SQUARES的251 s降低至130 s,目标程序合成成功率由80%提升至89%。

Constrained least squares algorithm for channel vector estimation in 2-D RAKE receiver

Based on the fact that the variation of tile direction of arrival (DOA) isslower than that of the channel fading, the steering vector of the desired signal is estimatedfirstly using a subspace decomposition method and then a constrained condition is configured.Traffic signals are further employed to estimate the channel vector based on the constrained leastsquares criterion. We use the iterative least squares with projection (ILSP) algorithm initializedby the pilot to get the estimation. The accuracy of channel estimation and symbol detection can beprogressively increased through the iteration procedure of the ILSP algorithm. Simulation resultsdemonstrate that the proposed algorithm improves the system performance effectively compared withthe conventional 2-D RAKE receiver.

Least-Squares及Galerkin谱元方法求解环形区域内的泊松方程

为研究基于Least-Squares变分及Galerkin变分两种形式的谱元方法的求解特性,推导了极坐标系中采用两种变分方法求解环形区域内Poisson方程时对应的弱解形式,采用Chebyshev多项式构造插值基函数进行空间离散,得到两种谱元方法对应的代数方程组,由此分析了系数矩阵结构的特点。数值计算结果显示:Least-Squares谱元方法为实现方程的降阶而引入新的求解变量,使得代数方程组形式更为复杂,但边界条件的处理比Galerkin谱元方法更为简单;两种谱元方法均能求解极坐标系中的Poisson方程且能获得高精度的数值解,二者绝对误差分布基本一致;固定单元内的插值阶数时,增加单元数可减小数值误差,且表现出代数精度的特点,误差降低速度较慢,而固定单元数时,在一定范围内数值误差随插值阶数的增加而减小的速度更快,表现出谱精度的特点;单元内插值阶数较高时,代数方程组系数矩阵的条件数急剧增多,方程组呈现病态,数值误差增大,这一特点限制了单元内插值阶数的取值。研究内容对深入了解两种谱元方法在极坐标系中求解Poisson方程时的特点、进一步采用相关分裂算法求解实际流动问题具有参考价值。

Least Squares Evaluations for Form and Profile Errors of Ellipse Using Coordinate Data

To improve the measurement and evaluation of form error of an elliptic section, an evaluation method based on least squares fitting is investigated to analyze the form and profile errors of an ellipse using coordinate data. Two error indicators for defining ellipticity are discussed, namely the form error and the profile error, and the difference between both is considered as the main parameter for evaluating machining quality of surface and profile. Because the form error and the profile error rely on different evaluation benchmarks, the major axis and the foci rather than the centre of an ellipse are used as the evaluation benchmarks and can accurately evaluate a tolerance range with the separated form error and profile error of workpiece. Additionally, an evaluation program based on the LS model is developed to extract the form error and the profile error of the elliptic section, which is well suited for separating the two errors by a standard program. Finally, the evaluation method about the form and profile errors of the ellipse is applied to the measurement of skirt line of the piston, and results indicate the effectiveness of the evaluation. This approach provides the new evaluation indicators for the measurement of form and profile errors of ellipse, which is found to have better accuracy and can thus be used to solve the difficult of the measurement and evaluation of the piston in industrial production.

FAST RECURSIVE LEAST SQUARES LEARNING ALGORITHM FOR PRINCIPAL COMPONENT ANALYSIS

Based on the least-square minimization a computationally efficient learning algorithm for the Principal Component Analysis(PCA) is derived. The dual learning rate parameters are adaptively introduced to make the proposed algorithm providing the capability of the fast convergence and high accuracy for extracting all the principal components. It is shown that all the information needed for PCA can be completely represented by the unnormalized weight vector which is updated based only on the corresponding neuron input-output product. The convergence performance of the proposed algorithm is briefly analyzed.The relation between Oja’s rule and the least squares learning rule is also established. Finally, a simulation example is given to illustrate the effectiveness of this algorithm for PCA.