Selection of the Linear Regression Model According to the Parameter Estimation

In this paper, based on the theory of parameter estimation, we give a selection method and, in a sense of a good character of the parameter estimation, we think that it is very reasonable. Moreover, we offer a calculation method of selection statistic and an applied example.

EMPIRICAL BAYES ESTIMATION FOR ESTIMABLE FUNCTION OF REGRESSION COEFFICIENT IN A MULTIPLE LINEAR REGRESSION MODEL

In this paper we consider the empirical Bayes (EB) estimation problem for estimable function of regression coefficient in a multiple linear regression model Y=Xβ+e. where e with given β has a multivariate standard normal distribution. We get the EB estimators by using kernel estimation of multivariate density function and its first order partial derivatives. It is shown that the convergence rates of the EB estimators are under the condition where an integer k > 1 . is an arbitrary small number and m is the dimension of the vector Y.

Parametric estimation for the simple linear regression model under moving extremes ranked set sampling design

Cost effective sampling design is a major concern in some experiments especially when the measurement of the characteristic of interest is costly or painful or time consuming.Ranked set sampling(RSS)was first proposed by McIntyre[1952.A method for unbiased selective sampling,using ranked sets.Australian Journal of Agricultural Research 3,385-390]as an effective way to estimate the pasture mean.In the current paper,a modification of ranked set sampling called moving extremes ranked set sampling(MERSS)is considered for the best linear unbiased estimators(BLUEs)for the simple linear regression model.The BLUEs for this model under MERSS are derived.The BLUEs under MERSS are shown to be markedly more efficient for normal data when compared with the BLUEs under simple random sampling.

New Facts in Regression Estimation under Conditions of Multicollinearity

This paper considers the approaches and methods for reducing the influence of multi-collinearity. Great attention is paid to the question of using shrinkage estimators for this purpose. Two classes of regression models are investigated, the first of which corresponds to systems with a negative feedback, while the second class presents systems without the feedback. In the first case the use of shrinkage estimators, especially the Principal Component estimator, is inappropriate but is possible in the second case with the right choice of the regularization parameter or of the number of principal components included in the regression model. This fact is substantiated by the study of the distribution of the random variable , where b is the LS estimate and β is the true coefficient, since the form of this distribution is the basic characteristic of the specified classes. For this study, a regression approximation of the distribution of the event based on the Edgeworth series was developed. Also, alternative approaches are examined to resolve the multicollinearity issue, including an application of the known Inequality Constrained Least Squares method and the Dual estimator method proposed by the author. It is shown that with a priori information the Euclidean distance between the estimates and the true coefficients can be significantly reduced.

A LARGE SAMPLE ESTIMATE IN MEDIAN LINEAR REGRESSION MODEL Ⅰ: NONTRUNCATED CASE

This paper uses a grouping-adjusting procedure to the data from a median linear regression model, and estimtes the regression coefficients by the method of weighted least squares. This method simplifies computation and in the meantime, preserves the same asymptotic normal distribution for the estimator, as in the ordinary minimum L_1-norm estimates.

Rainfall Estimation using Image Processing and Regression Model on DWR Rainfall Product for Delhi-NCR Region

Observed rainfall is a very essential parameter for the analysis of rainfall,day to day weather forecast and its validation.The observed rainfall data is only available from five observatories of IMD;while no rainfall data is available at various important locations in and around Delhi-NCR.However,the 24-hour rainfall data observed by Doppler Weather Radar(DWR)for entire Delhi and surrounding region(up to 150 km)is readily available in a pictorial form.In this paper,efforts have been made to derive/estimate the rainfall at desired locations using DWR hydrological products.Firstly,the rainfall at desired locations has been estimated from the precipitation accumulation product(PAC)of the DWR using image processing in Python language.After this,a linear regression model using the least square method has been developed in R language.Estimated and observed rainfall data of year 2018(July,August and September)was used to train the model.After this,the model was tested on rainfall data of year 2019(July,August and September)and validated.With the use of linear regression model,the error in mean rainfall estimation reduced by 46.58% and the error in max rainfall estimation reduced by 84.53% for the year 2019.The error in mean rainfall estimation reduced by 81.36% and the error in max rainfall estimation reduced by 33.81%for the year 2018.Thus,the rainfall can be estimated with a fair degree of accuracy at desired locations within the range of the Doppler Weather Radar using the radar rainfall products and the developed linear regression model.

LIMITING BEHAVIOR OF RECURSIVE M-ESTIMATORS IN MULTIVARIATE LINEAR REGRESSION MODELS AND THEIR ASYMPTOTIC EFFICIENCIES

Recursive algorithms are very useful for computing M-estimators of regression coefficients and scatter parameters. In this article, it is shown that for a nondecreasing ul （t）, under some mild conditions the recursive M-estimators of regression coefficients and scatter parameters are strongly consistent and the recursive M-estimator of the regression coefficients is also asymptotically normal distributed. Furthermore, optimal recursive M-estimators, asymptotic efficiencies of recursive M-estimators and asymptotic relative efficiencies between recursive M-estimators of regression coefficients are studied.

Estimators of Linear Regression Model and Prediction under Some Assumptions Violation

The development of many estimators of parameters of linear regression model is traceable to non-validity of the assumptions under which the model is formulated, especially when applied to real life situation. This notwithstanding, regression analysis may aim at prediction. Consequently, this paper examines the performances of the Ordinary Least Square (OLS) estimator, Cochrane-Orcutt (COR) estimator, Maximum Likelihood (ML) estimator and the estimators based on Principal Component (PC) analysis in prediction of linear regression model under the joint violations of the assumption of non-stochastic regressors, independent regressors and error terms. With correlated stochastic normal variables as regressors and autocorrelated error terms, Monte-Carlo experiments were conducted and the study further identifies the best estimator that can be used for prediction purpose by adopting the goodness of fit statistics of the estimators. From the results, it is observed that the performances of COR at each level of correlation (multicollinearity) and that of ML, especially when the sample size is large, over the levels of autocorrelation have a convex-like pattern while that of OLS and PC are concave-like. Also, as the levels of multicollinearity increase, the estimators, except the PC estimators when multicollinearity is negative, rapidly perform better over the levels autocorrelation. The COR and ML estimators are generally best for prediction in the presence of multicollinearity and autocorrelated error terms. However, at low levels of autocorrelation, the OLS estimator is either best or competes consistently with the best estimator, while the PC estimator is either best or competes with the best when multicollinearity level is high(λ>0.8 or λ-0.49).

The M-estimate of Local Linear Regression with Variable Window Breadth

In this paper, by using the Brouwer fixed point theorem, we consider the existence and uniqueness of the solution for local linear regression with variable window breadth.

A Hybrid Model for Improving Software Cost Estimation in Global Software Development

Accurate software cost estimation in Global Software Development(GSD)remains challenging due to reliance on historical data and expert judgments.Traditional models,such as the Constructive Cost Model(COCOMO II),rely heavily on historical and accurate data.In addition,expert judgment is required to set many input parameters,which can introduce subjectivity and variability in the estimation process.Consequently,there is a need to improve the current GSD models to mitigate reliance on historical data,subjectivity in expert judgment,inadequate consideration of GSD-based cost drivers and limited integration of modern technologies with cost overruns.This study introduces a novel hybrid model that synergizes the COCOMO II with Artificial Neural Networks(ANN)to address these challenges.The proposed hybrid model integrates additional GSD-based cost drivers identified through a systematic literature review and further vetted by industry experts.This article compares the effectiveness of the proposedmodelwith state-of-the-artmachine learning-basedmodels for software cost estimation.Evaluating the NASA 93 dataset by adopting twenty-six GSD-based cost drivers reveals that our hybrid model achieves superior accuracy,outperforming existing state-of-the-artmodels.The findings indicate the potential of combining COCOMO II,ANN,and additional GSD-based cost drivers to transform cost estimation in GSD.

Statistical Analysis of Fuzzy Linear Regression Model Based on Centroid Method

This paper transforms fuzzy number into clear number using the centroid method, thus we can research the traditional linear regression model which is transformed from the fuzzy linear regression model. The model’s input and output are fuzzy numbers, and the regression coefficients are clear numbers. This paper considers the parameter estimation and impact analysis based on data deletion. Through the study of example and comparison with other models, it can be concluded that the model in this paper is applied easily and better.

Simple Linear Regression Model for Hidden/Hard-to-Reach/Elusive Populations

Estimation methods have over the years been a problem for Statistician especially in sectors that have to do with Hidden/Hard-to-Reach population. In this paper, a regression model was derived for Elusive/Hard-to-Reach/Hidden populations. This was achieved by modelling the Multiplicity Estimator given by Birnbaum and Sirken (1965) into a regression model. The paper also gave the least-squares estimation of the unknown parameters β0 and β1, and σ2.

Linear Maximum Likelihood Regression Analysis for Untransformed Log-Normally Distributed Data

Medical research data are often skewed and heteroscedastic. It has therefore become practice to log-transform data in regression analysis, in order to stabilize the variance. Regression analysis on log-transformed data estimates the relative effect, whereas it is often the absolute effect of a predictor that is of interest. We propose a maximum likelihood (ML)-based approach to estimate a linear regression model on log-normal, heteroscedastic data. The new method was evaluated with a large simulation study. Log-normal observations were generated according to the simulation models and parameters were estimated using the new ML method, ordinary least-squares regression (LS) and weighed least-squares regression (WLS). All three methods produced unbiased estimates of parameters and expected response, and ML and WLS yielded smaller standard errors than LS. The approximate normality of the Wald statistic, used for tests of the ML estimates, in most situations produced correct type I error risk. Only ML and WLS produced correct confidence intervals for the estimated expected value. ML had the highest power for tests regarding β1.

Linear Regression Analysis for Symbolic Interval Data

In the network technology era, the collected data are growing more and more complex, and become larger than before. In this article, we focus on estimates of the linear regression parameters for symbolic interval data. We propose two approaches to estimate regression parameters for symbolic interval data under two different data models and compare our proposed approaches with the existing methods via simulations. Finally, we analyze two real datasets with the proposed methods for illustrations.

On Diagnostics in Stochastic Restricted Linear Regression Models

The aim of this paper is to propose some diagnostic methods in stochastic restricted linear regression models. A review of stochastic restricted linear regression models is given. For the model, this paper studies the method and application of the diagnostic mostly. Firstly, review the estimators of this model. Secondly, show that the case deletion model is equivalent to the mean shift outlier model for diagnostic purpose. Then, some diagnostic statistics are given. At last, example is given to illustrate our results.

NOTE OF ADMISSIBILITY IN LINEAR ESTIMATION

１ＩＮＴＲＯＤＵＣＴＩＯＮＡｍｏｄｅｌｉｓｇｉｖｅｎａｓｆｏｌｏｗｓＹｎｘｍ＝ＸＢｐｘｍ＋ε；Ｂε～ΝＡΘ０，Σ△（１）ｗｈｅｒｅＹｉｓａｍａｔｒｉｘｏｆｏｂｓｅｒｖａｔｉｏｎｓ．Ｂεｈａｓａｍａｔｒｉｘｍｏｒｍａｌｄｉｓｔｒｉｂｕｔｉｏｎｗｉｔｈ...

Parameter Estimation of Time-Varying ARMA Model

The auto-regressive moving-average (ARMA) model with time-varying parameters is analyzed. The time-varying parameters are assumed to be a linear combination of a set of basis time-varying functions, and the feedback linear estimation algorithm is used to estimate the time-varying parameters of the ARMA model. This algorithm includes 2 linear least squares estimations and a linear filter. The influence of the order of basis time-(varying) functions on parameters estimation is analyzed. The method has the advantage of simple, saving computation time and storage space. Theoretical analysis and experimental results show the validity of this method.

The EM algorithm for ML Estimators under nonlinear inequalities restrictions on the parameters

One of the most powerful algorithms for obtaining maximum likelihood estimates for many incomplete-data problems is the EM algorithm.However,when the parameters satisfy a set of nonlinear restrictions,It is difficult to apply the EM algorithm directly.In this paper,we propose an asymptotic maximum likelihood estimation procedure under a set of nonlinear inequalities restrictions on the parameters,in which the EM algorithm can be used.Essentially this kind of estimation problem is a stochastic optimization problem in the M-step.We make use of methods in stochastic optimization to overcome the difficulty caused by nonlinearity in the given constraints.

City Routing Velocity Estimation Model under theEnvironment of Lack of Floating Car Data

After introducing the principle of float car data (FCD), this paper gives the primary flow of pre-handing and map- matching of the FCD. After analyzing the percentage of coverage of FCD on the road network, large quantity of heritage database of routing status is used to estimate the routing velocity when lack of FCD on parts road segments. Multi liner regression model is then put forwarded by considering the spatial correlativity among the road network, and some model parameters are deduced when time series is classified in day and week. Besides, error of velocity probability and error of status probability are achieved based on the result from field testing while the feasibility and reliability of the velocity estimation model is obtained as well. Finally, as a case study in Shanghai center area, the whole routing velocity in the road network is estimated and published in real time.

The Consistency of LSE Estimators in Partial Linear Regression Models under Mixing Random Errors

In this paper,we consider the partial linear regression model y_(i)=x_(i)β^(*)+g(ti)+ε_(i),i=1,2,...,n,where(x_(i),ti)are known fixed design points,g(·)is an unknown function,andβ^(*)is an unknown parameter to be estimated,random errorsε_(i)are(α,β)-mix_(i)ng random variables.The p-th(p>1)mean consistency,strong consistency and complete consistency for least squares estimators ofβ^(*)and g(·)are investigated under some mild conditions.In addition,a numerical simulation is carried out to study the finite sample performance of the theoretical results.Finally,a real data analysis is provided to further verify the effect of the model.