Quasi-Maximum Likelihood Estimators in Generalized Linear Models with Autoregressive Processes

The paper studies a generalized linear model（GLM）yt = h（xt^T β） ＋ εt,t = l,2,...,n,where ε1 = η1,ε1 =ρεt ＋ηt,t = 2,3,...;n,h is a continuous differentiable function,ηt＇s are independent and identically distributed random errors with zero mean and finite variance σ^2.Firstly,the quasi-maximum likelihood（QML） estimators of β,p and σ^2 are given.Secondly,under mild conditions,the asymptotic properties（including the existence,weak consistency and asymptotic distribution） of the QML estimators are investigated.Lastly,the validity of method is illuminated by a simulation example.

AN EXPONENTIAL INEQUALITY FOR AUTOREGRESSIVE PROCESSES IN ADAPTIVE TRACKING

A wide range of literature concerning classical asymptotic properties for linear models with adaptive control is available, such as strong laws of large numbers or central limit theorems. Unfortunately, in contrast with the situation without control, it appears to be impossible to find sharp asymptotic or nonasymptotic properties such as large deviation principles or exponential inequalities. Our purpose is to provide a first step towards that direction by proving a very simple exponential inequality for the standard least squares estimator of the unknown parameter of Gaussian autoregressive process in adaptive tracking.

Bull and Bear Dynamics of the Nigeria Stock Returns Transitory via Mingled Autoregressive Random Processes

This paper expounds the nitty-gritty of stock returns transitory, periodical behavior of its markets’ demands and cyclical-like tenure-changing of number of the stocks sold. Mingling of autoregressive random processes via Poisson and Extreme-Value-Distributions (Fréchet, Gumbel, and Weibull) error terms were designed, generalized and imitated to capture stylized traits of k-serial tenures (ability to handle cycles), Markov transitional mixing weights, switching of mingling autoregressive processes and full range shape changing predictive distributions (multimodalities) that are usually caused by large fluctuations (outliers) and long-memory in stock returns. The Poisson and Extreme-Value-Distributions Mingled Autoregressive (PMA and EVDs) models were applied to a monthly number of stocks sold in Nigeria from 1960 to 2020. It was deduced that fitted Gumbel-MAR (2:1, 1) outstripped other linear models as well as best fitted among the Poisson and Extreme-Value-Distributions Mingled autoregressive models subjected to the discrete monthly stocks sold series.

A New Modified EWMA Control Chart for Monitoring Processes Involving Autocorrelated Data

Control charts are one of the tools in statistical process control widely used for monitoring,measuring,controlling,improving the quality,and detecting problems in processes in variousfields.The average run length(ARL)can be used to determine the efficacy of a control chart.In this study,we develop a new modified exponentially weighted moving average(EWMA)control chart and derive explicit formulas for both one and the two-sided ARLs for a p-order autoregressive(AR(p))process with exponential white noise on the new modified EWMA control chart.The accuracy of the explicit formulas was compared to that of the well-known numerical integral equation(NIE)method.Although both methods were highly consistent with an absolute percentage difference of less than 0.00001%,the ARL using the explicit formulas method could be computed much more quickly.Moreover,the performance of the explicit formulas for the ARL on the new modified EWMA control chart was better than on the modified and standard EWMA control charts based on the relative mean index(RMI).In addition,to illustrate the applicability of using the proposed explicit formulas for the ARL on the new modified EWMA control chart in practice,the explicit formulas for the ARL were also applied to a process with real data from the energy and agriculturalfields.

Efficiency of Some Estimators for a Generalized Poisson Autoregressive Process of Order 1

Various models have been proposed in the literature to study non-negative integer-valued time series. In this paper, we study estimators for the generalized Poisson autoregressive process of order 1, a model developed by Alzaid and Al-Osh [1]. We compare three estimation methods, the methods of moments, quasi-likelihood and conditional maximum likelihood and study their asymptotic properties. To compare the bias of the estimators in small samples, we perform a simulation study for various parameter values. Using the theory of estimating equations, we obtain expressions for the variance-covariance matrices of those three estimators, and we compare their asymptotic efficiency. Finally, we apply the methods derived in the paper to a real time series.

Explicit bivariate rate functions for large deviations in AR(1)and MA(1)processes with Gaussian innovations

We investigate the large deviations properties for centered stationary AR(1)and MA(1)processes with independent Gaussian innovations,by giving the explicit bivariate rate functions for the sequence of two-dimensional random vectors.Via the Contraction Principle,we provide the explicit rate functions for the sample mean and the sample second moment.In the AR(1)case,we also give the explicit rate function for the sequence of two-dimensional random vectors(W_(n))n≥2=(n^(-1(∑_(k=1)^(n)X_(k),∑_(k=1)^(n)X_(k)^(2))))_(n∈N)n≥2,but we obtain an analytic rate function that gives different values for the upper and lower bounds,depending on the evaluated set and its intersection with the respective set of exposed points.A careful analysis of the properties of a certain family of Toeplitz matrices is necessary.The large deviations properties of three particular sequences of one-dimensional random variables will follow after we show how to apply a weaker version of the Contraction Principle for our setting,providing new proofs for two already known results on the explicit deviation function for the sample second moment and Yule-Walker estimators.We exhibit the properties of the large deviations of the first-order empirical autocovariance,its explicit deviation function and this is also a new result.

Bayesian autoregressive adaptive refined descriptive sampling algorithm in the Monte Carlo

This paper deals with the Monte Carlo Simulation in a Bayesian framework.It shows the impor-tance of the use of Monte Carlo experiments through refined descriptive sampling within the autoregressive model Xt=ρXt-1+Yt,where 0<ρ<1 and the errors Yt are independent ran-dom variables following an exponential distribution of parameterθ.To achieve this,a Bayesian Autoregressive Adaptive Refined Descriptive Sampling(B2ARDS)algorithm is proposed to esti-mate the parametersρandθof such a model by a Bayesian method.We have used the same prior as the one already used by some authors,and computed their properties when the Nor-mality error assumption is released to an exponential distribution.The results show that B2ARDS algorithm provides accurate and efficient point estimates.

Model Averaging Multistep Prediction in an Infinite Order Autoregressive Process

The key issue in the frequentist model averaging is the choice of weights.In this paper,the authors advocate an asymptotic framework of mean-squared prediction error(MSPE)and develop a model averaging criterion for multistep prediction in an infinite order autoregressive(AR(∞))process.Under the assumption that the order of the candidate model is bounded,this criterion is proved to be asymptotically optimal,in the sense of achieving the lowest out of sample MSPE for the samerealization prediction.Simulations and real data analysis further demonstrate the effectiveness and the efficiency of the theoretical results.

A LIL for independent non-identically distributed random variables in Banach space and its applications

In this paper,we prove a general law of the iterated logarithm (LIL) for independent non-identically distributed B-valued random variables.As an interesting application,we obtain the law of the iterated logarithm for the empirical covariance of Hilbertian autoregressive processes.

Berry-Esseen Bounds for Self-Normalized Martingales

A Berry–Esseen bound is obtained for self-normalized martingales under the assumption of finite moments.The bound coincides with the classical Berry–Esseenboundforstandardizedmartingales.Anexampleisgiventoshowtheoptimality of the bound.Applications to Student’s statistic and autoregressive process are also discussed.

Convergence of Recursive Identification for ARMAX Process with Increasing Variances

The autoregressive moving average exogenous （ARMAX） model is commonly adopted for describing linear stochastic systems driven by colored noise. The model is a finite mixture with the ARMA component and external inputs. In this paper we focus on a parameter estimate of the ARMAX model. Classical modeling methods are usually based on the assumption that the driven noise in the moving average （MA） part has bounded variances, while in the model considered here the variances of noise may increase by a power of log n. The plant parameters are identified by the recursive stochastic gradient algorithm. The diminishing excitation technique and some results of martingale difference theory are adopted in order to prove the convergence of the identification. Finally, some simulations are given to show the reliability of the theoretical results.

Greedy nonlinear autoregression for multifidelity computer models at different scales

Although the popular multi-fidelity surrogate models,stochastic collocation and nonlinear autoregression have been applied successfully to multiple benchmark problems in different areas of science and engineering,they have certain limitations.We propose a uniform Bayesian framework that connects these two methods allowing us to combine the strengths of both.To this end,we introduce Greedy-NAR,a nonlinear Bayesian autoregressive model that can handle complex between-fidelity correlations and involves a sequential construction that allows for significant improvements in performance given a limited computational budget.The proposed enhanced nonlinear autoregressive method is applied to three benchmark problems that are typical of energy applications,namely molecular dynamics and computational fluid dynamics.The results indicate an increase in both prediction stability and accuracy when compared to those of the standard multi-fidelity autoregression implementations.The results also reveal the advantages over the stochastic collocation approach in terms of accuracy and computational cost.Generally speaking,the proposed enhancement provides a straightforward and easily implemented approach for boosting the accuracy and efficiency of concatenated structure multi-fidelity simulation methods,e.g.,the nonlinear autoregressive model,with a negligible additional computational cost.