Optimal Estimation of High-Dimensional Covariance Matrices with Missing and Noisy Data

The estimation of covariance matrices is very important in many fields, such as statistics. In real applications, data are frequently influenced by high dimensions and noise. However, most relevant studies are based on complete data. This paper studies the optimal estimation of high-dimensional covariance matrices based on missing and noisy sample under the norm. First, the model with sub-Gaussian additive noise is presented. The generalized sample covariance is then modified to define a hard thresholding estimator , and the minimax upper bound is derived. After that, the minimax lower bound is derived, and it is concluded that the estimator presented in this article is rate-optimal. Finally, numerical simulation analysis is performed. The result shows that for missing samples with sub-Gaussian noise, if the true covariance matrix is sparse, the hard thresholding estimator outperforms the traditional estimate method.

Data-Based Filters for Non-Gaussian Dynamic Systems With Unknown Output Noise Covariance

This paper proposes linear and nonlinear filters for a non-Gaussian dynamic system with an unknown nominal covariance of the output noise.The challenge of designing a suitable filter in the presence of an unknown covariance matrix is addressed by focusing on the output data set of the system.Considering that data generated from a Gaussian distribution exhibit ellipsoidal scattering,we first propose the weighted sum of norms(SON)clustering method that prioritizes nearby points,reduces distant point influence,and lowers computational cost.Then,by introducing the weighted maximum likelihood,we propose a semi-definite program(SDP)to detect outliers and reduce their impacts on each cluster.Detecting these weights paves the way to obtain an appropriate covariance of the output noise.Next,two filtering approaches are presented:a cluster-based robust linear filter using the maximum a posterior(MAP)estimation and a clusterbased robust nonlinear filter assuming that output noise distribution stems from some Gaussian noise resources according to the ellipsoidal clusters.At last,simulation results demonstrate the effectiveness of our proposed filtering approaches.

THEORETIC RESEARCH ON ROBUSTIFIED LEAST SQUARES ESTIMATOR BASED ON EQUIVALENT VARIANCE-COVARIANCE

Depending on analyzing the abuse of equivalent weights,a set of self-contained theory system on robust estimation based on equivalent variance-covariance is established,which includes ρ function, φ function,equivalent variance-covariance function,influence function and breakdown point.And an example is given to verify that the robust models proposed in this paper are reliable and correct.

Underdetermined DOA estimation via multiple time-delay covariance matrices and deep residual network

Higher-order statistics based approaches and signal sparseness based approaches have emerged in recent decades to resolve the underdetermined direction-of-arrival(DOA)estimation problem.These model-based methods face great challenges in practical applications due to high computational complexity and dependence on ideal assumptions.This paper presents an effective DOA estimation approach based on a deep residual network(DRN)for the underdetermined case.We first extract an input feature from a new matrix calculated by stacking several covariance matrices corresponding to different time delays.We then provide the input feature to the trained DRN to construct the super resolution spectrum.The DRN learns the mapping relationship between the input feature and the spatial spectrum by training.The proposed approach is superior to existing model-based estimation methods in terms of calculation efficiency,independence of source sparseness and adaptive capacity to non-ideal conditions(e.g.,low signal to noise ratio,short bit sequence).Simulations demonstrate the validity and strong performance of the proposed algorithm on both overdetermined and underdetermined cases.

Application of an Error Statistics Estimation Method to the PSAS Forecast Error Covariance Model

In atmospheric data assimilation systems, the forecast error covariance model is an important component. However, the paralneters required by a forecast error covariance model are difficult to obtain due to the absence of the truth. This study applies an error statistics estimation method to the Pfiysical-space Statistical Analysis System （PSAS） height-wind forecast error covariance model. This method consists of two components： the first component computes the error statistics by using the National Meteorological Center （NMC） method, which is a lagged-forecast difference approach, within the framework of the PSAS height-wind forecast error covariance model; the second obtains a calibration formula to rescale the error standard deviations provided by the NMC method. The calibration is against the error statistics estimated by using a maximum-likelihood estimation （MLE） with rawindsonde height observed-minus-forecast residuals. A complete set of formulas for estimating the error statistics and for the calibration is applied to a one-month-long dataset generated by a general circulation model of the Global Model and Assimilation Office （GMAO）, NASA. There is a clear constant relationship between the error statistics estimates of the NMC-method and MLE. The final product provides a full set of 6-hour error statistics required by the PSAS height-wind forecast error covariance model over the globe. The features of these error statistics are examined and discussed.

On convergence of covariance matrix of empirical Bayes hyper-parameter estimator

Regularized system identification has become the research frontier of system identification in the past decade.One related core subject is to study the convergence properties of various hyper-parameter estimators as the sample size goes to infinity.In this paper,we consider one commonly used hyper-parameter estimator,the empirical Bayes(EB).Its convergence in distribution has been studied,and the explicit expression of the covariance matrix of its limiting distribution has been given.However,what we are truly interested in are factors contained in the covariance matrix of the EB hyper-parameter estimator,and then,the convergence of its covariance matrix to that of its limiting distribution is required.In general,the convergence in distribution of a sequence of random variables does not necessarily guarantee the convergence of its covariance matrix.Thus,the derivation of such convergence is a necessary complement to our theoretical analysis about factors that influence the convergence properties of the EB hyper-parameter estimator.In this paper,we consider the regularized finite impulse response(FIR)model estimation with deterministic inputs,and show that the covariance matrix of the EB hyper-parameter estimator converges to that of its limiting distribution.Moreover,we run numerical simulations to demonstrate the efficacy of ourtheoretical results.

Novel Spatially Adaptive Image Denoising Algorithm Based on Covariance Estimation in Wavelet Domain

A new method for image denoising is proposed. By analyzing image's statistical properties in wavelet domain, it is shown that the natural image has a strong and spatial variable covariance structure relationship in local space of sub-band. A non-direct estimation method is suggested to make an adaptive estimate of spatial variable covariance by estimating the correlation coefficient and variance of subband image separately. It can be used to estimate adaptive filtering of subband image. The experiment shows that this method can improve the image's SNR, and has strong ability to preserve edges.

IMPROVED ESTIMATES OF THE COVARIANCE MATRIX IN GENERAL LINEAR MIXED MODELS

In this article, the problem of estimating the covariance matrix in general linear mixed models is considered. Two new classes of estimators obtained by shrinking the eigenvalues towards the origin and the arithmetic mean, respectively, are proposed. It is shown that these new estimators dominate the unbiased estimator under the squared error loss function. Finally, some simulation results to compare the performance of the proposed estimators with that of the unbiased estimator are reported. The simulation results indicate that these new shrinkage estimators provide a substantial improvement in risk under most situations.

Two Stage Estimation and Its Covariance Matrix in Multivariate Seemingly Unrelated Regression System

Multivariate 看起来无关的回归系统首先被提起，二个阶段评价和它的协变性矩阵被给。文学的结果[1-5 ] 在这份报纸被扩大。

THE ESTIMATION OF VARIANCE AND COVARIANCE COMPONENTS FOR GPS BASELINE NETWORK BY MINQUE METHOD

This paper studies the estimation of variance and covariance compo-nents for GPS baseline network by MINQUE method.The fundamental rule forselecting variance-covariance model has been presented,and the alternative algo-rithm which simultaneouly estimates fixed variance components and scalled vari-ance components of the distance,azimuth and geodetic height difference for a GPSbaseline vector has been developed.

Using Analysis State to Construct a Forecast Error Covariance Matrix in Ensemble Kalman Filter Assimilation

Correctly estimating the forecast error covariance matrix is a key step in any data assimilation scheme. If it is not correctly estimated, the assimilated states could be far from the true states. A popular method to address this problem is error covariance matrix inflation. That is, to multiply the forecast error covariance matrix by an appropriate factor. In this paper, analysis states are used to construct the forecast error covariance matrix and an adaptive estimation procedure associated with the error covariance matrix inflation technique is developed. The proposed assimilation scheme was tested on the Lorenz-96 model and 2D Shallow Water Equation model, both of which are associated with spatially correlated observational systems. The experiments showed that by introducing the proposed structure of the forecast error eovariance matrix and applying its adaptive estimation procedure, the assimilation results were further improved.

Saliency detection of infrared image based on region covariance and global feature

In order to better represent infrared target features under different environments, a saliency detection method based on region covariance and global feature is proposed. Firstly, the region covariance features on different scale spaces and different image regions are extracted and transformed into sigma features,then combined with central position feature, the local salient map is generated. Next, a global salient map is generated by gray contrast and density estimation. Finally, the saliency detection result of infrared images is obtained by fusing the local and global salient maps. The experimental results show that the salient map of the proposed method has complete target features and obvious edges,and the proposed method is better than the state of art method both qualitatively and quantitatively.

Expectation-maximization (EM) Algorithm Based on IMM Filtering with Adaptive Noise Covariance

A novel method under the interactive multiple model (IMM) filtering framework is presented in this paper, in which the expectation-maximization (EM) algorithm is used to identify the process noise covariance Q online. For the existing IMM filtering theory, the matrix Q is determined by means of design experience, but Q is actually changed with the state of the maneuvering target. Meanwhile it is severely influenced by the environment around the target, i.e., it is a variable of time. Therefore, the experiential covariance Q can not represent the influence of state noise in the maneuvering process exactly. Firstly, it is assumed that the evolved state and the initial conditions of the system can be modeled by using Gaussian distribution, although the dynamic system is of a nonlinear measurement equation, and furthermore the EM algorithm based on IMM filtering with the Q identification online is proposed. Secondly, the truncated error analysis is performed. Finally, the Monte Carlo simulation results are given to show that the proposed algorithm outperforms the existing algorithms and the tracking precision for the maneuvering targets is improved efficiently.

NONPARAMETRIC SPECTRAL ESTIMATORS FORSECOND-ORDER (ALMOST) CYCLOSTATIONARYCOMPLEX PROCESSES

Second-order almost cycloststionary complex processes are complex random signals with almost periodically time-varying statistics. Smoothed periodograms are proposed for related to cyclic spectral estimation and are shown to be consistent. Asymptotic covariance expressions are derived along with their computable forms.

A Modified Regression Estimator for Single Phase Sampling in the Presence of Observational Errors

In this paper, a regression method of estimation has been used to derive the mean estimate of the survey variable using simple random sampling without replacement in the presence of observational errors. Two covariates were used and a case where the observational errors were in both the survey variable and the covariates was considered. The inclusion of observational errors was due to the fact that data collected through surveys are often not free from errors that occur during observation. These errors can occur due to over-reporting, under-reporting, memory failure by the respondents or use of imprecise tools of data collection. The expression of mean squared error (MSE) based on the obtained estimator has been derived to the first degree of approximation. The results of a simulation study show that the derived modified regression mean estimator under observational errors is more efficient than the mean per unit estimator and some other existing estimators. The proposed estimator can therefore be used in estimating a finite population mean, while considering observational errors that may occur during a study.

分布式散射体相位估计奇异值分解法

常规的分布式散射体(DS)相位估计方法需要生成全组合干涉对以构建样本协方差矩阵(SCM),然后根据SCM的统计特性估计DS相位,这一过程不但计算耗时,而且占据大量存储空间。本文提出了一种基于奇异值分解技术的DS相位快速估计方法(SVDI)。该方法分析的对象是单主影像干涉对组成的干涉相位矩阵而非全组合干涉对组成的SCM,因而可以有效提高计算效率、节省存储空间。并且,理论上证明了在一定条件下SVDI的结果与常规的特征值分解方法(EVD)是一致的。模拟数据和真实SAR数据的结果表明,SVDI算法有更高的计算效率,并且其相位估计精度以及形变解算精度与常规算法是一致的。

基于二次分数低阶协方差的时延估计方法

针对强脉冲噪声背景下基于分数低阶统计量时延估计方法性能退化且需要噪声先验知识的问题,提出了一种基于二次分数低阶协方差的时延估计新方法。所提方法首先利用有界非线性Sigmoid函数对含有脉冲噪声的信号进行预处理,使其在不影响有用信号时延信息的基础上对附加脉冲噪声进行充分压缩;然后对处理后的收发信号进行二次分数低阶协方差运算,即求得发射信号的自分数低阶协方差和收发信号的互分数低阶协方差之后,再次计算二者的互分数低阶协方差,以期更大程度上抑制脉冲噪声的影响。通过模拟仿真实验对所提方法进行了有效性验证,结果表明所提方法突破了分数低阶矩阶次需小于Alpha稳定分布噪声特征指数的限制,并且比分数低阶协方差方法具有更高的估计精度。仿真实验结果表明在广义信噪比-10 dB情况下,时延估计用时为0.0560 s,准确率达到97.76%。

纵向多分类数据的广义估计方程分析

广义估计方程(GEE)是分析纵向数据的常用方法.如果响应变量的维数是一,XIE和YANG(2003)及WANG(2011)分别研究了协变量维数是固定的和协变量维数趋于无穷时,GEE估计的渐近性质.本文研究纵向多分类数据(multicategorical data)的GEE建模和GEE估计的渐近性质.当数据的分类数大于二时,响应变量的维数大于一,所以推广了文献的相关结果.

基于小快拍场景的联合校正稳健波束形成算法

针对传统的自适应波束形成算法在目标导向矢量失配及接收数据的协方差矩阵存在误差时,性能急剧下降的问题,提出了一种基于小快拍场景的联合协方差矩阵重构,及导向矢量优化的稳健波束形成算法。对不确定集约束求解得到干扰导向矢量,根据稀疏干扰来向的导向矢量近似正交,求出干扰导向矢量对应的干扰功率,从而完成协方差矩阵重构;对期望信号来向及其邻域进行权值求解,对加权后的数据特征分解,利用多信号分类(Multiple Signal Classification, MUSIC)谱估计算法对信号区域积分得到信号协方差矩阵,将其主特征值近似为期望信号的导向矢量完成重新估计。仿真结果表明,在无误差时,算法输出信干噪比(Signal to Interference Plus Noise Ratio, SINR)接近理论最优;在多种误差环境下输出性能随信噪比(Signal to Noise Ratio, SNR)的变化均具有较好的稳健性,并且在信号来向可精准形成波束;在小快拍时可以较快收敛至理论最优值。

无误差阵列协方差矩阵分离的阵列自校正方法

针对高分辨方位估计方法受阵列幅度相位影响导致性能退化的问题,提出一种无误差阵列协方差矩阵分离的阵列自校正方法。该方法利用协方差矩阵重构方法获取近似无误差阵列的协方差矩阵,以弱化协方差矩阵中的阵列误差,并利用特征结构配置方法求解幅度和相位误差。迭代上述重构方法和特征结构配置方法,实现从未校正阵列的协方差矩阵中分离出无误差阵列的协方差矩阵和幅度相位误差矩阵。仿真结果表明,该方法准确地估计阵列误差,利用重构协方差矩阵进行方位估计能够提高方位估计精度和分辨力。湖试试验结果表明,经阵列校正后,空间中方位角度邻近的声源和干扰目标可被分辨。