Resolution performance analysis of cumulants-based rank reduction estimator in presence of unexpected modeling errors

Compared to the rank reduction estimator （RARE） based on second-order statistics （called SOS-RARE）, the RARE employing fourth-order cumulants （referred to as FOC-RARE） is capable of dealing with more sources and mitigating the negative influences of the Gaussian colored noise. However, in the presence of unexpected modeling errors, the resolution behavior of the FOC-RARE also deteriorate significantly as SOS-RARE, even for a known array covariance matrix. For this reason, the angle resolution capability of the FOC-RARE was theoretically analyzed. Firstly, the explicit formula for the mathematical expectation of the FOC-RARE spatial spectrum was derived through the second-order perturbation analysis method. Then, with the assumption that the unexpected modeling errors were drawn from complex circular Gaussian distribution, the theoretical formulas for the angle resolution probability of the FOC-RARE were presented. Numerical experiments validate our analytical results and demonstrate that the FOC-RARE has higher robustness to the unexpected modeling en＇ors than that of the SOS-RARE from the resolution point of view.

Performance of cumulant-based rank reduction estimator in presence of unexpected modeling errors

Compared with the rank reduction estimator(RARE) based on second-order statistics(called SOS-RARE), the RARE based on fourth-order cumulants(referred to as FOC-RARE) can handle more sources and restrain the negative impacts of the Gaussian colored noise. However, the unexpected modeling errors appearing in practice are known to significantly degrade the performance of the RARE. Therefore, the direction-of-arrival(DOA) estimation performance of the FOC-RARE is quantitatively derived. The explicit expression for direction-finding(DF) error is derived via the first-order perturbation analysis, and then the theoretical formula for the mean square error(MSE) is given. Simulation results demonstrate the validation of the theoretical analysis and reveal that the FOC-RARE is more robust to the unexpected modeling errors than the SOS-RARE.