Convergence Diagnostics for Gibbs Sampler via Maximum Likelihood Estimation

A diagnostic procedure based on maximum likelihood estimation, to study the convergence of the Markov chain produced by Gibbs sampler, is presented. The unbiasedness, consistent and asymptotic normality are considered for the estimation of the parameters produced by the procedure. An example is provided to illustrate the procedure, and the numerical result is consistent with the theoretical one.

Joint polarization and DOA estimation based on improved maximum likelihood estimator and performance analysis for conformal array

The conformal array can make full use of the aperture,save space,meet the requirements of aerodynamics,and is sensitive to polarization information.It has broad application prospects in military,aerospace,and communication fields.The joint polarization and direction-of-arrival(DOA)estimation based on the conformal array and the theoretical analysis of its parameter estimation performance are the key factors to promote the engineering application of the conformal array.To solve these problems,this paper establishes the wave field signal model of the conformal array.Then,for the case of a single target,the cost function of the maximum likelihood(ML)estimator is rewritten with Rayleigh quotient from a problem of maximizing the ratio of quadratic forms into those of minimizing quadratic forms.On this basis,rapid parameter estimation is achieved with the idea of manifold separation technology(MST).Compared with the modified variable projection(MVP)algorithm,it reduces the computational complexity and improves the parameter estimation performance.Meanwhile,the MST is used to solve the partial derivative of the steering vector.Then,the theoretical performance of ML,the multiple signal classification(MUSIC)estimator and Cramer-Rao bound(CRB)based on the conformal array are derived respectively,which provides theoretical foundation for the engineering application of the conformal array.Finally,the simulation experiment verifies the effectiveness of the proposed method.

Life prediction for vacuum fluorescent display using maximum likelihood estimation

In order to obtain the life information of the vacuum fluorescent display （VFD） in a short time, a model of constant stress accelerated life tests （CSALT） is established with its filament temperature increased, and four constant stress tests are conducted. The Weibull function is applied to describe the life distribution of the VFD, and the maximum likelihood estimation （MLE） and its iterative flow chart are used to calculate the shape parameters and the scale parameters. Furthermore, the accelerated life equation is determined by the least square method, the Kolmogorov-Smirnov test is performed to verify whether the VFD life meets the Weibull distribution or not, and selfdeveloped software is employed to predict the average life and the reliable life. Statistical data analysis results demonstrate that the test plans are feasible and versatile, that the VFD life follows the Weibull distribution, and that the VFD accelerated model satisfies the linear Arrhenius equation. The proposed method and the estimated life information of the VFD can provide some significant guideline to its manufacturers and customers.

Fast method for spreading sequence estimation of DSSS signal based on maximum likelihood function

To estimate the spreading sequence of the direct sequence spread spectrum (DSSS) signal, a fast algorithm based on maximum likelihood function is proposed, and the theoretical derivation of the algorithm is provided. By simplifying the objective function of maximum likelihood estimation, the algorithm can realize sequence synchronization and sequence estimation via adaptive iteration and sliding window. Since it avoids the correlation matrix computation, the algorithm significantly reduces the storage requirement and the computation complexity. Simulations show that it is a fast convergent algorithm, and can perform well in low signal to noise ratio (SNR).

Heuristic techniques for maximum likelihood localization of radioactive sources via a sensor network

Maximum likelihood estimation(MLE)is an effective method for localizing radioactive sources in a given area.However,it requires an exhaustive search for parameter estimation,which is time-consuming.In this study,heuristic techniques were employed to search for radiation source parameters that provide the maximum likelihood by using a network of sensors.Hence,the time consumption of MLE would be effectively reduced.First,the radiation source was detected using the k-sigma method.Subsequently,the MLE was applied for parameter estimation using the readings and positions of the detectors that have detected the radiation source.A comparative study was performed in which the estimation accuracy and time consump-tion of the MLE were evaluated for traditional methods and heuristic techniques.The traditional MLE was performed via a grid search method using fixed and multiple resolutions.Additionally,four commonly used heuristic algorithms were applied:the firefly algorithm(FFA),particle swarm optimization(PSO),ant colony optimization(ACO),and artificial bee colony(ABC).The experiment was conducted using real data collected by the Low Scatter Irradiator facility at the Savannah River National Laboratory as part of the Intelligent Radiation Sensing System program.The comparative study showed that the estimation time was 3.27 s using fixed resolution MLE and 0.59 s using multi-resolution MLE.The time consumption for the heuristic-based MLE was 0.75,0.03,0.02,and 0.059 s for FFA,PSO,ACO,and ABC,respectively.The location estimation error was approximately 0.4 m using either the grid search-based MLE or the heuristic-based MLE.Hence,heuristic-based MLE can provide comparable estimation accuracy through a less time-consuming process than traditional MLE.

Maximum Likelihood Estimation of the Identification Parameters and Its Correction

By taking the subsequence out of the input-output sequence of a system polluted by white noise, an independent observation sequence and its probability density are obtained and then a maximum likelihood estimation of the identification parameters is given. In order to decrease the asymptotic error, a corrector of maximum likelihood (CML) estimation with its recursive algorithm is given. It has been proved that the corrector has smaller asymptotic error than the least square methods. A simulation example shows that the corrector of maximum likelihood estimation is of higher approximating precision to the true parameters than the least square methods.

MAXIMUM LIKELIHOOD ESTIMATION FOR INSAR IMAGE CO-REGISTRATION

This paper presents a closed-form robust phase correlation based algorithm for performing image registration to subpixel accuracy.The subpixel translational shift information is directly obtained from the phase of the normalized cross power spectrum by using Maximum Likelihood Estimation(MLE).The proposed algorithm also has slighter time complexity.Experimental results show that the proposed algorithm yields superior registration precision on the Cramér-Rao Bound(CRB) in the presence of aliasing and noise.

Parameters Estimation of a Bivariate Generalized Poisson Distribution with Applications to Metabolic Syndrome Data

Background: Bivariate count data are commonly encountered in medicine, biology, engineering, epidemiology and many other applications. The Poisson distribution has been the model of choice to analyze such data. In most cases mutual independence among the variables is assumed, however this fails to take into accounts the correlation between the outcomes of interests. A special bivariate form of the multivariate Lagrange family of distribution, names Generalized Bivariate Poisson Distribution, is considered in this paper. Objectives: We estimate the model parameters using the method of maximum likelihood and show that the model fits the count variables representing components of metabolic syndrome in spousal pairs. We use the likelihood local score to test the significance of the correlation between the counts. We also construct confidence interval on the ratio of the two correlated Poisson means. Methods: Based on a random sample of pairs of count data, we show that the score test of independence is locally most powerful. We also provide a formula for sample size estimation for given level of significance and given power. The confidence intervals on the ratio of correlated Poisson means are constructed using the delta method, the Fieller’s theorem, and the nonparametric bootstrap. We illustrate the methodologies on metabolic syndrome data collected from 4000 spousal pairs. Results: The bivariate Poisson model fitted the metabolic syndrome data quite satisfactorily. Moreover, the three methods of confidence interval estimation were almost identical, meaning that they have the same interval width.

Immune Clone Maximum Likelihood Estimation of Improved Non-homogeneous Poisson Process Model Parameters

Aiming at the solving problem of improved nonhomogeneous Poisson process( NHPP) model in engineering application,the immune clone maximum likelihood estimation( MLE)method for solving model parameters was proposed. The minimum negative log-likelihood function was used as the objective function to optimize instead of using iterative method to solve complex system of equations,and the problem of parameter estimation of improved NHPP model was solved by immune clone algorithm. And the interval estimation of reliability indices was given by using fisher information matrix method and delta method. An example of failure truncated data from multiple numerical control( NC) machine tools was taken to prove the method. and the results show that the algorithm has a higher convergence rate and computational accuracy, which demonstrates the feasibility of the method.

Maximum likelihood channel estimation algorithm combines logarithm likelihood ratio decoding in the coal mine application

The environment of the wireless communication system in the coal mine has unique characteristics： great noise, strong multiple path interference, and the wireless communication of orthogonal frequency division multiplexing （OFDM） in underground coal mine is sensitive to the frequency selection of multiple path fading channel, whose decoding is separated from the traditional channel estimation algorithm. In order to increase its accuracy and reliability, a new iterating channel estimation algorithm combining the logarithm likelihood ratio （LLR） decode iterate based on the maximum likelihood estimation （ML） is proposed in this paper, which estimates iteration channel in combination with LLR decode. Without estimating the channel noise power, it exchanges the information between the ML channel estimation and the LLR decode using the feedback information of LLR decode. The decoding speed is very quick, and the satisfied result will be obtained by iterating in some time. The simulation results of the shortwave broadband channel in the coal mine show that the error rate of the system is basically convergent after the iteration in two times.

Maximum Likelihood Estimation of Clock Synchronization Error in OFDM System

The performance degradation of an orthogonal frequency division multiplexing (OFDM) systems due to clock synchronization error is analyzed and a pilot-aided maximum likelihood (ML) estimating method is proposed to correct it. The proposed algorithm enables clock synchronization error estimation from a pilot whose duration is only two symbol periods. The study shows that this method is simple and exact. The clock synchronization error can be corrected almost entirely.

Maximum likelihood spectrum estimation method and its application in seismo－magnet－icrelation

Ｍａｘｉｍｕｍｌｉｋｅｌｉｈｏｏｄｓｐｅｃｔｒｕｍｅｓｔｉｍａｔｉｏｎｍｅｔｈｏｄａｎｄｉｔｓａｐｐｌｉｃａｔｉｏｎｉｎｓｅｉｓｍｏ┐ｍａｇｎｅｔ┐ｉｃｒｅｌａｔｉｏｎＸＩＡＯ－ＰＩＮＧＺＥＮＧ１）（曾小苹），ＹＵＮ－ＦＡＮＧＬＩＮ１）（林云芳），...

Blind Joint Maximum Likelihood Channel Estimation and Data Detection for SIMO Systems

A blind adaptive scheme is proposed for joint maximum likelihood （ML） channel estimation and data detection of singleinput multiple-output （SIMO） systems. The joint ML optimisation over channel and data is decomposed into an iterative optimisation loop. An efficient global optimisation algorithm called the repeated weighted boosting search is employed at the upper level to optimally identify the unknown SIMO channel model, and the Viterbi algorithm is used at the lower level to produce the maximum likelihood sequence estimation of the unknown data sequence. A simulation example is used to demonstrate the effectiveness of this joint ML optimisation scheme for blind adaptive SIMO systems.

EXACT MAXIMUM LIKELIHOOD ESTIMATOR FOR DRIFT FRACTIONAL BROWNIAN MOTION AT DISCRETE OBSERVATION

This paper deals with the problems of consistency and strong consistency of the maximum likelihood estimators of the mean and variance of the drift fractional Brownian motions observed at discrete time instants. Both the central limit theorem and the Berry-Ess′een bounds for these estimators are obtained by using the Stein’s method via Malliavin calculus.

Asymptotic properties and expectation-maximization algorithm for maximum likelihood estimates of the parameters from Weibull-Logarithmic model

In this article, we consider a lifetime distribution, the Weibull-Logarithmic distri- bution introduced by [6]. We investigate some new statistical characterizations and properties. We develop the maximum likelihood inference using EM algorithm. Asymptotic properties of the MLEs are obtained and extensive simulations are conducted to assess the performance of parameter estimation. A numerical example is used to illustrate the application.

The Maximum Likelihood Method of Aerodynamic Parameter Identification

In this paper a method of aerodynamic parameter identification of vehicle, the maximum likelihood method, is introduced. The aerodynamic model of vehicle is identified and the basic equations using maximum likelihood method are established. After that, the simulation data is identified to verify the correctness of the mathematic model and identification method. Last, the practical flight data is identified and analyzed.

Improving Accuracy of Estimating Two-Qubit States with Hedged Maximum Likelihood

As a widely used reconstruction algorithm in quantum state tomography, maximum likelihood estimation tends to assign a rank-deficient matrix, which decreases estimation accuracy for certain quantum states. Fortunately, hedged maximum likelihood estimation （HMLE） [Phys. Rev. Lett. 105 （2010）200504] was proposed to avoid this problem. Here we study more details about this proposal in the two-qubit case and further improve its performance. We ameliorate the HMLE method by updating the hedging function based on the purity of the estimated state. Both performances of HMLE and ameliorated HMLE are demonstrated by numerical simulation and experimental implementation on the Werner states of polarization-entangled photons.

Comparisons of Maximum Likelihood Estimates and Bayesian Estimates for the Discretized Discovery Process Model

A Bayesian approach using Markov chain Monte Carlo algorithms has been developed to analyze Smith’s discretized version of the discovery process model. It avoids the problems involved in the maximum likelihood method by effectively making use of the information from the prior distribution and that from the discovery sequence according to posterior probabilities. All statistical inferences about the parameters of the model and total resources can be quantified by drawing samples directly from the joint posterior distribution. In addition, statistical errors of the samples can be easily assessed and the convergence properties can be monitored during the sampling. Because the information contained in a discovery sequence is not enough to estimate all parameters, especially the number of fields, geologically justified prior information is crucial to the estimation. The Bayesian approach allows the analyst to specify his subjective estimates of the required parameters and his degree of uncertainty about the estimates in a clearly identified fashion throughout the analysis. As an example, this approach is applied to the same data of the North Sea on which Smith demonstrated his maximum likelihood method. For this case, the Bayesian approach has really improved the overly pessimistic results and downward bias of the maximum likelihood procedure.

Asymptotic Efficiency of the Maximum Likelihood Estimator for the Box-Cox Transformation Model with Heteroscedastic Disturbances

This paper considers the asymptotic efficiency of the maximum likelihood estimator (MLE) for the Box-Cox transformation model with heteroscedastic disturbances. The MLE under the normality assumption (BC MLE) is a consistent and asymptotically efficient estimator if the “small ” condition is satisfied and the number of parameters is finite. However, the BC MLE cannot be asymptotically efficient and its rate of convergence is slower than ordinal order when the number of parameters goes to infinity. Anew consistent estimator of order is proposed. One important implication of this study is that estimation methods should be carefully chosen when the model contains many parameters in actual empirical studies.

Percentiles Estimation for a Response Distribution

To estimate percentiles of a response distribution, the transformed response rule of Wetherill and Robbins-Monro sequential design were proposed under Log-Logistic model. Based on responses data, a necessary and sufficient condition for the existence of maximum likelihood estimators and then the calculating formula were presented. After a simulation study, the proposed approach was applied to 65# detonator. Numerical results showed that estimators of percentiles from the proposed approach are robust to the parametric models lacking information on the original response distribution.