A unified Minorization-Maximization approach for estimation of general mixture models

The mixed distribution model is often used to extract information from heteroge-neous data and perform modeling analysis.When the density function of mixed distribution is complicated or the variable dimension is high,it usually brings challenges to the parameter es-timation of the mixed distribution model.The application of MM algorithm can avoid complex expectation calculations,and can also solve the problem of high-dimensional optimization by decomposing the objective function.In this paper,MM algorithm is applied to the parameter estimation problem of mixed distribution model.The method of assembly and decomposition is used to construct the substitute function with separable parameters,which avoids the problems of complex expectation calculations and the inversion of high-dimensional matrices.

The improved artificial bee colony algorithm for mixed additive and multiplicative random error model and the bootstrap method for its precision estimation

To solve the complex weight matrix derivative problem when using the weighted least squares method to estimate the parameters of the mixed additive and multiplicative random error model(MAM error model),we use an improved artificial bee colony algorithm without derivative and the bootstrap method to estimate the parameters and evaluate the accuracy of MAM error model.The improved artificial bee colony algorithm can update individuals in multiple dimensions and improve the cooperation ability between individuals by constructing a new search equation based on the idea of quasi-affine transformation.The experimental results show that based on the weighted least squares criterion,the algorithm can get the results consistent with the weighted least squares method without multiple formula derivation.The parameter estimation and accuracy evaluation method based on the bootstrap method can get better parameter estimation and more reasonable accuracy information than existing methods,which provides a new idea for the theory of parameter estimation and accuracy evaluation of the MAM error model.

Improved cat swarm optimization for parameter estimation of mixed additive and multiplicative random error model

To estimate the parameters of the mixed additive and multiplicative(MAM)random error model using the weighted least squares iterative algorithm that requires derivation of the complex weight array,we introduce a derivative-free cat swarm optimization for parameter estimation.We embed the Powell method,which uses conjugate direction acceleration and does not need to derive the objective function,into the original cat swarm optimization to accelerate its convergence speed and search accuracy.We use the ordinary least squares,weighted least squares,original cat swarm optimization,particle swarm algorithm and improved cat swarm optimization to estimate the parameters of the straight-line fitting MAM model with lower nonlinearity and the DEM MAM model with higher nonlinearity,respectively.The experimental results show that the improved cat swarm optimization has faster convergence speed,higher search accuracy,and better stability than the original cat swarm optimization and the particle swarm algorithm.At the same time,the improved cat swarm optimization can obtain results consistent with the weighted least squares method based on the objective function only while avoiding multiple complex weight array derivations.The method in this paper provides a new idea for theoretical research on parameter estimation of MAM error models.

State Estimation Moving Window Gradient Iterative Algorithm for Bilinear Systems Using the Continuous Mixed p-norm Technique

This paper studies the parameter estimation problems of the nonlinear systems described by the bilinear state space models in the presence of disturbances.A bilinear state observer is designed for deriving identification algorithms to estimate the state variables using the input-output data.Based on the bilinear state observer,a novel gradient iterative algorithm is derived for estimating the parameters of the bilinear systems by means of the continuous mixed p-norm cost function.The gain at each iterative step adapts to the data quality so that the algorithm has good robustness to the noise disturbance.Furthermore,to improve the performance of the proposed algorithm,a dynamicmoving window is designed which can update the dynamical data by removing the oldest data and adding the newestmeasurement data.A numerical example of identification of bilinear systems is presented to validate the theoretical analysis.

A Posteriori Error Estimate of Two Grid Mixed Finite Element Methods for Semilinear Elliptic Equations

In this paper, we present the a posteriori error estimate of two-grid mixed finite element methods by averaging techniques for semilinear elliptic equations. We first propose the two-grid algorithms to linearize the mixed method equations. Then, the averaging technique is used to construct the a posteriori error estimates of the two-grid mixed finite element method and theoretical analysis are given for the error estimators. Finally, we give some numerical examples to verify the reliability and efficiency of the a posteriori error estimator.

Ridge estimation iterative solution of ill-posed mixed additive and multiplicative random error model with equality constraints

The reasonable prior information between the parameters in the adjustment processing can significantly improve the precision of the parameter solution. Based on the principle of equality constraints, we establish the mixed additive and multiplicative random error model with equality constraints and derive the weighted least squares iterative solution of the model. In addition, aiming at the ill-posed problem of the coefficient matrix, we also propose the ridge estimation iterative solution of ill-posed mixed additive and multiplicative random error model with equality constraints based on the principle of ridge estimation method and derive the U-curve method to determine the ridge parameter. The experimental results show that the weighted least squares iterative solution can obtain more reasonable parameter estimation and precision information than existing solutions, verifying the feasibility of applying the equality constraints to the mixed additive and multiplicative random error model. Furthermore, the ridge estimation iterative solution can obtain more accurate parameter estimation and precision information than the weighted least squares iterative solution.

A POSTERIORI ERROR ESTIMATION OF THE NEW MIXED ELEMENT SCHEMES FOR SECOND ORDER ELLIPTIC PROBLEM ON ANISOTROPIC MESHES

This paper presents a posteriori residual error estimator for the new mixed el-ement scheme for second order elliptic problem on anisotropic meshes. The reliability and efficiency of our estimator are established without any regularity assumption on the mesh.

ROBUST ESTIMATION IN PARTIAL LINEAR MIXED MODEL FOR LONGITUDINAL DATA

In this article, robust generalized estimating equation for the analysis of partial linear mixed model for longitudinal data is used. The authors approximate the nonparametric function by a regression spline. Under some regular conditions, the asymptotic properties of the estimators are obtained. To avoid the computation of high-dimensional integral, a robust Monte Carlo Newton-Raphson algorithm is used. Some simulations are carried out to study the performance of the proposed robust estimators. In addition, the authors also study the robustness and the efficiency of the proposed estimators by simulation. Finally, two real longitudinal data sets are analyzed.

Parameter Estimation of Mixed Weibull Distributions Using Cuckoo Search

The lifetime data of products with multiple failure modes which are collected from life testing are often fitted by the mixed Weibull distributions. Since the mixed Weibull distributions contain no less than five parameters,the parameter estimation is difficult and inaccurate. In order to enhance the accuracy,a new method of parameter estimation based on Cuckoo search( CS) is proposed. An optimization model for the mixed Weibull distribution is formulated by minimizing the residual sum of squares. The optimal parameters are searched via CS algorithm. In the case study,the lifetime data come from the life testing of diesel injectors and are fitted by the twocomponent Weibull mixture. Regarding the maximum absolute error and the accumulative absolute error between estimated and observed values as the accuracy index of parameter estimation,the results of four parameter estimation methods that the graphic estimation method,the nonlinear least square method,the optimization method based on particle swarm optimization( PSO) and the proposed method are compared. The result shows that the proposed method is more efficient and more accurate than the other three methods.

Robust Variance Components Estimation in the PERG Mixed Distributions of Empirical Variances—PEROBVC Method

A mixed distribution of empirical variances, composed of two distributions the basic and contaminating ones, and referred to as PERG mixed distribution of empirical variances, is considered. In the paper a robust inverse problem solution is given, namely a (new) robust method for estimation of variances of both distributions—PEROBVC Method, as well as the estimates for the numbers of observations for both distributions and, in this way also the estimate of contamination degree.

基于新权重函数的MIX-GARCH-L模型及其应用

文章引入一种新的权重函数,并构建新的波动率模型——MIX-GARCH-L模型,新模型能够充分利用高低频数据提炼出更有价值的信息。针对新模型参数估计问题,提出MIX-GARCH-L模型的参数估计方法来分析估计量的理论性质,证明了对应的中心极限定理以及用Service-Boostrap方法模拟检验估计量的数据表现。所提模型具有以下优势:新权重函数能够更好地根据交易特征的变动来自动调整不同交易日的权重,从而使每个高频交易日所分配到的权重与未来波动率产生的冲击效果一致;能够利用同一交易过程中多种高频交易数据,信息利用更加充分,使得MIX-GARCH-L模型具有更好的预测精度和预测优势。实证结果显示:MIX-GARCH-L模型的MSPE值明显小于GARCH-RV模型和GARCH-M模型的MSPE值,说明MIX-GARCH-L模型不仅在模型预测上有更高的预测精度,而且在稳健性上的表现也更好。

Error estimates of H^1-Galerkin mixed finite element method for Schrdinger equation

An H^1-Galerkin mixed finite element method is discussed for a class of second order SchrSdinger equation. Optimal error estimates of semidiscrete schemes are derived for problems in one space dimension. At the same time, optimal error estimates are derived for fully discrete schemes. And it is showed that the H1-Galerkin mixed finite element approximations have the same rate of convergence as in the classical mixed finite element methods without requiring the LBB consistency condition.

Error Estimates for Mixed Finite Element Methods for Sobolev Equation

The purpose of this paper is to investigate the convergence of the mixed finite element method for the initial-boundary value problem for the Sobolev equation Ut-div{aut + b1 u} = f based on the Raviart-Thomas space Vh × Wh H(div; × L2(). Optimal order estimates are obtained for the approximation of u, ut, the associated velocity p and divp respectively in L(0,T;L2()), L(0,T;L2()), L(0,T;L2()2), and L2(0, T; L2()). Quasi-optimal order estimates are obtained for the approximations of u, ut in L(0, T; L()) and p in L(0,T; L()2).

A PRIORI L_2 ERROR ESTIMATES FOR A NONLINEAR PARABOLIC SYSTEM BASED ON COMBINING THE METHOD OF CHARACTERISTICS WITH MIXED FINITE ELEMENT PROCEDURE

A nonlinear parabolic system is derived to describe incompressible nuclear waste-disposal contamination in porous media. A sequential implicit tirne-stepping is defined, in which the pressure and Darcy velocity of the mixture are approximated simultaneously by a mixed finite element method and the brine, radionuclid and heat are treated by a combination of a Galerkin finite element method and the method of characteristics. Optimal-order convergence in L2 is proved. Time-truncation errors of standard procedures are reduced by time stepping along the characteristics of the hyperbolic part of the brine, radionuclide and heal equalios, temporal and spatial error are lossened by direct compulation of the velocity in the mixed method, as opposed to differentiation of the pressure.

A MIXED FINITE ELEMENT AND CHARACTERISTIC MIXED FINITE ELEMENT FOR INCOMPRESSIBLE MISCIBLE DARCY-FORCHHEIMER DISPLACEMENT AND NUMERICAL ANALYSIS

In this paper a mixed finite element-characteristic mixed finite element method is discussed to simulate an incompressible miscible Darcy-Forchheimer problem.The flow equation is solved by a mixed finite element and the approximation accuracy of Darch-Forchheimer velocity is improved one order.The concentration equation is solved by the method of mixed finite element,where the convection is discretized along the characteristic direction and the diffusion is discretized by the zero-order mixed finite element method.The characteristics can confirm strong stability at sharp fronts and avoids numerical dispersion and nonphysical oscillation.In actual computations the characteristics adopts a large time step without any loss of accuracy.The scalar unknowns and its adjoint vector function are obtained simultaneously and the law of mass conservation holds in every element by the zero-order mixed finite element discretization of diffusion flux.In order to derive the optimal 3/2-order error estimate in L^(2) norm,a post-processing technique is included in the approximation to the scalar unknowns.Numerical experiments are illustrated finally to validate theoretical analysis and efficiency.This method can be used to solve such an important problem.

IMPROVED ESTIMATES OF THE COVARIANCE MATRIX IN GENERAL LINEAR MIXED MODELS

In this article, the problem of estimating the covariance matrix in general linear mixed models is considered. Two new classes of estimators obtained by shrinking the eigenvalues towards the origin and the arithmetic mean, respectively, are proposed. It is shown that these new estimators dominate the unbiased estimator under the squared error loss function. Finally, some simulation results to compare the performance of the proposed estimators with that of the unbiased estimator are reported. The simulation results indicate that these new shrinkage estimators provide a substantial improvement in risk under most situations.

A NONLINEAR GALERKIN MIXED ELEMENT METHOD AND A POSTERIORI ERROR ESTIMATOR FOR THE STATIONARY NAVIER-STOKES EQUATIONS

A nonlinear Galerkin mixed element (NGME) method and a posteriori error exstimator based on the method are established for the stationary Navier-Stokes equations. The existence and error estimates of the NGME solution are first discussed, and then a posteriori error estimator based on the NGME method is derived.

Error Estimates of H^1-Galerkin Mixed Methods for the Viscoelasticity Wave Equation

H1-Galerkin 混合了方法为粘弹性波浪方程被建议。取决于兴趣的物理数量，二个方法被讨论。最佳的错误估计和存在的证明和 semidiscrete 解决方案的唯一在一种空格尺寸为问题被导出。并且方法不要求 LBB 条件。

A novel image fusion algorithm based on 2D scale-mixing complex wavelet transform and Bayesian MAP estimation for multimodal medical images

In this paper,we propose a new image fusion algorithm based on two-dimensional Scale-Mixing Complex Wavelet Transform(2D-SMCWT).The fusion of the detail 2D-SMCWT cofficients is performed via a Bayesian Maximum a Posteriori(MAP)approach by considering a trivariate statistical model for the local neighboring of 2D-SMCWT coefficients.For the approx imation coefficients,a new fusion rule based on the Principal Component Analysis(PCA)is applied.We conduct several experiments using three different groups of multimodal medical images to evaluate the performance of the proposed method.The obt ained results prove the superiority of the proposed method over the state of the art fusion methods in terms of visual quality and several commonly used metrics.Robustness of the proposed method is further tested against different types of noise.The plots of fusion met rics establish the accuracy of the proposed fusion method.

Mixed-Effects Parametric Proportional Hazard Model with Generalized Log-Logistic Baseline Distribution

Clustered survival data are widely observed in a variety of setting. Most survival models incorporate clustering and grouping of data accounting for between-cluster variability that creates correlation in order to prevent underestimate of the standard errors of the parameter estimators but do not include random effects. In this study, we developed a mixed-effect parametric proportional hazard (MEPPH) model with a generalized log-logistic distribution baseline. The parameters of the model were estimated by the application of the maximum likelihood estimation technique with an iterative optimization procedure (quasi-Newton Raphson). The developed MEPPH model’s performance was evaluated using Monte Carlo simulation. The Leukemia dataset with right-censored data was used to demonstrate the model’s applicability. The results revealed that all covariates, except age in PH models, were significant in all considered distributions. Age and Townsend score were significant when the GLL distribution was used in MEPPH, while sex, age and Townsend score were significant in MEPPH model when other distributions were used. Based on information criteria values, the Generalized Log-Logistic Mixed-Effects Parametric Proportional Hazard model (GLL-MEPPH) outperformed other models.