The mixed distribution model is often used to extract information from heteroge-neous data and perform modeling analysis.When the density function of mixed distribution is complicated or the variable dimension is high...The mixed distribution model is often used to extract information from heteroge-neous data and perform modeling analysis.When the density function of mixed distribution is complicated or the variable dimension is high,it usually brings challenges to the parameter es-timation of the mixed distribution model.The application of MM algorithm can avoid complex expectation calculations,and can also solve the problem of high-dimensional optimization by decomposing the objective function.In this paper,MM algorithm is applied to the parameter estimation problem of mixed distribution model.The method of assembly and decomposition is used to construct the substitute function with separable parameters,which avoids the problems of complex expectation calculations and the inversion of high-dimensional matrices.展开更多
Mixture of Experts(MoE)regression models are widely studied in statistics and machine learning for modeling heterogeneity in data for regression,clustering and classification.Laplace distribution is one of the most im...Mixture of Experts(MoE)regression models are widely studied in statistics and machine learning for modeling heterogeneity in data for regression,clustering and classification.Laplace distribution is one of the most important statistical tools to analyze thick and tail data.Laplace Mixture of Linear Experts(LMoLE)regression models are based on the Laplace distribution which is more robust.Similar to modelling variance parameter in a homogeneous population,we propose and study a new novel class of models:heteroscedastic Laplace mixture of experts regression models to analyze the heteroscedastic data coming from a heterogeneous population in this paper.The issues of maximum likelihood estimation are addressed.In particular,Minorization-Maximization(MM)algorithm for estimating the regression parameters is developed.Properties of the estimators of the regression coefficients are evaluated through Monte Carlo simulations.Results from the analysis of two real data sets are presented.展开更多
基金Supported by the National Natural Science Foundation of China(12261108)the General Program of Basic Research Programs of Yunnan Province(202401AT070126)+1 种基金the Yunnan Key Laboratory of Modern Analytical Mathematics and Applications(202302AN360007)the Cross-integration Innovation team of modern Applied Mathematics and Life Sciences in Yunnan Province,China(202405AS350003).
文摘The mixed distribution model is often used to extract information from heteroge-neous data and perform modeling analysis.When the density function of mixed distribution is complicated or the variable dimension is high,it usually brings challenges to the parameter es-timation of the mixed distribution model.The application of MM algorithm can avoid complex expectation calculations,and can also solve the problem of high-dimensional optimization by decomposing the objective function.In this paper,MM algorithm is applied to the parameter estimation problem of mixed distribution model.The method of assembly and decomposition is used to construct the substitute function with separable parameters,which avoids the problems of complex expectation calculations and the inversion of high-dimensional matrices.
基金the National Natural Science Foundation of China(11861041,11261025).
文摘Mixture of Experts(MoE)regression models are widely studied in statistics and machine learning for modeling heterogeneity in data for regression,clustering and classification.Laplace distribution is one of the most important statistical tools to analyze thick and tail data.Laplace Mixture of Linear Experts(LMoLE)regression models are based on the Laplace distribution which is more robust.Similar to modelling variance parameter in a homogeneous population,we propose and study a new novel class of models:heteroscedastic Laplace mixture of experts regression models to analyze the heteroscedastic data coming from a heterogeneous population in this paper.The issues of maximum likelihood estimation are addressed.In particular,Minorization-Maximization(MM)algorithm for estimating the regression parameters is developed.Properties of the estimators of the regression coefficients are evaluated through Monte Carlo simulations.Results from the analysis of two real data sets are presented.
