A unified Minorization-Maximization approach for estimation of general mixture models

The mixed distribution model is often used to extract information from heteroge-neous data and perform modeling analysis.When the density function of mixed distribution is complicated or the variable dimension is high,it usually brings challenges to the parameter es-timation of the mixed distribution model.The application of MM algorithm can avoid complex expectation calculations,and can also solve the problem of high-dimensional optimization by decomposing the objective function.In this paper,MM algorithm is applied to the parameter estimation problem of mixed distribution model.The method of assembly and decomposition is used to construct the substitute function with separable parameters,which avoids the problems of complex expectation calculations and the inversion of high-dimensional matrices.

An Efficient Reliability-Based Optimization Method Utilizing High-Dimensional Model Representation and Weight-Point Estimation Method

The objective of reliability-based design optimization(RBDO)is to minimize the optimization objective while satisfying the corresponding reliability requirements.However,the nested loop characteristic reduces the efficiency of RBDO algorithm,which hinders their application to high-dimensional engineering problems.To address these issues,this paper proposes an efficient decoupled RBDO method combining high dimensional model representation(HDMR)and the weight-point estimation method(WPEM).First,we decouple the RBDO model using HDMR and WPEM.Second,Lagrange interpolation is used to approximate a univariate function.Finally,based on the results of the first two steps,the original nested loop reliability optimization model is completely transformed into a deterministic design optimization model that can be solved by a series of mature constrained optimization methods without any additional calculations.Two numerical examples of a planar 10-bar structure and an aviation hydraulic piping system with 28 design variables are analyzed to illustrate the performance and practicability of the proposed method.

Multiple model PHD filter for tracking sharply maneuvering targets using recursive RANSAC based adaptive birth estimation

An algorithm to track multiple sharply maneuvering targets without prior knowledge about new target birth is proposed. These targets are capable of achieving sharp maneuvers within a short period of time, such as drones and agile missiles.The probability hypothesis density (PHD) filter, which propagates only the first-order statistical moment of the full target posterior, has been shown to be a computationally efficient solution to multitarget tracking problems. However, the standard PHD filter operates on the single dynamic model and requires prior information about target birth distribution, which leads to many limitations in terms of practical applications. In this paper,we introduce a nonzero mean, white noise turn rate dynamic model and generalize jump Markov systems to multitarget case to accommodate sharply maneuvering dynamics. Moreover, to adaptively estimate newborn targets’information, a measurement-driven method based on the recursive random sampling consensus (RANSAC) algorithm is proposed. Simulation results demonstrate that the proposed method achieves significant improvement in tracking multiple sharply maneuvering targets with adaptive birth estimation.

Enhancing Software Effort Estimation:A Hybrid Model Combining LSTM and Random Forest

Effort estimation plays a crucial role in software development projects,aiding in resource allocation,project planning,and risk management.Traditional estimation techniques often struggle to provide accurate estimates due to the complex nature of software projects.In recent years,machine learning approaches have shown promise in improving the accuracy of effort estimation models.This study proposes a hybrid model that combines Long Short-Term Memory(LSTM)and Random Forest(RF)algorithms to enhance software effort estimation.The proposed hybrid model takes advantage of the strengths of both LSTM and RF algorithms.To evaluate the performance of the hybrid model,an extensive set of software development projects is used as the experimental dataset.The experimental results demonstrate that the proposed hybrid model outperforms traditional estimation techniques in terms of accuracy and reliability.The integration of LSTM and RF enables the model to efficiently capture temporal dependencies and non-linear interactions in the software development data.The hybrid model enhances estimation accuracy,enabling project managers and stakeholders to make more precise predictions of effort needed for upcoming software projects.

Impacts of Model Mismatch and Array Scale on Channel Estimation for XL-HRIS-Aided Systems

Extremely large-scale hybrid reconfigurable intelligence surface(XL-HRIS),an improved version of the RIS,can receive the incident signal and enhance communication performance.However,as the RIS size increases,the phase variations of the received signal across the whole array are nonnegligible in the near-field region,and the channel model mismatch,which will decrease the estimation accuracy,must be considered.In this paper,the lower bound(LB)of the estimated parameter is studied and the impacts of the distance and signal-tonoise ratio(SNR)on LB are then evaluated.Moreover,the impacts of the array scale on LB and spectral efficiency(SE)are also studied.Simulation results verify that even in extremely large-scale array systems with infinite SNR,channel model mismatch can still limit estimation accuracy.However,this impact decreases with increasing distance.

MDTCNet:Multi-Task Classifications Network and TCNN for Direction of Arrival Estimation

The direction-of-arrival(DoA) estimation is one of the hot research areas in signal processing. To overcome the DoA estimation challenge without the prior information about signal sources number and multipath number in millimeter wave system,the multi-task deep residual shrinkage network(MTDRSN) and transfer learning-based convolutional neural network(TCNN), namely MDTCNet, are proposed. The sampling covariance matrix based on the received signal is used as the input to the proposed network. A DRSN-based multi-task classifications model is first introduced to estimate signal sources number and multipath number simultaneously. Then, the DoAs with multi-signal and multipath are estimated by the regression model. The proposed CNN is applied for DoAs estimation with the predicted number of signal sources and paths. Furthermore, the modelbased transfer learning is also introduced into the regression model. The TCNN inherits the partial network parameters of the already formed optimization model obtained by the CNN. A series of experimental results show that the MDTCNet-based DoAs estimation method can accurately predict the signal sources number and multipath number under a range of signal-to-noise ratios. Remarkably, the proposed method achieves the lower root mean square error compared with some existing deep learning-based and traditional methods.

Uncertainty and disturbance estimator-based model predictive control for wet flue gas desulphurization system

Wet flue gas desulphurization technology is widely used in the industrial process for its capability of efficient pollution removal.The desulphurization control system,however,is subjected to complex reaction mechanisms and severe disturbances,which make for it difficult to achieve certain practically relevant control goals including emission and economic performances as well as system robustness.To address these challenges,a new robust control scheme based on uncertainty and disturbance estimator(UDE)and model predictive control(MPC)is proposed in this paper.The UDE is used to estimate and dynamically compensate acting disturbances,whereas MPC is deployed for optimal feedback regulation of the resultant dynamics.By viewing the system nonlinearities and unknown dynamics as disturbances,the proposed control framework allows to locally treat the considered nonlinear plant as a linear one.The obtained simulation results confirm that the utilization of UDE makes the tracking error negligibly small,even in the presence of unmodeled dynamics.In the conducted comparison study,the introduced control scheme outperforms both the standard MPC and PID(proportional-integral-derivative)control strategies in terms of transient performance and robustness.Furthermore,the results reveal that a lowpass-filter time constant has a significant effect on the robustness and the convergence range of the tracking error.

Asymptotic normality of error density estimator in stationary and explosive autoregressive models

In this paper,we consider the limit distribution of the error density function estima-tor in the rst-order autoregressive models with negatively associated and positively associated random errors.Under mild regularity assumptions,some asymptotic normality results of the residual density estimator are obtained when the autoregressive models are stationary process and explosive process.In order to illustrate these results,some simulations such as con dence intervals and mean integrated square errors are provided in this paper.It shows that the residual density estimator can replace the density\estimator"which contains errors.

A hierarchical enhanced data-driven battery pack capacity estimation framework for real-world operating conditions with fewer labeled data

Battery pack capacity estimation under real-world operating conditions is important for battery performance optimization and health management,contributing to the reliability and longevity of batterypowered systems.However,complex operating conditions,coupling cell-to-cell inconsistency,and limited labeled data pose great challenges to accurate and robust battery pack capacity estimation.To address these issues,this paper proposes a hierarchical data-driven framework aimed at enhancing the training of machine learning models with fewer labeled data.Unlike traditional data-driven methods that lack interpretability,the hierarchical data-driven framework unveils the“mechanism”of the black box inside the data-driven framework by splitting the final estimation target into cell-level and pack-level intermediate targets.A generalized feature matrix is devised without requiring all cell voltages,significantly reducing the computational cost and memory resources.The generated intermediate target labels and the corresponding features are hierarchically employed to enhance the training of two machine learning models,effectively alleviating the difficulty of learning the relationship from all features due to fewer labeled data and addressing the dilemma of requiring extensive labeled data for accurate estimation.Using only 10%of degradation data,the proposed framework outperforms the state-of-the-art battery pack capacity estimation methods,achieving mean absolute percentage errors of 0.608%,0.601%,and 1.128%for three battery packs whose degradation load profiles represent real-world operating conditions.Its high accuracy,adaptability,and robustness indicate the potential in different application scenarios,which is promising for reducing laborious and expensive aging experiments at the pack level and facilitating the development of battery technology.

Non-cooperative Space Target Estimation Algorithm Without Prior Information Dependence Based on Temporal Line of Sight Constraint

Under single-satellite observation,the parameter estimation of the boost phase of high-precision space noncooperative targets requires prior information.To improve the accuracy without prior information,we propose a parameter estimation model of the boost phase based on trajectory plane parametric cutting.The use of the plane passing through the geo-center and the cutting sequence line of sight(LOS)generates the trajectory-cutting plane.With the coefficient of the trajectory cutting plane directly used as the parameter to be estimated,a motion parameter estimation model in space non-cooperative targets is established,and the Gauss-Newton iteration method is used to solve the flight parameters.The experimental results show that the estimation algorithm proposed in this paper weakly relies on prior information and has higher estimation accuracy,providing a practical new idea and method for the parameter estimation of space non-cooperative targets under single-satellite warning.

Optimizing near-carbon-free nuclear energy systems:advances in reactor operation digital twin through hybrid machine learning algorithms for parameter identification and state estimation

Accurate and efficient online parameter identification and state estimation are crucial for leveraging digital twin simulations to optimize the operation of near-carbon-free nuclear energy systems.In previous studies,we developed a reactor operation digital twin(RODT).However,non-differentiabilities and discontinuities arise when employing machine learning-based surrogate forward models,challenging traditional gradient-based inverse methods and their variants.This study investigated deterministic and metaheuristic algorithms and developed hybrid algorithms to address these issues.An efficient modular RODT software framework that incorporates these methods into its post-evaluation module is presented for comprehensive comparison.The methods were rigorously assessed based on convergence profiles,stability with respect to noise,and computational performance.The numerical results show that the hybrid KNNLHS algorithm excels in real-time online applications,balancing accuracy and efficiency with a prediction error rate of only 1%and processing times of less than 0.1 s.Contrastingly,algorithms such as FSA,DE,and ADE,although slightly slower(approximately 1 s),demonstrated higher accuracy with a 0.3%relative L_2 error,which advances RODT methodologies to harness machine learning and system modeling for improved reactor monitoring,systematic diagnosis of off-normal events,and lifetime management strategies.The developed modular software and novel optimization methods presented offer pathways to realize the full potential of RODT for transforming energy engineering practices.

Improving the accuracy of precipitation estimates in a typical inland arid area of China using a dynamic Bayesian model averaging approach

Xinjiang Uygur Autonomous Region is a typical inland arid area in China with a sparse and uneven distribution of meteorological stations,limited access to precipitation data,and significant water scarcity.Evaluating and integrating precipitation datasets from different sources to accurately characterize precipitation patterns has become a challenge to provide more accurate and alternative precipitation information for the region,which can even improve the performance of hydrological modelling.This study evaluated the applicability of widely used five satellite-based precipitation products(Climate Hazards Group InfraRed Precipitation with Station(CHIRPS),China Meteorological Forcing Dataset(CMFD),Climate Prediction Center morphing method(CMORPH),Precipitation Estimation from Remotely Sensed Information using Artificial Neural Networks-Climate Data Record(PERSIANN-CDR),and Tropical Rainfall Measuring Mission Multi-satellite Precipitation Analysis(TMPA))and a reanalysis precipitation dataset(ECMWF Reanalysis v5-Land Dataset(ERA5-Land))in Xinjiang using ground-based observational precipitation data from a limited number of meteorological stations.Based on this assessment,we proposed a framework that integrated different precipitation datasets with varying spatial resolutions using a dynamic Bayesian model averaging(DBMA)approach,the expectation-maximization method,and the ordinary Kriging interpolation method.The daily precipitation data merged using the DBMA approach exhibited distinct spatiotemporal variability,with an outstanding performance,as indicated by low root mean square error(RMSE=1.40 mm/d)and high Person's correlation coefficient(CC=0.67).Compared with the traditional simple model averaging(SMA)and individual product data,although the DBMA-fused precipitation data were slightly lower than the best precipitation product(CMFD),the overall performance of DBMA was more robust.The error analysis between DBMA-fused precipitation dataset and the more advanced Integrated Multi-satellite Retrievals for Global Precipitation Measurement Final(IMERG-F)precipitation product,as well as hydrological simulations in the Ebinur Lake Basin,further demonstrated the superior performance of DBMA-fused precipitation dataset in the entire Xinjiang region.The proposed framework for solving the fusion problem of multi-source precipitation data with different spatial resolutions is feasible for application in inland arid areas,and aids in obtaining more accurate regional hydrological information and improving regional water resources management capabilities and meteorological research in these regions.

Robust design of sliding mode control for airship trajectory tracking with uncertainty and disturbance estimation

The robotic airship can provide a promising aerostatic platform for many potential applications.These applications require a precise autonomous trajectory tracking control for airship.Airship has a nonlinear and uncertain dynamics.It is prone to wind disturbances that offer a challenge for a trajectory tracking control design.This paper addresses the airship trajectory tracking problem having time varying reference path.A lumped parameter estimation approach under model uncertainties and wind disturbances is opted against distributed parameters.It uses extended Kalman filter(EKF)for uncertainty and disturbance estimation.The estimated parameters are used by sliding mode controller(SMC)for ultimate control of airship trajectory tracking.This comprehensive algorithm,EKF based SMC(ESMC),is used as a robust solution to track airship trajectory.The proposed estimator provides the estimates of wind disturbances as well as model uncertainty due to the mass matrix variations and aerodynamic model inaccuracies.The stability and convergence of the proposed method are investigated using the Lyapunov stability analysis.The simulation results show that the proposed method efficiently tracks the desired trajectory.The method solves the stability,convergence,and chattering problem of SMC under model uncertainties and wind disturbances.

Improved cat swarm optimization for parameter estimation of mixed additive and multiplicative random error model

To estimate the parameters of the mixed additive and multiplicative(MAM)random error model using the weighted least squares iterative algorithm that requires derivation of the complex weight array,we introduce a derivative-free cat swarm optimization for parameter estimation.We embed the Powell method,which uses conjugate direction acceleration and does not need to derive the objective function,into the original cat swarm optimization to accelerate its convergence speed and search accuracy.We use the ordinary least squares,weighted least squares,original cat swarm optimization,particle swarm algorithm and improved cat swarm optimization to estimate the parameters of the straight-line fitting MAM model with lower nonlinearity and the DEM MAM model with higher nonlinearity,respectively.The experimental results show that the improved cat swarm optimization has faster convergence speed,higher search accuracy,and better stability than the original cat swarm optimization and the particle swarm algorithm.At the same time,the improved cat swarm optimization can obtain results consistent with the weighted least squares method based on the objective function only while avoiding multiple complex weight array derivations.The method in this paper provides a new idea for theoretical research on parameter estimation of MAM error models.

UAMP-Based Delay-Doppler Channel Estimation for OTFS Systems

Orthogonal time frequency space(OTFS)technique, which modulates data symbols in the delayDoppler(DD) domain, presents a potential solution for supporting reliable information transmission in highmobility vehicular networks. In this paper, we study the issues of DD channel estimation for OTFS in the presence of fractional Doppler. We first propose a channel estimation algorithm with both low complexity and high accuracy based on the unitary approximate message passing(UAMP), which exploits the structured sparsity of the effective DD domain channel using hidden Markov model(HMM). The empirical state evolution(SE) analysis is then leveraged to predict the performance of our proposed algorithm. To refine the hyperparameters in the proposed algorithm,we derive the update criterion for the hyperparameters through the expectation-maximization(EM) algorithm. Finally, Our simulation results demonstrate that our proposed algorithm can achieve a significant gain over various baseline schemes.

A Survey on Deep Learning-Based 2D Human Pose Estimation Models

In this article,a comprehensive survey of deep learning-based(DLbased)human pose estimation(HPE)that can help researchers in the domain of computer vision is presented.HPE is among the fastest-growing research domains of computer vision and is used in solving several problems for human endeavours.After the detailed introduction,three different human body modes followed by the main stages of HPE and two pipelines of twodimensional(2D)HPE are presented.The details of the four components of HPE are also presented.The keypoints output format of two popular 2D HPE datasets and the most cited DL-based HPE articles from the year of breakthrough are both shown in tabular form.This study intends to highlight the limitations of published reviews and surveys respecting presenting a systematic review of the current DL-based solution to the 2D HPE model.Furthermore,a detailed and meaningful survey that will guide new and existing researchers on DL-based 2D HPE models is achieved.Finally,some future research directions in the field of HPE,such as limited data on disabled persons and multi-training DL-based models,are revealed to encourage researchers and promote the growth of HPE research.

Parameter estimation of the stochastic AMR model and its application to the study of several strong earthquakes

Based on the stochastic AMR model, this paper constructs man-made earthquake catalogues to investigate the property of parameter estimation of the model. Then the stochastic AMR model is applied to the study of several strong earthquakes in China and New Zealand. Akaikes AIC criterion is used to discriminate whether an accelerating mode of earthquake activity precedes those events or not. Finally, regional accelerating seismic activity and possible prediction approach for future strong earthquakes are discussed.

Joint Multi-Domain Channel Estimation Based on Sparse Bayesian Learning for OTFS System

Since orthogonal time-frequency space(OTFS)can effectively handle the problems caused by Doppler effect in high-mobility environment,it has gradually become a promising candidate for modulation scheme in the next generation of mobile communication.However,the inter-Doppler interference(IDI)problem caused by fractional Doppler poses great challenges to channel estimation.To avoid this problem,this paper proposes a joint time and delayDoppler(DD)domain based on sparse Bayesian learning(SBL)channel estimation algorithm.Firstly,we derive the original channel response(OCR)from the time domain channel impulse response(CIR),which can reflect the channel variation during one OTFS symbol.Compare with the traditional channel model,the OCR can avoid the IDI problem.After that,the dimension of OCR is reduced by using the basis expansion model(BEM)and the relationship between the time and DD domain channel model,so that we have turned the underdetermined problem into an overdetermined problem.Finally,in terms of sparsity of channel in delay domain,SBL algorithm is used to estimate the basis coefficients in the BEM without any priori information of channel.The simulation results show the effectiveness and superiority of the proposed channel estimation algorithm.

Physics-informed neural network approach for heat generation rate estimation of lithium-ion battery under various driving conditions

Accurate insight into the heat generation rate(HGR) of lithium-ion batteries(LIBs) is one of key issues for battery management systems to formulate thermal safety warning strategies in advance.For this reason,this paper proposes a novel physics-informed neural network(PINN) approach for HGR estimation of LIBs under various driving conditions.Specifically,a single particle model with thermodynamics(SPMT) is first constructed for extracting the critical physical knowledge related with battery HGR.Subsequently,the surface concentrations of positive and negative electrodes in battery SPMT model are integrated into the bidirectional long short-term memory(BiLSTM) networks as physical information.And combined with other feature variables,a novel PINN approach to achieve HGR estimation of LIBs with higher accuracy is constituted.Additionally,some critical hyperparameters of BiLSTM used in PINN approach are determined through Bayesian optimization algorithm(BOA) and the results of BOA-based BiLSTM are compared with other traditional BiLSTM/LSTM networks.Eventually,combined with the HGR data generated from the validated virtual battery,it is proved that the proposed approach can well predict the battery HGR under the dynamic stress test(DST) and worldwide light vehicles test procedure(WLTP),the mean absolute error under DST is 0.542 kW/m^(3),and the root mean square error under WLTP is1.428 kW/m^(3)at 25℃.Lastly,the investigation results of this paper also show a new perspective in the application of the PINN approach in battery HGR estimation.

Diagnostics in generalized nonlinear models based on maximum L_q-likelihood estimation

In order to detect whether the data conforms to the given model, it is necessary to diagnose the data in the statistical way. The diagnostic problem in generalized nonlinear models based on the maximum Lq-likelihood estimation is considered. Three diagnostic statistics are used to detect whether the outliers exist in the data set. Simulation results show that when the sample size is small, the values of diagnostic statistics based on the maximum Lq-likelihood estimation are greater than the values based on the maximum likelihood estimation. As the sample size increases, the difference between the values of the diagnostic statistics based on two estimation methods diminishes gradually. It means that the outliers can be distinguished easier through the maximum Lq-likelihood method than those through the maximum likelihood estimation method.