Sparse representation based on projection method in online least squares support vector machines

A sparse approximation algorithm based on projection is presented in this paper in order to overcome the limitation of the non-sparsity of least squares support vector machines （LS-SVM）. The new inputs are projected into the subspace spanned by previous basis vectors （BV） and those inputs whose squared distance from the subspace is higher than a threshold are added in the BV set, while others are rejected. This consequently results in the sparse approximation. In addition, a recursive approach to deleting an exiting vector in the BV set is proposed. Then the online LS-SVM, sparse approximation and BV removal are combined to produce the sparse online LS-SVM algorithm that can control the size of memory irrespective of the processed data size. The suggested algorithm is applied in the online modeling of a pH neutralizing process and the isomerization plant of a refinery, respectively. The detailed comparison of computing time and precision is also given between the suggested algorithm and the nonsparse one. The results show that the proposed algorithm greatly improves the sparsity just with little cost of precision.

Wiener model identification and nonlinear model predictive control of a pH neutralization process based on Laguerre filters and least squares support vector machines

This paper deals with Wiener model based predictive control of a pH neutralization process.The dynamic linear block of the Wiener model is parameterized using Laguerre filters while the nonlinear block is constructed using least squares support vector machines (LSSVM).Input-output data from the first principle model of the pH neutralization process are used for the Wiener model identification.Simulation results show that the proposed Wiener model has higher prediction accuracy than Laguerre-support vector regression (SVR) Wiener models,Laguerre-polynomial Wiener models,and linear Laguerre models.The identified Wiener model is used here for nonlinear model predictive control (NMPC) of the pH neutralization process.The set-point tracking performance of the proposed NMPC is compared with those of the Laguerre-SVR Wiener model based NMPC,Laguerre-polynomial Wiener model based NMPC,and linear model predictive control (LMPC).Validation results show that the proposed NMPC outperforms the other three controllers.