The phenomenon of a target echo peak overlapping with the backscattered echo peak significantly undermines the detection range and precision of underwater laser fuzes.To overcome this issue,we propose a four-quadrant ...The phenomenon of a target echo peak overlapping with the backscattered echo peak significantly undermines the detection range and precision of underwater laser fuzes.To overcome this issue,we propose a four-quadrant dual-beam circumferential scanning laser fuze to distinguish various interference signals and provide more real-time data for the backscatter filtering algorithm.This enhances the algorithm loading capability of the fuze.In order to address the problem of insufficient filtering capacity in existing linear backscatter filtering algorithms,we develop a nonlinear backscattering adaptive filter based on the spline adaptive filter least mean square(SAF-LMS)algorithm.We also designed an algorithm pause module to retain the original trend of the target echo peak,improving the time discrimination accuracy and anti-interference capability of the fuze.Finally,experiments are conducted with varying signal-to-noise ratios of the original underwater target echo signals.The experimental results show that the average signal-to-noise ratio before and after filtering can be improved by more than31 d B,with an increase of up to 76%in extreme detection distance.展开更多
The automatic detection of cardiac arrhythmias through remote monitoring is still a challenging task since electrocardiograms(ECGs)are easily contaminated by physiological artifacts and external noises,and these morph...The automatic detection of cardiac arrhythmias through remote monitoring is still a challenging task since electrocardiograms(ECGs)are easily contaminated by physiological artifacts and external noises,and these morphological characteristics show significant variations for different patients.A fast patient-specific arrhythmia diagnosis classifier scheme is proposed,in which a wavelet adaptive threshold denoising is combined with quantum genetic algorithm(QAG)based on least squares twin support vector machine(LSTSVM).The wavelet adaptive threshold denoising is employed for noise reduction,and then morphological features combined with the timing interval features are extracted to evaluate the classifier.For each patient,an individual and fast classifier will be trained by common and patient-specific training data.Following the recommendations of the Association for the Advancements of Medical Instrumentation(AAMI),experimental results over the MIT-BIH arrhythmia benchmark database demonstrated that our proposed method achieved the average detection accuracy of 98.22%,99.65%and 99.41%for the abnormal,ventricular ectopic beats(VEBs)and supra-VEBs(SVEBs),respectively.Besides the detection accuracy,sensitivity and specificity,our proposed method consumes the less CPU running time compared with the other representative state of the art methods.It can be ported to Android based embedded system,henceforth suitable for a wearable device.展开更多
A quantitative structure-activity relationships (QSAR) study is suggested for the prediction of solubility of some thiazolidine-4- carboxylic acid derivatives in aqueous solution. Ab initio theory was used to calcul...A quantitative structure-activity relationships (QSAR) study is suggested for the prediction of solubility of some thiazolidine-4- carboxylic acid derivatives in aqueous solution. Ab initio theory was used to calculate some quantum chemical descriptors including electrostatic potentials and local charges at each atom, HOMO and LUMO energies, etc. Modeling of the solubility of thiazolidine- 4-carboxylic acid derivatives as a function of molecular structures was established by means of the partial least squares (PLS). The subset of descriptors, which resulted in the low prediction error, was selected by genetic algorithm. This model was applied for the prediction of the solubility of some thiazolidine-4-carboxylic acid derivatives, which were not in the modeling procedure. The relative errors of prediction lower that -4% was obtained by using GA-PLS method. The resulted model showed high prediction ability with RMSEP of 3.8836 and 2.9500 for PLS and GA-PLS models, respectively.展开更多
With the power system harmonic pollution problems becoming more and more serious, how to distinguish the harmonic responsibility accurately and solve the grid harmonics simply and effectively has become the main devel...With the power system harmonic pollution problems becoming more and more serious, how to distinguish the harmonic responsibility accurately and solve the grid harmonics simply and effectively has become the main development direction in harmonic control subjects. This paper, based on linear regression analysis of basic equation and improvement equation, deduced the least squares estimation (LSE) iterative algorithm and obtained the real-time estimates of regression coefficients, and then calculated the level of the harmonic impedance and emission estimates in real time. This paper used power system simulation software Matlab/Simulink as analysis tool and analyzed the user side of the harmonic amplitude and phase fluctuations PCC (point of common coupling) at the harmonic emission level, thus the research has a certain theoretical significance. The development of this algorithm combined with the instrument can be used in practical engineering.展开更多
The recursive least square is widely used in parameter identification. But if is easy to bring about the phenomena of parameters burst-off. A convergence analysis of a more stable identification algorithm-recursive da...The recursive least square is widely used in parameter identification. But if is easy to bring about the phenomena of parameters burst-off. A convergence analysis of a more stable identification algorithm-recursive damped least square is proposed. This is done by normalizing the measurement vector entering into the identification algorithm. rt is shown that the parametric distance converges to a zero mean random variable. It is also shown that under persistent excitation condition, the condition number of the adaptation gain matrix is bounded, and the variance of the parametric distance is bounded.展开更多
Active Magnetic Bearing(AMB) is a kind of electromagnetic support that makes the rotor movement frictionless and can suppress rotor vibration by controlling the magnetic force. The most common approach to restrain the...Active Magnetic Bearing(AMB) is a kind of electromagnetic support that makes the rotor movement frictionless and can suppress rotor vibration by controlling the magnetic force. The most common approach to restrain the rotor vibration in AMBs is to adopt a notch filter or adaptive filter in the AMB controller. However, these methods cannot obtain the precise amplitude and phase of the compensation current. Thus, they are not so effective in terms of suppressing the vibrations of the fundamental and other harmonic orders over the whole speed range. To improve the vibration suppression performance of AMBs,an adaptive filter based on Least Mean Square(LMS) is applied to extract the vibration signals from the rotor displacement signal. An Iterative Search Algorithm(ISA) is proposed in this paper to obtain the corresponding relationship between the compensation current and vibration signals. The ISA is responsible for searching the compensating amplitude and shifting phase online for the LMS filter, enabling the AMB controller to generate the corresponding compensation force for vibration suppression. The results of ISA are recorded to suppress vibration using the Look-Up Table(LUT) in variable speed range. Comprehensive simulations and experimental validations are carried out in fixed and variable speed range, and the results demonstrate that by employing the ISA, vibrations of the fundamental and other harmonic orders are suppressed effectively.展开更多
Electricity is the guarantee of economic development and daily life. Thus, accurate monthly electricity consumption forecasting can provide reliable guidance for power construction planning. In this paper, a hybrid mo...Electricity is the guarantee of economic development and daily life. Thus, accurate monthly electricity consumption forecasting can provide reliable guidance for power construction planning. In this paper, a hybrid model in combination of least squares support vector machine(LSSVM) model with fruit fly optimization algorithm(FOA) and the seasonal index adjustment is constructed to predict monthly electricity consumption. The monthly electricity consumption demonstrates a nonlinear characteristic and seasonal tendency. The LSSVM has a good fit for nonlinear data, so it has been widely applied to handling nonlinear time series prediction. However, there is no unified selection method for key parameters and no unified method to deal with the effect of seasonal tendency. Therefore, the FOA was hybridized with the LSSVM and the seasonal index adjustment to solve this problem. In order to evaluate the forecasting performance of hybrid model, two samples of monthly electricity consumption of China and the United States were employed, besides several different models were applied to forecast the two empirical time series. The results of the two samples all show that, for seasonal data, the adjusted model with seasonal indexes has better forecasting performance. The forecasting performance is better than the models without seasonal indexes. The fruit fly optimized LSSVM model outperforms other alternative models. In other words, the proposed hybrid model is a feasible method for the electricity consumption forecasting.展开更多
The Second Crustal Deformation Monitoring Center, China Seismological Bureau, has detected a marked uplift associated with the Gonghe Ms=7.0 earthquake on April 26, 1990, Qinghai Province. From the observed vertical d...The Second Crustal Deformation Monitoring Center, China Seismological Bureau, has detected a marked uplift associated with the Gonghe Ms=7.0 earthquake on April 26, 1990, Qinghai Province. From the observed vertical deformations and using a rectangular uniform slip model in a homogeneous elastic half space, we first employ genetic algorithms (GA) to infer the approximate global optimal solution, and further use least squares method to get more accurate global optimal solution by taking the approximate solution of GA as the initial parameters of least squares. The inversion results show that the causative fault of Gonghe Ms=7.0 earthquake is a right-lateral reverse fault with strike NW60°, dip SW and dip angle 37°, the coseismic fracture length, width and slip are 37 km, 6 km and 2.7 m respectively. Combination of GA and least squares algorithms is an effective joint inversion method, which could not only escape from local optimum of least squares, but also solve the slow convergence problem of GA after reaching adjacency of global optimal solution.展开更多
Compositional data, such as relative information, is a crucial aspect of machine learning and other related fields. It is typically recorded as closed data or sums to a constant, like 100%. The statistical linear mode...Compositional data, such as relative information, is a crucial aspect of machine learning and other related fields. It is typically recorded as closed data or sums to a constant, like 100%. The statistical linear model is the most used technique for identifying hidden relationships between underlying random variables of interest. However, data quality is a significant challenge in machine learning, especially when missing data is present. The linear regression model is a commonly used statistical modeling technique used in various applications to find relationships between variables of interest. When estimating linear regression parameters which are useful for things like future prediction and partial effects analysis of independent variables, maximum likelihood estimation (MLE) is the method of choice. However, many datasets contain missing observations, which can lead to costly and time-consuming data recovery. To address this issue, the expectation-maximization (EM) algorithm has been suggested as a solution for situations including missing data. The EM algorithm repeatedly finds the best estimates of parameters in statistical models that depend on variables or data that have not been observed. This is called maximum likelihood or maximum a posteriori (MAP). Using the present estimate as input, the expectation (E) step constructs a log-likelihood function. Finding the parameters that maximize the anticipated log-likelihood, as determined in the E step, is the job of the maximization (M) phase. This study looked at how well the EM algorithm worked on a made-up compositional dataset with missing observations. It used both the robust least square version and ordinary least square regression techniques. The efficacy of the EM algorithm was compared with two alternative imputation techniques, k-Nearest Neighbor (k-NN) and mean imputation (), in terms of Aitchison distances and covariance.展开更多
Aimed at the problems of small gradient, low learning rate, slow convergence error when the DBN using back-propagation process to fix the network connection weight and bias, proposing a new algorithm that combines wit...Aimed at the problems of small gradient, low learning rate, slow convergence error when the DBN using back-propagation process to fix the network connection weight and bias, proposing a new algorithm that combines with multi-innovation theory to improve standard DBN algorithm, that is the multi-innovation DBN(MI-DBN). It sets up a new model of back-propagation process in DBN algorithm, making the use of single innovation in previous algorithm extend to the use of innovation of the preceding multiple period, thus increasing convergence rate of error largely. To study the application of the algorithm in the social computing, and recognize the meaningful information about the handwritten numbers in social networking images. This paper compares MI-DBN algorithm with other representative classifiers through experiments. The result shows that MI-DBN algorithm, comparing with other representative classifiers, has a faster convergence rate and a smaller error for MNIST dataset recognition. And handwritten numbers on the image also have a precise degree of recognition.展开更多
Order-recursive least-squares(ORLS)algorithms are applied to the prob-lems of estimation and identification of FIR or ARMA system parameters where a fixedset of input signal samples is available and the desired order ...Order-recursive least-squares(ORLS)algorithms are applied to the prob-lems of estimation and identification of FIR or ARMA system parameters where a fixedset of input signal samples is available and the desired order of the underlying model isunknown.On the basis of several universal formulae for updating nonsymmetric projec-tion operators,this paper presents three kinds of LS algorithms,called nonsymmetric,symmetric and square root normalized fast ORLS algorithms,respectively.As to the au-thors’ knowledge,the first and the third have not been so far provided,and the second isone of those which have the lowest computational requirement.Several simplified versionsof the algorithms are also considered.展开更多
This paper presents a new highly parallel algorithm for computing the minimum-norm least-squares solution of inconsistent linear equations Ax = b(A∈Rm×n,b∈R (A)). By this algorithm the solution x = A + b is obt...This paper presents a new highly parallel algorithm for computing the minimum-norm least-squares solution of inconsistent linear equations Ax = b(A∈Rm×n,b∈R (A)). By this algorithm the solution x = A + b is obtained in T = n(log2m + log2(n - r + 1) + 5) + log2m + 1 steps with P=mn processors when m × 2(n - 1) and with P = 2n(n - 1) processors otherwise.展开更多
The neural network partial least square (NNPLS) method was used to establish a robust reaction model for a multi-component catalyst of methane oxidative coupling. The details, including the learning algorithm, the num...The neural network partial least square (NNPLS) method was used to establish a robust reaction model for a multi-component catalyst of methane oxidative coupling. The details, including the learning algorithm, the number of hidden units of the inner network, activation function, initialization of the network weights and the principal components, are discussed. The results show that the structural organizations of inner neural network are 1-10-5-1, 1-8-4-1, 1-8-5-1, 1-7-4-1, 1-8-4-1, 1-8-6-1, respectively. The Levenberg-Marquardt method was used in the learning algorithm, and the central sigmoidal function is the activation function. Calculation results show that four principal components are convenient in the use of the multi-component catalyst modeling of methane oxidative coupling. Therefore a robust reaction model expressed by NNPLS succeeds in correlating the relations between elements in catalyst and catalytic reaction results. Compared with the direct network modeling, NNPLS model can be adjusted by experimental data and the calculation of the model is simpler and faster than that of the direct network model.展开更多
General neural network inverse adaptive controller has two flaws: the first is the slow convergence speed; the second is the invalidation to the non-minimum phase system. These defects limit the scope in which the neu...General neural network inverse adaptive controller has two flaws: the first is the slow convergence speed; the second is the invalidation to the non-minimum phase system. These defects limit the scope in which the neural network inverse adaptive controller is used. We employ Davidon least squares in training the multi-layer feedforward neural network used in approximating the inverse model of plant to expedite the convergence, and then through constructing the pseudo-plant, a neural network inverse adaptive controller is put forward which is still effective to the nonlinear non-minimum phase system. The simulation results show the validity of this scheme.展开更多
The objective of modelling from data is not that the model simply fits the training data well. Rather, the goodness of a model is characterized by its generalization capability, interpretability and ease for knowledge...The objective of modelling from data is not that the model simply fits the training data well. Rather, the goodness of a model is characterized by its generalization capability, interpretability and ease for knowledge extraction. All these desired properties depend crucially on the ability to construct appropriate parsimonious models by the modelling process, and a basic principle in practical nonlinear data modelling is the parsimonious principle of ensuring the smallest possible model that explains the training data. There exists a vast amount of works in the area of sparse modelling, and a widely adopted approach is based on the linear-in-the-parameters data modelling that include the radial basis function network, the neurofuzzy network and all the sparse kernel modelling techniques. A well tested strategy for parsimonious modelling from data is the orthogonal least squares (OLS) algorithm for forward selection modelling, which is capable of constructing sparse models that generalise well. This contribution continues this theme and provides a unified framework for sparse modelling from data that includes regression and classification, which belong to supervised learning, and probability density function estimation, which is an unsupervised learning problem. The OLS forward selection method based on the leave-one-out test criteria is presented within this unified data-modelling framework. Examples from regression, classification and density estimation applications are used to illustrate the effectiveness of this generic parsimonious modelling approach from data.展开更多
At present,the principal data processing methods involving complex observations are based on two strategies according to characteristics of the observation process,i.e.,step-by-step and direct resolution.However,these...At present,the principal data processing methods involving complex observations are based on two strategies according to characteristics of the observation process,i.e.,step-by-step and direct resolution.However,these strategies have some limitations,e.g.they cannot consider statistical observation error information,redundant observations and so on.This paper applies least squares methods to complex data processing to extend surveying adjustment theory from real to complex number space.We compared the two adjustment criteria for a complex domain in a quantitative way.In order to understand the effectiveness of complex least squares,tree height inversion from PolInSAR data is taken as an example.We firstly established both a complex adjustment function model and a stochastic model for PolInSAR tree height inversion,and then applied the complex least squares method to estimate tree height.Results show that the complex least squares approach is reliable and outperforms other classic tree height retrieval methods;the method is simple and easy to implement.展开更多
This paper presents a two-level learning method for designing an optimal Radial Basis Function Network (RBFN) using Adaptive Velocity Update Relaxation Particle Swarm Optimization algorithm (AVURPSO) and Orthogonal Le...This paper presents a two-level learning method for designing an optimal Radial Basis Function Network (RBFN) using Adaptive Velocity Update Relaxation Particle Swarm Optimization algorithm (AVURPSO) and Orthogonal Least Squares algorithm (OLS) called as OLS-AVURPSO method. The novelty is to develop an AVURPSO algorithm to form the hybrid OLS-AVURPSO method for designing an optimal RBFN. The proposed method at the upper level finds the global optimum of the spread factor parameter using AVURPSO while at the lower level automatically constructs the RBFN using OLS algorithm. Simulation results confirm that the RBFN is superior to Multilayered Perceptron Network (MLPN) in terms of network size and computing time. To demonstrate the effectiveness of proposed OLS-AVURPSO in the design of RBFN, the Mackey-Glass Chaotic Time-Series as an example is modeled by both MLPN and RBFN.展开更多
Data coming from different sources have different types and temporal states. Relations between one type of data and another ones, or between data and unknown parameters are almost nonlinear. It is not accurate and rel...Data coming from different sources have different types and temporal states. Relations between one type of data and another ones, or between data and unknown parameters are almost nonlinear. It is not accurate and reliable to process the data in building the digital earth with the classical least squares method or the method of the common nonlinear least squares. So a generalized nonlinear dynamic least squares method was put forward to process data in building the digital earth. A separating solution model and the iterative calculation method were used to solve the generalized nonlinear dynamic least squares problem. In fact, a complex problem can be separated and then solved by converting to two sub problems, each of which has a single variable. Therefore the dimension of unknown parameters can be reduced to its half, which simplifies the original high dimensional equations.展开更多
基金supported by the 2021 Open Project Fund of Science and Technology on Electromechanical Dynamic Control Laboratory,grant number 212-C-J-F-QT-2022-0020China Postdoctoral Science Foundation,grant number 2021M701713+1 种基金Postgraduate Research&Practice Innovation Program of Jiangsu Province,grant number KYCX23_0511the Jiangsu Funding Program for Excellent Postdoctoral Talent,grant number 20220ZB245。
文摘The phenomenon of a target echo peak overlapping with the backscattered echo peak significantly undermines the detection range and precision of underwater laser fuzes.To overcome this issue,we propose a four-quadrant dual-beam circumferential scanning laser fuze to distinguish various interference signals and provide more real-time data for the backscatter filtering algorithm.This enhances the algorithm loading capability of the fuze.In order to address the problem of insufficient filtering capacity in existing linear backscatter filtering algorithms,we develop a nonlinear backscattering adaptive filter based on the spline adaptive filter least mean square(SAF-LMS)algorithm.We also designed an algorithm pause module to retain the original trend of the target echo peak,improving the time discrimination accuracy and anti-interference capability of the fuze.Finally,experiments are conducted with varying signal-to-noise ratios of the original underwater target echo signals.The experimental results show that the average signal-to-noise ratio before and after filtering can be improved by more than31 d B,with an increase of up to 76%in extreme detection distance.
基金Supported by the National Natural Science Foundation of China(61571063)Key Scientific Research Projects of Colleges and Universities in Henan Province(20A510014)Key Scientific and Technological Projects in Henan Province。
文摘The automatic detection of cardiac arrhythmias through remote monitoring is still a challenging task since electrocardiograms(ECGs)are easily contaminated by physiological artifacts and external noises,and these morphological characteristics show significant variations for different patients.A fast patient-specific arrhythmia diagnosis classifier scheme is proposed,in which a wavelet adaptive threshold denoising is combined with quantum genetic algorithm(QAG)based on least squares twin support vector machine(LSTSVM).The wavelet adaptive threshold denoising is employed for noise reduction,and then morphological features combined with the timing interval features are extracted to evaluate the classifier.For each patient,an individual and fast classifier will be trained by common and patient-specific training data.Following the recommendations of the Association for the Advancements of Medical Instrumentation(AAMI),experimental results over the MIT-BIH arrhythmia benchmark database demonstrated that our proposed method achieved the average detection accuracy of 98.22%,99.65%and 99.41%for the abnormal,ventricular ectopic beats(VEBs)and supra-VEBs(SVEBs),respectively.Besides the detection accuracy,sensitivity and specificity,our proposed method consumes the less CPU running time compared with the other representative state of the art methods.It can be ported to Android based embedded system,henceforth suitable for a wearable device.
文摘A quantitative structure-activity relationships (QSAR) study is suggested for the prediction of solubility of some thiazolidine-4- carboxylic acid derivatives in aqueous solution. Ab initio theory was used to calculate some quantum chemical descriptors including electrostatic potentials and local charges at each atom, HOMO and LUMO energies, etc. Modeling of the solubility of thiazolidine- 4-carboxylic acid derivatives as a function of molecular structures was established by means of the partial least squares (PLS). The subset of descriptors, which resulted in the low prediction error, was selected by genetic algorithm. This model was applied for the prediction of the solubility of some thiazolidine-4-carboxylic acid derivatives, which were not in the modeling procedure. The relative errors of prediction lower that -4% was obtained by using GA-PLS method. The resulted model showed high prediction ability with RMSEP of 3.8836 and 2.9500 for PLS and GA-PLS models, respectively.
文摘With the power system harmonic pollution problems becoming more and more serious, how to distinguish the harmonic responsibility accurately and solve the grid harmonics simply and effectively has become the main development direction in harmonic control subjects. This paper, based on linear regression analysis of basic equation and improvement equation, deduced the least squares estimation (LSE) iterative algorithm and obtained the real-time estimates of regression coefficients, and then calculated the level of the harmonic impedance and emission estimates in real time. This paper used power system simulation software Matlab/Simulink as analysis tool and analyzed the user side of the harmonic amplitude and phase fluctuations PCC (point of common coupling) at the harmonic emission level, thus the research has a certain theoretical significance. The development of this algorithm combined with the instrument can be used in practical engineering.
文摘The recursive least square is widely used in parameter identification. But if is easy to bring about the phenomena of parameters burst-off. A convergence analysis of a more stable identification algorithm-recursive damped least square is proposed. This is done by normalizing the measurement vector entering into the identification algorithm. rt is shown that the parametric distance converges to a zero mean random variable. It is also shown that under persistent excitation condition, the condition number of the adaptation gain matrix is bounded, and the variance of the parametric distance is bounded.
基金supported by the Natural Science Foundation of China (U22A20214)。
文摘Active Magnetic Bearing(AMB) is a kind of electromagnetic support that makes the rotor movement frictionless and can suppress rotor vibration by controlling the magnetic force. The most common approach to restrain the rotor vibration in AMBs is to adopt a notch filter or adaptive filter in the AMB controller. However, these methods cannot obtain the precise amplitude and phase of the compensation current. Thus, they are not so effective in terms of suppressing the vibrations of the fundamental and other harmonic orders over the whole speed range. To improve the vibration suppression performance of AMBs,an adaptive filter based on Least Mean Square(LMS) is applied to extract the vibration signals from the rotor displacement signal. An Iterative Search Algorithm(ISA) is proposed in this paper to obtain the corresponding relationship between the compensation current and vibration signals. The ISA is responsible for searching the compensating amplitude and shifting phase online for the LMS filter, enabling the AMB controller to generate the corresponding compensation force for vibration suppression. The results of ISA are recorded to suppress vibration using the Look-Up Table(LUT) in variable speed range. Comprehensive simulations and experimental validations are carried out in fixed and variable speed range, and the results demonstrate that by employing the ISA, vibrations of the fundamental and other harmonic orders are suppressed effectively.
基金National Social Science Foundation of China(No.18AGL028)Social Science Foundation of the Higher Education Institutions Jiangsu Province,China(No.2018SJZDI070)Social Science Foundation of the Jiangsu Province,China(Nos.16ZZB004,17ZTB005)
文摘Electricity is the guarantee of economic development and daily life. Thus, accurate monthly electricity consumption forecasting can provide reliable guidance for power construction planning. In this paper, a hybrid model in combination of least squares support vector machine(LSSVM) model with fruit fly optimization algorithm(FOA) and the seasonal index adjustment is constructed to predict monthly electricity consumption. The monthly electricity consumption demonstrates a nonlinear characteristic and seasonal tendency. The LSSVM has a good fit for nonlinear data, so it has been widely applied to handling nonlinear time series prediction. However, there is no unified selection method for key parameters and no unified method to deal with the effect of seasonal tendency. Therefore, the FOA was hybridized with the LSSVM and the seasonal index adjustment to solve this problem. In order to evaluate the forecasting performance of hybrid model, two samples of monthly electricity consumption of China and the United States were employed, besides several different models were applied to forecast the two empirical time series. The results of the two samples all show that, for seasonal data, the adjusted model with seasonal indexes has better forecasting performance. The forecasting performance is better than the models without seasonal indexes. The fruit fly optimized LSSVM model outperforms other alternative models. In other words, the proposed hybrid model is a feasible method for the electricity consumption forecasting.
文摘The Second Crustal Deformation Monitoring Center, China Seismological Bureau, has detected a marked uplift associated with the Gonghe Ms=7.0 earthquake on April 26, 1990, Qinghai Province. From the observed vertical deformations and using a rectangular uniform slip model in a homogeneous elastic half space, we first employ genetic algorithms (GA) to infer the approximate global optimal solution, and further use least squares method to get more accurate global optimal solution by taking the approximate solution of GA as the initial parameters of least squares. The inversion results show that the causative fault of Gonghe Ms=7.0 earthquake is a right-lateral reverse fault with strike NW60°, dip SW and dip angle 37°, the coseismic fracture length, width and slip are 37 km, 6 km and 2.7 m respectively. Combination of GA and least squares algorithms is an effective joint inversion method, which could not only escape from local optimum of least squares, but also solve the slow convergence problem of GA after reaching adjacency of global optimal solution.
文摘Compositional data, such as relative information, is a crucial aspect of machine learning and other related fields. It is typically recorded as closed data or sums to a constant, like 100%. The statistical linear model is the most used technique for identifying hidden relationships between underlying random variables of interest. However, data quality is a significant challenge in machine learning, especially when missing data is present. The linear regression model is a commonly used statistical modeling technique used in various applications to find relationships between variables of interest. When estimating linear regression parameters which are useful for things like future prediction and partial effects analysis of independent variables, maximum likelihood estimation (MLE) is the method of choice. However, many datasets contain missing observations, which can lead to costly and time-consuming data recovery. To address this issue, the expectation-maximization (EM) algorithm has been suggested as a solution for situations including missing data. The EM algorithm repeatedly finds the best estimates of parameters in statistical models that depend on variables or data that have not been observed. This is called maximum likelihood or maximum a posteriori (MAP). Using the present estimate as input, the expectation (E) step constructs a log-likelihood function. Finding the parameters that maximize the anticipated log-likelihood, as determined in the E step, is the job of the maximization (M) phase. This study looked at how well the EM algorithm worked on a made-up compositional dataset with missing observations. It used both the robust least square version and ordinary least square regression techniques. The efficacy of the EM algorithm was compared with two alternative imputation techniques, k-Nearest Neighbor (k-NN) and mean imputation (), in terms of Aitchison distances and covariance.
文摘Aimed at the problems of small gradient, low learning rate, slow convergence error when the DBN using back-propagation process to fix the network connection weight and bias, proposing a new algorithm that combines with multi-innovation theory to improve standard DBN algorithm, that is the multi-innovation DBN(MI-DBN). It sets up a new model of back-propagation process in DBN algorithm, making the use of single innovation in previous algorithm extend to the use of innovation of the preceding multiple period, thus increasing convergence rate of error largely. To study the application of the algorithm in the social computing, and recognize the meaningful information about the handwritten numbers in social networking images. This paper compares MI-DBN algorithm with other representative classifiers through experiments. The result shows that MI-DBN algorithm, comparing with other representative classifiers, has a faster convergence rate and a smaller error for MNIST dataset recognition. And handwritten numbers on the image also have a precise degree of recognition.
文摘Order-recursive least-squares(ORLS)algorithms are applied to the prob-lems of estimation and identification of FIR or ARMA system parameters where a fixedset of input signal samples is available and the desired order of the underlying model isunknown.On the basis of several universal formulae for updating nonsymmetric projec-tion operators,this paper presents three kinds of LS algorithms,called nonsymmetric,symmetric and square root normalized fast ORLS algorithms,respectively.As to the au-thors’ knowledge,the first and the third have not been so far provided,and the second isone of those which have the lowest computational requirement.Several simplified versionsof the algorithms are also considered.
基金This project is supported by the National Natural Science Foundation of China
文摘This paper presents a new highly parallel algorithm for computing the minimum-norm least-squares solution of inconsistent linear equations Ax = b(A∈Rm×n,b∈R (A)). By this algorithm the solution x = A + b is obtained in T = n(log2m + log2(n - r + 1) + 5) + log2m + 1 steps with P=mn processors when m × 2(n - 1) and with P = 2n(n - 1) processors otherwise.
文摘The neural network partial least square (NNPLS) method was used to establish a robust reaction model for a multi-component catalyst of methane oxidative coupling. The details, including the learning algorithm, the number of hidden units of the inner network, activation function, initialization of the network weights and the principal components, are discussed. The results show that the structural organizations of inner neural network are 1-10-5-1, 1-8-4-1, 1-8-5-1, 1-7-4-1, 1-8-4-1, 1-8-6-1, respectively. The Levenberg-Marquardt method was used in the learning algorithm, and the central sigmoidal function is the activation function. Calculation results show that four principal components are convenient in the use of the multi-component catalyst modeling of methane oxidative coupling. Therefore a robust reaction model expressed by NNPLS succeeds in correlating the relations between elements in catalyst and catalytic reaction results. Compared with the direct network modeling, NNPLS model can be adjusted by experimental data and the calculation of the model is simpler and faster than that of the direct network model.
基金Tianjin Natural Science Foundation !983602011National 863/CIMS Research Foundation !863-511-945-010
文摘General neural network inverse adaptive controller has two flaws: the first is the slow convergence speed; the second is the invalidation to the non-minimum phase system. These defects limit the scope in which the neural network inverse adaptive controller is used. We employ Davidon least squares in training the multi-layer feedforward neural network used in approximating the inverse model of plant to expedite the convergence, and then through constructing the pseudo-plant, a neural network inverse adaptive controller is put forward which is still effective to the nonlinear non-minimum phase system. The simulation results show the validity of this scheme.
文摘The objective of modelling from data is not that the model simply fits the training data well. Rather, the goodness of a model is characterized by its generalization capability, interpretability and ease for knowledge extraction. All these desired properties depend crucially on the ability to construct appropriate parsimonious models by the modelling process, and a basic principle in practical nonlinear data modelling is the parsimonious principle of ensuring the smallest possible model that explains the training data. There exists a vast amount of works in the area of sparse modelling, and a widely adopted approach is based on the linear-in-the-parameters data modelling that include the radial basis function network, the neurofuzzy network and all the sparse kernel modelling techniques. A well tested strategy for parsimonious modelling from data is the orthogonal least squares (OLS) algorithm for forward selection modelling, which is capable of constructing sparse models that generalise well. This contribution continues this theme and provides a unified framework for sparse modelling from data that includes regression and classification, which belong to supervised learning, and probability density function estimation, which is an unsupervised learning problem. The OLS forward selection method based on the leave-one-out test criteria is presented within this unified data-modelling framework. Examples from regression, classification and density estimation applications are used to illustrate the effectiveness of this generic parsimonious modelling approach from data.
基金The National Natural Science Foundation of China(41274010,40974007,40901172)National Key Basic Research and Development Program of China(2012AA121301)+2 种基金Hunan Provincial Natural Science Foundation of China(12JJ4035)Postgraduate Autonomous Exploration Project of Central South University(2013zzts055)China Scholarship Council(201406370079).
文摘At present,the principal data processing methods involving complex observations are based on two strategies according to characteristics of the observation process,i.e.,step-by-step and direct resolution.However,these strategies have some limitations,e.g.they cannot consider statistical observation error information,redundant observations and so on.This paper applies least squares methods to complex data processing to extend surveying adjustment theory from real to complex number space.We compared the two adjustment criteria for a complex domain in a quantitative way.In order to understand the effectiveness of complex least squares,tree height inversion from PolInSAR data is taken as an example.We firstly established both a complex adjustment function model and a stochastic model for PolInSAR tree height inversion,and then applied the complex least squares method to estimate tree height.Results show that the complex least squares approach is reliable and outperforms other classic tree height retrieval methods;the method is simple and easy to implement.
文摘This paper presents a two-level learning method for designing an optimal Radial Basis Function Network (RBFN) using Adaptive Velocity Update Relaxation Particle Swarm Optimization algorithm (AVURPSO) and Orthogonal Least Squares algorithm (OLS) called as OLS-AVURPSO method. The novelty is to develop an AVURPSO algorithm to form the hybrid OLS-AVURPSO method for designing an optimal RBFN. The proposed method at the upper level finds the global optimum of the spread factor parameter using AVURPSO while at the lower level automatically constructs the RBFN using OLS algorithm. Simulation results confirm that the RBFN is superior to Multilayered Perceptron Network (MLPN) in terms of network size and computing time. To demonstrate the effectiveness of proposed OLS-AVURPSO in the design of RBFN, the Mackey-Glass Chaotic Time-Series as an example is modeled by both MLPN and RBFN.
文摘Data coming from different sources have different types and temporal states. Relations between one type of data and another ones, or between data and unknown parameters are almost nonlinear. It is not accurate and reliable to process the data in building the digital earth with the classical least squares method or the method of the common nonlinear least squares. So a generalized nonlinear dynamic least squares method was put forward to process data in building the digital earth. A separating solution model and the iterative calculation method were used to solve the generalized nonlinear dynamic least squares problem. In fact, a complex problem can be separated and then solved by converting to two sub problems, each of which has a single variable. Therefore the dimension of unknown parameters can be reduced to its half, which simplifies the original high dimensional equations.