In view of the composition analysis and identification of ancient glass products, L1 regularization, K-Means cluster analysis, elbow rule and other methods were comprehensively used to build logical regression, cluste...In view of the composition analysis and identification of ancient glass products, L1 regularization, K-Means cluster analysis, elbow rule and other methods were comprehensively used to build logical regression, cluster analysis, hyper-parameter test and other models, and SPSS, Python and other tools were used to obtain the classification rules of glass products under different fluxes, sub classification under different chemical compositions, hyper-parameter K value test and rationality analysis. Research can provide theoretical support for the protection and restoration of ancient glass relics.展开更多
Many methods have been put forward to solve unconstrained optimization problems,among which conjugate gradient method(CG)is very important.With the increasing emergence of large⁃scale problems,the subspace technology ...Many methods have been put forward to solve unconstrained optimization problems,among which conjugate gradient method(CG)is very important.With the increasing emergence of large⁃scale problems,the subspace technology has become particularly important and widely used in the field of optimization.In this study,a new CG method was put forward,which combined subspace technology and a cubic regularization model.Besides,a special scaled norm in a cubic regularization model was analyzed.Under certain conditions,some significant characteristics of the search direction were given and the convergence of the algorithm was built.Numerical comparisons show that for the 145 test functions under the CUTEr library,the proposed method is better than two classical CG methods and two new subspaces conjugate gradient methods.展开更多
Theoretical results related to properties of a regularized recursive algorithm for estimation of a high dimensional vector of parameters are presented and proved. The recursive character of the procedure is proposed t...Theoretical results related to properties of a regularized recursive algorithm for estimation of a high dimensional vector of parameters are presented and proved. The recursive character of the procedure is proposed to overcome the difficulties with high dimension of the observation vector in computation of a statistical regularized estimator. As to deal with high dimension of the vector of unknown parameters, the regularization is introduced by specifying a priori non-negative covariance structure for the vector of estimated parameters. Numerical example with Monte-Carlo simulation for a low-dimensional system as well as the state/parameter estimation in a very high dimensional oceanic model is presented to demonstrate the efficiency of the proposed approach.展开更多
A GMM (Gaussian Mixture Model) based adaptive image restoration is proposed in this paper. The feature vectors of pixels are selected and extracted. Pixels are clustered into smooth,edge or detail texture region accor...A GMM (Gaussian Mixture Model) based adaptive image restoration is proposed in this paper. The feature vectors of pixels are selected and extracted. Pixels are clustered into smooth,edge or detail texture region according to variance-sum criteria function of the feature vectors. Then pa-rameters of GMM are calculated by using the statistical information of these feature vectors. GMM predicts the regularization parameter for each pixel adaptively. Hopfield Neural Network (Hopfield-NN) is used to optimize the objective function of image restoration,and network weight value matrix is updated by the output of GMM. Since GMM is used,the regularization parameters share properties of different kind of regions. In addition,the regularization parameters are different from pixel to pixel. GMM-based regularization method is consistent with human visual system,and it has strong gener-alization capability. Comparing with non-adaptive and some adaptive image restoration algorithms,experimental results show that the proposed algorithm obtains more preferable restored images.展开更多
How to get the rapid and stable inversion results and reconstruct the clear subsurface resistivity structures is a focus problem in current magnetotelluric inversion. A stable solution of an ill-posed inverse problem ...How to get the rapid and stable inversion results and reconstruct the clear subsurface resistivity structures is a focus problem in current magnetotelluric inversion. A stable solution of an ill-posed inverse problem was obtained by the regularization methods in which some desired structures were imposed to stabilize the inverse problem. By the smoothness-constrained model and approximate sensitivity method, the stable subsurface resistivity structures were reconstructed. The synthetic examples show that the smoothness-constrained regularized inversion method is effective and can be reasonable to reconstruct three-dimensional subsurface resistivity structures.展开更多
In order to decrease the sensitivity of the constant scale parameter, adaptively optimize the scale parameter in the iteration regularization model (IRM) and attain a desirable level of applicability for image denoi...In order to decrease the sensitivity of the constant scale parameter, adaptively optimize the scale parameter in the iteration regularization model (IRM) and attain a desirable level of applicability for image denoising, a novel IRM with the adaptive scale parameter is proposed. First, the classic regularization item is modified and the equation of the adaptive scale parameter is deduced. Then, the initial value of the varying scale parameter is obtained by the trend of the number of iterations and the scale parameter sequence vectors. Finally, the novel iterative regularization method is used for image denoising. Numerical experiments show that compared with the IRM with the constant scale parameter, the proposed method with the varying scale parameter can not only reduce the number of iterations when the scale parameter becomes smaller, but also efficiently remove noise when the scale parameter becomes bigger and well preserve the details of images.展开更多
Bayesian regularized BP neural network(BRBPNN) technique was applied in the chlorophyll-α prediction of Nanzui water area in Dongting Lake. Through BP network interpolation method, the input and output samples of t...Bayesian regularized BP neural network(BRBPNN) technique was applied in the chlorophyll-α prediction of Nanzui water area in Dongting Lake. Through BP network interpolation method, the input and output samples of the network were obtained. After the selection of input variables using stepwise/multiple linear regression method in SPSS i1.0 software, the BRBPNN model was established between chlorophyll-α and environmental parameters, biological parameters. The achieved optimal network structure was 3-11-1 with the correlation coefficients and the mean square errors for the training set and the test set as 0.999 and 0.000?8426, 0.981 and 0.0216 respectively. The sum of square weights between each input neuron and the hidden layer of optimal BRBPNN models of different structures indicated that the effect of individual input parameter on chlorophyll- α declined in the order of alga amount 〉 secchi disc depth(SD) 〉 electrical conductivity (EC). Additionally, it also demonstrated that the contributions of these three factors were the maximal for the change of chlorophyll-α concentration, total phosphorus(TP) and total nitrogen(TN) were the minimal. All the results showed that BRBPNN model was capable of automated regularization parameter selection and thus it may ensure the excellent generation ability and robustness. Thus, this study laid the foundation for the application of BRBPNN model in the analysis of aquatic ecological data(chlorophyll-α prediction) and the explanation about the effective eutrophication treatment measures for Nanzui water area in Dongting Lake.展开更多
The modified sub regular solution model was used for a calculation of the activity coefficient of immiscible binary alloy systems. The parameters needed for the calculation are the interaction parameters, λ 1 a...The modified sub regular solution model was used for a calculation of the activity coefficient of immiscible binary alloy systems. The parameters needed for the calculation are the interaction parameters, λ 1 and λ 2, which are represented as a linear function of temperature, T . The molar excess Gibbs free energy, G m E, can be written in the form G m E= x A x B[( λ 11 + λ 12 T )+( λ 21 + λ 22 T ) x B ] The calculation is carried out numerically for three immiscible binary alloy systems, Al Pb, Cu Tl and In V. The agreement between the calculated and experimentally determined values of activity coefficient is excellent.展开更多
In this paper, we present a noise removal technique by combining the P-M model with the LLT model. The combined technique takes full use of the advantage of both filters which is able to preserve edges and simultaneou...In this paper, we present a noise removal technique by combining the P-M model with the LLT model. The combined technique takes full use of the advantage of both filters which is able to preserve edges and simultaneously overcomes the staircase effect. We use a weighting function in our model, and compare this model with the P-M model as well as other fourth-order functional both in theory and numerical experiment.展开更多
Neural networks based on high-dimensional random feature generation have become popular under the notions extreme learning machine (ELM) and reservoir computing (RC). We provide an in-depth analysis of such networks w...Neural networks based on high-dimensional random feature generation have become popular under the notions extreme learning machine (ELM) and reservoir computing (RC). We provide an in-depth analysis of such networks with respect to feature selection, model complexity, and regularization. Starting from an ELM, we show how recurrent connections increase the effective complexity leading to reservoir networks. On the contrary, intrinsic plasticity (IP), a biologically inspired, unsupervised learning rule, acts as a task-specific feature regularizer, which tunes the effective model complexity. Combing both mechanisms in the framework of static reservoir computing, we achieve an excellent balance of feature complexity and regularization, which provides an impressive robustness to other model selection parameters like network size, initialization ranges, or the regularization parameter of the output learning. We demonstrate the advantages on several synthetic data as well as on benchmark tasks from the UCI repository providing practical insights how to use high-dimensional random networks for data processing.展开更多
Crosswell seismic tomography can be used to study the lateral variation of reservoirs, reservoir properties and the dynamic movement of fluids. In view of the instability of crosswell seismic tomography, the gradient ...Crosswell seismic tomography can be used to study the lateral variation of reservoirs, reservoir properties and the dynamic movement of fluids. In view of the instability of crosswell seismic tomography, the gradient method was improved by introducing regularization, and a gradient regularization method is presented in this paper. This method was verified by processing numerical simulation data and physical model data.展开更多
To improve forecasting and sustained control level of underground pests, trapping quantity of underground pests (black cutworm,mole cricket and scar-ab) by lamps and their field dynamics in Hangzhou district from 20...To improve forecasting and sustained control level of underground pests, trapping quantity of underground pests (black cutworm,mole cricket and scar-ab) by lamps and their field dynamics in Hangzhou district from 2005 to 2011 were investigated in the paper. The results showed that different pests had obvious differences in population dynamic. The black cutworm (Agrotis ypsilon) had several damage peaks (late May, late June and late July) and the moth amount in early period was relatively high. The mole cricket ( Gryllotalpa africana) had two damage peaks (late May to early July, early September to mid and late October). The scarab (Anomala corpulenta) had one damage peak (late May to late June). There were periodic changes in total quantity of underground pests among years, and the peak period appeared in the year of 2005, 2007 to 2009 and 2011, respectively. On this basis, temperature, humidity, rainfall and light were used as forecas- ting factors, using the method of stepwise regression, 19 factors with significant correlation were screened out and prediction models for occurrence quantity and oc- currence period of the three pests were established. By using accuracy degree judge model for verification, the score values of prediction model for occurrence quan-tity and occurrence period of the three underground pests were more than 58 and 70, which indicated that the historical coincident rate and prediction accuracy of estabhshed prediction models were good.展开更多
Because it is hard to search similar structure for low similarity unknown structure proteins directly from the Protein Data Bank (PDB) database, 3D-structure is modeled in this paper for secondary structure regular ...Because it is hard to search similar structure for low similarity unknown structure proteins directly from the Protein Data Bank (PDB) database, 3D-structure is modeled in this paper for secondary structure regular fragments (α-Helices, β-Strands) of such proteins by the protein secondary structure prediction software, the Basic Local Alignment Search Tool (BLAST) and the side chain construction software SCWRL3. First, the protein secondary structure prediction software is adopted to extract secondary structure fragments from the unknown structure proteins. Then, regular fragments are regulated by BLAST based on comparative modeling, providing main chain configurations. Finally, SCWRL3 is applied to assemble side chains for regular fragments, so that 3D-structure of regular fragments of low similarity unknown structure protein is obtained. Regular fragments of several neurotoxins are used for test. Simulation results show that the prediction errors are less than 0.06nm for regular fragments less than 10 amino acids, implying the simpleness and effectiveness of the proposed method.展开更多
文摘In view of the composition analysis and identification of ancient glass products, L1 regularization, K-Means cluster analysis, elbow rule and other methods were comprehensively used to build logical regression, cluster analysis, hyper-parameter test and other models, and SPSS, Python and other tools were used to obtain the classification rules of glass products under different fluxes, sub classification under different chemical compositions, hyper-parameter K value test and rationality analysis. Research can provide theoretical support for the protection and restoration of ancient glass relics.
基金Sponsored by the National Natural Science Foundation of China(Grant No.11901561).
文摘Many methods have been put forward to solve unconstrained optimization problems,among which conjugate gradient method(CG)is very important.With the increasing emergence of large⁃scale problems,the subspace technology has become particularly important and widely used in the field of optimization.In this study,a new CG method was put forward,which combined subspace technology and a cubic regularization model.Besides,a special scaled norm in a cubic regularization model was analyzed.Under certain conditions,some significant characteristics of the search direction were given and the convergence of the algorithm was built.Numerical comparisons show that for the 145 test functions under the CUTEr library,the proposed method is better than two classical CG methods and two new subspaces conjugate gradient methods.
文摘Theoretical results related to properties of a regularized recursive algorithm for estimation of a high dimensional vector of parameters are presented and proved. The recursive character of the procedure is proposed to overcome the difficulties with high dimension of the observation vector in computation of a statistical regularized estimator. As to deal with high dimension of the vector of unknown parameters, the regularization is introduced by specifying a priori non-negative covariance structure for the vector of estimated parameters. Numerical example with Monte-Carlo simulation for a low-dimensional system as well as the state/parameter estimation in a very high dimensional oceanic model is presented to demonstrate the efficiency of the proposed approach.
文摘A GMM (Gaussian Mixture Model) based adaptive image restoration is proposed in this paper. The feature vectors of pixels are selected and extracted. Pixels are clustered into smooth,edge or detail texture region according to variance-sum criteria function of the feature vectors. Then pa-rameters of GMM are calculated by using the statistical information of these feature vectors. GMM predicts the regularization parameter for each pixel adaptively. Hopfield Neural Network (Hopfield-NN) is used to optimize the objective function of image restoration,and network weight value matrix is updated by the output of GMM. Since GMM is used,the regularization parameters share properties of different kind of regions. In addition,the regularization parameters are different from pixel to pixel. GMM-based regularization method is consistent with human visual system,and it has strong gener-alization capability. Comparing with non-adaptive and some adaptive image restoration algorithms,experimental results show that the proposed algorithm obtains more preferable restored images.
基金Project(20110162120064)supported by Higher School Doctor Subject Special Scientific Research Foundation of ChinaProject(10JJ6059)supported by the Natural Science Foundation of Hunan Province,China
文摘How to get the rapid and stable inversion results and reconstruct the clear subsurface resistivity structures is a focus problem in current magnetotelluric inversion. A stable solution of an ill-posed inverse problem was obtained by the regularization methods in which some desired structures were imposed to stabilize the inverse problem. By the smoothness-constrained model and approximate sensitivity method, the stable subsurface resistivity structures were reconstructed. The synthetic examples show that the smoothness-constrained regularized inversion method is effective and can be reasonable to reconstruct three-dimensional subsurface resistivity structures.
基金The National Natural Science Foundation of China(No.60702069)the Research Project of Department of Education of Zhe-jiang Province (No.20060601)+1 种基金the Natural Science Foundation of Zhe-jiang Province (No.Y1080851)Shanghai International Cooperation onRegion of France (No.06SR07109)
文摘In order to decrease the sensitivity of the constant scale parameter, adaptively optimize the scale parameter in the iteration regularization model (IRM) and attain a desirable level of applicability for image denoising, a novel IRM with the adaptive scale parameter is proposed. First, the classic regularization item is modified and the equation of the adaptive scale parameter is deduced. Then, the initial value of the varying scale parameter is obtained by the trend of the number of iterations and the scale parameter sequence vectors. Finally, the novel iterative regularization method is used for image denoising. Numerical experiments show that compared with the IRM with the constant scale parameter, the proposed method with the varying scale parameter can not only reduce the number of iterations when the scale parameter becomes smaller, but also efficiently remove noise when the scale parameter becomes bigger and well preserve the details of images.
文摘Bayesian regularized BP neural network(BRBPNN) technique was applied in the chlorophyll-α prediction of Nanzui water area in Dongting Lake. Through BP network interpolation method, the input and output samples of the network were obtained. After the selection of input variables using stepwise/multiple linear regression method in SPSS i1.0 software, the BRBPNN model was established between chlorophyll-α and environmental parameters, biological parameters. The achieved optimal network structure was 3-11-1 with the correlation coefficients and the mean square errors for the training set and the test set as 0.999 and 0.000?8426, 0.981 and 0.0216 respectively. The sum of square weights between each input neuron and the hidden layer of optimal BRBPNN models of different structures indicated that the effect of individual input parameter on chlorophyll- α declined in the order of alga amount 〉 secchi disc depth(SD) 〉 electrical conductivity (EC). Additionally, it also demonstrated that the contributions of these three factors were the maximal for the change of chlorophyll-α concentration, total phosphorus(TP) and total nitrogen(TN) were the minimal. All the results showed that BRBPNN model was capable of automated regularization parameter selection and thus it may ensure the excellent generation ability and robustness. Thus, this study laid the foundation for the application of BRBPNN model in the analysis of aquatic ecological data(chlorophyll-α prediction) and the explanation about the effective eutrophication treatment measures for Nanzui water area in Dongting Lake.
文摘The modified sub regular solution model was used for a calculation of the activity coefficient of immiscible binary alloy systems. The parameters needed for the calculation are the interaction parameters, λ 1 and λ 2, which are represented as a linear function of temperature, T . The molar excess Gibbs free energy, G m E, can be written in the form G m E= x A x B[( λ 11 + λ 12 T )+( λ 21 + λ 22 T ) x B ] The calculation is carried out numerically for three immiscible binary alloy systems, Al Pb, Cu Tl and In V. The agreement between the calculated and experimentally determined values of activity coefficient is excellent.
文摘In this paper, we present a noise removal technique by combining the P-M model with the LLT model. The combined technique takes full use of the advantage of both filters which is able to preserve edges and simultaneously overcomes the staircase effect. We use a weighting function in our model, and compare this model with the P-M model as well as other fourth-order functional both in theory and numerical experiment.
文摘Neural networks based on high-dimensional random feature generation have become popular under the notions extreme learning machine (ELM) and reservoir computing (RC). We provide an in-depth analysis of such networks with respect to feature selection, model complexity, and regularization. Starting from an ELM, we show how recurrent connections increase the effective complexity leading to reservoir networks. On the contrary, intrinsic plasticity (IP), a biologically inspired, unsupervised learning rule, acts as a task-specific feature regularizer, which tunes the effective model complexity. Combing both mechanisms in the framework of static reservoir computing, we achieve an excellent balance of feature complexity and regularization, which provides an impressive robustness to other model selection parameters like network size, initialization ranges, or the regularization parameter of the output learning. We demonstrate the advantages on several synthetic data as well as on benchmark tasks from the UCI repository providing practical insights how to use high-dimensional random networks for data processing.
文摘Crosswell seismic tomography can be used to study the lateral variation of reservoirs, reservoir properties and the dynamic movement of fluids. In view of the instability of crosswell seismic tomography, the gradient method was improved by introducing regularization, and a gradient regularization method is presented in this paper. This method was verified by processing numerical simulation data and physical model data.
基金Supported by Science and Technology Project of Hangzhou City (20110232B17)
文摘To improve forecasting and sustained control level of underground pests, trapping quantity of underground pests (black cutworm,mole cricket and scar-ab) by lamps and their field dynamics in Hangzhou district from 2005 to 2011 were investigated in the paper. The results showed that different pests had obvious differences in population dynamic. The black cutworm (Agrotis ypsilon) had several damage peaks (late May, late June and late July) and the moth amount in early period was relatively high. The mole cricket ( Gryllotalpa africana) had two damage peaks (late May to early July, early September to mid and late October). The scarab (Anomala corpulenta) had one damage peak (late May to late June). There were periodic changes in total quantity of underground pests among years, and the peak period appeared in the year of 2005, 2007 to 2009 and 2011, respectively. On this basis, temperature, humidity, rainfall and light were used as forecas- ting factors, using the method of stepwise regression, 19 factors with significant correlation were screened out and prediction models for occurrence quantity and oc- currence period of the three pests were established. By using accuracy degree judge model for verification, the score values of prediction model for occurrence quan-tity and occurrence period of the three underground pests were more than 58 and 70, which indicated that the historical coincident rate and prediction accuracy of estabhshed prediction models were good.
基金Sponsored by the National Natural Science Foundation of China (60374069) and the Excellent Young Scholars Research Fund of Beijing Institute of Technology (000Y01-3).
文摘Because it is hard to search similar structure for low similarity unknown structure proteins directly from the Protein Data Bank (PDB) database, 3D-structure is modeled in this paper for secondary structure regular fragments (α-Helices, β-Strands) of such proteins by the protein secondary structure prediction software, the Basic Local Alignment Search Tool (BLAST) and the side chain construction software SCWRL3. First, the protein secondary structure prediction software is adopted to extract secondary structure fragments from the unknown structure proteins. Then, regular fragments are regulated by BLAST based on comparative modeling, providing main chain configurations. Finally, SCWRL3 is applied to assemble side chains for regular fragments, so that 3D-structure of regular fragments of low similarity unknown structure protein is obtained. Regular fragments of several neurotoxins are used for test. Simulation results show that the prediction errors are less than 0.06nm for regular fragments less than 10 amino acids, implying the simpleness and effectiveness of the proposed method.