Principal Component Analysis (PCA) is a widely used technique for data analysis and dimensionality reduction, but its sensitivity to feature scale and outliers limits its applicability. Robust Principal Component Anal...Principal Component Analysis (PCA) is a widely used technique for data analysis and dimensionality reduction, but its sensitivity to feature scale and outliers limits its applicability. Robust Principal Component Analysis (RPCA) addresses these limitations by decomposing data into a low-rank matrix capturing the underlying structure and a sparse matrix identifying outliers, enhancing robustness against noise and outliers. This paper introduces a novel RPCA variant, Robust PCA Integrating Sparse and Low-rank Priors (RPCA-SL). Each prior targets a specific aspect of the data’s underlying structure and their combination allows for a more nuanced and accurate separation of the main data components from outliers and noise. Then RPCA-SL is solved by employing a proximal gradient algorithm for improved anomaly detection and data decomposition. Experimental results on simulation and real data demonstrate significant advancements.展开更多
In underdetermined blind source separation, more sources are to be estimated from less observed mixtures without knowing source signals and the mixing matrix. This paper presents a robust clustering algorithm for unde...In underdetermined blind source separation, more sources are to be estimated from less observed mixtures without knowing source signals and the mixing matrix. This paper presents a robust clustering algorithm for underdetermined blind separation of sparse sources with unknown number of sources in the presence of noise. It uses the robust competitive agglomeration (RCA) algorithm to estimate the source number and the mixing matrix, and the source signals then are recovered by using the interior point linear programming. Simulation results show good performance of the proposed algorithm for underdetermined blind sources separation (UBSS).展开更多
Least squares projection twin support vector machine(LSPTSVM)has faster computing speed than classical least squares support vector machine(LSSVM).However,LSPTSVM is sensitive to outliers and its solution lacks sparsi...Least squares projection twin support vector machine(LSPTSVM)has faster computing speed than classical least squares support vector machine(LSSVM).However,LSPTSVM is sensitive to outliers and its solution lacks sparsity.Therefore,it is difficult for LSPTSVM to process large-scale datasets with outliers.In this paper,we propose a robust LSPTSVM model(called R-LSPTSVM)by applying truncated least squares loss function.The robustness of R-LSPTSVM is proved from a weighted perspective.Furthermore,we obtain the sparse solution of R-LSPTSVM by using the pivoting Cholesky factorization method in primal space.Finally,the sparse R-LSPTSVM algorithm(SR-LSPTSVM)is proposed.Experimental results show that SR-LSPTSVM is insensitive to outliers and can deal with large-scale datasets fastly.展开更多
In this paper, based on sparse representation classification and robust thought, we propose a new classifier, named MRSRC (Metasample Based Robust Sparse Representation Classificatier), for DNA microarray data classif...In this paper, based on sparse representation classification and robust thought, we propose a new classifier, named MRSRC (Metasample Based Robust Sparse Representation Classificatier), for DNA microarray data classification. Firstly, we extract Metasample from trainning sample. Secondly, a weighted matrix W is added to solve an l1-regular- ized least square problem. Finally, the testing sample is classified according to the sparsity coefficient vector of it. The experimental results on the DNA microarray data classification prove that the proposed algorithm is efficient.展开更多
The traditional estimation of Gaussian mixture model is sensitive to heavy-tailed errors;thus we propose a robust mixture regression model by assuming that the error terms follow a Laplace distribution in this article...The traditional estimation of Gaussian mixture model is sensitive to heavy-tailed errors;thus we propose a robust mixture regression model by assuming that the error terms follow a Laplace distribution in this article. And for the variable selection problem in our new robust mixture regression model, we introduce the adaptive sparse group Lasso penalty to achieve sparsity at both the group-level and within-group-level. As numerical experiments show, compared with other alternative methods, our method has better performances in variable selection and parameter estimation. Finally, we apply our proposed method to analyze NBA salary data during the period from 2018 to 2019.展开更多
We consider sparse signals embedded in additive white noise. We study parametrically optimal as well as tree-search sub-optimal signal detection policies. As a special case, we consider a constant signal and Gaussian ...We consider sparse signals embedded in additive white noise. We study parametrically optimal as well as tree-search sub-optimal signal detection policies. As a special case, we consider a constant signal and Gaussian noise, with and without data outliers present. In the presence of outliers, we study outlier resistant robust detection techniques. We compare the studied policies in terms of error performance, complexity and resistance to outliers.展开更多
We cast vehicle recognition as problem of feature representation and classification, and introduce a sparse learning based framework for vehicle recognition and classification in this paper. After objects captured wit...We cast vehicle recognition as problem of feature representation and classification, and introduce a sparse learning based framework for vehicle recognition and classification in this paper. After objects captured with a GMM background subtraction program, images are labeled with vehicle type for dictionary learning and decompose the images with sparse coding (SC), a linear SVM trained with the SC feature for vehicle classification. A simple but efficient active learning stategy is adopted by adding the false positive samples into previous training set for dictionary and SVM model retraining. Compared with traditional feature representation and classification realized with SVM, SC method achieves dramatically improvement on classification accuracy and exhibits strong robustness. The work is also validated on real-world surveillance video.展开更多
The sparse phase retrieval aims to recover the sparse signal from quadratic measurements. However, the measurements are often affected by outliers and asymmetric distribution noise. This paper introduces a novel metho...The sparse phase retrieval aims to recover the sparse signal from quadratic measurements. However, the measurements are often affected by outliers and asymmetric distribution noise. This paper introduces a novel method that combines the quantile regression and the L<sub>1/2</sub>-regularizer. It is a non-convex, non-smooth, non-Lipschitz optimization problem. We propose an efficient algorithm based on the Alternating Direction Methods of Multiplier (ADMM) to solve the corresponding optimization problem. Numerous numerical experiments show that this method can recover sparse signals with fewer measurements and is robust to dense bounded noise and Laplace noise.展开更多
This paper presents a robust topology optimization design approach for multi-material functional graded structures under periodic constraint with load uncertainties.To characterize the random-field uncertainties with ...This paper presents a robust topology optimization design approach for multi-material functional graded structures under periodic constraint with load uncertainties.To characterize the random-field uncertainties with a reduced set of random variables,the Karhunen-Lo`eve(K-L)expansion is adopted.The sparse grid numerical integration method is employed to transform the robust topology optimization into a weighted summation of series of deterministic topology optimization.Under dividing the design domain,the volume fraction of each preset gradient layer is extracted.Based on the ordered solid isotropic microstructure with penalization(Ordered-SIMP),a functionally graded multi-material interpolation model is formulated by individually optimizing each preset gradient layer.The periodic constraint setting of the gradient layer is achieved by redistributing the average element compliance in sub-regions.Then,the method of moving asymptotes(MMA)is introduced to iteratively update the design variables.Several numerical examples are presented to verify the validity and applicability of the proposed method.The results demonstrate that the periodic functionally graded multi-material topology can be obtained under different numbers of sub-regions,and robust design structures are more stable than that indicated by the deterministic results.展开更多
Transportation network vulnerability analysis has developed increasingly in the last decade with the goal to identify the most critical locations against incidences.In this domain,many of the previous researches have ...Transportation network vulnerability analysis has developed increasingly in the last decade with the goal to identify the most critical locations against incidences.In this domain,many of the previous researches have focused on congested urban networks;however,there is still a need to consider regional and interurban sparse rail networks,specifically those networks in developing countries.In such sparse rail networks,there are limited possibilities to redirect trains if a link is disrupted,there might be less possibility of finding redundant alternative routes,and network failures are usually accompanied by a phenomenon called‘unsatisfied demand.’The study reported in this paper stemmed from research aimed to design precautionary actions for a developing country’s sparse railway system.Our study framework deemed to find the most vulnerable part of an inter-urban sparse rail network using a network scan approach,which found the consequences of network disruptions.A number of criteria were defined to determine the total cost including unsatisfied demand and additional transportation costs due to disruptions.The results showed that how well the process of the vulnerability analysis,considering the features of both supply and demand sides,can be a guide for railway authorities in applying system safety measures.展开更多
Reinforcement learning as autonomous learning is greatly driving artificial intelligence(AI)development to practical applications.Having demonstrated the potential to significantly improve synchronously parallel learn...Reinforcement learning as autonomous learning is greatly driving artificial intelligence(AI)development to practical applications.Having demonstrated the potential to significantly improve synchronously parallel learning,the parallel computing based asynchronous advantage actor-critic(A3C)opens a new door for reinforcement learning.Unfortunately,the acceleration's influence on A3C robustness has been largely overlooked.In this paper,we perform the first robustness assessment of A3C based on parallel computing.By perceiving the policy's action,we construct a global matrix of action probability deviation and define two novel measures of skewness and sparseness to form an integral robustness measure.Based on such static assessment,we then develop a dynamic robustness assessing algorithm through situational whole-space state sampling of changing episodes.Extensive experiments with different combinations of agent number and learning rate are implemented on an A3C-based pathfinding application,demonstrating that our proposed robustness assessment can effectively measure the robustness of A3C,which can achieve an accuracy of 83.3%.展开更多
针对经典最近等值线迭代(ICCP)算法因重力异常测量误差导致匹配精度下降甚至失效的问题,提出联合抗差匹配算法以提高匹配精度及可靠性。首先,分析了匹配点集间的匹配残差在高斯噪声影响下呈非高斯分布,为抑制其影响,采用l_(p)范数代替l_...针对经典最近等值线迭代(ICCP)算法因重力异常测量误差导致匹配精度下降甚至失效的问题,提出联合抗差匹配算法以提高匹配精度及可靠性。首先,分析了匹配点集间的匹配残差在高斯噪声影响下呈非高斯分布,为抑制其影响,采用l_(p)范数代替l_(2)范数计算匹配残差,并利用匹配残差重调野值点以获得有效的匹配区域。在此基础上,提出混合稀疏ICCP算法,并利用其进行粗匹配,然后将粗匹配后的位置作为惯导系统(INS)指示位置,再使用经典ICCP算法进行精匹配,获得更高的定位精度。仿真结果表明,考虑重力异常测量误差的情况下,重力联合抗差匹配算法的误差最大值小于1 n mile,导航精度较传统ICCP算法提升60%以上,提升了算法的鲁棒性和匹配精度。展开更多
Block principle and pattern classification component analysis (BPCA) is a recently developed technique in computer vision In this paper, we propose a robust and sparse BPCA with Lp-norm, referred to as BPCALp-S, whi...Block principle and pattern classification component analysis (BPCA) is a recently developed technique in computer vision In this paper, we propose a robust and sparse BPCA with Lp-norm, referred to as BPCALp-S, which inherits the robustness of BPCA-L1 due to the employment of adjustable Lp-norm. In order to perform a sparse modelling, the elastic net is integrated into the objective function. An iterative algorithm which extracts feature vectors one by one greedily is elaborately designed. The monotonicity of the proposed iterative procedure is theoretically guaranteed. Experiments of image classification and reconstruction on several benchmark sets show the effectiveness of the proposed approach.展开更多
文摘Principal Component Analysis (PCA) is a widely used technique for data analysis and dimensionality reduction, but its sensitivity to feature scale and outliers limits its applicability. Robust Principal Component Analysis (RPCA) addresses these limitations by decomposing data into a low-rank matrix capturing the underlying structure and a sparse matrix identifying outliers, enhancing robustness against noise and outliers. This paper introduces a novel RPCA variant, Robust PCA Integrating Sparse and Low-rank Priors (RPCA-SL). Each prior targets a specific aspect of the data’s underlying structure and their combination allows for a more nuanced and accurate separation of the main data components from outliers and noise. Then RPCA-SL is solved by employing a proximal gradient algorithm for improved anomaly detection and data decomposition. Experimental results on simulation and real data demonstrate significant advancements.
基金the Research Foundation for Doctoral Programs of Higher Education of China (Grant No.20060280003)the Shanghai Leading Academic Discipline Project (Grant No.T0102)
文摘In underdetermined blind source separation, more sources are to be estimated from less observed mixtures without knowing source signals and the mixing matrix. This paper presents a robust clustering algorithm for underdetermined blind separation of sparse sources with unknown number of sources in the presence of noise. It uses the robust competitive agglomeration (RCA) algorithm to estimate the source number and the mixing matrix, and the source signals then are recovered by using the interior point linear programming. Simulation results show good performance of the proposed algorithm for underdetermined blind sources separation (UBSS).
基金supported by the National Natural Science Foundation of China(6177202062202433+4 种基金621723716227242262036010)the Natural Science Foundation of Henan Province(22100002)the Postdoctoral Research Grant in Henan Province(202103111)。
文摘Least squares projection twin support vector machine(LSPTSVM)has faster computing speed than classical least squares support vector machine(LSSVM).However,LSPTSVM is sensitive to outliers and its solution lacks sparsity.Therefore,it is difficult for LSPTSVM to process large-scale datasets with outliers.In this paper,we propose a robust LSPTSVM model(called R-LSPTSVM)by applying truncated least squares loss function.The robustness of R-LSPTSVM is proved from a weighted perspective.Furthermore,we obtain the sparse solution of R-LSPTSVM by using the pivoting Cholesky factorization method in primal space.Finally,the sparse R-LSPTSVM algorithm(SR-LSPTSVM)is proposed.Experimental results show that SR-LSPTSVM is insensitive to outliers and can deal with large-scale datasets fastly.
文摘In this paper, based on sparse representation classification and robust thought, we propose a new classifier, named MRSRC (Metasample Based Robust Sparse Representation Classificatier), for DNA microarray data classification. Firstly, we extract Metasample from trainning sample. Secondly, a weighted matrix W is added to solve an l1-regular- ized least square problem. Finally, the testing sample is classified according to the sparsity coefficient vector of it. The experimental results on the DNA microarray data classification prove that the proposed algorithm is efficient.
文摘The traditional estimation of Gaussian mixture model is sensitive to heavy-tailed errors;thus we propose a robust mixture regression model by assuming that the error terms follow a Laplace distribution in this article. And for the variable selection problem in our new robust mixture regression model, we introduce the adaptive sparse group Lasso penalty to achieve sparsity at both the group-level and within-group-level. As numerical experiments show, compared with other alternative methods, our method has better performances in variable selection and parameter estimation. Finally, we apply our proposed method to analyze NBA salary data during the period from 2018 to 2019.
文摘We consider sparse signals embedded in additive white noise. We study parametrically optimal as well as tree-search sub-optimal signal detection policies. As a special case, we consider a constant signal and Gaussian noise, with and without data outliers present. In the presence of outliers, we study outlier resistant robust detection techniques. We compare the studied policies in terms of error performance, complexity and resistance to outliers.
基金the National Natural Science Foundation of China under Grant NO 61472166,NO 61105015,Jiangsu Provincial Natural Science Foundation under Grant NO BK2010366 and Key Laboratory of Cloud Computing and Intelligent Information Processing of Changzhou City under Grand NO CM20123004
文摘We cast vehicle recognition as problem of feature representation and classification, and introduce a sparse learning based framework for vehicle recognition and classification in this paper. After objects captured with a GMM background subtraction program, images are labeled with vehicle type for dictionary learning and decompose the images with sparse coding (SC), a linear SVM trained with the SC feature for vehicle classification. A simple but efficient active learning stategy is adopted by adding the false positive samples into previous training set for dictionary and SVM model retraining. Compared with traditional feature representation and classification realized with SVM, SC method achieves dramatically improvement on classification accuracy and exhibits strong robustness. The work is also validated on real-world surveillance video.
文摘The sparse phase retrieval aims to recover the sparse signal from quadratic measurements. However, the measurements are often affected by outliers and asymmetric distribution noise. This paper introduces a novel method that combines the quantile regression and the L<sub>1/2</sub>-regularizer. It is a non-convex, non-smooth, non-Lipschitz optimization problem. We propose an efficient algorithm based on the Alternating Direction Methods of Multiplier (ADMM) to solve the corresponding optimization problem. Numerous numerical experiments show that this method can recover sparse signals with fewer measurements and is robust to dense bounded noise and Laplace noise.
基金This work is supported by the Natural Science Foundation of China(Grant 51705268)China Postdoctoral Science Foundation Funded Project(Grant 2017M612191).
文摘This paper presents a robust topology optimization design approach for multi-material functional graded structures under periodic constraint with load uncertainties.To characterize the random-field uncertainties with a reduced set of random variables,the Karhunen-Lo`eve(K-L)expansion is adopted.The sparse grid numerical integration method is employed to transform the robust topology optimization into a weighted summation of series of deterministic topology optimization.Under dividing the design domain,the volume fraction of each preset gradient layer is extracted.Based on the ordered solid isotropic microstructure with penalization(Ordered-SIMP),a functionally graded multi-material interpolation model is formulated by individually optimizing each preset gradient layer.The periodic constraint setting of the gradient layer is achieved by redistributing the average element compliance in sub-regions.Then,the method of moving asymptotes(MMA)is introduced to iteratively update the design variables.Several numerical examples are presented to verify the validity and applicability of the proposed method.The results demonstrate that the periodic functionally graded multi-material topology can be obtained under different numbers of sub-regions,and robust design structures are more stable than that indicated by the deterministic results.
文摘Transportation network vulnerability analysis has developed increasingly in the last decade with the goal to identify the most critical locations against incidences.In this domain,many of the previous researches have focused on congested urban networks;however,there is still a need to consider regional and interurban sparse rail networks,specifically those networks in developing countries.In such sparse rail networks,there are limited possibilities to redirect trains if a link is disrupted,there might be less possibility of finding redundant alternative routes,and network failures are usually accompanied by a phenomenon called‘unsatisfied demand.’The study reported in this paper stemmed from research aimed to design precautionary actions for a developing country’s sparse railway system.Our study framework deemed to find the most vulnerable part of an inter-urban sparse rail network using a network scan approach,which found the consequences of network disruptions.A number of criteria were defined to determine the total cost including unsatisfied demand and additional transportation costs due to disruptions.The results showed that how well the process of the vulnerability analysis,considering the features of both supply and demand sides,can be a guide for railway authorities in applying system safety measures.
基金supported by the National Natural Science Foundation of China under Grant Nos.61972025,61802389,61672092,U1811264,and 61966009the National Key Research and Development Program of China under Grant Nos.2020YFB1005604 and 2020YFB2103802Guangxi Key Laboratory of Trusted Software under Grant No.KX201902.
文摘Reinforcement learning as autonomous learning is greatly driving artificial intelligence(AI)development to practical applications.Having demonstrated the potential to significantly improve synchronously parallel learning,the parallel computing based asynchronous advantage actor-critic(A3C)opens a new door for reinforcement learning.Unfortunately,the acceleration's influence on A3C robustness has been largely overlooked.In this paper,we perform the first robustness assessment of A3C based on parallel computing.By perceiving the policy's action,we construct a global matrix of action probability deviation and define two novel measures of skewness and sparseness to form an integral robustness measure.Based on such static assessment,we then develop a dynamic robustness assessing algorithm through situational whole-space state sampling of changing episodes.Extensive experiments with different combinations of agent number and learning rate are implemented on an A3C-based pathfinding application,demonstrating that our proposed robustness assessment can effectively measure the robustness of A3C,which can achieve an accuracy of 83.3%.
文摘针对经典最近等值线迭代(ICCP)算法因重力异常测量误差导致匹配精度下降甚至失效的问题,提出联合抗差匹配算法以提高匹配精度及可靠性。首先,分析了匹配点集间的匹配残差在高斯噪声影响下呈非高斯分布,为抑制其影响,采用l_(p)范数代替l_(2)范数计算匹配残差,并利用匹配残差重调野值点以获得有效的匹配区域。在此基础上,提出混合稀疏ICCP算法,并利用其进行粗匹配,然后将粗匹配后的位置作为惯导系统(INS)指示位置,再使用经典ICCP算法进行精匹配,获得更高的定位精度。仿真结果表明,考虑重力异常测量误差的情况下,重力联合抗差匹配算法的误差最大值小于1 n mile,导航精度较传统ICCP算法提升60%以上,提升了算法的鲁棒性和匹配精度。
基金the National Natural Science Foundation of China(No.61572033)the Natural Science Foundation of Education Department of Anhui Province of China(No.KJ2015ZD08)the Higher Education Promotion Plan of Anhui Province of China(No.TSKJ2015B14)
文摘Block principle and pattern classification component analysis (BPCA) is a recently developed technique in computer vision In this paper, we propose a robust and sparse BPCA with Lp-norm, referred to as BPCALp-S, which inherits the robustness of BPCA-L1 due to the employment of adjustable Lp-norm. In order to perform a sparse modelling, the elastic net is integrated into the objective function. An iterative algorithm which extracts feature vectors one by one greedily is elaborately designed. The monotonicity of the proposed iterative procedure is theoretically guaranteed. Experiments of image classification and reconstruction on several benchmark sets show the effectiveness of the proposed approach.