Recently, dictionary learning(DL) based methods have been introduced to compressed sensing magnetic resonance imaging(CS-MRI), which outperforms pre-defined analytic sparse priors. However, single-scale trained dictio...Recently, dictionary learning(DL) based methods have been introduced to compressed sensing magnetic resonance imaging(CS-MRI), which outperforms pre-defined analytic sparse priors. However, single-scale trained dictionary directly from image patches is incapable of representing image features from multi-scale, multi-directional perspective, which influences the reconstruction performance. In this paper, incorporating the superior multi-scale properties of uniform discrete curvelet transform(UDCT) with the data matching adaptability of trained dictionaries, we propose a flexible sparsity framework to allow sparser representation and prominent hierarchical essential features capture for magnetic resonance(MR) images. Multi-scale decomposition is implemented by using UDCT due to its prominent properties of lower redundancy ratio, hierarchical data structure, and ease of implementation. Each sub-dictionary of different sub-bands is trained independently to form the multi-scale dictionaries. Corresponding to this brand-new sparsity model, we modify the constraint splitting augmented Lagrangian shrinkage algorithm(C-SALSA) as patch-based C-SALSA(PB C-SALSA) to solve the constraint optimization problem of regularized image reconstruction. Experimental results demonstrate that the trained sub-dictionaries at different scales, enforcing sparsity at multiple scales, can then be efficiently used for MRI reconstruction to obtain satisfactory results with further reduced undersampling rate. Multi-scale UDCT dictionaries potentially outperform both single-scale trained dictionaries and multi-scale analytic transforms. Our proposed sparsity model achieves sparser representation for reconstructed data, which results in fast convergence of reconstruction exploiting PB C-SALSA. Simulation results demonstrate that the proposed method outperforms conventional CS-MRI methods in maintaining intrinsic properties, eliminating aliasing, reducing unexpected artifacts, and removing noise. It can achieve comparable performance of reconstruction with the state-of-the-art methods even under substantially high undersampling factors.展开更多
Under the demand of urban expansion and the constraints of China’s’National Main Functional Area Planning’policy,urban agglomerations are facing with a huge contradiction between land utilization and ecological pro...Under the demand of urban expansion and the constraints of China’s’National Main Functional Area Planning’policy,urban agglomerations are facing with a huge contradiction between land utilization and ecological protection,especially for HarbinChangchun urban agglomeration who owns a large number of land used for the protection of agricultural production and ecological function.To alleviate this contradiction and provide insight into future land use patterns under different ecological constraints’scenarios,we introduced the patch-based land use simulation(PLUS)model and simulated urban expansion of the Harbin-Changchun urban agglomeration.After verifying the accuracy of the simulation result in 2018,we predicted future urban expansion under the constraints of three different ecological scenarios in 2026.The morphological spatial pattern analysis(MSPA)method and minimum cumulative resistance(MCR)model were also introduced to identify different levels of ecological security pattern(ESP)as ecological constraints.The predicted result of the optimal protection(OP)scenario showed less proportion of water and forest than those of natural expansion(NE)and basic protection(BP)scenarios in 2026.The conclusions are that the PLUS model can improve the simulation accuracy at urban agglomeration scale compared with other cellular automata(CA)models,and the future urban expansion under OP scenario has the least threat to the ecosystem,while the expansion under the natural expansion(NE)scenario poses the greatest threat to the ecosystem.Combined with the MSPA and MCR methods,PLUS model can also be used in other spatial simulations of urban agglomerations under ecological constraints.展开更多
Expression detection plays a vital role to determine the patient’s condition in healthcare systems.It helps the monitoring teams to respond swiftly in case of emergency.Due to the lack of suitable methods,results are...Expression detection plays a vital role to determine the patient’s condition in healthcare systems.It helps the monitoring teams to respond swiftly in case of emergency.Due to the lack of suitable methods,results are often compromised in an unconstrained environment because of pose,scale,occlusion and illumination variations in the image of the face of the patient.A novel patch-based multiple local binary patterns(LBP)feature extraction technique is proposed for analyzing human behavior using facial expression recognition.It consists of three-patch[TPLBP]and four-patch LBPs[FPLBP]based feature engineering respectively.Image representation is encoded from local patch statistics using these descriptors.TPLBP and FPLBP capture information that is encoded to find likenesses between adjacent patches of pixels by using short bit strings contrary to pixel-based methods.Coded images are transformed into the frequency domain using a discrete cosine transform(DCT).Most discriminant features extracted from coded DCT images are combined to generate a feature vector.Support vector machine(SVM),k-nearest neighbor(KNN),and Naïve Bayes(NB)are used for the classification of facial expressions using selected features.Extensive experimentation is performed to analyze human behavior by considering standard extended Cohn Kanade(CK+)and Oulu–CASIA datasets.Results demonstrate that the proposed methodology outperforms the other techniques used for comparison.展开更多
To address the problem of using fixed feature and single apparent model which is difficult to adapt to the complex scenarios, a Kernelized correlation filter target tracking algorithm based on online saliency feature ...To address the problem of using fixed feature and single apparent model which is difficult to adapt to the complex scenarios, a Kernelized correlation filter target tracking algorithm based on online saliency feature selection and fusion is proposed. It combined the correlation filter tracking framework and the salient feature model of the target. In the tracking process, the maximum Kernel correlation filter response values of different feature models were calculated respectively, and the response weights were dynamically set according to the saliency of different features. According to the filter response value, the final target position was obtained, which improves the target positioning accuracy. The target model was dynamically updated in an online manner based on the feature saliency measurement results. The experimental results show that the proposed method can effectively utilize the distinctive feature fusion to improve the tracking effect in complex environments.展开更多
When combining very different images which often contain complex objects and backgrounds,producing consistent compositions is a challenging problem requiring seamless image editing. In this paper, we propose a general...When combining very different images which often contain complex objects and backgrounds,producing consistent compositions is a challenging problem requiring seamless image editing. In this paper, we propose a general approach, called objectaware image editing, to obtain consistency in structure,color, and texture in a unified way. Our approach improves upon previous gradient-domain composition in three ways. Firstly, we introduce an iterative optimization algorithm to minimize mismatches on the boundaries when the target region contains multiple objects of interest. Secondly, we propose a mixeddomain consistency metric for measuring gradients and colors, and formulate composition as a unified minimization problem that can be solved with a sparse linear system. In particular, we encode texture consistency using a patch-based approach without searching and matching. Thirdly, we adopt an objectaware approach to separately manipulate the guidance gradient fields for objects of interest and backgrounds of interest, which facilitates a variety of seamless image editing applications. Our unified method outperforms previous state-of-the-art methods in preserving global texture consistency in addition to local structure continuity.展开更多
Label fusion is a powerful image segmentation strategy that is becoming increasingly popular in medical imaging. However, satisfying the requirements of higher accuracy and less running time is always a great challeng...Label fusion is a powerful image segmentation strategy that is becoming increasingly popular in medical imaging. However, satisfying the requirements of higher accuracy and less running time is always a great challenge. In this paper we propose a novel patch-based segmentation method combining a local weighted voting strategy with Bayesian inference. Multiple atlases are registered to a target image by an advanced normalization tools(ANTs) algorithm. To obtain a segmentation of the target, labels of the atlas images are propagated to the target image. We first adopt intensity prior and label prior as two key metrics when implementing the local weighted voting scheme, and then compute the two priors at the patch level. Further, we analyze the label fusion procedure concerning the image background and take the image background as an isolated label when estimating the label prior. Finally, by taking the Dice score as a criterion to quantitatively assess the accuracy of segmentations, we compare the results with those of other methods, including joint fusion, majority voting, local weighted voting, majority voting based on patch, and the widely used Free Surfer whole-brain segmentation tool. It can be clearly seen that the proposed algorithm provides better results than the other methods. During the experiments, we make explorations about the influence of different parameters(including patch size, patch area, and the number of training subjects) on segmentation accuracy.展开更多
基金Project supported by the National Natural Science Foundation of China(Nos.61175012 and 61201422)the Natural Science Foundation of Gansu Province of China(No.1208RJ-ZA265)+1 种基金the Specialized Research Fund for the Doctoral Program of Higher Education of China(No.2011021111-0026)the Fundamental Research Funds for the Central Universities of China(Nos.lzujbky-2015-108 and lzujbky-2015-197)
文摘Recently, dictionary learning(DL) based methods have been introduced to compressed sensing magnetic resonance imaging(CS-MRI), which outperforms pre-defined analytic sparse priors. However, single-scale trained dictionary directly from image patches is incapable of representing image features from multi-scale, multi-directional perspective, which influences the reconstruction performance. In this paper, incorporating the superior multi-scale properties of uniform discrete curvelet transform(UDCT) with the data matching adaptability of trained dictionaries, we propose a flexible sparsity framework to allow sparser representation and prominent hierarchical essential features capture for magnetic resonance(MR) images. Multi-scale decomposition is implemented by using UDCT due to its prominent properties of lower redundancy ratio, hierarchical data structure, and ease of implementation. Each sub-dictionary of different sub-bands is trained independently to form the multi-scale dictionaries. Corresponding to this brand-new sparsity model, we modify the constraint splitting augmented Lagrangian shrinkage algorithm(C-SALSA) as patch-based C-SALSA(PB C-SALSA) to solve the constraint optimization problem of regularized image reconstruction. Experimental results demonstrate that the trained sub-dictionaries at different scales, enforcing sparsity at multiple scales, can then be efficiently used for MRI reconstruction to obtain satisfactory results with further reduced undersampling rate. Multi-scale UDCT dictionaries potentially outperform both single-scale trained dictionaries and multi-scale analytic transforms. Our proposed sparsity model achieves sparser representation for reconstructed data, which results in fast convergence of reconstruction exploiting PB C-SALSA. Simulation results demonstrate that the proposed method outperforms conventional CS-MRI methods in maintaining intrinsic properties, eliminating aliasing, reducing unexpected artifacts, and removing noise. It can achieve comparable performance of reconstruction with the state-of-the-art methods even under substantially high undersampling factors.
基金Under the auspices of National Key R&D Program of China(No.2018YFC0704705)。
文摘Under the demand of urban expansion and the constraints of China’s’National Main Functional Area Planning’policy,urban agglomerations are facing with a huge contradiction between land utilization and ecological protection,especially for HarbinChangchun urban agglomeration who owns a large number of land used for the protection of agricultural production and ecological function.To alleviate this contradiction and provide insight into future land use patterns under different ecological constraints’scenarios,we introduced the patch-based land use simulation(PLUS)model and simulated urban expansion of the Harbin-Changchun urban agglomeration.After verifying the accuracy of the simulation result in 2018,we predicted future urban expansion under the constraints of three different ecological scenarios in 2026.The morphological spatial pattern analysis(MSPA)method and minimum cumulative resistance(MCR)model were also introduced to identify different levels of ecological security pattern(ESP)as ecological constraints.The predicted result of the optimal protection(OP)scenario showed less proportion of water and forest than those of natural expansion(NE)and basic protection(BP)scenarios in 2026.The conclusions are that the PLUS model can improve the simulation accuracy at urban agglomeration scale compared with other cellular automata(CA)models,and the future urban expansion under OP scenario has the least threat to the ecosystem,while the expansion under the natural expansion(NE)scenario poses the greatest threat to the ecosystem.Combined with the MSPA and MCR methods,PLUS model can also be used in other spatial simulations of urban agglomerations under ecological constraints.
基金supported in part by the MSIT(Ministry of Science and ICT),Korea,under the ITRC(Information Technology Research Center)support program(IITP2020-2016-0-00312)supervised by the IITP(Institute for Information&communications Technology Planning&Evaluation)and in part by the Faculty Research Fund of Sejong University in 2019.
文摘Expression detection plays a vital role to determine the patient’s condition in healthcare systems.It helps the monitoring teams to respond swiftly in case of emergency.Due to the lack of suitable methods,results are often compromised in an unconstrained environment because of pose,scale,occlusion and illumination variations in the image of the face of the patient.A novel patch-based multiple local binary patterns(LBP)feature extraction technique is proposed for analyzing human behavior using facial expression recognition.It consists of three-patch[TPLBP]and four-patch LBPs[FPLBP]based feature engineering respectively.Image representation is encoded from local patch statistics using these descriptors.TPLBP and FPLBP capture information that is encoded to find likenesses between adjacent patches of pixels by using short bit strings contrary to pixel-based methods.Coded images are transformed into the frequency domain using a discrete cosine transform(DCT).Most discriminant features extracted from coded DCT images are combined to generate a feature vector.Support vector machine(SVM),k-nearest neighbor(KNN),and Naïve Bayes(NB)are used for the classification of facial expressions using selected features.Extensive experimentation is performed to analyze human behavior by considering standard extended Cohn Kanade(CK+)and Oulu–CASIA datasets.Results demonstrate that the proposed methodology outperforms the other techniques used for comparison.
基金the National Natural Science Foundation (61472196, 61672305)Natural Science Foundation of Shandong Province (BS2015DX010, ZR2015FM012)Key Research and Development Foundation of Shandong Province (2017GGX10133).
文摘To address the problem of using fixed feature and single apparent model which is difficult to adapt to the complex scenarios, a Kernelized correlation filter target tracking algorithm based on online saliency feature selection and fusion is proposed. It combined the correlation filter tracking framework and the salient feature model of the target. In the tracking process, the maximum Kernel correlation filter response values of different feature models were calculated respectively, and the response weights were dynamically set according to the saliency of different features. According to the filter response value, the final target position was obtained, which improves the target positioning accuracy. The target model was dynamically updated in an online manner based on the feature saliency measurement results. The experimental results show that the proposed method can effectively utilize the distinctive feature fusion to improve the tracking effect in complex environments.
基金supported in part by the National Key Research and Development Plan(Grant No.2016YFC0801005)the National Natural Science Foundation of China(Grant Nos.61772513 and 61402463)the Open Foundation Project of Robot Technology Used for Special Environment Key Laboratory of Sichuan Province in China(Grant No.16kftk01)
文摘When combining very different images which often contain complex objects and backgrounds,producing consistent compositions is a challenging problem requiring seamless image editing. In this paper, we propose a general approach, called objectaware image editing, to obtain consistency in structure,color, and texture in a unified way. Our approach improves upon previous gradient-domain composition in three ways. Firstly, we introduce an iterative optimization algorithm to minimize mismatches on the boundaries when the target region contains multiple objects of interest. Secondly, we propose a mixeddomain consistency metric for measuring gradients and colors, and formulate composition as a unified minimization problem that can be solved with a sparse linear system. In particular, we encode texture consistency using a patch-based approach without searching and matching. Thirdly, we adopt an objectaware approach to separately manipulate the guidance gradient fields for objects of interest and backgrounds of interest, which facilitates a variety of seamless image editing applications. Our unified method outperforms previous state-of-the-art methods in preserving global texture consistency in addition to local structure continuity.
基金Project supported by the National Natural Science Foundation of China(No.61203224)the Science and Technology Innovation Foundation of Shanghai Municipal Education Commission,China(No.13YZ101)
文摘Label fusion is a powerful image segmentation strategy that is becoming increasingly popular in medical imaging. However, satisfying the requirements of higher accuracy and less running time is always a great challenge. In this paper we propose a novel patch-based segmentation method combining a local weighted voting strategy with Bayesian inference. Multiple atlases are registered to a target image by an advanced normalization tools(ANTs) algorithm. To obtain a segmentation of the target, labels of the atlas images are propagated to the target image. We first adopt intensity prior and label prior as two key metrics when implementing the local weighted voting scheme, and then compute the two priors at the patch level. Further, we analyze the label fusion procedure concerning the image background and take the image background as an isolated label when estimating the label prior. Finally, by taking the Dice score as a criterion to quantitatively assess the accuracy of segmentations, we compare the results with those of other methods, including joint fusion, majority voting, local weighted voting, majority voting based on patch, and the widely used Free Surfer whole-brain segmentation tool. It can be clearly seen that the proposed algorithm provides better results than the other methods. During the experiments, we make explorations about the influence of different parameters(including patch size, patch area, and the number of training subjects) on segmentation accuracy.