In this paper, a new approach of muhi-modality image registration is represented with not only image intensity, but also features describing image structure. There are two novelties in the proposed method. Firstly, in...In this paper, a new approach of muhi-modality image registration is represented with not only image intensity, but also features describing image structure. There are two novelties in the proposed method. Firstly, instead of standard mutual information ( MI ) based on joint intensity histogram, regional mutual information ( RMI ) is employed, which allows neighborhood information to be taken into account. Secondly, a new feature images obtained by means of phase congruency are invariants to brightness or contrast changes. By incorporating these features and intensity into RMI, we can combine the aspects of both structural and neighborhood information together, which offers a more robust and a high level of registration accuracy.展开更多
Mutual information is widely used in medical image registration, because it does not require preprocessing the image. However, the local maximum problem in the registration is insurmountable. We combine mutual informa...Mutual information is widely used in medical image registration, because it does not require preprocessing the image. However, the local maximum problem in the registration is insurmountable. We combine mutual information and gradient information to solve this problem and apply it to the non-rigid deformation image registration. To improve the accuracy, we provide some implemental issues, for example, the Powell searching algorithm, gray interpolation and consideration of outlier points. The experimental results show the accuracy of the method and the feasibility in non-rigid medical image registration.展开更多
An improved image registration method is proposed based on mutual infor- mation with hybrid optimizer. Firstly, mutual information measure is combined with morphological gradient information. The essence of the gradie...An improved image registration method is proposed based on mutual infor- mation with hybrid optimizer. Firstly, mutual information measure is combined with morphological gradient information. The essence of the gradient information is that locations a large gradient magnitude should be aligned, but also the orientation of the gradients at those locations should be similar. Secondly, a hybrid optimizer combined PSO with Powell algorithm is proposed to restrain local maxima of mutual information function and improve the registration accuracy to sub-pixel level. Lastly, muhlresolution data structure based on Mallat decomposition can not only improve the behavior of registration function, but also improve the speed of the algorithm. Experimental results demonstrate that the new method can yield good registration result, superior to traditional optimizer with respect to smoothness and attraction basin as well as convergence speed.展开更多
A new implementation of the image registration algorithm based on the mutual information is presented for the case of medical images. The registration is achieved if the maximum of the mutual information is attained. ...A new implementation of the image registration algorithm based on the mutual information is presented for the case of medical images. The registration is achieved if the maximum of the mutual information is attained. In this maximization process optimal values of five parameters of an affine transformation are searched.展开更多
Mutual information has currently been one of the most intensivelyresearched measures. It has been proven to be accurate and effective registrationmeasure. Despite the general promising results, mutual information some...Mutual information has currently been one of the most intensivelyresearched measures. It has been proven to be accurate and effective registrationmeasure. Despite the general promising results, mutual information sometimes mightlead to misregistration because of neglecting spatial information and treating intensityvariations with undue sensitivity. In this paper, an extension of mutual informationframework was proposed in which higher-order spatial information regarding imagestructures was incorporated into the registration processing of PET and MR. Thesecond-order estimate of mutual information algorithm was applied to the registrationof seven patients. Evaluation from Vanderbilt University and our visual inspectionshowed that sub-voxel accuracy and robust results were achieved in all cases withsecond-order mutual information as the similarity measure and with Powell's multi-dimensional direction set method as optimization strategy.展开更多
Medical image registration is important in many medical applications. Registration method based on maximization of mutual information of voxel intensities is one of the most popular methods for 3-D multi-modality medi...Medical image registration is important in many medical applications. Registration method based on maximization of mutual information of voxel intensities is one of the most popular methods for 3-D multi-modality medical image registration. Generally, the optimization process is easily trapped in local maximum, resulting in wrong registration results. In order to find the correct optimum, a new multi-resolution approach for brain image registration based on normalized mutual information is proposed. In this method, to eliminate the effect of local optima, multi-scale wavelet transformation is adopted to extract the image edge features. Then the feature images are registered, and the result at this level is taken as the initial estimate for the registration of the original images. Three-dimensional volumes are used to test the algorithm. Experimental results show that the registration strategy proposed is a robust and efficient method which can reach sub-voxel accuracy and improve the optimization speed.展开更多
Mutual information (MI)-based image registration is effective in registering medical images, but it is computationally expensive. This paper accelerates MI-based image registration by dividing computation of mutual ...Mutual information (MI)-based image registration is effective in registering medical images, but it is computationally expensive. This paper accelerates MI-based image registration by dividing computation of mutual information into spatial transformation and histogram-based calculation, and performing 3D spatial transformation and trilinear interpolation on graphic processing unit (GPU). The 3D floating image is downloaded to GPU as flat 3D texture, and then fetched and interpolated for each new voxel location in fragment shader. The transformed resuits are rendered to textures by using frame buffer object (FBO) extension, and then read to the main memory used for the remaining computation on CPU. Experimental results show that GPU-accelerated method can achieve speedup about an order of magnitude with better registration result compared with the software implementation on a single-core CPU.展开更多
Currently the voxel based registration methods have been used widely such as the well known mutual information (MI). Although the accuracy of their results is plausible, the registration procedure is slow. This paper ...Currently the voxel based registration methods have been used widely such as the well known mutual information (MI). Although the accuracy of their results is plausible, the registration procedure is slow. This paper proposed some methods to rigid registration based on mutual information, aiming for an acceleration of the registration process without significantly loss of precision in the final results. The efficiency of these methods is examined by registration of CT MR and PET MR. Experimental results show that the speedup is effective and efficient. By using the fast methods, the registration of 3 D medical image could also be implemented on PC rapidly.展开更多
Image registration is an important issue in medical analysis. In this process the spatial transformation that aligns the reference image and the floating image is estimated by optimizing a similarity metric. Mutual in...Image registration is an important issue in medical analysis. In this process the spatial transformation that aligns the reference image and the floating image is estimated by optimizing a similarity metric. Mutual information (MI), a popular similarity metric, is a reliable criterion for medical image registration. In this paper, we present an improved method for multimodal image registration based on maximization of a new form of normalized MI incorporating particle swarm optimization, PSO, as a searching strategy. Also a new hybrid PSO algorithm is applied to approach more precise and robust results with better performance.展开更多
A mutual information based 3D non-rigid registration approach was proposed for the registration of deformable CT/MR body abdomen images. The Parzen Windows Density Estimation (PWDE) method is adopted to calculate the ...A mutual information based 3D non-rigid registration approach was proposed for the registration of deformable CT/MR body abdomen images. The Parzen Windows Density Estimation (PWDE) method is adopted to calculate the mutual information between the two modals of CT and MRI abdomen images. By maximizing MI between the CT and MR volume images, the overlapping part of them reaches the biggest, which means that the two body images of CT and MR matches best to each other. Visible Human Project (VHP) Male abdomen CT and MRI Data are used as experimental data sets. The experimental results indicate that this approach of non-rigid 3D registration of CT/MR body abdominal images can be achieved effectively and automatically, without any prior processing procedures such as segmentation and feature extraction, but has a main drawback of very long computation time.展开更多
Log-polar transformation(LPT)is widely used in image registration due to its scale and rotation invariant properties.Through LPT,rotation and scale transformation can be made into translation displacement in log-polar...Log-polar transformation(LPT)is widely used in image registration due to its scale and rotation invariant properties.Through LPT,rotation and scale transformation can be made into translation displacement in log-polar coordinates,and phase correlation technique can be used to get the displacement.In LPT based image registration,constant samples in digitalization processing produce less precise and effective results.Thus,dynamic log-polar transformation(DLPT)is used in this paper.DLPT is a method that generates several sample sets in axes to produce several results and only the effective results are used to get the final results by using statistical approach.Therefore,DLPT can get more precise and effective transformation results than the conventional LPT.Mutual information(MI)is a similarity measure to align two images and has been used in image registration for a long time.An optimal transform for image registration can be obtained by maximizing MI between the two images.Image registration based on MI is robust in noisy,occlusion and illumination changing circumstance.In this paper,we study image registration using MI and DLPT.Experiments with digitalizing images and with real image datasets are performed,and the experimental results show that the combination of MI with DLPT is an effective and precise method for image registration.展开更多
A new approach to the problem of registration of ultrasound images is presented, using a concept of Nonlinear Correlation Information Entropy (NCIE) as the matching criterion. The proposed method applies NCIE to measu...A new approach to the problem of registration of ultrasound images is presented, using a concept of Nonlinear Correlation Information Entropy (NCIE) as the matching criterion. The proposed method applies NCIE to measure the correlation degree between the image intensities of corresponding voxel in the floating and reference images. Registration is achieved by adjustment of the relative position until NCIE between the images is maximized. However, unlike mutual information (MI), NCIE varies in the closed interval [0, 1], and around the extremum it varies sharply, which makes it possible that thresholds of NCIE can be used to boost the search for the registration transformation. Using this feature of NCIE, we combine the downhill simplex searching algorithm to register the ultrasound images. The simulations are conducted to testify the effectiveness and rapidity of the proposed registration method, in which the ultrasound floating images are aligned to the reference images with required registration accuracy. Moreover, the NCIE based method can overcome local minima problem by setting thresholds and can take care of the differences in contrast between the floating and reference images.展开更多
Common tools based on landmarks in medical image elastic registration are Thin Plate Spline (TPS) and Compact Support Radial Basis Function (CSRBF). TPS forces the corresponding landmarks to exactly match each other a...Common tools based on landmarks in medical image elastic registration are Thin Plate Spline (TPS) and Compact Support Radial Basis Function (CSRBF). TPS forces the corresponding landmarks to exactly match each other and minimizes the bending energy of the whole image. However, in real application, such scheme would deform the image globally when deformation is only local. CSRBF needs manually determine the support size, although its deformation is limited local. Therefore, to limit the effect of the deformation, new Compact Support Thin Plate Spline algorithm (CSTPS) is approached, analyzed and applied. Such new approach gains optimal mutual information, which shows its registration result satisfactory. The experiments also show it can apply in both local and global elastic registration.展开更多
文摘In this paper, a new approach of muhi-modality image registration is represented with not only image intensity, but also features describing image structure. There are two novelties in the proposed method. Firstly, instead of standard mutual information ( MI ) based on joint intensity histogram, regional mutual information ( RMI ) is employed, which allows neighborhood information to be taken into account. Secondly, a new feature images obtained by means of phase congruency are invariants to brightness or contrast changes. By incorporating these features and intensity into RMI, we can combine the aspects of both structural and neighborhood information together, which offers a more robust and a high level of registration accuracy.
文摘Mutual information is widely used in medical image registration, because it does not require preprocessing the image. However, the local maximum problem in the registration is insurmountable. We combine mutual information and gradient information to solve this problem and apply it to the non-rigid deformation image registration. To improve the accuracy, we provide some implemental issues, for example, the Powell searching algorithm, gray interpolation and consideration of outlier points. The experimental results show the accuracy of the method and the feasibility in non-rigid medical image registration.
文摘An improved image registration method is proposed based on mutual infor- mation with hybrid optimizer. Firstly, mutual information measure is combined with morphological gradient information. The essence of the gradient information is that locations a large gradient magnitude should be aligned, but also the orientation of the gradients at those locations should be similar. Secondly, a hybrid optimizer combined PSO with Powell algorithm is proposed to restrain local maxima of mutual information function and improve the registration accuracy to sub-pixel level. Lastly, muhlresolution data structure based on Mallat decomposition can not only improve the behavior of registration function, but also improve the speed of the algorithm. Experimental results demonstrate that the new method can yield good registration result, superior to traditional optimizer with respect to smoothness and attraction basin as well as convergence speed.
文摘A new implementation of the image registration algorithm based on the mutual information is presented for the case of medical images. The registration is achieved if the maximum of the mutual information is attained. In this maximization process optimal values of five parameters of an affine transformation are searched.
基金The images and the standard transformation were provided as part of the project,"Retrospective Im-age Registration Evaluation"(National Institutes of Health,1 R01 CA89323),the principal investigator,J.Michael Fitzpatrick,Vanderbilt Universi
文摘Mutual information has currently been one of the most intensivelyresearched measures. It has been proven to be accurate and effective registrationmeasure. Despite the general promising results, mutual information sometimes mightlead to misregistration because of neglecting spatial information and treating intensityvariations with undue sensitivity. In this paper, an extension of mutual informationframework was proposed in which higher-order spatial information regarding imagestructures was incorporated into the registration processing of PET and MR. Thesecond-order estimate of mutual information algorithm was applied to the registrationof seven patients. Evaluation from Vanderbilt University and our visual inspectionshowed that sub-voxel accuracy and robust results were achieved in all cases withsecond-order mutual information as the similarity measure and with Powell's multi-dimensional direction set method as optimization strategy.
基金Supported by National Natural Science Foundation of China (No.60373061)Natural Science Foundation of Tianjin (No.04310491R)+1 种基金National Natural Science Foundation of ChinaGeneral Administration of Civil Aviation of China (No.60372048) .
文摘Medical image registration is important in many medical applications. Registration method based on maximization of mutual information of voxel intensities is one of the most popular methods for 3-D multi-modality medical image registration. Generally, the optimization process is easily trapped in local maximum, resulting in wrong registration results. In order to find the correct optimum, a new multi-resolution approach for brain image registration based on normalized mutual information is proposed. In this method, to eliminate the effect of local optima, multi-scale wavelet transformation is adopted to extract the image edge features. Then the feature images are registered, and the result at this level is taken as the initial estimate for the registration of the original images. Three-dimensional volumes are used to test the algorithm. Experimental results show that the registration strategy proposed is a robust and efficient method which can reach sub-voxel accuracy and improve the optimization speed.
基金Supported by National High Technology Research and Development Program("863"Program)of China(No.863-306-ZD13-03-06)
文摘Mutual information (MI)-based image registration is effective in registering medical images, but it is computationally expensive. This paper accelerates MI-based image registration by dividing computation of mutual information into spatial transformation and histogram-based calculation, and performing 3D spatial transformation and trilinear interpolation on graphic processing unit (GPU). The 3D floating image is downloaded to GPU as flat 3D texture, and then fetched and interpolated for each new voxel location in fragment shader. The transformed resuits are rendered to textures by using frame buffer object (FBO) extension, and then read to the main memory used for the remaining computation on CPU. Experimental results show that GPU-accelerated method can achieve speedup about an order of magnitude with better registration result compared with the software implementation on a single-core CPU.
文摘Currently the voxel based registration methods have been used widely such as the well known mutual information (MI). Although the accuracy of their results is plausible, the registration procedure is slow. This paper proposed some methods to rigid registration based on mutual information, aiming for an acceleration of the registration process without significantly loss of precision in the final results. The efficiency of these methods is examined by registration of CT MR and PET MR. Experimental results show that the speedup is effective and efficient. By using the fast methods, the registration of 3 D medical image could also be implemented on PC rapidly.
文摘Image registration is an important issue in medical analysis. In this process the spatial transformation that aligns the reference image and the floating image is estimated by optimizing a similarity metric. Mutual information (MI), a popular similarity metric, is a reliable criterion for medical image registration. In this paper, we present an improved method for multimodal image registration based on maximization of a new form of normalized MI incorporating particle swarm optimization, PSO, as a searching strategy. Also a new hybrid PSO algorithm is applied to approach more precise and robust results with better performance.
基金An international cooperation project between Shanghai Jiaotong U niversity and Hong Kong Polytechnic University
文摘A mutual information based 3D non-rigid registration approach was proposed for the registration of deformable CT/MR body abdomen images. The Parzen Windows Density Estimation (PWDE) method is adopted to calculate the mutual information between the two modals of CT and MRI abdomen images. By maximizing MI between the CT and MR volume images, the overlapping part of them reaches the biggest, which means that the two body images of CT and MR matches best to each other. Visible Human Project (VHP) Male abdomen CT and MRI Data are used as experimental data sets. The experimental results indicate that this approach of non-rigid 3D registration of CT/MR body abdominal images can be achieved effectively and automatically, without any prior processing procedures such as segmentation and feature extraction, but has a main drawback of very long computation time.
基金the National Natural Science Foundation of China(Nos.61440016,61273225 and 61201423)the Natural Science Foundation of Hubei Province(No.2014CFB247)
文摘Log-polar transformation(LPT)is widely used in image registration due to its scale and rotation invariant properties.Through LPT,rotation and scale transformation can be made into translation displacement in log-polar coordinates,and phase correlation technique can be used to get the displacement.In LPT based image registration,constant samples in digitalization processing produce less precise and effective results.Thus,dynamic log-polar transformation(DLPT)is used in this paper.DLPT is a method that generates several sample sets in axes to produce several results and only the effective results are used to get the final results by using statistical approach.Therefore,DLPT can get more precise and effective transformation results than the conventional LPT.Mutual information(MI)is a similarity measure to align two images and has been used in image registration for a long time.An optimal transform for image registration can be obtained by maximizing MI between the two images.Image registration based on MI is robust in noisy,occlusion and illumination changing circumstance.In this paper,we study image registration using MI and DLPT.Experiments with digitalizing images and with real image datasets are performed,and the experimental results show that the combination of MI with DLPT is an effective and precise method for image registration.
文摘A new approach to the problem of registration of ultrasound images is presented, using a concept of Nonlinear Correlation Information Entropy (NCIE) as the matching criterion. The proposed method applies NCIE to measure the correlation degree between the image intensities of corresponding voxel in the floating and reference images. Registration is achieved by adjustment of the relative position until NCIE between the images is maximized. However, unlike mutual information (MI), NCIE varies in the closed interval [0, 1], and around the extremum it varies sharply, which makes it possible that thresholds of NCIE can be used to boost the search for the registration transformation. Using this feature of NCIE, we combine the downhill simplex searching algorithm to register the ultrasound images. The simulations are conducted to testify the effectiveness and rapidity of the proposed registration method, in which the ultrasound floating images are aligned to the reference images with required registration accuracy. Moreover, the NCIE based method can overcome local minima problem by setting thresholds and can take care of the differences in contrast between the floating and reference images.
基金the National Natural Science Foundation of China (No.60572101) the Natural Science Foundation of Guangdong Province (No.31789).
文摘Common tools based on landmarks in medical image elastic registration are Thin Plate Spline (TPS) and Compact Support Radial Basis Function (CSRBF). TPS forces the corresponding landmarks to exactly match each other and minimizes the bending energy of the whole image. However, in real application, such scheme would deform the image globally when deformation is only local. CSRBF needs manually determine the support size, although its deformation is limited local. Therefore, to limit the effect of the deformation, new Compact Support Thin Plate Spline algorithm (CSTPS) is approached, analyzed and applied. Such new approach gains optimal mutual information, which shows its registration result satisfactory. The experiments also show it can apply in both local and global elastic registration.