Background A medical content-based image retrieval(CBIR)system is designed to retrieve images from large imaging repositories that are visually similar to a user′s query image.CBIR is widely used in evidence-based di...Background A medical content-based image retrieval(CBIR)system is designed to retrieve images from large imaging repositories that are visually similar to a user′s query image.CBIR is widely used in evidence-based diagnosis,teaching,and research.Although the retrieval accuracy has largely improved,there has been limited development toward visualizing important image features that indicate the similarity of retrieved images.Despite the prevalence of 3D volumetric data in medical imaging such as computed tomography(CT),current CBIR systems still rely on 2D cross-sectional views for the visualization of retrieved images.Such 2D visualization requires users to browse through the image stacks to confirm the similarity of the retrieved images and often involves mental reconstruction of 3D information,including the size,shape,and spatial relations of multiple structures.This process is time-consuming and reliant on users'experience.Methods In this study,we proposed an importance-aware 3D volume visualization method.The rendering parameters were automatically optimized to maximize the visibility of important structures that were detected and prioritized in the retrieval process.We then integrated the proposed visualization into a CBIR system,thereby complementing the 2D cross-sectional views for relevance feedback and further analyses.Results Our preliminary results demonstrate that 3D visualization can provide additional information using multimodal positron emission tomography and computed tomography(PETCT)images of a non-small cell lung cancer dataset.展开更多
This paper presents an approach to improve medical image retrieval, particularly for brain tumors, by addressing the gap between low-level visual and high-level perceived contents in MRI, X-ray, and CT scans. Traditio...This paper presents an approach to improve medical image retrieval, particularly for brain tumors, by addressing the gap between low-level visual and high-level perceived contents in MRI, X-ray, and CT scans. Traditional methods based on color, shape, or texture are less effective. The proposed solution uses machine learning to handle high-dimensional image features, reducing computational complexity and mitigating issues caused by artifacts or noise. It employs a genetic algorithm for feature reduction and a hybrid residual UNet(HResUNet) model for Region-of-Interest(ROI) segmentation and classification, with enhanced image preprocessing. The study examines various loss functions, finding that a hybrid loss function yields superior results, and the GA-HResUNet model outperforms the HResUNet. Comparative analysis with state-of-the-art models shows a 4% improvement in retrieval accuracy.展开更多
CBIR(Content Based Im age Retrieval)是当前多媒体检索的热点 .颜色特征是图像检索的重要特征 .为了提高颜色特征的检索效果 ,在提取图像主色特征的基础上 ,进一步提取了相应的主色空间分布信息——主色矩特征 ,并建立了图像主色特征...CBIR(Content Based Im age Retrieval)是当前多媒体检索的热点 .颜色特征是图像检索的重要特征 .为了提高颜色特征的检索效果 ,在提取图像主色特征的基础上 ,进一步提取了相应的主色空间分布信息——主色矩特征 ,并建立了图像主色特征的描述模型 .在改进加权二次型相似性度量方法的基础上 ,提出主色多特征相似性度量方法 ,并对几种不同的相似性度量方案进行了对比 ,其中 DCME方法在 WWW发布方式的 CBIR原型系统上取得了较好的实验结果 .展开更多
文摘Background A medical content-based image retrieval(CBIR)system is designed to retrieve images from large imaging repositories that are visually similar to a user′s query image.CBIR is widely used in evidence-based diagnosis,teaching,and research.Although the retrieval accuracy has largely improved,there has been limited development toward visualizing important image features that indicate the similarity of retrieved images.Despite the prevalence of 3D volumetric data in medical imaging such as computed tomography(CT),current CBIR systems still rely on 2D cross-sectional views for the visualization of retrieved images.Such 2D visualization requires users to browse through the image stacks to confirm the similarity of the retrieved images and often involves mental reconstruction of 3D information,including the size,shape,and spatial relations of multiple structures.This process is time-consuming and reliant on users'experience.Methods In this study,we proposed an importance-aware 3D volume visualization method.The rendering parameters were automatically optimized to maximize the visibility of important structures that were detected and prioritized in the retrieval process.We then integrated the proposed visualization into a CBIR system,thereby complementing the 2D cross-sectional views for relevance feedback and further analyses.Results Our preliminary results demonstrate that 3D visualization can provide additional information using multimodal positron emission tomography and computed tomography(PETCT)images of a non-small cell lung cancer dataset.
文摘This paper presents an approach to improve medical image retrieval, particularly for brain tumors, by addressing the gap between low-level visual and high-level perceived contents in MRI, X-ray, and CT scans. Traditional methods based on color, shape, or texture are less effective. The proposed solution uses machine learning to handle high-dimensional image features, reducing computational complexity and mitigating issues caused by artifacts or noise. It employs a genetic algorithm for feature reduction and a hybrid residual UNet(HResUNet) model for Region-of-Interest(ROI) segmentation and classification, with enhanced image preprocessing. The study examines various loss functions, finding that a hybrid loss function yields superior results, and the GA-HResUNet model outperforms the HResUNet. Comparative analysis with state-of-the-art models shows a 4% improvement in retrieval accuracy.
