Visual near-infrared imaging equipment has broad applications in various fields such as venipuncture,facial injections,and safety verification due to its noncontact,compact,and portable design.Currently,most studies u...Visual near-infrared imaging equipment has broad applications in various fields such as venipuncture,facial injections,and safety verification due to its noncontact,compact,and portable design.Currently,most studies utilize near-infrared single-wavelength for image acquisition of veins.However,many substances in the skin,including water,protein,and melanin can create significant background noise,which hinders accurate detection.In this paper,we developed a dual-wavelength imaging system with phase-locked denoising technology to acquire vein image.The signals in the effective region are compared by using the absorption valley and peak of hemoglobin at 700nm and 940nm,respectively.The phase-locked denoising algorithm is applied to decrease the noise and interference of complex surroundings from the images.The imaging results of the vein are successfully extracted in complex noise environment.It is demonstrated that the denoising effect on hand veins imaging can be improved with 57.3%by using our dual-wavelength phase-locked denoising technology.Consequently,this work proposes a novel approach for venous imaging with dual-wavelengths and phase-locked denoising algorithm to extract venous imaging results in complex noisy environment better.展开更多
●AIM:To determine the teaching effects of a real-time three dimensional(3D)visualization system in the operating room for early-stage phacoemulsification training.●METHODS:A total of 10 ophthalmology residents of th...●AIM:To determine the teaching effects of a real-time three dimensional(3D)visualization system in the operating room for early-stage phacoemulsification training.●METHODS:A total of 10 ophthalmology residents of the first-year postgraduate were included.All the residents were novices to cataract surgery.Real-time cataract surgical observations were performed using a custom-built 3D visualization system.The training lasted 4wk(32h)in all.A modified International Council of Ophthalmology’s Ophthalmology Surgical Competency Assessment Rubric(ICO-OSCAR)containing 4 specific steps of cataract surgery was applied.The self-assessment(self)and expert-assessment(expert)were performed through the microsurgical attempts in the wet lab for each participant.●RESULTS:Compared with pre-training assessments(self 3.2±0.8,expert 2.5±0.6),the overall mean scores of posttraining(self 5.2±0.4,expert 4.7±0.6)were significantly improved after real-time observation training of 3D visualization system(P<0.05).Scores of 4 surgical items were significantly improved both self and expert assessment after training(P<0.05).●CONCLUSION:The 3D observation training provides novice ophthalmic residents with a better understanding of intraocular microsurgical techniques.It is a useful tool to improve teaching efficiency of surgical education.展开更多
Background A medical content-based image retrieval(CBIR)system is designed to retrieve images from large imaging repositories that are visually similar to a user′s query image.CBIR is widely used in evidence-based di...Background A medical content-based image retrieval(CBIR)system is designed to retrieve images from large imaging repositories that are visually similar to a user′s query image.CBIR is widely used in evidence-based diagnosis,teaching,and research.Although the retrieval accuracy has largely improved,there has been limited development toward visualizing important image features that indicate the similarity of retrieved images.Despite the prevalence of 3D volumetric data in medical imaging such as computed tomography(CT),current CBIR systems still rely on 2D cross-sectional views for the visualization of retrieved images.Such 2D visualization requires users to browse through the image stacks to confirm the similarity of the retrieved images and often involves mental reconstruction of 3D information,including the size,shape,and spatial relations of multiple structures.This process is time-consuming and reliant on users'experience.Methods In this study,we proposed an importance-aware 3D volume visualization method.The rendering parameters were automatically optimized to maximize the visibility of important structures that were detected and prioritized in the retrieval process.We then integrated the proposed visualization into a CBIR system,thereby complementing the 2D cross-sectional views for relevance feedback and further analyses.Results Our preliminary results demonstrate that 3D visualization can provide additional information using multimodal positron emission tomography and computed tomography(PETCT)images of a non-small cell lung cancer dataset.展开更多
Background A task assigned to space exploration satellites involves detecting the physical environment within a certain space.However,space detection data are complex and abstract.These data are not conducive for rese...Background A task assigned to space exploration satellites involves detecting the physical environment within a certain space.However,space detection data are complex and abstract.These data are not conducive for researchers'visual perceptions of the evolution and interaction of events in the space environment.Methods A time-series dynamic data sampling method for large-scale space was proposed for sample detection data in space and time,and the corresponding relationships between data location features and other attribute features were established.A tone-mapping method based on statistical histogram equalization was proposed and applied to the final attribute feature data.The visualization process is optimized for rendering by merging materials,reducing the number of patches,and performing other operations.Results The results of sampling,feature extraction,and uniform visualization of the detection data of complex types,long duration spans,and uneven spatial distributions were obtained.The real-time visualization of large-scale spatial structures using augmented reality devices,particularly low-performance devices,was also investigated.Conclusions The proposed visualization system can reconstruct the three-dimensional structure of a large-scale space,express the structure and changes in the spatial environment using augmented reality,and assist in intuitively discovering spatial environmental events and evolutionary rules.展开更多
Digital technology has driven the innovation of architectural design methods and tools,applying digital techniques to allow greater possibilities for more innovative and scientific design of public building spaces.Thi...Digital technology has driven the innovation of architectural design methods and tools,applying digital techniques to allow greater possibilities for more innovative and scientific design of public building spaces.This article first analyzes the characteristics of digital visualization and its advantages in the design of urban public building spaces,including aspects such as visualizing three-dimensional expression,rational analysis of building space,Virtual Reality Experience,and integration of design and construction processes.Subsequently,by introducing digital design methods such as parametric design,algorithmic generation,nonlinear design,and artificial intelligence-assisted design,it explores the methods and implementation approaches of digital visualization in the design of public building spaces.The aim is to offer insights and references for the deeper integration of digital technology into architectural design practices.展开更多
Objective:To evaluate the current state of research and areas of interest for traditional Chinese medicine(TCM)in the field of colorectal cancer treatment.Methods:Related papers published between January 1,2012,and No...Objective:To evaluate the current state of research and areas of interest for traditional Chinese medicine(TCM)in the field of colorectal cancer treatment.Methods:Related papers published between January 1,2012,and November 27,2021,were found using the Web of Science Core Collection Science Citation Index Expanded.Using CiteSpace's network map generation capability,we then determined the top writers,organizations,countries,keywords,co-cited writers,journals,references,and research trends.Results:This investigation yielded a total of 336 relevant papers.China is the most productive country.Shanghai University of Traditional Chinese Medicine is the leading institution.The journal with the most popularity and publishing volume is Evidence-based Complementary and Alternative Medicine.The author with the most citations and centrality is Lin JM.The terms"epithelial-mesenchymal transition,""cell cycle arrest,""apoptosis,"and"autophagy"are highly frequent and have a high betweenness centrality.Conclusion:According to the results,research on natural products,traditional Chinese medicine(TCM)extracts,and the molecular mechanisms of TCM chemical constituents constitutes the primary focus within TCM cancer treatment investigations.In recent years,there has been a surge of interest in exploring the role of gut microbiota in TCM chemical constituents research,particularly in its ability to induce apoptosis and autophagy in tumor cells,thereby suppressing tumor cell proliferation,metastasis,and invasion.However,due to the intricate composition of TCM and existing technical limitations,the underlying principles guiding TCM's efficacy in treating colorectal cancer remain unclear and warrant further investigation.展开更多
Recently,convolutional neural network(CNN)-based visual inspec-tion has been developed to detect defects on building surfaces automatically.The CNN model demonstrates remarkable accuracy in image data analysis;however...Recently,convolutional neural network(CNN)-based visual inspec-tion has been developed to detect defects on building surfaces automatically.The CNN model demonstrates remarkable accuracy in image data analysis;however,the predicted results have uncertainty in providing accurate informa-tion to users because of the“black box”problem in the deep learning model.Therefore,this study proposes a visual explanation method to overcome the uncertainty limitation of CNN-based defect identification.The visual repre-sentative gradient-weights class activation mapping(Grad-CAM)method is adopted to provide visually explainable information.A visualizing evaluation index is proposed to quantitatively analyze visual representations;this index reflects a rough estimate of the concordance rate between the visualized heat map and intended defects.In addition,an ablation study,adopting three-branch combinations with the VGG16,is implemented to identify perfor-mance variations by visualizing predicted results.Experiments reveal that the proposed model,combined with hybrid pooling,batch normalization,and multi-attention modules,achieves the best performance with an accuracy of 97.77%,corresponding to an improvement of 2.49%compared with the baseline model.Consequently,this study demonstrates that reliable results from an automatic defect classification model can be provided to an inspector through the visual representation of the predicted results using CNN models.展开更多
The interpretability of deep learning models has emerged as a compelling area in artificial intelligence research.The safety criteria for medical imaging are highly stringent,and models are required for an explanation...The interpretability of deep learning models has emerged as a compelling area in artificial intelligence research.The safety criteria for medical imaging are highly stringent,and models are required for an explanation.However,existing convolutional neural network solutions for left ventricular segmentation are viewed in terms of inputs and outputs.Thus,the interpretability of CNNs has come into the spotlight.Since medical imaging data are limited,many methods to fine-tune medical imaging models that are popular in transfer models have been built using massive public Image Net datasets by the transfer learning method.Unfortunately,this generates many unreliable parameters and makes it difficult to generate plausible explanations from these models.In this study,we trained from scratch rather than relying on transfer learning,creating a novel interpretable approach for autonomously segmenting the left ventricle with a cardiac MRI.Our enhanced GPU training system implemented interpretable global average pooling for graphics using deep learning.The deep learning tasks were simplified.Simplification included data management,neural network architecture,and training.Our system monitored and analyzed the gradient changes of different layers with dynamic visualizations in real-time and selected the optimal deployment model.Our results demonstrated that the proposed method was feasible and efficient:the Dice coefficient reached 94.48%,and the accuracy reached 99.7%.It was found that no current transfer learning models could perform comparably to the ImageNet transfer learning architectures.This model is lightweight and more convenient to deploy on mobile devices than transfer learning models.展开更多
针对复杂背景条件下目标难以识别的问题,采用彩色偏振成像技术,提出了一种基于彩色偏振图像的目标增强方法。该方法首先根据分焦平面彩色偏振相机获得的数据得到彩色线偏振度(degree of linear polarization, DoLP)、彩色偏振角(angle o...针对复杂背景条件下目标难以识别的问题,采用彩色偏振成像技术,提出了一种基于彩色偏振图像的目标增强方法。该方法首先根据分焦平面彩色偏振相机获得的数据得到彩色线偏振度(degree of linear polarization, DoLP)、彩色偏振角(angle of polarization, AoP)和彩色强度(S0)图像;然后利用目标和背景的彩色偏振特性差异大的特点提取DoLP、AoP和S0的视觉显著度,使目标得到初步的增强;随后将3种视觉显著度图像转到HSV空间进行融合,最后转到RGB空间显示。使用对比度和矢量角度距离作为客观评价指标开展实验,多个实验场景数据表明,融合图像的对比度和矢量角度距离分别比融合前图像最高提升了3.971倍和1.711倍。展开更多
基金funded by National Key R&D Pro-gram of China(2021YFC2103300)National Key R&D Program of China(2021YFA0715500)+2 种基金National Natural Science Foundation of China(NSFC)(12227901)Strategic Priority Research Program(B)of the Chinese Academy of Sciences(XDB0580000)Chinese Academy of Sciences President's International Fellowship Initiative(2021PT0007).
文摘Visual near-infrared imaging equipment has broad applications in various fields such as venipuncture,facial injections,and safety verification due to its noncontact,compact,and portable design.Currently,most studies utilize near-infrared single-wavelength for image acquisition of veins.However,many substances in the skin,including water,protein,and melanin can create significant background noise,which hinders accurate detection.In this paper,we developed a dual-wavelength imaging system with phase-locked denoising technology to acquire vein image.The signals in the effective region are compared by using the absorption valley and peak of hemoglobin at 700nm and 940nm,respectively.The phase-locked denoising algorithm is applied to decrease the noise and interference of complex surroundings from the images.The imaging results of the vein are successfully extracted in complex noise environment.It is demonstrated that the denoising effect on hand veins imaging can be improved with 57.3%by using our dual-wavelength phase-locked denoising technology.Consequently,this work proposes a novel approach for venous imaging with dual-wavelengths and phase-locked denoising algorithm to extract venous imaging results in complex noisy environment better.
基金Supported by research grants from the National Key Research and Development Program of China(No.2020YFE0204400)the National Natural Science Foundation of China(No.82271042+1 种基金No.52203191)the Zhejiang Province Key Research and Development Program(No.2023C03090).
文摘●AIM:To determine the teaching effects of a real-time three dimensional(3D)visualization system in the operating room for early-stage phacoemulsification training.●METHODS:A total of 10 ophthalmology residents of the first-year postgraduate were included.All the residents were novices to cataract surgery.Real-time cataract surgical observations were performed using a custom-built 3D visualization system.The training lasted 4wk(32h)in all.A modified International Council of Ophthalmology’s Ophthalmology Surgical Competency Assessment Rubric(ICO-OSCAR)containing 4 specific steps of cataract surgery was applied.The self-assessment(self)and expert-assessment(expert)were performed through the microsurgical attempts in the wet lab for each participant.●RESULTS:Compared with pre-training assessments(self 3.2±0.8,expert 2.5±0.6),the overall mean scores of posttraining(self 5.2±0.4,expert 4.7±0.6)were significantly improved after real-time observation training of 3D visualization system(P<0.05).Scores of 4 surgical items were significantly improved both self and expert assessment after training(P<0.05).●CONCLUSION:The 3D observation training provides novice ophthalmic residents with a better understanding of intraocular microsurgical techniques.It is a useful tool to improve teaching efficiency of surgical education.
文摘Background A medical content-based image retrieval(CBIR)system is designed to retrieve images from large imaging repositories that are visually similar to a user′s query image.CBIR is widely used in evidence-based diagnosis,teaching,and research.Although the retrieval accuracy has largely improved,there has been limited development toward visualizing important image features that indicate the similarity of retrieved images.Despite the prevalence of 3D volumetric data in medical imaging such as computed tomography(CT),current CBIR systems still rely on 2D cross-sectional views for the visualization of retrieved images.Such 2D visualization requires users to browse through the image stacks to confirm the similarity of the retrieved images and often involves mental reconstruction of 3D information,including the size,shape,and spatial relations of multiple structures.This process is time-consuming and reliant on users'experience.Methods In this study,we proposed an importance-aware 3D volume visualization method.The rendering parameters were automatically optimized to maximize the visibility of important structures that were detected and prioritized in the retrieval process.We then integrated the proposed visualization into a CBIR system,thereby complementing the 2D cross-sectional views for relevance feedback and further analyses.Results Our preliminary results demonstrate that 3D visualization can provide additional information using multimodal positron emission tomography and computed tomography(PETCT)images of a non-small cell lung cancer dataset.
文摘Background A task assigned to space exploration satellites involves detecting the physical environment within a certain space.However,space detection data are complex and abstract.These data are not conducive for researchers'visual perceptions of the evolution and interaction of events in the space environment.Methods A time-series dynamic data sampling method for large-scale space was proposed for sample detection data in space and time,and the corresponding relationships between data location features and other attribute features were established.A tone-mapping method based on statistical histogram equalization was proposed and applied to the final attribute feature data.The visualization process is optimized for rendering by merging materials,reducing the number of patches,and performing other operations.Results The results of sampling,feature extraction,and uniform visualization of the detection data of complex types,long duration spans,and uneven spatial distributions were obtained.The real-time visualization of large-scale spatial structures using augmented reality devices,particularly low-performance devices,was also investigated.Conclusions The proposed visualization system can reconstruct the three-dimensional structure of a large-scale space,express the structure and changes in the spatial environment using augmented reality,and assist in intuitively discovering spatial environmental events and evolutionary rules.
文摘Digital technology has driven the innovation of architectural design methods and tools,applying digital techniques to allow greater possibilities for more innovative and scientific design of public building spaces.This article first analyzes the characteristics of digital visualization and its advantages in the design of urban public building spaces,including aspects such as visualizing three-dimensional expression,rational analysis of building space,Virtual Reality Experience,and integration of design and construction processes.Subsequently,by introducing digital design methods such as parametric design,algorithmic generation,nonlinear design,and artificial intelligence-assisted design,it explores the methods and implementation approaches of digital visualization in the design of public building spaces.The aim is to offer insights and references for the deeper integration of digital technology into architectural design practices.
基金funded by the National Natural Science Foundation of China(82122075,82074232)Shanghai Frontier Research Base of Disease and Syndrome Biology of Inflammatory Cancer Trans-formation(2021KJ03-12)"Shu Guang"project supported by Shanghai Municipal Education Commission and Shanghai Education Development Foundation(21SG43).
文摘Objective:To evaluate the current state of research and areas of interest for traditional Chinese medicine(TCM)in the field of colorectal cancer treatment.Methods:Related papers published between January 1,2012,and November 27,2021,were found using the Web of Science Core Collection Science Citation Index Expanded.Using CiteSpace's network map generation capability,we then determined the top writers,organizations,countries,keywords,co-cited writers,journals,references,and research trends.Results:This investigation yielded a total of 336 relevant papers.China is the most productive country.Shanghai University of Traditional Chinese Medicine is the leading institution.The journal with the most popularity and publishing volume is Evidence-based Complementary and Alternative Medicine.The author with the most citations and centrality is Lin JM.The terms"epithelial-mesenchymal transition,""cell cycle arrest,""apoptosis,"and"autophagy"are highly frequent and have a high betweenness centrality.Conclusion:According to the results,research on natural products,traditional Chinese medicine(TCM)extracts,and the molecular mechanisms of TCM chemical constituents constitutes the primary focus within TCM cancer treatment investigations.In recent years,there has been a surge of interest in exploring the role of gut microbiota in TCM chemical constituents research,particularly in its ability to induce apoptosis and autophagy in tumor cells,thereby suppressing tumor cell proliferation,metastasis,and invasion.However,due to the intricate composition of TCM and existing technical limitations,the underlying principles guiding TCM's efficacy in treating colorectal cancer remain unclear and warrant further investigation.
基金supported by a Korea Agency for Infrastructure Technology Advancement(KAIA)grant funded by the Ministry of Land,Infrastructure,and Transport(Grant 22CTAP-C163951-02).
文摘Recently,convolutional neural network(CNN)-based visual inspec-tion has been developed to detect defects on building surfaces automatically.The CNN model demonstrates remarkable accuracy in image data analysis;however,the predicted results have uncertainty in providing accurate informa-tion to users because of the“black box”problem in the deep learning model.Therefore,this study proposes a visual explanation method to overcome the uncertainty limitation of CNN-based defect identification.The visual repre-sentative gradient-weights class activation mapping(Grad-CAM)method is adopted to provide visually explainable information.A visualizing evaluation index is proposed to quantitatively analyze visual representations;this index reflects a rough estimate of the concordance rate between the visualized heat map and intended defects.In addition,an ablation study,adopting three-branch combinations with the VGG16,is implemented to identify perfor-mance variations by visualizing predicted results.Experiments reveal that the proposed model,combined with hybrid pooling,batch normalization,and multi-attention modules,achieves the best performance with an accuracy of 97.77%,corresponding to an improvement of 2.49%compared with the baseline model.Consequently,this study demonstrates that reliable results from an automatic defect classification model can be provided to an inspector through the visual representation of the predicted results using CNN models.
基金The National Natural Science Foundation of China (62176048)provided funding for this research.
文摘The interpretability of deep learning models has emerged as a compelling area in artificial intelligence research.The safety criteria for medical imaging are highly stringent,and models are required for an explanation.However,existing convolutional neural network solutions for left ventricular segmentation are viewed in terms of inputs and outputs.Thus,the interpretability of CNNs has come into the spotlight.Since medical imaging data are limited,many methods to fine-tune medical imaging models that are popular in transfer models have been built using massive public Image Net datasets by the transfer learning method.Unfortunately,this generates many unreliable parameters and makes it difficult to generate plausible explanations from these models.In this study,we trained from scratch rather than relying on transfer learning,creating a novel interpretable approach for autonomously segmenting the left ventricle with a cardiac MRI.Our enhanced GPU training system implemented interpretable global average pooling for graphics using deep learning.The deep learning tasks were simplified.Simplification included data management,neural network architecture,and training.Our system monitored and analyzed the gradient changes of different layers with dynamic visualizations in real-time and selected the optimal deployment model.Our results demonstrated that the proposed method was feasible and efficient:the Dice coefficient reached 94.48%,and the accuracy reached 99.7%.It was found that no current transfer learning models could perform comparably to the ImageNet transfer learning architectures.This model is lightweight and more convenient to deploy on mobile devices than transfer learning models.
文摘针对复杂背景条件下目标难以识别的问题,采用彩色偏振成像技术,提出了一种基于彩色偏振图像的目标增强方法。该方法首先根据分焦平面彩色偏振相机获得的数据得到彩色线偏振度(degree of linear polarization, DoLP)、彩色偏振角(angle of polarization, AoP)和彩色强度(S0)图像;然后利用目标和背景的彩色偏振特性差异大的特点提取DoLP、AoP和S0的视觉显著度,使目标得到初步的增强;随后将3种视觉显著度图像转到HSV空间进行融合,最后转到RGB空间显示。使用对比度和矢量角度距离作为客观评价指标开展实验,多个实验场景数据表明,融合图像的对比度和矢量角度距离分别比融合前图像最高提升了3.971倍和1.711倍。