This paper addresses the common orthopedic trauma of spinal vertebral fractures and aims to enhance doctors’diagnostic efficiency.Therefore,a deep-learning-based automated diagnostic systemwithmulti-label segmentatio...This paper addresses the common orthopedic trauma of spinal vertebral fractures and aims to enhance doctors’diagnostic efficiency.Therefore,a deep-learning-based automated diagnostic systemwithmulti-label segmentation is proposed to recognize the condition of vertebral fractures.The whole spine Computed Tomography(CT)image is segmented into the fracture,normal,and background using U-Net,and the fracture degree of each vertebra is evaluated(Genant semi-qualitative evaluation).The main work of this paper includes:First,based on the spatial configuration network(SCN)structure,U-Net is used instead of the SCN feature extraction network.The attention mechanismandthe residual connectionbetweenthe convolutional layers are added in the local network(LN)stage.Multiple filtering is added in the global network(GN)stage,and each layer of the LN decoder feature map is filtered separately using dot product,and the filtered features are re-convolved to obtain the GN output heatmap.Second,a network model with improved SCN(M-SCN)helps automatically localize the center-of-mass position of each vertebra,and the voxels around each localized vertebra were clipped,eliminating a large amount of redundant information(e.g.,background and other interfering vertebrae)and keeping the vertebrae to be segmented in the center of the image.Multilabel segmentation of the clipped portion was subsequently performed using U-Net.This paper uses VerSe’19,VerSe’20(using only data containing vertebral fractures),and private data(provided by Guizhou Orthopedic Hospital)for model training and evaluation.Compared with the original SCN network,the M-SCN reduced the prediction error rate by 1.09%and demonstrated the effectiveness of the improvement in ablation experiments.In the vertebral segmentation experiment,the Dice Similarity Coefficient(DSC)index reached 93.50%and the Maximum Symmetry Surface Distance(MSSD)index was 4.962 mm,with accuracy and recall of 95.82%and 91.73%,respectively.Fractured vertebrae were also marked as red and normal vertebrae were marked as white in the experiment,and the semi-qualitative assessment results of Genant were provided,as well as the results of spinal localization visualization and 3D reconstructed views of the spine to analyze the actual predictive ability of the model.It provides a promising tool for vertebral fracture detection.展开更多
Fracture is one of the most common and unexpected traumas.If not treated in time,it may cause serious consequences such as joint stiffness,traumatic arthritis,and nerve injury.Using computer vision technology to detec...Fracture is one of the most common and unexpected traumas.If not treated in time,it may cause serious consequences such as joint stiffness,traumatic arthritis,and nerve injury.Using computer vision technology to detect fractures can reduce the workload and misdiagnosis of fractures and also improve the fracture detection speed.However,there are still some problems in sternum fracture detection,such as the low detection rate of small and occult fractures.In this work,the authors have constructed a dataset with 1227 labelled X-ray images for sternum fracture detection.The authors designed a fully automatic fracture detection model based on a deep convolution neural network(CNN).The authors used cascade R-CNN,attention mechanism,and atrous convolution to optimise the detection of small fractures in a large X-ray image with big local variations.The authors compared the detection results of YOLOv5 model,cascade R-CNN and other state-of-the-art models.The authors found that the convolution neural network based on cascade and attention mechanism models has a better detection effect and arrives at an mAP of 0.71,which is much better than using the YOLOv5 model(mAP=0.44)and cascade R-CNN(mAP=0.55).展开更多
The thermal front in the oceanic system is believed to have a significant effect on biological activity.During an era of climate change,changes in heat regulation between the atmosphere and oceanic interior can alter ...The thermal front in the oceanic system is believed to have a significant effect on biological activity.During an era of climate change,changes in heat regulation between the atmosphere and oceanic interior can alter the characteristics of this important feature.Using the simulation results of the 3D Regional Ocean Modelling System(ROMS),we identified the location of thermal fronts and determined their dynamic variability in the area between the southern Andaman Sea and northern Malacca Strait.The Single Image Edge Detection(SIED)algorithm was used to detect the thermal front from model-derived temperature.Results show that a thermal front occurred every year from 2002 to 2012 with the temperature gradient at the location of the front was 0.3°C/km.Compared to the years affected by El Ni?o and negative Indian Ocean Dipole(IOD),the normal years(e.g.,May 2003)show the presence of the thermal front at every selected depth(10,25,50,and 75 m),whereas El Ni?o and negative IOD during 2010 show the presence of the thermal front only at depth of 75 m due to greater warming,leading to the thermocline deepening and enhanced stratification.During May 2003,the thermal front was separated by cooler SST in the southern Andaman Sea and warmer SST in the northern Malacca Strait.The higher SST in the northern Malacca Strait was believed due to the besieged Malacca Strait,which trapped the heat and make it difficult to release while higher chlorophyll a in Malacca Strait is due to the freshwater conduit from nearby rivers(Klang,Langat,Perak,and Selangor).Furthermore,compared to the southern Andaman Sea,the chlorophyll a in the northern Malacca Strait is easier to reach the surface area due to the shallower thermocline,which allows nutrients in the area to reach the surface faster.展开更多
Fluorescence lifetime imaging microscopy(FLIM)is increasingly used in biomedicine,material science,chemistry,and other related research fields,because of its advantages of high specificity and sensitivity in monitorin...Fluorescence lifetime imaging microscopy(FLIM)is increasingly used in biomedicine,material science,chemistry,and other related research fields,because of its advantages of high specificity and sensitivity in monitoring cellular microenvironments,studying interaction between proteins,metabolic state,screening drugs and analyzing their efficacy,characterizing novel materials,and diagnosing early cancers.Understandably,there is a large interest in obtaining FLIM data within an acquisition time as short as possible.Consequently,there is currently a technology that advances towards faster and faster FLIM recording.However,the maximum speed of a recording technique is only part of the problerm.The acquisition time of a FLIM image is a complex function of many factors.These include the photon rate that can be obtained from the sample,the amount of information a technique extracts from the decay functions,the fficiency at which it determines fluorescence decay parameters from the recorded photons,the demands for the accuracy of these parameters,the number of pixels,and the lateral and axial resolutions that are obtained in biological materials.Starting from a discussion of the parameters which determine the acquisition time,this review will describe existing and emerging FLIM techniques and data analysis algo-rithms,and analyze their performance and recording speed in biological and biomedical applications.展开更多
Cities are in constant change and city managers aim to keep an updated digital model of the city for city governance. There are a lot of images uploaded daily on image sharing platforms (as “Flickr”, “Twitter”, et...Cities are in constant change and city managers aim to keep an updated digital model of the city for city governance. There are a lot of images uploaded daily on image sharing platforms (as “Flickr”, “Twitter”, etc.). These images feature a rough localization and no orientation information. Nevertheless, they can help to populate an active collaborative database of street images usable to maintain a city 3D model, but their localization and orientation need to be known. Based on these images, we propose the Data Gathering system for image Pose Estimation (DGPE) that helps to find the pose (position and orientation) of the camera used to shoot them with better accuracy than the sole GPS localization that may be embedded in the image header. DGPE uses both visual and semantic information, existing in a single image processed by a fully automatic chain composed of three main layers: Data retrieval and preprocessing layer, Features extraction layer, Decision Making layer. In this article, we present the whole system details and compare its detection results with a state of the art method. Finally, we show the obtained localization, and often orientation results, combining both semantic and visual information processing on 47 images. Our multilayer system succeeds in 26% of our test cases in finding a better localization and orientation of the original photo. This is achieved by using only the image content and associated metadata. The use of semantic information found on social media such as comments, hash tags, etc. has doubled the success rate to 59%. It has reduced the search area and thus made the visual search more accurate.展开更多
Cancer is the second-leading cause of death in the United State and surgery remains the primary treatment for most solid mass tumors. However, accurately identifying tumor margins in real-time remains a challenge. In ...Cancer is the second-leading cause of death in the United State and surgery remains the primary treatment for most solid mass tumors. However, accurately identifying tumor margins in real-time remains a challenge. In this study, the design and testing of hyperspectral imaging (HSI) system based on a single-pixel camera engine is discussed. The primary advantage of a single pixel architecture over traditional scanning HSI techniques is its high sensitivity and potential to function at low light levels. The objective for the imaging system described here is to detect changes in the reflectance spectra of tissue and to use these differences to delineate tumor margins. This paper presents the results of a 19-patient pilot study that assesses the ability of the HSI system to use reflectance imaging to delineate adenocarcinoma tumor margins in human pancreatic tissue imaged<em> ex vivo</em>. Pancreatic tissue excised during pancreatectomy was imaged immediately after being sent to the pathology lab. A pathologist sectioned the tissue and placed samples into standard tissue embedding cassettes. These tissue samples were then imaged using the HSI system. After imaging, the samples were returned to the pathologist for processing and analysis. The HSI was later compared to the histological analysis. The spectral angle mapping (SAM) and support vector machine (SVM) algorithms were used to classify pixels in the HSI images as healthy or unhealthy in order to delineate margins. Good agreement between margins determined via HSI (using both SAM and SVM) and histology/white light imaging was found.展开更多
Image processing plays an important role in engineering treatment. The authors mainly introduced the feature recognition of borehole image process based on Ant Colony Algorithm (ACA). The most important geological str...Image processing plays an important role in engineering treatment. The authors mainly introduced the feature recognition of borehole image process based on Ant Colony Algorithm (ACA). The most important geological structure-fracture on the borehole image was identified, and quantitative parameters were obtained by HOUGH transform. Several case studies show that the method is feasible.展开更多
Acid phosphatase(ACP)is a ubiquitous phosphatase in living organisms.The abnormal variation of ACP is related to various diseases.Herein,we propose a colorimetric method based on CeO_(2)-modified gold core shell nanop...Acid phosphatase(ACP)is a ubiquitous phosphatase in living organisms.The abnormal variation of ACP is related to various diseases.Herein,we propose a colorimetric method based on CeO_(2)-modified gold core shell nanoparticles(Au@CeO_(2)NPs)to analyze ACP activity with high sensitivity and specificity.In this design,2-phospho-L-ascorbic acid trisodium salt(AAP)is dephosphorylated by ACP and produces reductive ascorbic acid(AA),which makes the CeO_(2)shell decomposition.A remarkable blue shift of localized surface plasmon resonance peak(LSPR,from yellow to green)along with the scattering intensity ratio changes from individual Au@CeO_(2)NPs are observed.ACP activity can be quantified by calculating the ratio changes of individual Au@CeO_(2)NPs.This assay reveals limit of detection(LOD)of 0.044 mU/mL and the linear range of 0.05–5.0 mU/mL,which are much lower than most of spectroscopic measurements in bulk solution.Furthermore,the recovery measurements in real samples are satisfactory and the capacity for practical application is demonstrated.As a consequence,Au@CeO_(2)NPs used in this assay will find new applications for the ultrasensitive detection of enzyme activity.展开更多
文摘This paper addresses the common orthopedic trauma of spinal vertebral fractures and aims to enhance doctors’diagnostic efficiency.Therefore,a deep-learning-based automated diagnostic systemwithmulti-label segmentation is proposed to recognize the condition of vertebral fractures.The whole spine Computed Tomography(CT)image is segmented into the fracture,normal,and background using U-Net,and the fracture degree of each vertebra is evaluated(Genant semi-qualitative evaluation).The main work of this paper includes:First,based on the spatial configuration network(SCN)structure,U-Net is used instead of the SCN feature extraction network.The attention mechanismandthe residual connectionbetweenthe convolutional layers are added in the local network(LN)stage.Multiple filtering is added in the global network(GN)stage,and each layer of the LN decoder feature map is filtered separately using dot product,and the filtered features are re-convolved to obtain the GN output heatmap.Second,a network model with improved SCN(M-SCN)helps automatically localize the center-of-mass position of each vertebra,and the voxels around each localized vertebra were clipped,eliminating a large amount of redundant information(e.g.,background and other interfering vertebrae)and keeping the vertebrae to be segmented in the center of the image.Multilabel segmentation of the clipped portion was subsequently performed using U-Net.This paper uses VerSe’19,VerSe’20(using only data containing vertebral fractures),and private data(provided by Guizhou Orthopedic Hospital)for model training and evaluation.Compared with the original SCN network,the M-SCN reduced the prediction error rate by 1.09%and demonstrated the effectiveness of the improvement in ablation experiments.In the vertebral segmentation experiment,the Dice Similarity Coefficient(DSC)index reached 93.50%and the Maximum Symmetry Surface Distance(MSSD)index was 4.962 mm,with accuracy and recall of 95.82%and 91.73%,respectively.Fractured vertebrae were also marked as red and normal vertebrae were marked as white in the experiment,and the semi-qualitative assessment results of Genant were provided,as well as the results of spinal localization visualization and 3D reconstructed views of the spine to analyze the actual predictive ability of the model.It provides a promising tool for vertebral fracture detection.
基金Science and technology plan project of Xi'an,Grant/Award Number:GXYD17.12Open Fund of Shaanxi Key Laboratory of Network Data Intelligent Processing,Grant/Award Number:XUPT-KLND(201802,201803)Key Research and Development Program of Shaanxi,Grant/Award Number:2019GY-021。
文摘Fracture is one of the most common and unexpected traumas.If not treated in time,it may cause serious consequences such as joint stiffness,traumatic arthritis,and nerve injury.Using computer vision technology to detect fractures can reduce the workload and misdiagnosis of fractures and also improve the fracture detection speed.However,there are still some problems in sternum fracture detection,such as the low detection rate of small and occult fractures.In this work,the authors have constructed a dataset with 1227 labelled X-ray images for sternum fracture detection.The authors designed a fully automatic fracture detection model based on a deep convolution neural network(CNN).The authors used cascade R-CNN,attention mechanism,and atrous convolution to optimise the detection of small fractures in a large X-ray image with big local variations.The authors compared the detection results of YOLOv5 model,cascade R-CNN and other state-of-the-art models.The authors found that the convolution neural network based on cascade and attention mechanism models has a better detection effect and arrives at an mAP of 0.71,which is much better than using the YOLOv5 model(mAP=0.44)and cascade R-CNN(mAP=0.55).
基金the Higher Education Ministry research grant,under the Long-Term Research Grant Scheme(No.LRGS/1/2020/UMT/01/1/2)the Universiti Malaysia Terengganu Scholarship(BUMT)。
文摘The thermal front in the oceanic system is believed to have a significant effect on biological activity.During an era of climate change,changes in heat regulation between the atmosphere and oceanic interior can alter the characteristics of this important feature.Using the simulation results of the 3D Regional Ocean Modelling System(ROMS),we identified the location of thermal fronts and determined their dynamic variability in the area between the southern Andaman Sea and northern Malacca Strait.The Single Image Edge Detection(SIED)algorithm was used to detect the thermal front from model-derived temperature.Results show that a thermal front occurred every year from 2002 to 2012 with the temperature gradient at the location of the front was 0.3°C/km.Compared to the years affected by El Ni?o and negative Indian Ocean Dipole(IOD),the normal years(e.g.,May 2003)show the presence of the thermal front at every selected depth(10,25,50,and 75 m),whereas El Ni?o and negative IOD during 2010 show the presence of the thermal front only at depth of 75 m due to greater warming,leading to the thermocline deepening and enhanced stratification.During May 2003,the thermal front was separated by cooler SST in the southern Andaman Sea and warmer SST in the northern Malacca Strait.The higher SST in the northern Malacca Strait was believed due to the besieged Malacca Strait,which trapped the heat and make it difficult to release while higher chlorophyll a in Malacca Strait is due to the freshwater conduit from nearby rivers(Klang,Langat,Perak,and Selangor).Furthermore,compared to the southern Andaman Sea,the chlorophyll a in the northern Malacca Strait is easier to reach the surface area due to the shallower thermocline,which allows nutrients in the area to reach the surface faster.
基金support from the National Key R&D Program of China(2017YFA0700500)National Natural Science Foundation of China(61775144/61525503/61620106016/61835009/81727804)+2 种基金(Key)Project of Department of Education of Guangdong Province(2015KGJHZ002/2016KCXTD007)Guangdong Natural Science Foundation(2014A030312008,2017A030310132,2018A030313362)Shenzhen Basic Research Project(JCYJ20170818144012025/JCYJ20170818141701667/JCYJ20170412105003520/JCYJ20150930104948169).
文摘Fluorescence lifetime imaging microscopy(FLIM)is increasingly used in biomedicine,material science,chemistry,and other related research fields,because of its advantages of high specificity and sensitivity in monitoring cellular microenvironments,studying interaction between proteins,metabolic state,screening drugs and analyzing their efficacy,characterizing novel materials,and diagnosing early cancers.Understandably,there is a large interest in obtaining FLIM data within an acquisition time as short as possible.Consequently,there is currently a technology that advances towards faster and faster FLIM recording.However,the maximum speed of a recording technique is only part of the problerm.The acquisition time of a FLIM image is a complex function of many factors.These include the photon rate that can be obtained from the sample,the amount of information a technique extracts from the decay functions,the fficiency at which it determines fluorescence decay parameters from the recorded photons,the demands for the accuracy of these parameters,the number of pixels,and the lateral and axial resolutions that are obtained in biological materials.Starting from a discussion of the parameters which determine the acquisition time,this review will describe existing and emerging FLIM techniques and data analysis algo-rithms,and analyze their performance and recording speed in biological and biomedical applications.
文摘Cities are in constant change and city managers aim to keep an updated digital model of the city for city governance. There are a lot of images uploaded daily on image sharing platforms (as “Flickr”, “Twitter”, etc.). These images feature a rough localization and no orientation information. Nevertheless, they can help to populate an active collaborative database of street images usable to maintain a city 3D model, but their localization and orientation need to be known. Based on these images, we propose the Data Gathering system for image Pose Estimation (DGPE) that helps to find the pose (position and orientation) of the camera used to shoot them with better accuracy than the sole GPS localization that may be embedded in the image header. DGPE uses both visual and semantic information, existing in a single image processed by a fully automatic chain composed of three main layers: Data retrieval and preprocessing layer, Features extraction layer, Decision Making layer. In this article, we present the whole system details and compare its detection results with a state of the art method. Finally, we show the obtained localization, and often orientation results, combining both semantic and visual information processing on 47 images. Our multilayer system succeeds in 26% of our test cases in finding a better localization and orientation of the original photo. This is achieved by using only the image content and associated metadata. The use of semantic information found on social media such as comments, hash tags, etc. has doubled the success rate to 59%. It has reduced the search area and thus made the visual search more accurate.
文摘Cancer is the second-leading cause of death in the United State and surgery remains the primary treatment for most solid mass tumors. However, accurately identifying tumor margins in real-time remains a challenge. In this study, the design and testing of hyperspectral imaging (HSI) system based on a single-pixel camera engine is discussed. The primary advantage of a single pixel architecture over traditional scanning HSI techniques is its high sensitivity and potential to function at low light levels. The objective for the imaging system described here is to detect changes in the reflectance spectra of tissue and to use these differences to delineate tumor margins. This paper presents the results of a 19-patient pilot study that assesses the ability of the HSI system to use reflectance imaging to delineate adenocarcinoma tumor margins in human pancreatic tissue imaged<em> ex vivo</em>. Pancreatic tissue excised during pancreatectomy was imaged immediately after being sent to the pathology lab. A pathologist sectioned the tissue and placed samples into standard tissue embedding cassettes. These tissue samples were then imaged using the HSI system. After imaging, the samples were returned to the pathologist for processing and analysis. The HSI was later compared to the histological analysis. The spectral angle mapping (SAM) and support vector machine (SVM) algorithms were used to classify pixels in the HSI images as healthy or unhealthy in order to delineate margins. Good agreement between margins determined via HSI (using both SAM and SVM) and histology/white light imaging was found.
文摘Image processing plays an important role in engineering treatment. The authors mainly introduced the feature recognition of borehole image process based on Ant Colony Algorithm (ACA). The most important geological structure-fracture on the borehole image was identified, and quantitative parameters were obtained by HOUGH transform. Several case studies show that the method is feasible.
基金supported by the Natural Science Foundation of Hunan Province,China(No.2022JJ40266)the Open Research Fund of School of Chemistry and Chemical Engineering,Henan Normal University,China(No.2022A04).
文摘Acid phosphatase(ACP)is a ubiquitous phosphatase in living organisms.The abnormal variation of ACP is related to various diseases.Herein,we propose a colorimetric method based on CeO_(2)-modified gold core shell nanoparticles(Au@CeO_(2)NPs)to analyze ACP activity with high sensitivity and specificity.In this design,2-phospho-L-ascorbic acid trisodium salt(AAP)is dephosphorylated by ACP and produces reductive ascorbic acid(AA),which makes the CeO_(2)shell decomposition.A remarkable blue shift of localized surface plasmon resonance peak(LSPR,from yellow to green)along with the scattering intensity ratio changes from individual Au@CeO_(2)NPs are observed.ACP activity can be quantified by calculating the ratio changes of individual Au@CeO_(2)NPs.This assay reveals limit of detection(LOD)of 0.044 mU/mL and the linear range of 0.05–5.0 mU/mL,which are much lower than most of spectroscopic measurements in bulk solution.Furthermore,the recovery measurements in real samples are satisfactory and the capacity for practical application is demonstrated.As a consequence,Au@CeO_(2)NPs used in this assay will find new applications for the ultrasensitive detection of enzyme activity.