Encouraging and astonishing developments have recently been achieved in image-based diagnostic technology.Modern medical care and imaging technology are becoming increasingly inseparable.However,the current diagnosis ...Encouraging and astonishing developments have recently been achieved in image-based diagnostic technology.Modern medical care and imaging technology are becoming increasingly inseparable.However,the current diagnosis pattern of signal to image to knowledge inevitably leads to information distortion and noise introduction in the procedure of image reconstruction(from signal to image).Artificial intelligence(AI)technologies that can mine knowledge from vast amounts of data offer opportunities to disrupt established workflows.In this prospective study,for the first time,we develop an AI-based signal-toknowledge diagnostic scheme for lung nodule classification directly from the computed tomography(CT)raw data(the signal).We find that the raw data achieves almost comparable performance with CT,indicating that it is possible to diagnose diseases without reconstructing images.Moreover,the incorporation of raw data through three common convolutional network structures greatly improves the performance of the CT models in all cohorts(with a gain ranging from 0.01 to 0.12),demonstrating that raw data contains diagnostic information that CT does not possess.Our results break new ground and demonstrate the potential for direct signal-to-knowledge domain analysis.展开更多
Although prognostic prediction of nasopharyngeal carcinoma (NPC) remains a pivotal research area, the role of dynamic contrast-enhanced magnetic resonance (DCE-MR) has been less explored. This study aimed to investiga...Although prognostic prediction of nasopharyngeal carcinoma (NPC) remains a pivotal research area, the role of dynamic contrast-enhanced magnetic resonance (DCE-MR) has been less explored. This study aimed to investigate the role of DCR-MR in predicting progression-free survival (PFS) in patients with NPC using magnetic resonance (MR)- and DCE-MR-based radiomic models. A total of 434 patients with two MR scanning sequences were included. The MR- and DCE-MR-based radiomics models were developed based on 289 patients with only MR scanning sequences and 145 patients with four additional pharmacokinetic parameters (volume fraction of extravascular extracellular space (ve), volume fraction of plasma space (vp), volume transfer constant (Ktrans), and reverse reflux rate constant (kep) of DCE-MR. A combined model integrating MR and DCE-MR was constructed. Utilizing methods such as correlation analysis, least absolute shrinkage and selection operator regression, and multivariate Cox proportional hazards regression, we built the radiomics models. Finally, we calculated the net reclassification index and C-index to evaluate and compare the prognostic performance of the radiomics models. Kaplan-Meier survival curve analysis was performed to investigate the model’s ability to stratify risk in patients with NPC. The integration of MR and DCE-MR radiomic features significantly enhanced prognostic prediction performance compared to MR- and DCE-MR-based models, evidenced by a test set C-index of 0.808 vs 0.729 and 0.731, respectively. The combined radiomics model improved net reclassification by 22.9%-52.6% and could significantly stratify the risk levels of patients with NPC (p = 0.036). Furthermore, the MR-based radiomic feature maps achieved similar results to the DCE-MR pharmacokinetic parameters in terms of reflecting the underlying angiogenesis information in NPC. Compared to conventional MR-based radiomics models, the combined radiomics model integrating MR and DCE-MR showed promising results in delivering more accurate prognostic predictions and provided more clinical benefits in quantifying and monitoring phenotypic changes associated with NPC prognosis.展开更多
Gastric cancer(GC)is one of the most common malignant tumors with high mortality.Accurate diagnosis and treatment decisions for GC rely heavily on human experts’careful judgments on medical images.However,the improve...Gastric cancer(GC)is one of the most common malignant tumors with high mortality.Accurate diagnosis and treatment decisions for GC rely heavily on human experts’careful judgments on medical images.However,the improvement of the accuracy is hindered by imaging conditions,limited experience,objective criteria,and inter-observer discrepancies.Recently,the developments of machine learning,especially deep-learning algorithms,have been facilitating computers to extract more information from data automatically.Researchers are exploring the far-reaching applications of artificial intelligence(AI)in various clinical practices,including GC.Herein,we aim to provide a broad framework to summarize current research on AI in GC.In the screening of GC,AI can identify precancerous diseases and assist in early cancer detection with endoscopic examination and pathological confirmation.In the diagnosis of GC,AI can support tumor-node-metastasis(TNM)staging and subtype classification.For treatment decisions,AI can help with surgical margin determination and prognosis prediction.Meanwhile,current approaches are challenged by data scarcity and poor interpretability.To tackle these problems,more regulated data,unified processing procedures,and advanced algorithms are urgently needed to build more accurate and robust AI models for GC.展开更多
Importance:Digestive system neoplasms(DSNs)are the leading cause of cancer-related mortality with a 5-year survival rate of less than 20%.Subjective evaluation of medical images including endoscopic images,whole slide...Importance:Digestive system neoplasms(DSNs)are the leading cause of cancer-related mortality with a 5-year survival rate of less than 20%.Subjective evaluation of medical images including endoscopic images,whole slide images,computed tomography images,and magnetic resonance images plays a vital role in the clinical practice of DSNs,but with limited performance and increased workload of radiologists or pathologists.The application of artificial intelligence(AI)in medical image analysis holds promise to augment the visual interpretation of medical images,which could not only automate the complicated evaluation process but also convert medical images into quantitative imaging features that associated with tumor heterogeneity.Highlights:We briefly introduce the methodology of AI for medical image analysis and then review its clinical applications including clinical auxiliary diagnosis,assessment of treatment response,and prognosis prediction on 4 typical DSNs including esophageal cancer,gastric cancer,colorectal cancer,and hepatocellular carcinoma.Conclusion:AI technology has great potential in supporting the clinical diagnosis and treatment decision-making of DSNs.Several technical issues should be overcome before its application into clinical practice of DSNs.展开更多
基金supported by the National Key Research and Development Program of China (2017YFA0205200,2023YFC2415200,2021YFF1201003,and 2021YFC2500402)the National Natural Science Foundation of China (82022036,91959130,81971776,62027901,81930053,81771924,62333022,82361168664,62176013,and 82302317)+5 种基金the Beijing Natural Science Foundation (Z20J00105)Strategic Priority Research Program of Chinese Academy of Sciences (XDB38040200)Chinese Academy of Sciences (GJJSTD20170004 and QYZDJ-SSW-JSC005)the Project of High-Level Talents Team Introduction in Zhuhai City (Zhuhai HLHPTP201703)the Youth Innovation Promotion Association CAS (Y2021049)the China Postdoctoral Science Foundation (2021M700341).
文摘Encouraging and astonishing developments have recently been achieved in image-based diagnostic technology.Modern medical care and imaging technology are becoming increasingly inseparable.However,the current diagnosis pattern of signal to image to knowledge inevitably leads to information distortion and noise introduction in the procedure of image reconstruction(from signal to image).Artificial intelligence(AI)technologies that can mine knowledge from vast amounts of data offer opportunities to disrupt established workflows.In this prospective study,for the first time,we develop an AI-based signal-toknowledge diagnostic scheme for lung nodule classification directly from the computed tomography(CT)raw data(the signal).We find that the raw data achieves almost comparable performance with CT,indicating that it is possible to diagnose diseases without reconstructing images.Moreover,the incorporation of raw data through three common convolutional network structures greatly improves the performance of the CT models in all cohorts(with a gain ranging from 0.01 to 0.12),demonstrating that raw data contains diagnostic information that CT does not possess.Our results break new ground and demonstrate the potential for direct signal-to-knowledge domain analysis.
基金the Natural Science Foundation of Hainan Province,No.821MS125the National Key R&D Program of China,No.2023YFC2415200+6 种基金the Key R&D projects in Hainan Province,No.ZDYF-2021SHFZ239the Natural Science Research Project“open competition mechanism”of Hainan Medical College,Nos.JBGS202113 and JBGS202107Strategic Priority Research Program of the Chinese Academy of Sciences,No.XDB 38040200National Natural Science Foundation of China,Nos.82372053,82302296,81871346,81971602,82022036,91959130,81971776,81771924,62027901,81930053Beijing Natural Science Foundation,No.L182061 and Z20J00105Chinese Academy of Sciences,Nos.GJJSTD20170004 and QYZDJ-SSW-JSC005and Youth Innovation Promotion Association CAS,No.2017175.
文摘Although prognostic prediction of nasopharyngeal carcinoma (NPC) remains a pivotal research area, the role of dynamic contrast-enhanced magnetic resonance (DCE-MR) has been less explored. This study aimed to investigate the role of DCR-MR in predicting progression-free survival (PFS) in patients with NPC using magnetic resonance (MR)- and DCE-MR-based radiomic models. A total of 434 patients with two MR scanning sequences were included. The MR- and DCE-MR-based radiomics models were developed based on 289 patients with only MR scanning sequences and 145 patients with four additional pharmacokinetic parameters (volume fraction of extravascular extracellular space (ve), volume fraction of plasma space (vp), volume transfer constant (Ktrans), and reverse reflux rate constant (kep) of DCE-MR. A combined model integrating MR and DCE-MR was constructed. Utilizing methods such as correlation analysis, least absolute shrinkage and selection operator regression, and multivariate Cox proportional hazards regression, we built the radiomics models. Finally, we calculated the net reclassification index and C-index to evaluate and compare the prognostic performance of the radiomics models. Kaplan-Meier survival curve analysis was performed to investigate the model’s ability to stratify risk in patients with NPC. The integration of MR and DCE-MR radiomic features significantly enhanced prognostic prediction performance compared to MR- and DCE-MR-based models, evidenced by a test set C-index of 0.808 vs 0.729 and 0.731, respectively. The combined radiomics model improved net reclassification by 22.9%-52.6% and could significantly stratify the risk levels of patients with NPC (p = 0.036). Furthermore, the MR-based radiomic feature maps achieved similar results to the DCE-MR pharmacokinetic parameters in terms of reflecting the underlying angiogenesis information in NPC. Compared to conventional MR-based radiomics models, the combined radiomics model integrating MR and DCE-MR showed promising results in delivering more accurate prognostic predictions and provided more clinical benefits in quantifying and monitoring phenotypic changes associated with NPC prognosis.
基金supported by the National Natural Science Foundation of China[grant numbers 82022036,91959130,81971776,62027901,81930053]National Key R&D Program of China[grant number 2017YFA0205200]+2 种基金the Beijing Natural Science Foundation[grant number Z20J00105]Strategic Priority Research Program of Chinese Academy of Sciences[grant number XDB38040200]the Youth Innovation Promotion Association CAS[grant number Y2021049].
文摘Gastric cancer(GC)is one of the most common malignant tumors with high mortality.Accurate diagnosis and treatment decisions for GC rely heavily on human experts’careful judgments on medical images.However,the improvement of the accuracy is hindered by imaging conditions,limited experience,objective criteria,and inter-observer discrepancies.Recently,the developments of machine learning,especially deep-learning algorithms,have been facilitating computers to extract more information from data automatically.Researchers are exploring the far-reaching applications of artificial intelligence(AI)in various clinical practices,including GC.Herein,we aim to provide a broad framework to summarize current research on AI in GC.In the screening of GC,AI can identify precancerous diseases and assist in early cancer detection with endoscopic examination and pathological confirmation.In the diagnosis of GC,AI can support tumor-node-metastasis(TNM)staging and subtype classification.For treatment decisions,AI can help with surgical margin determination and prognosis prediction.Meanwhile,current approaches are challenged by data scarcity and poor interpretability.To tackle these problems,more regulated data,unified processing procedures,and advanced algorithms are urgently needed to build more accurate and robust AI models for GC.
基金the National Natural Science Foundation of China(82102140,62027901,81930053,82022036,81971776,and 91959205)the Beijing Natural Science Foundation(Z20J00105).
文摘Importance:Digestive system neoplasms(DSNs)are the leading cause of cancer-related mortality with a 5-year survival rate of less than 20%.Subjective evaluation of medical images including endoscopic images,whole slide images,computed tomography images,and magnetic resonance images plays a vital role in the clinical practice of DSNs,but with limited performance and increased workload of radiologists or pathologists.The application of artificial intelligence(AI)in medical image analysis holds promise to augment the visual interpretation of medical images,which could not only automate the complicated evaluation process but also convert medical images into quantitative imaging features that associated with tumor heterogeneity.Highlights:We briefly introduce the methodology of AI for medical image analysis and then review its clinical applications including clinical auxiliary diagnosis,assessment of treatment response,and prognosis prediction on 4 typical DSNs including esophageal cancer,gastric cancer,colorectal cancer,and hepatocellular carcinoma.Conclusion:AI technology has great potential in supporting the clinical diagnosis and treatment decision-making of DSNs.Several technical issues should be overcome before its application into clinical practice of DSNs.