Transformers have dominated the field of natural language processing and have recently made an impact in the area of computer vision.In the field of medical image analysis,transformers have also been successfully used...Transformers have dominated the field of natural language processing and have recently made an impact in the area of computer vision.In the field of medical image analysis,transformers have also been successfully used in to full-stack clinical applications,including image synthesis/reconstruction,registration,segmentation,detection,and diagnosis.This paper aimed to promote awareness of the applications of transformers in medical image analysis.Specifically,we first provided an overview of the core concepts of the attention mechanism built into transformers and other basic components.Second,we reviewed various transformer architectures tailored for medical image applications and discuss their limitations.Within this review,we investigated key challenges including the use of transformers in different learning paradigms,improving model efficiency,and coupling with other techniques.We hope this review would provide a comprehensive picture of transformers to readers with an interest in medical image analysis.展开更多
Hydrocephalus is often treated with a cerebrospinal fluid shunt(CFS) for excessive amounts of cerebrospinal fluid in the brain.However,it is very difficult to distinguish whether the ventricular enlargement is due to ...Hydrocephalus is often treated with a cerebrospinal fluid shunt(CFS) for excessive amounts of cerebrospinal fluid in the brain.However,it is very difficult to distinguish whether the ventricular enlargement is due to hydrocephalus or other causes,such as brain atrophy after brain damage and surgery.The non-trivial evaluation of the consciousness level,along with a continuous drainage test of the lumbar cistern is thus clinically important before the decision for CFS is made.We studied 32 secondary mild hydrocephalus patients with different consciousness levels,who received T1 and diffusion tensor imaging magnetic resonance scans before and after lumbar cerebrospinal fluid drainage.We applied a novel machine-learning method to find the most discriminative features from the multi-modal neuroimages.Then,we built a regression model to regress the JFK Coma Recovery Scale-Revised(CRS-R) scores to quantify the level of consciousness.The experimental results showed that our method not only approximated the CRS-R scores but also tracked the temporal changes in individual patients.The regression model has high potential for the evaluation of consciousness in clinical practice.展开更多
基金the National Natural Science Foundation of China(Grant No.62106101)the Natural Science Foundation of Jiangsu Province(Grant No.BK20210180).
文摘Transformers have dominated the field of natural language processing and have recently made an impact in the area of computer vision.In the field of medical image analysis,transformers have also been successfully used in to full-stack clinical applications,including image synthesis/reconstruction,registration,segmentation,detection,and diagnosis.This paper aimed to promote awareness of the applications of transformers in medical image analysis.Specifically,we first provided an overview of the core concepts of the attention mechanism built into transformers and other basic components.Second,we reviewed various transformer architectures tailored for medical image applications and discuss their limitations.Within this review,we investigated key challenges including the use of transformers in different learning paradigms,improving model efficiency,and coupling with other techniques.We hope this review would provide a comprehensive picture of transformers to readers with an interest in medical image analysis.
基金supported by the National Natural Science Foundation of China (81571025 and 81702461)the National Key Research and Development Program of China (2018YFC0116400)+6 种基金the International Cooperation Project from Shanghai Science Foundation (18410711300)Shanghai Science and Technology Development Funds (16JC1420100)the Shanghai Sailing Program (17YF1426600)STCSM (19QC1400600, 17411953300)the Shanghai Pujiang Program (19PJ1406800)the Shanghai Municipal Science and Technology Major Project (No.2018SHZDZX01) and ZJlabthe Interdisciplinary Program of Shanghai Jiao Tong University。
文摘Hydrocephalus is often treated with a cerebrospinal fluid shunt(CFS) for excessive amounts of cerebrospinal fluid in the brain.However,it is very difficult to distinguish whether the ventricular enlargement is due to hydrocephalus or other causes,such as brain atrophy after brain damage and surgery.The non-trivial evaluation of the consciousness level,along with a continuous drainage test of the lumbar cistern is thus clinically important before the decision for CFS is made.We studied 32 secondary mild hydrocephalus patients with different consciousness levels,who received T1 and diffusion tensor imaging magnetic resonance scans before and after lumbar cerebrospinal fluid drainage.We applied a novel machine-learning method to find the most discriminative features from the multi-modal neuroimages.Then,we built a regression model to regress the JFK Coma Recovery Scale-Revised(CRS-R) scores to quantify the level of consciousness.The experimental results showed that our method not only approximated the CRS-R scores but also tracked the temporal changes in individual patients.The regression model has high potential for the evaluation of consciousness in clinical practice.
