1|INTRODUCTION.Large language models(LLMs)have made breakthroughs in natural language processing(NLP)and understanding,and have brought revolutions in many other fields[1-4].Inspired by those successes,several large c...1|INTRODUCTION.Large language models(LLMs)have made breakthroughs in natural language processing(NLP)and understanding,and have brought revolutions in many other fields[1-4].Inspired by those successes,several large cellular models(LCMs)adopting similar structures of LLMs have been developed for single-cell transcriptomics,including(but not limited to)scBERT[5],Geneformer[6],scGPT[7],scFoundation[8],and GeneCompass[9].The practices of these models have shown LCMs’power and potential in various biological tasks and illustrated the possibilities of revolutionizing future biological studies by LCMs.展开更多
基金National Natural Science Foundation of China,Grant/Award Number:62250005National Key Research and Development Program of China,Grant/Award Number:2021YFF1200900。
文摘1|INTRODUCTION.Large language models(LLMs)have made breakthroughs in natural language processing(NLP)and understanding,and have brought revolutions in many other fields[1-4].Inspired by those successes,several large cellular models(LCMs)adopting similar structures of LLMs have been developed for single-cell transcriptomics,including(but not limited to)scBERT[5],Geneformer[6],scGPT[7],scFoundation[8],and GeneCompass[9].The practices of these models have shown LCMs’power and potential in various biological tasks and illustrated the possibilities of revolutionizing future biological studies by LCMs.
