大语言模型(large language models,LLMs)所展现的处理各种自然语言处理(natural language processing,NLP)任务的能力引发了广泛关注.然而,它们在处理现实中各种复杂场景时的鲁棒性尚未得到充分探索,这对于评估模型的稳定性和可靠性尤...大语言模型(large language models,LLMs)所展现的处理各种自然语言处理(natural language processing,NLP)任务的能力引发了广泛关注.然而,它们在处理现实中各种复杂场景时的鲁棒性尚未得到充分探索,这对于评估模型的稳定性和可靠性尤为重要.因此,使用涵盖了9个常见NLP任务的15个数据集(约147000个原始测试样本)和来自TextFlint的61种鲁棒的文本变形方法分析GPT-3和GPT-3.5系列模型在原始数据集上的性能,以及其在不同任务和文本变形级别(字符、词和句子)上的鲁棒性.研究结果表明,GPT模型虽然在情感分析、语义匹配等分类任务和阅读理解任务中表现出良好的性能,但其处理信息抽取任务的能力仍较为欠缺,比如其对关系抽取任务中各种关系类型存在严重混淆,甚至出现“幻觉”现象.在鲁棒性评估实验中,GPT模型在任务层面和变形层面的鲁棒性都较弱,其中,在分类任务和句子级别的变形中鲁棒性缺乏更为显著.此外,探究了模型迭代过程中性能和鲁棒性的变化,以及提示中的演示数量和演示内容对模型性能和鲁棒性的影响.结果表明,随着模型的迭代以及上下文学习的加入,模型的性能稳步提升,但是鲁棒性依然亟待提升.这些发现从任务类型、变形种类、提示内容等方面揭示了GPT模型还无法完全胜任常见的NLP任务,并且模型存在的鲁棒性问题难以通过提升模型性能或改变提示内容等方式解决.通过对gpt-3.5-turbo的更新版本、gpt-4模型,以及开源模型LLaMA2-7B和LLaMA2-13B的性能和鲁棒性表现进行对比,进一步验证了实验结论.鉴于此,未来的大模型研究应当提升模型在信息提取以及语义理解等方面的能力,并且应当在模型训练或微调阶段考虑提升其鲁棒性.展开更多
AIM To evaluate diagnostic yields of capsule endoscopy(CE) and/or single-balloon enteroscopy(SBE) in patients with suspected small bowel diseases.METHODS Were trospectively analyzed 700 patients with suspected small b...AIM To evaluate diagnostic yields of capsule endoscopy(CE) and/or single-balloon enteroscopy(SBE) in patients with suspected small bowel diseases.METHODS Were trospectively analyzed 700 patients with suspected small bowel diseases from September 2010 to March 2016. CE, SBE, or SBE with prior CE was performed in 401, 353, and 47 patients, respectively. Data from clinical and endoscopy records were collected for analysis. Indications, procedure times, diagnostic yields, and complications were summarized and evaluated.RESULTS The overall diagnostic yield for the CE group was 57.6%. The diagnostic yield of CE in patients with obscure gastroin testinal bleeding(OGIB) was significantly greater than that in patients with no bleeding(70.5% vs 43.8%, P < 0.01). The overall diagnostic yield of SBE was 69.7%. There was no difference in the diagnostic yield of SBE between patients with OGIB and those with no bleeding(72.5% vs 68.9%, P = 0.534). Forty-seven patients underwent CE prior to SBE. Among them, the diagnostic yield of SBE with positive findings on prior CE was 93.3%. In addition, SBE detected two cases with superficial ulcer and erosive lesions in the small bowel, which were missed by CE. However, one case with lymphoma and two with Crohn's disease were not confirmed by SBE. The rate of capsule retention was 2.0%. There were no significant complications during or after SBE examinations.CONCLUSION SBE is a safe and effective technique for diagnosing small bowel diseases. SBE with prior CE seemed to improve the diagnostic yield of small bowel diseases.展开更多
OBJECTIVE: To investigate the mechanism of Bushen Huoxue decoction( 补肾活血汤, BSHXD) to treat endometriosis-induced infertility. MEDHODS: The main compounds of BSHXD were determined by high performance liquid chroma...OBJECTIVE: To investigate the mechanism of Bushen Huoxue decoction( 补肾活血汤, BSHXD) to treat endometriosis-induced infertility. MEDHODS: The main compounds of BSHXD were determined by high performance liquid chromatographymass spectrometry(HPLC-MS/MS). The effect of BSHXD on Homeobox A10(HOXA10) and alpha(v)beta(3)(αvβ3) integrin expression of Ishikawa cells, mouse model, and endometriosis-associated infertility women was evaluated by using Western blot analysis, immunohistochemistry and Real-Time quantitative polymerase chain reaction(RTq PCR). The efficacy of BSHXD on embryo attachment were examined by using the Be Wo spheroid and mouse embryo attachment assay. HOXA10 concentration in uterine flushing fluid of endometriosis-associated infertility women treated with BSHXD was measured by EnzymeLinked immunosorbent assay(ELISA).RESULTS: BSHXD improved Be Wo spheroid and mice blastocysts attachment to Ishikawa cells and increased embryo implantation rates in mice and pregnancy rates in women with endometriosis-associated infertility. BSHXD enhanced HOXA10 and αvβ3 integrin expression in Ishikawa cell, endometriosis mouse model, and endometriosis-associated infertility women, which potentially improved endometrial receptivity. CONCLUSIONS: BSHXD could improve endometrial receptivity of endometriosis-associated infertility in a dosedependent manner by regulating HOXA10 and αvβ3 integrin expression.展开更多
文摘大语言模型(large language models,LLMs)所展现的处理各种自然语言处理(natural language processing,NLP)任务的能力引发了广泛关注.然而,它们在处理现实中各种复杂场景时的鲁棒性尚未得到充分探索,这对于评估模型的稳定性和可靠性尤为重要.因此,使用涵盖了9个常见NLP任务的15个数据集(约147000个原始测试样本)和来自TextFlint的61种鲁棒的文本变形方法分析GPT-3和GPT-3.5系列模型在原始数据集上的性能,以及其在不同任务和文本变形级别(字符、词和句子)上的鲁棒性.研究结果表明,GPT模型虽然在情感分析、语义匹配等分类任务和阅读理解任务中表现出良好的性能,但其处理信息抽取任务的能力仍较为欠缺,比如其对关系抽取任务中各种关系类型存在严重混淆,甚至出现“幻觉”现象.在鲁棒性评估实验中,GPT模型在任务层面和变形层面的鲁棒性都较弱,其中,在分类任务和句子级别的变形中鲁棒性缺乏更为显著.此外,探究了模型迭代过程中性能和鲁棒性的变化,以及提示中的演示数量和演示内容对模型性能和鲁棒性的影响.结果表明,随着模型的迭代以及上下文学习的加入,模型的性能稳步提升,但是鲁棒性依然亟待提升.这些发现从任务类型、变形种类、提示内容等方面揭示了GPT模型还无法完全胜任常见的NLP任务,并且模型存在的鲁棒性问题难以通过提升模型性能或改变提示内容等方式解决.通过对gpt-3.5-turbo的更新版本、gpt-4模型,以及开源模型LLaMA2-7B和LLaMA2-13B的性能和鲁棒性表现进行对比,进一步验证了实验结论.鉴于此,未来的大模型研究应当提升模型在信息提取以及语义理解等方面的能力,并且应当在模型训练或微调阶段考虑提升其鲁棒性.
基金Supported by the Key Medical Personnel of Jiangsu Province,No.RC2011063
文摘AIM To evaluate diagnostic yields of capsule endoscopy(CE) and/or single-balloon enteroscopy(SBE) in patients with suspected small bowel diseases.METHODS Were trospectively analyzed 700 patients with suspected small bowel diseases from September 2010 to March 2016. CE, SBE, or SBE with prior CE was performed in 401, 353, and 47 patients, respectively. Data from clinical and endoscopy records were collected for analysis. Indications, procedure times, diagnostic yields, and complications were summarized and evaluated.RESULTS The overall diagnostic yield for the CE group was 57.6%. The diagnostic yield of CE in patients with obscure gastroin testinal bleeding(OGIB) was significantly greater than that in patients with no bleeding(70.5% vs 43.8%, P < 0.01). The overall diagnostic yield of SBE was 69.7%. There was no difference in the diagnostic yield of SBE between patients with OGIB and those with no bleeding(72.5% vs 68.9%, P = 0.534). Forty-seven patients underwent CE prior to SBE. Among them, the diagnostic yield of SBE with positive findings on prior CE was 93.3%. In addition, SBE detected two cases with superficial ulcer and erosive lesions in the small bowel, which were missed by CE. However, one case with lymphoma and two with Crohn's disease were not confirmed by SBE. The rate of capsule retention was 2.0%. There were no significant complications during or after SBE examinations.CONCLUSION SBE is a safe and effective technique for diagnosing small bowel diseases. SBE with prior CE seemed to improve the diagnostic yield of small bowel diseases.
基金National Natural Science Foundation-funded Project:the Mechanism of Effect of Bushen Huoxue Decotion on Endometrial Receptivity in Endometriosis (No. 81603372)National Natural Science Foundation-funded Project:to Investigate the Mechanism of Bushen Huoxue Decoction in Improving Endometrial Receptivity Based on SUMOylation of Homeobox A10 (No. 82274190)Jiangsu Commission of Health Project:to Investigate the Mechanism of Bushen Huoxue Decoction in Improving Endometrial Receptivity Based on Leukemia Inhibitory Factor Signaling (No. M2022079)。
文摘OBJECTIVE: To investigate the mechanism of Bushen Huoxue decoction( 补肾活血汤, BSHXD) to treat endometriosis-induced infertility. MEDHODS: The main compounds of BSHXD were determined by high performance liquid chromatographymass spectrometry(HPLC-MS/MS). The effect of BSHXD on Homeobox A10(HOXA10) and alpha(v)beta(3)(αvβ3) integrin expression of Ishikawa cells, mouse model, and endometriosis-associated infertility women was evaluated by using Western blot analysis, immunohistochemistry and Real-Time quantitative polymerase chain reaction(RTq PCR). The efficacy of BSHXD on embryo attachment were examined by using the Be Wo spheroid and mouse embryo attachment assay. HOXA10 concentration in uterine flushing fluid of endometriosis-associated infertility women treated with BSHXD was measured by EnzymeLinked immunosorbent assay(ELISA).RESULTS: BSHXD improved Be Wo spheroid and mice blastocysts attachment to Ishikawa cells and increased embryo implantation rates in mice and pregnancy rates in women with endometriosis-associated infertility. BSHXD enhanced HOXA10 and αvβ3 integrin expression in Ishikawa cell, endometriosis mouse model, and endometriosis-associated infertility women, which potentially improved endometrial receptivity. CONCLUSIONS: BSHXD could improve endometrial receptivity of endometriosis-associated infertility in a dosedependent manner by regulating HOXA10 and αvβ3 integrin expression.
