摘要
【目的】系统梳理和测试当前互联网中可获取和使用的大模型在编校方面的表现,明晰现有大模型的强项与不足,为编辑人员选用大模型进行编校提供参考,为推动模型编校能力发展提供依据。【方法】设计不同类型、不同难度等级差错文本,综合使用文本对比法、比较分析法、统计分析法等方法,根据模型回答的结果判断其准确率与稳定性。【结果】发现已有58款大模型具备编校能力;展示36款大模型处理不同类型和不同难度文本时的表现;归纳大模型在测试中表现出来的不足;国产大模型与Chat GPT相比具有优势。【结论】在实践层面,编辑可以选择合适的模型辅助编校工作;建立知识库,探索个性化的模型编校方式;使用角色设定和思维链询问方法以提高效率;进一步提升信息素养和专业技能。
[Purposes]This study systematically reviews and tests the performance of currently available large models on the internet in terms of editing and proofreading.It aims to clarify the strengths and weaknesses of the existing large models,provide references for editors choosing large models for editing and proofreading,and offer a basis for advancing the development of these models'capabilities of editing and proofreading.[Methods]Different types of texts with varying complexity levels of error were designed to evaluate the accuracy and stability of the models'responses.Methods such as text comparison,comparative analysis,and statistical analysis were comprehensively employed.[Findings]58 models demonstrate editing and proofreading capabilities.The study showcases the performance of 36 models when handling different types and levels of textual complexity,summarizes the shortcomings observed during testing,and shows that the Chinese models have comparative advantages over ChatGPT.[Conclusions]In practical aspects,editors can select appropriate models to assist with their tasks,establish knowledge bases and personalized model-based editing and proofreading methods,use role setting and chain of thought inquiry methods to improve efficiency,and further enhance their information literacy and professional skills.
作者
夏丽云
岳于佳
徐敏赟
丁懿楠
代建华
XIA Liyun;YUE Yujia;XU Minyun;DING Yinan;DAI Jianhua(Journal Office of Hunan Normal University,36 Lushan South Road,Yuelu District,Changsha 410081,China;Hunan Provincial Key Laboratory of Intelligent Computing and Language Information Processing,36 Lushan South Road,Yuelu District,Changsha 410081,China;Editorial Office of International Forum,School of International Relations and Diplomacy,Beijing Foreign Studies University,2 Xisanhuan North Road,Haidian District,Beijing 100089,China)
出处
《中国科技期刊研究》
北大核心
2024年第7期948-956,共9页
Chinese Journal of Scientific and Technical Periodicals
基金
北京外国语大学中央高校基本科研业务费专项资金“外国语言文学学科影响力排名及数据库建设”(2021JS003)。
关键词
大模型
人工智能
编辑校对
实测
Large model
Artificial intelligence
Editing and proofreading
Practical test