Objective:To evaluate the efficacy of scalp acupuncture combined with language rehabilitation training in the treatment of motor aphasia.Methods:CNKI,VIP,Wan Fang Database,MEDLINE,Embase,Web of Science and Cochrane Li...Objective:To evaluate the efficacy of scalp acupuncture combined with language rehabilitation training in the treatment of motor aphasia.Methods:CNKI,VIP,Wan Fang Database,MEDLINE,Embase,Web of Science and Cochrane Library were searched for published researches up to March,2021.Randomized controlled trials RCTs that focused on scalp acupuncture combined with language rehabilitation training in the treatment of motor aphasia were included.We managed the data analysis with RevMan 5.3 software.Results:A total of 16 RCTs with 1323 patients were involved.The results of meta-analysis showed that:①The effective rate of scalp acupuncture combined with language rehabilitation training in the treatment of motor aphasia after stroke was significantly better than that of simple language rehabilitation training[OR=3.94,95%CI(2.73,5.68),P<0.00001];②In the evaluation of language function,compared with the language rehabilitation training,the scalp acupuncture combined with language rehabilitation training can significantly improve the reading ability of the patients with motor aphasia after stroke[MD=7.22,95%CI(3.55,10.89),P=0.0001],writing ability[MD=6.51,95%CI(3.61,9.41),P<0.0001],expressive ability[MD=4.13,95%CI(2.37,5.89),P<0.0001],retelling ability[MD=5.00,95%CI(2.38,7.63),P=0.0002],listening comprehension ability[MD=5.36,95%CI(3.12,7.61),P<0.00001]and naming ability[MD=5.60,95%CI(4.20,7.00),P<0.00001];③Compared with simple language rehabilitation training,scalp acupuncture combined with language rehabilitation can significantly improve the daily life language communication ability of patients with motor aphasia,and the difference was statistically significant[MD=30.01,95%CI(11.30,48.72),P=0.002].Conclusion:Scalp acupuncture combined with language rehabilitation training has a significant effect on motor aphasia.However,due to the small sample size,more RCTs are needed to confirm that.展开更多
Large Language Models (LLMs) have revolutionized Generative Artificial Intelligence (GenAI) tasks, becoming an integral part of various applications in society, including text generation, translation, summarization, a...Large Language Models (LLMs) have revolutionized Generative Artificial Intelligence (GenAI) tasks, becoming an integral part of various applications in society, including text generation, translation, summarization, and more. However, their widespread usage emphasizes the critical need to enhance their security posture to ensure the integrity and reliability of their outputs and minimize harmful effects. Prompt injections and training data poisoning attacks are two of the most prominent vulnerabilities in LLMs, which could potentially lead to unpredictable and undesirable behaviors, such as biased outputs, misinformation propagation, and even malicious content generation. The Common Vulnerability Scoring System (CVSS) framework provides a standardized approach to capturing the principal characteristics of vulnerabilities, facilitating a deeper understanding of their severity within the security and AI communities. By extending the current CVSS framework, we generate scores for these vulnerabilities such that organizations can prioritize mitigation efforts, allocate resources effectively, and implement targeted security measures to defend against potential risks.展开更多
The vocational education and training(VET)system helps people from culturally and linguistically diverse(CALD)back-grounds to integrate and settle into society.However,successful completion of VET is closely related t...The vocational education and training(VET)system helps people from culturally and linguistically diverse(CALD)back-grounds to integrate and settle into society.However,successful completion of VET is closely related to CALD learners’language skills.This literature review aims at identifying the main methods of language skills improvement for VET learners from CALD backgrounds.Five language support/training methods based on different theoretical models are also introduced in this literature re-view,including the model outlines and target groups.展开更多
Objective To observe therapeutic effects of acupuncture combined with language training on aphasia induced by ischemic apoplexy and investigate the mechanisms. Methods 60 patients were randomly divided into a treatmen...Objective To observe therapeutic effects of acupuncture combined with language training on aphasia induced by ischemic apoplexy and investigate the mechanisms. Methods 60 patients were randomly divided into a treatment group treated by acupuncture associated with language training and a control group treated by simple language training. Tongue-acupuncture was applied as the main therapy, and language training included speech organ training, mouth-shape and voice training, spoken language expression training and practical communication ability training. According to Aphosio Bottery of Chinese (ABC), language ex- amination evaluation was made, and event related potential (P300) was detected before and after treatment. Results The therapeutic effect in the treatment group was significantly better than that in the control group (P〈O. 05), and the scores of ABC items including information content, speech fluency, repetition, vocabula- ry denomination, color naming, response denomination, confirmation or negation, acoustic recognition and carrying out instruction in the treatment group were obviously higher than those in the control group (P〈0.05). After one course of treatment, the latencies of N2 and P3 waves in P300 were significantly short- ened and the amplitude of P3 was significantly elevated in the treatment group, compared with those in the control group (P〈0.05). Conclusion Acupuncture combined with language training provided remarkable therapeutic effects in treating cerebral infarction-induced motor aphasia, and it was better than simple lan- guage training. The results of enhancing of the ABC scores including information content, speech fluency, repetition, vocabulary denomination, color naming, response denomination, confirmation or negation, acous- tic recognition and carrying out instruction, and shortening of the latencies of N2 and P3 waves in P300 and ele- vation of P3 amplitude may be taken as the indices for evaluating and anticipating clinical therapeutic effects of the therapy for treating the disease, which may also be some of the mechanisms.展开更多
As the ultimate goal of education, autonomy in language learning has aroused a lot of attention from scholars at home and abroad. While in universities of China, students do not have strong autonomy in English languag...As the ultimate goal of education, autonomy in language learning has aroused a lot of attention from scholars at home and abroad. While in universities of China, students do not have strong autonomy in English language learning. The author tries to adopt specific meta-cognitive strategies to facilitate students' autonomy in learning by improving learners' capacities in study planning or management, monitoring and evaluating in learning to raise their consciousness and ability in autonomy, and lay a foundation for life-long learning.展开更多
A survey of language training centers(LTCs)in Dalian,China was conducted,to ascertain the strengths and weaknesses,or the differentiating factors,of such centers.The survey was undertaken to understand the current lan...A survey of language training centers(LTCs)in Dalian,China was conducted,to ascertain the strengths and weaknesses,or the differentiating factors,of such centers.The survey was undertaken to understand the current landscape of after-school institutes in the region,particularly those that offer training in English as a second/foreign language.The information uncovered by the research is considered beneficial not only to entrepreneurs who may wish to be involved in this industry,but also to college English majors who may wish to teach at an LTC.展开更多
The aim of foreign language teaching in the contemporary is to develop foreign language talents who own intercultural competence.Thus,it is necessary to improve teachers’cultural quality and intercultural awareness.T...The aim of foreign language teaching in the contemporary is to develop foreign language talents who own intercultural competence.Thus,it is necessary to improve teachers’cultural quality and intercultural awareness.The paper explores some relevant training courses on culture and intercultural awareness,and discusses the deficiency of these courses.展开更多
The COVID-19 outbreak severely affected formal face-to-face classroom teaching and learning.ICT-based online education and training can be a useful measure during the pandemic.In the Pakistani educational context,the ...The COVID-19 outbreak severely affected formal face-to-face classroom teaching and learning.ICT-based online education and training can be a useful measure during the pandemic.In the Pakistani educational context,the use of ICT-based online training is generally sporadic and often unavailable,especially for developing English-language instructors’listening comprehension skills.The major factors affecting availability include insufficient IT resources and infrastructure,a lack of proper online training for speech and listening,instructors with inadequate academic backgrounds,and an unfavorable environment for ICT-based training for listening comprehension.This study evaluated the effectiveness of ICT-based training for developing secondary-level English-language instructors’listening comprehension skills.To this end,collaborative online training was undertaken using random sampling.Specifically,60 private-school instructors in Chakwal District,Pakistan,were randomly selected to receive online-listening training sessions using English dialogs.The experimental group achieved significant scores in the posttest analysis.Specifically,there were substantial improvements in the participants’listening skills via online training.Given the unavailability of face-to-face learning during COVID-19,this study recommends using ICT-based online training to enhance listening comprehension skills.Education policymakers should revise curricula based on online teaching methods and modules.展开更多
Recently,great changes have taken place in the field of foreign language talents training in universities.Training of foreign language talents should take both national strategy and local development into consideratio...Recently,great changes have taken place in the field of foreign language talents training in universities.Training of foreign language talents should take both national strategy and local development into consideration.Traditional skill-centered foreign language talents training model has been gradually taken place by“foreign language+”model which can better adapt to new social needs and sustainable development of the foreign language major.In a word,foreign language talents training requires not only the language skills,but also professional knowledge and other abilities so that they can develop in full scale and meet the needs of the social development effectively.展开更多
This paper aims to talk about the superficial reflections on language testing from the perspective of professional training for test writers,to qualify test writers with basic testing theories,to make the test valid a...This paper aims to talk about the superficial reflections on language testing from the perspective of professional training for test writers,to qualify test writers with basic testing theories,to make the test valid and reliable,to help improve educational reform and language teaching,to fully conform to the standards set by syllabus.展开更多
This paper explores how to implement effective strategy training for part-time Chinese adult English learners in a tertiary FLT (Foreign Language Teaching) classroom. Through a study of threx~ semesters during which...This paper explores how to implement effective strategy training for part-time Chinese adult English learners in a tertiary FLT (Foreign Language Teaching) classroom. Through a study of threx~ semesters during which six sessions of learner training workshops and constant, integrated task-based instruction were carried out, empirical evidence was collected via the instrument of questionnaires, interviews, learners' regular written reports, and the findings indicate that: (1) The students reported a statistically significant increase of the overaU average frequency of language strategy use over all SILL (The Strategy Inventory for Language Learning) items with 2.95 at the beginning and 3.61 at the end; and (2) Well-organized, explicit, and discrete leaner training workshops combined with frequent, explicit, and integrated task-based strategy instruction are an effective and helpful way to improve learners' awareness, selection, and frequency of strategy use, which can further foster learner autonomy.展开更多
A great many recent studies have shown that making good use of learning strategies can contribute much to students' foreign language learning. This paper deals with some important issues about strategy training ba...A great many recent studies have shown that making good use of learning strategies can contribute much to students' foreign language learning. This paper deals with some important issues about strategy training based on O'Malley and Chamot's theory, including the concept, value and goals of strategy training and approaches to such training.展开更多
Based on the"Understandable Output Hypothesis"a practical study on the construction of college oral English network training camp is set up,through speech learning and imitation,building language input in na...Based on the"Understandable Output Hypothesis"a practical study on the construction of college oral English network training camp is set up,through speech learning and imitation,building language input in natural environment,exploring effective output mode based on information technology platform,providing foreign language learners with opportunities to express language and get feedback.Students use relevant resources on the Internet to complete the oral activities of"thematic activities"together,so as to cultivate students'cooperative learning,communication skills,team spirit and language communication ability.展开更多
With increasing global exchanges and cooperation,there is an increasing demand for foreign language interdisciplinary talents.The cultivation of interdisciplinary foreign language talents is a long-term,complicated me...With increasing global exchanges and cooperation,there is an increasing demand for foreign language interdisciplinary talents.The cultivation of interdisciplinary foreign language talents is a long-term,complicated methodical endeavor,which requires constant exploration by experts in foreign language circles.In order to cultivate compound foreign language talents in colleges and universities,it is important to change the educational concept,enhance the teaching staff,and innovate the talent training mode.In the training of compound foreign language talents in colleges and universities,a compound talent training model of“foreign language+major or direction”should be established,and beginning from the actual situation of the major,the bold exploration and implementation of the transformation of the concept of compound foreign language talent training should be followed through,while strengthening the construction of teaching staff,optimizing the professional curriculum,updating the teaching content,as well as enriching the methods and measures of teaching.展开更多
Automatic speech recognition(ASR)systems have emerged as indispensable tools across a wide spectrum of applications,ranging from transcription services to voice-activated assistants.To enhance the performance of these...Automatic speech recognition(ASR)systems have emerged as indispensable tools across a wide spectrum of applications,ranging from transcription services to voice-activated assistants.To enhance the performance of these systems,it is important to deploy efficient models capable of adapting to diverse deployment conditions.In recent years,on-demand pruning methods have obtained significant attention within the ASR domain due to their adaptability in various deployment scenarios.However,these methods often confront substantial trade-offs,particularly in terms of unstable accuracy when reducing the model size.To address challenges,this study introduces two crucial empirical findings.Firstly,it proposes the incorporation of an online distillation mechanism during on-demand pruning training,which holds the promise of maintaining more consistent accuracy levels.Secondly,it proposes the utilization of the Mogrifier long short-term memory(LSTM)language model(LM),an advanced iteration of the conventional LSTM LM,as an effective alternative for pruning targets within the ASR framework.Through rigorous experimentation on the ASR system,employing the Mogrifier LSTM LM and training it using the suggested joint on-demand pruning and online distillation method,this study provides compelling evidence.The results exhibit that the proposed methods significantly outperform a benchmark model trained solely with on-demand pruning methods.Impressively,the proposed strategic configuration successfully reduces the parameter count by approximately 39%,all the while minimizing trade-offs.展开更多
针对畜禽疫病文本语料匮乏、文本内包含大量疫病名称及短语等未登录词问题,提出了一种结合词典匹配的BERT-BiLSTM-CRF畜禽疫病文本分词模型。以羊疫病为研究对象,构建了常见疫病文本数据集,将其与通用语料PKU结合,利用BERT(Bidirectiona...针对畜禽疫病文本语料匮乏、文本内包含大量疫病名称及短语等未登录词问题,提出了一种结合词典匹配的BERT-BiLSTM-CRF畜禽疫病文本分词模型。以羊疫病为研究对象,构建了常见疫病文本数据集,将其与通用语料PKU结合,利用BERT(Bidirectional encoder representation from transformers)预训练语言模型进行文本向量化表示;通过双向长短时记忆网络(Bidirectional long short-term memory network,BiLSTM)获取上下文语义特征;由条件随机场(Conditional random field,CRF)输出全局最优标签序列。基于此,在CRF层后加入畜禽疫病领域词典进行分词匹配修正,减少在分词过程中出现的疫病名称及短语等造成的歧义切分,进一步提高了分词准确率。实验结果表明,结合词典匹配的BERT-BiLSTM-CRF模型在羊常见疫病文本数据集上的F1值为96.38%,与jieba分词器、BiLSTM-Softmax模型、BiLSTM-CRF模型、未结合词典匹配的本文模型相比,分别提升11.01、10.62、8.3、0.72个百分点,验证了方法的有效性。与单一语料相比,通用语料PKU和羊常见疫病文本数据集结合的混合语料,能够同时对畜禽疫病专业术语及疫病文本中常用词进行准确切分,在通用语料及疫病文本数据集上F1值都达到95%以上,具有较好的模型泛化能力。该方法可用于畜禽疫病文本分词。展开更多
基金supported by Gansu Natural Science Foundation(No.1610RJZA078)Research Project of Gansu Administration of Traditional Chinese Medicine(No.GZK-2017-19)Key Talent Projects of Gansu Province in 2019(No.Ganzu Tongzi No.39)。
文摘Objective:To evaluate the efficacy of scalp acupuncture combined with language rehabilitation training in the treatment of motor aphasia.Methods:CNKI,VIP,Wan Fang Database,MEDLINE,Embase,Web of Science and Cochrane Library were searched for published researches up to March,2021.Randomized controlled trials RCTs that focused on scalp acupuncture combined with language rehabilitation training in the treatment of motor aphasia were included.We managed the data analysis with RevMan 5.3 software.Results:A total of 16 RCTs with 1323 patients were involved.The results of meta-analysis showed that:①The effective rate of scalp acupuncture combined with language rehabilitation training in the treatment of motor aphasia after stroke was significantly better than that of simple language rehabilitation training[OR=3.94,95%CI(2.73,5.68),P<0.00001];②In the evaluation of language function,compared with the language rehabilitation training,the scalp acupuncture combined with language rehabilitation training can significantly improve the reading ability of the patients with motor aphasia after stroke[MD=7.22,95%CI(3.55,10.89),P=0.0001],writing ability[MD=6.51,95%CI(3.61,9.41),P<0.0001],expressive ability[MD=4.13,95%CI(2.37,5.89),P<0.0001],retelling ability[MD=5.00,95%CI(2.38,7.63),P=0.0002],listening comprehension ability[MD=5.36,95%CI(3.12,7.61),P<0.00001]and naming ability[MD=5.60,95%CI(4.20,7.00),P<0.00001];③Compared with simple language rehabilitation training,scalp acupuncture combined with language rehabilitation can significantly improve the daily life language communication ability of patients with motor aphasia,and the difference was statistically significant[MD=30.01,95%CI(11.30,48.72),P=0.002].Conclusion:Scalp acupuncture combined with language rehabilitation training has a significant effect on motor aphasia.However,due to the small sample size,more RCTs are needed to confirm that.
文摘Large Language Models (LLMs) have revolutionized Generative Artificial Intelligence (GenAI) tasks, becoming an integral part of various applications in society, including text generation, translation, summarization, and more. However, their widespread usage emphasizes the critical need to enhance their security posture to ensure the integrity and reliability of their outputs and minimize harmful effects. Prompt injections and training data poisoning attacks are two of the most prominent vulnerabilities in LLMs, which could potentially lead to unpredictable and undesirable behaviors, such as biased outputs, misinformation propagation, and even malicious content generation. The Common Vulnerability Scoring System (CVSS) framework provides a standardized approach to capturing the principal characteristics of vulnerabilities, facilitating a deeper understanding of their severity within the security and AI communities. By extending the current CVSS framework, we generate scores for these vulnerabilities such that organizations can prioritize mitigation efforts, allocate resources effectively, and implement targeted security measures to defend against potential risks.
文摘The vocational education and training(VET)system helps people from culturally and linguistically diverse(CALD)back-grounds to integrate and settle into society.However,successful completion of VET is closely related to CALD learners’language skills.This literature review aims at identifying the main methods of language skills improvement for VET learners from CALD backgrounds.Five language support/training methods based on different theoretical models are also introduced in this literature re-view,including the model outlines and target groups.
文摘Objective To observe therapeutic effects of acupuncture combined with language training on aphasia induced by ischemic apoplexy and investigate the mechanisms. Methods 60 patients were randomly divided into a treatment group treated by acupuncture associated with language training and a control group treated by simple language training. Tongue-acupuncture was applied as the main therapy, and language training included speech organ training, mouth-shape and voice training, spoken language expression training and practical communication ability training. According to Aphosio Bottery of Chinese (ABC), language ex- amination evaluation was made, and event related potential (P300) was detected before and after treatment. Results The therapeutic effect in the treatment group was significantly better than that in the control group (P〈O. 05), and the scores of ABC items including information content, speech fluency, repetition, vocabula- ry denomination, color naming, response denomination, confirmation or negation, acoustic recognition and carrying out instruction in the treatment group were obviously higher than those in the control group (P〈0.05). After one course of treatment, the latencies of N2 and P3 waves in P300 were significantly short- ened and the amplitude of P3 was significantly elevated in the treatment group, compared with those in the control group (P〈0.05). Conclusion Acupuncture combined with language training provided remarkable therapeutic effects in treating cerebral infarction-induced motor aphasia, and it was better than simple lan- guage training. The results of enhancing of the ABC scores including information content, speech fluency, repetition, vocabulary denomination, color naming, response denomination, confirmation or negation, acous- tic recognition and carrying out instruction, and shortening of the latencies of N2 and P3 waves in P300 and ele- vation of P3 amplitude may be taken as the indices for evaluating and anticipating clinical therapeutic effects of the therapy for treating the disease, which may also be some of the mechanisms.
文摘As the ultimate goal of education, autonomy in language learning has aroused a lot of attention from scholars at home and abroad. While in universities of China, students do not have strong autonomy in English language learning. The author tries to adopt specific meta-cognitive strategies to facilitate students' autonomy in learning by improving learners' capacities in study planning or management, monitoring and evaluating in learning to raise their consciousness and ability in autonomy, and lay a foundation for life-long learning.
文摘A survey of language training centers(LTCs)in Dalian,China was conducted,to ascertain the strengths and weaknesses,or the differentiating factors,of such centers.The survey was undertaken to understand the current landscape of after-school institutes in the region,particularly those that offer training in English as a second/foreign language.The information uncovered by the research is considered beneficial not only to entrepreneurs who may wish to be involved in this industry,but also to college English majors who may wish to teach at an LTC.
文摘The aim of foreign language teaching in the contemporary is to develop foreign language talents who own intercultural competence.Thus,it is necessary to improve teachers’cultural quality and intercultural awareness.The paper explores some relevant training courses on culture and intercultural awareness,and discusses the deficiency of these courses.
基金The authors are grateful to the Taif University Researchers Supporting Project number(TURSP-2020/36),Taif University,Taif,Saudi Arabia。
文摘The COVID-19 outbreak severely affected formal face-to-face classroom teaching and learning.ICT-based online education and training can be a useful measure during the pandemic.In the Pakistani educational context,the use of ICT-based online training is generally sporadic and often unavailable,especially for developing English-language instructors’listening comprehension skills.The major factors affecting availability include insufficient IT resources and infrastructure,a lack of proper online training for speech and listening,instructors with inadequate academic backgrounds,and an unfavorable environment for ICT-based training for listening comprehension.This study evaluated the effectiveness of ICT-based training for developing secondary-level English-language instructors’listening comprehension skills.To this end,collaborative online training was undertaken using random sampling.Specifically,60 private-school instructors in Chakwal District,Pakistan,were randomly selected to receive online-listening training sessions using English dialogs.The experimental group achieved significant scores in the posttest analysis.Specifically,there were substantial improvements in the participants’listening skills via online training.Given the unavailability of face-to-face learning during COVID-19,this study recommends using ICT-based online training to enhance listening comprehension skills.Education policymakers should revise curricula based on online teaching methods and modules.
基金the Project of Top Disciplines(A Study of“Foreign Language+Profession”Innovative Talents Training Model Driven by Social Needs,2018)in College of Foreign Languages,Yanbian University,China.
文摘Recently,great changes have taken place in the field of foreign language talents training in universities.Training of foreign language talents should take both national strategy and local development into consideration.Traditional skill-centered foreign language talents training model has been gradually taken place by“foreign language+”model which can better adapt to new social needs and sustainable development of the foreign language major.In a word,foreign language talents training requires not only the language skills,but also professional knowledge and other abilities so that they can develop in full scale and meet the needs of the social development effectively.
文摘This paper aims to talk about the superficial reflections on language testing from the perspective of professional training for test writers,to qualify test writers with basic testing theories,to make the test valid and reliable,to help improve educational reform and language teaching,to fully conform to the standards set by syllabus.
文摘This paper explores how to implement effective strategy training for part-time Chinese adult English learners in a tertiary FLT (Foreign Language Teaching) classroom. Through a study of threx~ semesters during which six sessions of learner training workshops and constant, integrated task-based instruction were carried out, empirical evidence was collected via the instrument of questionnaires, interviews, learners' regular written reports, and the findings indicate that: (1) The students reported a statistically significant increase of the overaU average frequency of language strategy use over all SILL (The Strategy Inventory for Language Learning) items with 2.95 at the beginning and 3.61 at the end; and (2) Well-organized, explicit, and discrete leaner training workshops combined with frequent, explicit, and integrated task-based strategy instruction are an effective and helpful way to improve learners' awareness, selection, and frequency of strategy use, which can further foster learner autonomy.
文摘A great many recent studies have shown that making good use of learning strategies can contribute much to students' foreign language learning. This paper deals with some important issues about strategy training based on O'Malley and Chamot's theory, including the concept, value and goals of strategy training and approaches to such training.
文摘Based on the"Understandable Output Hypothesis"a practical study on the construction of college oral English network training camp is set up,through speech learning and imitation,building language input in natural environment,exploring effective output mode based on information technology platform,providing foreign language learners with opportunities to express language and get feedback.Students use relevant resources on the Internet to complete the oral activities of"thematic activities"together,so as to cultivate students'cooperative learning,communication skills,team spirit and language communication ability.
基金Operating Expenses of Basic Scientific Research Project of Provincial Universities in 2020“On the Training Model of Inter-disciplinary Foreign Language Talents in Local Application-oriented Universities”(Project Number:YWk10236200111)。
文摘With increasing global exchanges and cooperation,there is an increasing demand for foreign language interdisciplinary talents.The cultivation of interdisciplinary foreign language talents is a long-term,complicated methodical endeavor,which requires constant exploration by experts in foreign language circles.In order to cultivate compound foreign language talents in colleges and universities,it is important to change the educational concept,enhance the teaching staff,and innovate the talent training mode.In the training of compound foreign language talents in colleges and universities,a compound talent training model of“foreign language+major or direction”should be established,and beginning from the actual situation of the major,the bold exploration and implementation of the transformation of the concept of compound foreign language talent training should be followed through,while strengthening the construction of teaching staff,optimizing the professional curriculum,updating the teaching content,as well as enriching the methods and measures of teaching.
基金supported by Institute of Information&communications Technology Planning&Evaluation(IITP)grant funded by the Korea government(MSIT)(No.2022-0-00377,Development of Intelligent Analysis and Classification Based Contents Class Categorization Technique to Prevent Imprudent Harmful Media Distribution).
文摘Automatic speech recognition(ASR)systems have emerged as indispensable tools across a wide spectrum of applications,ranging from transcription services to voice-activated assistants.To enhance the performance of these systems,it is important to deploy efficient models capable of adapting to diverse deployment conditions.In recent years,on-demand pruning methods have obtained significant attention within the ASR domain due to their adaptability in various deployment scenarios.However,these methods often confront substantial trade-offs,particularly in terms of unstable accuracy when reducing the model size.To address challenges,this study introduces two crucial empirical findings.Firstly,it proposes the incorporation of an online distillation mechanism during on-demand pruning training,which holds the promise of maintaining more consistent accuracy levels.Secondly,it proposes the utilization of the Mogrifier long short-term memory(LSTM)language model(LM),an advanced iteration of the conventional LSTM LM,as an effective alternative for pruning targets within the ASR framework.Through rigorous experimentation on the ASR system,employing the Mogrifier LSTM LM and training it using the suggested joint on-demand pruning and online distillation method,this study provides compelling evidence.The results exhibit that the proposed methods significantly outperform a benchmark model trained solely with on-demand pruning methods.Impressively,the proposed strategic configuration successfully reduces the parameter count by approximately 39%,all the while minimizing trade-offs.
文摘针对畜禽疫病文本语料匮乏、文本内包含大量疫病名称及短语等未登录词问题,提出了一种结合词典匹配的BERT-BiLSTM-CRF畜禽疫病文本分词模型。以羊疫病为研究对象,构建了常见疫病文本数据集,将其与通用语料PKU结合,利用BERT(Bidirectional encoder representation from transformers)预训练语言模型进行文本向量化表示;通过双向长短时记忆网络(Bidirectional long short-term memory network,BiLSTM)获取上下文语义特征;由条件随机场(Conditional random field,CRF)输出全局最优标签序列。基于此,在CRF层后加入畜禽疫病领域词典进行分词匹配修正,减少在分词过程中出现的疫病名称及短语等造成的歧义切分,进一步提高了分词准确率。实验结果表明,结合词典匹配的BERT-BiLSTM-CRF模型在羊常见疫病文本数据集上的F1值为96.38%,与jieba分词器、BiLSTM-Softmax模型、BiLSTM-CRF模型、未结合词典匹配的本文模型相比,分别提升11.01、10.62、8.3、0.72个百分点,验证了方法的有效性。与单一语料相比,通用语料PKU和羊常见疫病文本数据集结合的混合语料,能够同时对畜禽疫病专业术语及疫病文本中常用词进行准确切分,在通用语料及疫病文本数据集上F1值都达到95%以上,具有较好的模型泛化能力。该方法可用于畜禽疫病文本分词。