期刊文献+
共找到4篇文章
< 1 >
每页显示 20 50 100
基于强化学习的对抗预训练语言建模方法
1
作者 颜俊琦 孙水发 +2 位作者 吴义熔 裴伟 董方敏 《中文信息学报》 CSCD 北大核心 2022年第4期20-28,共9页
在大规模无监督语料上的BERT、XLNet等预训练语言模型,通常采用基于交叉熵损失函数的语言建模任务进行训练。模型的评价标准则采用困惑度或者模型在其他下游自然语言处理任务中的性能指标,存在损失函数和评测指标不匹配等问题。为解决... 在大规模无监督语料上的BERT、XLNet等预训练语言模型,通常采用基于交叉熵损失函数的语言建模任务进行训练。模型的评价标准则采用困惑度或者模型在其他下游自然语言处理任务中的性能指标,存在损失函数和评测指标不匹配等问题。为解决这些问题,该文提出一种结合强化学习的对抗预训练语言模型RL-XLNet(Reinforcement Learning-XLNet)。RL-XLNet采用对抗训练方式训练一个生成器,基于上下文预测选定词,并训练一个判别器判断生成器预测的词是否正确。通过对抗网络生成器和判别器的相互促进作用,强化生成器对语义的理解,提高模型的学习能力。由于在文本生成过程中存在采样过程,导致最终的损失无法直接进行回传,故提出采用强化学习的方式对生成器进行训练。基于通用语言理解评估基准(GLUE Benchmark)和斯坦福问答任务(SQuAD 1.1)的实验,结果表明,与现有BERT、XLNet方法相比,RL-XLNet模型在多项任务中的性能上表现出较明显的优势:在GLUE的六个任务中排名第1,一个任务排名第2,一个任务排名第3。在SQuAD 1.1任务中F 1值排名第1。考虑到运算资源有限,基于小语料集的模型性能也达到了领域先进水平。 展开更多
关键词 自然语言处理 预训练 语言模型 强化学习
下载PDF
MULTI-SHOP SCHEDULING PROBLEM 被引量:2
2
作者 HU yanhai yan junqi +2 位作者 MA Dengzhe YE Feifan ZHANG Jie 《Chinese Journal of Mechanical Engineering》 SCIE EI CAS CSCD 2007年第3期109-112,共4页
A new concept of multi-shop (M ) is put forward which contains all basic shops including open shop (O), job shop (J ), flow shop (F ) and hybrid flow shop (H ) so that these basic shop can be scheduled toget... A new concept of multi-shop (M ) is put forward which contains all basic shops including open shop (O), job shop (J ), flow shop (F ) and hybrid flow shop (H ) so that these basic shop can be scheduled together. Several algorithms including ant colony optimization (ACO), most work remaining (MWR), least work remaining (LWR), longest processing time (LPT) and shortest processing time (SPT) are used for scheduling the M. Numerical experiments of the M adopting data of some car and reC series benchmark instances are tested. The results show that the ACO algorithm has better performance for scheduling the M than the other algorithms, if minimizing the makespan ( Cmax^*) is taken as the objective function. As a comparison, the separate shops contained in the M are also scheduled by the ACO algorithm for the same objective function, when the completing time of the jobs in the previous shop is taken as the ready time of these jobs in the following shop. The results show that the M has the advantage of shortening the makespan upon separate shops. 展开更多
关键词 Multi-shop scheduling Mixed shop Hybrid flow shop HEURISTICS
下载PDF
Hands in Hands for Even Brighter Prospects of People-to-People Diplomacy——New Year Message
3
作者 yan junqi Wang Bo 《International Understanding》 2015年第1期1-1,共1页
In this dynamic and fresh season of spring when the flowers are in full blossom,on behalf of the Chinese Association for International Understanding(CAFIU),I’d like to extend cordial greetings and wishes to the reade... In this dynamic and fresh season of spring when the flowers are in full blossom,on behalf of the Chinese Association for International Understanding(CAFIU),I’d like to extend cordial greetings and wishes to the readers of the International Understanding home and abroad and people from all walks of life for your longstanding attention and support for the work and development of CAFIU. 展开更多
关键词 behalf season fresh EXCHANGES FLOWERS strive mankind cooperation POLITICS mutual
下载PDF
APPROACH TO INTEGRATED PROCESS PLANNING SYSTEM ARCHITECTURE
4
作者 yan junqi Luo Linhua Shanghai Jiaotong University 《Chinese Journal of Mechanical Engineering》 SCIE EI CAS CSCD 1994年第3期237-243,共17页
A series of researches on process planning system architecture is described.The definition of process planning in CIMS, a unified description for work procedure of various CAPP systems,including retneval,variant and g... A series of researches on process planning system architecture is described.The definition of process planning in CIMS, a unified description for work procedure of various CAPP systems,including retneval,variant and generative systems,and the information models about part, manufacturing facility are provided to form scientific basis for process planning automation where a Part Model based on Feature and a Production Environment Model based on Work-Element are to be important supports for implementation of the integrated process planning system.These concepts are applied to the development of a prototype system SIP,which is suitable for box-type mechanical parts and consists of three subsystems:CAD,CAPP and NCP.They are linked together by neutral files as interfaces. This is a successfol implementation for engineering integration. 展开更多
关键词 Architecture Process planning CPP CIMS Information model
全文增补中
上一页 1 下一页 到第
使用帮助 返回顶部