一种融合多头自注意力机制的粉笔字书写规范性评价方法

A Chalk Character Handwriting Standardization Evaluation Method Incorporating Multi-Head Self-Attention Mechanism

在粉笔字书写规范性评价系统中,采用数据到文本生成技术对粉笔字进行评价。基线模型使用双向门控循环单元(BiGRU)对输入序列建模,并在分组规划阶段利用GRU为每个句子生成要覆盖的输入项子集。对于直接拼接BiGRU状态信息可能无法充分捕捉键值对之间的复杂关系的问题,在数据分组规划前引入了多头自注意力机制来更精细地捕捉键值关系。在手写汉字数据集上的实验结果表明,该方法在BLEU-4、ROUGE和METEOR指标上分别达到0.68、0.75与0.67,为粉笔字书写规范性的自动评价提供了实际应用价值。

The data-to-text generation technology was applied to the evaluation system for chalk characters writing standard in the paper.The baseline model was improved firstly and then the improved baseline model was used to model input sequences by using bidirectional gated recurrent unit(BiGRU)and generated a subset of input items to be covered for each sentence using a GRU during the grouping planning phase.A multi-head self-attention mechanism was introduced before data grouping planning to capture key-value relationships more finely in terms of the problem that direct splicing of BiGRU state information might not adequately capture the complex relationships between key-value pairs.The tests on handwritten Chinese characters data sets demonstrated that the proposed method achieved 0.68,0.75 and 0.67 in BLEU-4,ROUGE and METEOR,respectively,which was of great practical application value for the automatic evaluation of the handwriting standard of chalk characters.