摘要
手写文字图像补全是图像补全问题中一个重要研究分支,其难点在于图片中具有无约束书写风格的文字的结构关系补全。为了模拟实际中复杂和困难的应用情景,在图像补全研究工作的启发下,针对大类别、小样本、多风格、未知语种等复杂情况下进行手写象形文字图像补全。采用全局和局部一致性保持的生成式对抗神经网络(GLC-GAN)。在大类别多风格的手写文字图像补全中,补全图片往往因可能的补全候选很丰富而导致补全区域模糊不清。为此,提出两级补全系统:第一级粗补全模块考虑文字结构的完整性,第二级细补全模块实现文字的清晰化、细致化。通过在大类别手写汉字数据库CASIA-HWDB1.1上的实验,验证了该两级系统的有效性,同时分析系统在不同书写风格和不同缺失区域情况下的补全效果。
Handwritten character completion is an important research topic in image completion. Its challenge comes from the completion of the structural relationships in handwritten characters with unconstrained handwritten styles. To simulate the complicated and difficult situations in the real-world applications, the paper focuses on handwritten pictographic characters with large category, small sample size, multiple unconstrained handwritten styles, and unknown language(i.e., with no access to the class label of each character). Inspired by the progress in natural image completion, the generative adversarial network with global and local consistency was leveraged to achieve handwritten character completion. Under the circumstances of large category and various writing styles, the completion areas of character completion suffer from low-fidelity because of the large number of potential completion candidates. To solve this problem, a two-stage character completion system was proposed: the first stage is coarse-grained completion module ensuring the completeness of the character;the second stage is fine-grained completion module improving the sharpness and details of characters. Extensive experiments were conducted on CASIA-HWDB1.1 to validate the effectiveness of the two-stage system and analyze the completion performance under different writing styles and different conditions of missing area.
作者
李农勤
杨维信
LI Nong-qin;YANG Wei-xin(School of Economics and Management,East China University of Technology,Nanchang Jiangxi 330013,China;School of Electronic and Information Engineering,South China University of Technology,Guangzhou Guangdong 510641,China;Mathematical Institute,University of Oxford,Oxford OX26GG)
出处
《图学学报》
CSCD
北大核心
2019年第5期878-884,共7页
Journal of Graphics
关键词
生成式对抗网络
手写文字
图像补全
结构补全
自监督学习
generative adversarial network
handwritten character
image completion
structure completion
unsupervised learning