基于运动传感的书空临摹交互方式

Interactively Painting by Shu-Kong Facsimile Based on Motion Sensors

临摹背默是传统水墨画学习最有效的方式之一,但是对于儿童来说这样的学习方法比较枯燥乏味.为了使儿童能够以更自然、直观的方式学习背默水墨画的样例程式,提出了以运动传感器替代传统毛笔的书空临摹交互方法.该方法先从水墨画中提取笔画和设计对应手势作为示范样例,用隐马尔科夫模型做手势识别;然后通过量化手势识别的差异率来对笔画进行相应的变形,并以儿童为目标用户,探索寓教于乐的隔空作画的交互方式对于记忆和理解水墨画的运笔方式和步骤的影响程度.实验结果表明,采用文中方法可以更直观、快捷地让儿童感受水墨画运笔方法的趣味性.

Facsimileing of existing painting artworks is one of the most effective methods to learn traditional ink painting.However,this method requires a lot of immovable and duplicated work thus is too boring for children.To allow natural and intuitive example-based learning,this paper proposes a new Shu-Kong facsimile interaction scheme that employs motion sensors instead of traditional painting brushes to strengthen the interaction.First,stokes from ink paintings are extracted and their corresponding hand gestures are collected as training samples.Then,HMM is employed as underlying model for gesture training and recognition.Finally,the recognized stokes are deformed according to the quantitative difference between the input and sample gestures.We evaluate the Shu-Kong based painting interface by having children as target users on a test set of Chinese ink painting artworks.Experiment results show that our approach can inspire the interests of the children on learning ink painting more effectively than the traditional pen-based interface.