基于AR技术的非遗保护在川剧虚拟试衣和交互变脸中的应用研究

Application Research of Intangible Cultural Heritage Preservation Based on AR Technology in Sichuan Opera Virtual Costume Try-on and Interactive Face Changing

非物质文化遗产(简称“非遗”)在如何吸引广大青年群体的关注方面存在着巨大挑战,即使像川剧这种互动性、趣味性很强的地方文化代表也面临着传承的困扰。本文利用增强现实(AR)技术实现了川剧服饰试穿和川剧交互变脸。通过对川剧旦角服饰进行虚拟建模、骨架绑定、权重设置,并利用身体和光线跟踪以及布料模拟技术渲染映射实现了川剧服饰的AR试穿;利用3D数字化复原了川剧变脸和行当的代表性脸谱,并通过可视化编程完成了AR交互变脸。实验结果显示,在AR环境中人体动作与服装、脸谱实时匹配且交互稳定,结合实验在青年群体中的调查发现,AR技术相较于传统方式更容易吸引这个年龄群体的关注和认可,更有利于非遗在青年群体中的传承和发展。

There are significant challenges in attracting young people's attention to the protection and inheritance of intangible cultural heritage(ICH).Even Sichuan opera,a highly interactive and entertaining local cultural representative,struggles with inheritance issues.To solve this problem,this paper utilizes Augmented Reality(AR)technology to achieve a virtual try-on of Sichuan opera costumes and interactive face transformation for Sichuan opera.By virtual modeling,skeleton binding,weight setting of Sichuan opera dan-role costumes,and rendering mapping using body tracking and ray tracing as well as cloth simulation techniques,the AR try-on of Sichuan opera costumes is realized.Additionally,the representative facial masks of Sichuan opera's face-changing and role types are digitally reconstructed in 3D,and AR interactive face transformation is accomplished through visual programming.Experimental results demonstrate that in the AR environment,real-time matching and stable interaction among human body movements,costumes,and facial masks are achieved.By conducting AR experiments and surveys among the youth group,it is found that compared to traditional methods,AR technology is more effective in capturing the attention and recognition of the younger generation.This is beneficial for the inheritance and development of intangible cultural heritage within this demographic.