基于深度相机的虚拟眼镜试戴

Virtual glasses try-on using a depth camera

当前,网上购物极大便利人们的生活,但是在网上购买眼镜时,消费者无法像在实体店中一样试戴眼镜,不能直观地看到眼镜佩戴效果,因而难以做出购买决策。针对这一问题,提出一种基于深度相机的虚拟眼镜试戴方法。该方法由2个阶段组成:第一阶段是重建人脸三维模型,利用深度相机采集得到的多角度人脸点云进行点云配准。点云配准时,首先得到特征点云完成一次粗配准,然后提取点云的重叠部分完成一次精细配准,由配准后的点云得到三维人脸模型;第二阶段是眼镜试戴,首先自动对齐人脸模型和眼镜模型并根据视频流实时估计的人脸姿态参数变换模型,并渲染模型,然后将经过消隐处理后的眼镜模型融合进视频流中,最终实现虚拟眼镜试戴效果。实验结果表明,该算法实时性好,试戴效果逼真,给用户带来良好的试戴体验。

Online shopping has significantly enhanced people’s lives.However,the challenge for consumers when purchasing glasses online arises from the lack of opportunity to physically try on glasses and directly visualize the results of the try-on,a convenience readily available in physical stores.To tackle this issue,this paper proposed a method for virtual glasses try-ons using depth cameras.The method comprised two phases:①3D face model reconstruction:This phase utilized the multi-angle face point cloud collected by the depth camera.It involved a two-step process for point clouds registration.First,a coarse registration was performed using feature point clouds.Next,the overlapping parts of the point clouds were extracted for fine registration,ultimately yielding a 3D face model from the registered point cloud.②Glasses try-on:In this phase,the face model and the glasses model were automatically aligned.The model was then transformed in response to the real-time facial pose parameters estimated based on the video stream.Afterward,the models were rendered,and the glasses model was fused into the video stream,following the occlusion culling procedure,resulting in a realistic virtual glasses try-on effect.Experimental results validated the algorithm’s excellent real-time performance and its ability to provide users with an immersive try-on experience.