基于人脸检测的多媒体互动游戏系统的研究

Study of multimedia interaction game system based on face detection technology

针对多媒体互动游戏系统实时互动的要求,提出一种人脸肤色与局部特征相结合的实时人脸检测与跟踪方法。首先对视频图像光线补偿,且帧差法提取出视频中运动目标;然后根据肤色在YCb Cr颜色空间内Cr和Cb分量的特定分布范围建立肤色模型,确定出可能存在人脸的类肤色区域;中值滤波去除噪声后,通过人脸简单几何特征和唇部独有的颜色特征滤除非人脸肤色区域,准确定位人脸在图像中的位置。实际应用表明,该互动游戏系统能快速准确的跟踪玩家的面部位置,通过处理器判断人脸与掉落物体是否对接,打分计数器做出相应打分,实现整个互动效果。该互动装置使玩家无需控制器即可享受交互体验,同时达到商品宣传促销的目的,具有巨大的商业前景。

To fast detecting and tracking human face in real-time video, a method based on the color and local character of face was proposed. Firstly, moving objects were extracted from the video with light compensation by frame difference method.Then skin-alike region was segmented based on skin color model established by specific distribution of Cr and Cb component in YCb Cr color space. After median filter to remove noise, the non-face skin area was eliminated according to the geometric characters of face and the unique color characters of lips, and then player＇s face was accurate positioning in real-time video.Practical applications show that this interactive game system can fast accurate tracking the player＇s face, then processor marked according to whether players＇ face docking with falling objects by score counter, realizing the interaction effects finally. This interactive device has a huge commercial prospect, not only allowing players enjoy interaction experience without controller but also reaching the purpose of product promotion at the same time.