Research and Development of Virtual Instruments System Based on Depth Camera

This paper takes advantage of the depth camera of somatosensory kinect and sensors to implement gesture recognition and design a virtual instrument system. As long as the user waves his arm without the help of other equipments, our system can automatically recognize the hand gesture and make suitable sound. In order to achieve depth camera's detection of hands movement,this paper introduce the depth imaging technology Light Coding and bone tracking technology to obtain the actual position information and hand movement information of the human body. Feet movement detection uses sensor technology, different stampede strength outputs different digital number after AD conversion so that the intensity can be controlled. A series of experiments show that the system has good fluency and practicality and increased the fun of playing instruments.