We never stop finding better ways to communicate with machines.To interact with computers we tried several ways,from punched tape and tape reader to QWERTY keyboards and command lines,from graphic user interface and m...We never stop finding better ways to communicate with machines.To interact with computers we tried several ways,from punched tape and tape reader to QWERTY keyboards and command lines,from graphic user interface and mouse to multi-touch screens.The way we communicate with computers or devices are getting more direct and easier.In this paper,we give gesture mouse simulation in human–computer interface based on 3 Gear Systems using two Kinect sensors.The Kinect sensor is the perfect device to achieve dynamic gesture tracking and pose recognition.We hope the 3 Gear Systems can work as a mouse,to be more specific,use gestures to do click,double click and scroll.We use Coordinate Converting Matrix and Kalman Filter to reduce the shaking caused by errors and makes the interface create a better user experience.Finally the future of human-computer interface is discussed.展开更多
基金Scientific Research Common Program of Beijing Municipal Commission of Education(KM201411232007)BISTU Teaching Reform Projects(2014KG22)+2 种基金IHLB(PHR201108258,PHR201106226)Beijing Natural Science Foundation(4142017)NSFC(Grant No.61261160497)。
文摘We never stop finding better ways to communicate with machines.To interact with computers we tried several ways,from punched tape and tape reader to QWERTY keyboards and command lines,from graphic user interface and mouse to multi-touch screens.The way we communicate with computers or devices are getting more direct and easier.In this paper,we give gesture mouse simulation in human–computer interface based on 3 Gear Systems using two Kinect sensors.The Kinect sensor is the perfect device to achieve dynamic gesture tracking and pose recognition.We hope the 3 Gear Systems can work as a mouse,to be more specific,use gestures to do click,double click and scroll.We use Coordinate Converting Matrix and Kalman Filter to reduce the shaking caused by errors and makes the interface create a better user experience.Finally the future of human-computer interface is discussed.