期刊文献+

基于单摄像头的自然用户接口引擎开发

A Single Camera Based Natural User Interface Engine Development
下载PDF
导出
摘要 自然用户接口(NUI)通过自然且直观的操作方法实现了人机交互中的控制接口,是人机交互手段研究的一个新兴的方向.本文利用廉价的网络摄像头作为NUI应用的信号输入端,设计了一套基于单摄像头的NUI结构,并通过融合CUDA工具包和DirectX软件开发包(SDK),开发了实时的NUI引擎系统.引擎使用网络摄像头进行视频捕捉后,利用图形处理器(GPU)编程方法实现实时的图形处理,并结合DirectX SDK展示NUI应用.为了检验所提出的实时NUI引擎的性能,本文利用其开发了若干非触摸操作的混合现实游戏和应用,实验结果表明本引擎实现了实时直观的交互式操作. Natural user interfaces(NUI)are a novel way to provide human computer interaction(HCI)with natural and intuitive operation interfaces.This paper designs a single camera based NUI architecture using an inexpensive web camera as a means of input device for NUI applications.By integrating the CUDA toolkit and the DirectX software development kit(SDK),a real-time NUI engine system is developed.The system captures video via the web camera,implements real-time image processing using graphic processing unit(GPU)programming,and presents the NUI applications using the DirectX SDK.To verify the efficacy of the proposed NUI engine,this paper utilizes it in the development of several touch-less operation applications and mixed reality games.The experienmantal results confirm that the engine realizes real-time and intuitive interactive operations.
出处 《北方工业大学学报》 2015年第1期20-29,41,共11页 Journal of North China University of Technology
基金 2015年度北京市教委科研计划项目(KM2015_10009006) 科研基地建设项目(PXM2015_014212_000024) 中央支持地方专项(PXM2014_014212_000097) 北方工业大学科研启动基金 北京市留学人员科技活动项目
关键词 自然用户接口 人机交互 GPU编程 混合现实技术 无触摸操作 实时图像处理 NUI HCI GPU programming mixed reality touch-less operation real-time image processing
  • 相关文献

参考文献21

  • 1Dewaele G, Devernay F, Horaud R Hand motion from 3D point trajectories and a smooth surface model [C]. Conf. Computer Vision, 2004: 495- 507.
  • 2Ho Y S. Challenging Technical Issues of 3D Video Processing [J]. Journal of Convergence, 2013, 4 (1):1 6.
  • 3Lai K, Konrad J, lshwar P. A gesture-driven computer interface using kinect [C]. IEEE South- west Symposium on Image Analysis and Interpre- tation, 2012:185-188.
  • 4Homer B D, Kinzer C K, Plass J L, et al. Moved to learn: The effects of interactivity in a kinect-based literacy game for beginning readers [J]. Computers . Education, 2014, 74:37-49.
  • 5Shotton J, Fitzgibbon A, Cook M, et al. Real- time human pose recognition in parts from single depth images [C]. IEEE Conf. Computer Vision and Pattern Recognition, 2011 : 1297-1304.
  • 6Goswami K, Hong G S, Kim B G. A Novel Mesh-Based Moving Object Detection Technique in Video Sequence [J]. Journal of Convergence, 2013, 4(3): 20-24.
  • 7Song W. Cho K, Um K, eta|. Intuitive terrain reconstruction using height observation-based ground segmentation and 3D object boundary esti-mation [J]. SENSORS, 2012, 12(12).. 17186- 17207.
  • 8Wilson A D, Benko H. Combining multiple depth cameras and projectors for interactions on, above, and between surfaces [C]//Proceedings of the 23rd annual ACM symposium on User interface software and technology. New York : ACM , 2010 .. 273-282.
  • 9Kim J O, Park C, Jeong J S, et al. A Gesture Based Camera Controlling Method in the 3D Vir- tual Space[J]. J. Smart Home, 2012, 6(4)=117- 126.
  • 10Ren Z, Yuan J, Zhang Z. Robust Part-Based Hand Gesture Recognition Using Kinect Sensor [J]. IEEE Transactions on multimedia, 2013, 15 (5) :i110-I120.

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部