基于Leap Motion的三维模型草图检索

Sketch-Based Three-Dimensional Model Retrieval Based on Leap Motion

对三维模型检索的需求在搜索领域日益增长,而基于草图的三维模型检索也已然成为最为有效且易用的检索方式。为了更好地提升草图检索的体验,着眼于人机交互的方式并对其加以改进是必由之路。其中,Leap Motion系统可高精度实时检测并跟踪手指的位置和手势信息等,为大屏幕、远距离交互提供了有效途径。文中提出了一种基于Leap Motion的三维模型草图检索系统用于三维模型检索。通过Leap Motion获得的数据将手的运动模拟信息实时地反映到浏览器上,实现草图的绘制和模型的检索。在草图检索部分,提出了一种改进的流形排序方法用于对模型间的相似度进行排序,结合模型语义分类信息的排序约束方法,提高了同类模型的排名分数。实验显示,该方法使得草图检索更加贴近和方便用户,进一步提高了草图检索的易用性以及三维模型检索的准确性。

The demand of3D model retrieval is increasing,and the sketch-based method has been proved to be the most effective and efficient approach to retrieve3D models.In order to get better experience on sketch retrieval,it's necessary to focus on the way of human-computer interaction as well as improve it.The Leap Motion sensor can detect the position information of fingers and gestures with high precision in real-time,which makes volume interaction with large screen at long-distance more effective.In this paper,an extended manifold ranking method based on Leap Motion is presented as a new retrieval framework.The sketch drawing and model retrieval processes are realized by obtaining data of hands from Leap Motion to the browser.In the process of sketch retrieval,manifold ranking is proposed to rank on similarities between models combining with semantic classification as a constraint,thus improving the ranking score of models belong to the same classification.Experiments have demonstrated that the proposed method makes the sketch retrieval more closable and convenient to the user as well as improves the accuracy of3D model retrieval.