Image-based rendering is important both in the field of computer graphics and computer vision,and it is also widely used in virtual reality technology.For more than two decades,people have done a lot of work on the re...Image-based rendering is important both in the field of computer graphics and computer vision,and it is also widely used in virtual reality technology.For more than two decades,people have done a lot of work on the research of image-based rendering,and these methods can be divided into two categories according to whether the geometric information of the scene is utilized.According to this classification,we introduce some classical methods and representative methods proposed in recent years.We also compare and analyze the basic principles,advantages and disadvantages of different methods.Finally,some suggestions are given for research directions on image-based rendering techniques in the future.展开更多
Realism rendering methods of outdoor augmented reality(AR)is an interesting topic.Realism items in outdoor AR need advanced impacts like shadows,sunshine,and relations between unreal items.A few realistic rendering ap...Realism rendering methods of outdoor augmented reality(AR)is an interesting topic.Realism items in outdoor AR need advanced impacts like shadows,sunshine,and relations between unreal items.A few realistic rendering approaches were built to overcome this issue.Several of these approaches are not dealt with real-time rendering.However,the issue remains an active research topic,especially in outdoor rendering.This paper introduces a new approach to accomplish reality real-time outdoor rendering by considering the relation between items in AR regarding shadows in any place during daylight.The proposed method includes three principal stages that cover various outdoor AR rendering challenges.First,real shadow recognition was generated considering the sun’s location and the intensity of the shadow.The second step involves real shadow protection.Finally,we introduced a shadow production algorithm technique and shades through its impacts on unreal items in the AR.The selected approach’s target is providing a fast shadow recognition technique without affecting the system’s accuracy.It achieved an average accuracy of 95.1%and an area under the curve(AUC)of 92.5%.The outputs demonstrated that the proposed approach had enhanced the reality of outside AR rendering.The results of the proposed method outperformed other state-of-the-art rendering shadow techniques’outcomes.展开更多
1. Background The virtual reality （VR） technology is now at the frontier of modern information science. VR is based on computer graphics, computer vision, and other fresh air topics in today＇s computer technology....1. Background The virtual reality （VR） technology is now at the frontier of modern information science. VR is based on computer graphics, computer vision, and other fresh air topics in today＇s computer technology. Nowadays the VR technology has been applied successfully in variety of fields such as military simulation, industry, medical training and visualization, environment protection and entertainment.展开更多
The most important goal of virtual reality is to create a virtual world by computers where users are allowed to view the environment and control the virtual objects interactively. naditionally virtual reality systems ...The most important goal of virtual reality is to create a virtual world by computers where users are allowed to view the environment and control the virtual objects interactively. naditionally virtual reality systems use 3D computer graphics to model and render a virtual environment in real time. However, this approach usually requires laborious modeling and expensive special-purpose rendering hardware. Image-based rendering is a new approach in composing a virtual environment in which a set of panoramic images is used to compose the virtual environment and walking in the space is accomplished by 'hopping' to different panoramic points. This paper introduces an experimeatal image-based VR system. The techniques utilized in the system, in particular the authoring and interactive control tools of the system, are described in detail.展开更多
三维模板跟踪旨在将预先构建的三维CAD模型与输入图像中的相应目标进行精确配准,在增强现实、机器人等领域具有重要的应用,也是计算机视觉领域的关键问题之一.近年来,三维模板跟踪的准确率和稳定性都得到了持续提升,但仅有少量的工作关...三维模板跟踪旨在将预先构建的三维CAD模型与输入图像中的相应目标进行精确配准,在增强现实、机器人等领域具有重要的应用,也是计算机视觉领域的关键问题之一.近年来,三维模板跟踪的准确率和稳定性都得到了持续提升,但仅有少量的工作关注三维模板跟踪数据集的构建.随着深度学习的普及,各领域中大规模数据集的构建越来越被重视,为算法的训练、测试和评估奠定了基础,极大地推动了相关领域的发展.以往的三维模板跟踪数据集大多存在规模有限,画面不够自然、真实,多样性不足等问题.基于此,本文创建了一个大规模的基于真实感渲染的三维模板跟踪数据集(Render Dataset for Object Tracking,简称RDOT),其包含多种不同结构和材质的物体、复杂的运动模式,并且在场景、光照、噪声、运动模糊和遮挡等方面有丰富细致的设置,是目前三维模板跟踪领域最大的数据集,满足三维模板跟踪算法评估的各种需求.针对现有三维模板跟踪算法测评时使用的数据集不统一,测评结果难以客观全面地反映算法性能的问题,本文基于所构建的数据集,利用平均边缘距离、平均表面距离和重初始化率三种度量标准全面评估了目前主流的三维模板跟踪算法,并对评测结果进行了深入的分析讨论,给出了全面的分析报告和技术展望.此外,基于所构建的数据集,本文提出了对跟踪结果建立误差分析模型,并对结果进行校正的方法,有效改善了三维模版跟踪算法的准确率.展开更多
针对增强现实应用中的复杂三维场景实时渲染问题,提出一种结合GPU加速的连续多细节层次(Levels of Detail,LOD)模型优化方法,以便提供更加流畅的用户感官体验。该方法采用并行局部处理架构,每个网格区域的生成均不依赖于已存在的其他网...针对增强现实应用中的复杂三维场景实时渲染问题,提出一种结合GPU加速的连续多细节层次(Levels of Detail,LOD)模型优化方法,以便提供更加流畅的用户感官体验。该方法采用并行局部处理架构,每个网格区域的生成均不依赖于已存在的其他网格,因此三维场景生成不使用任何层次结构,十分适合基于GPU的LOD处理,并且具有高度可扩展性。测试结果表明,相比其他模型优化方法,所提优化方法在流畅度方面表现出更好的性能,有效增加了场景模型的实时性。展开更多
基金National Natural Science Foundation of China(61632003).
文摘Image-based rendering is important both in the field of computer graphics and computer vision,and it is also widely used in virtual reality technology.For more than two decades,people have done a lot of work on the research of image-based rendering,and these methods can be divided into two categories according to whether the geometric information of the scene is utilized.According to this classification,we introduce some classical methods and representative methods proposed in recent years.We also compare and analyze the basic principles,advantages and disadvantages of different methods.Finally,some suggestions are given for research directions on image-based rendering techniques in the future.
文摘Realism rendering methods of outdoor augmented reality(AR)is an interesting topic.Realism items in outdoor AR need advanced impacts like shadows,sunshine,and relations between unreal items.A few realistic rendering approaches were built to overcome this issue.Several of these approaches are not dealt with real-time rendering.However,the issue remains an active research topic,especially in outdoor rendering.This paper introduces a new approach to accomplish reality real-time outdoor rendering by considering the relation between items in AR regarding shadows in any place during daylight.The proposed method includes three principal stages that cover various outdoor AR rendering challenges.First,real shadow recognition was generated considering the sun’s location and the intensity of the shadow.The second step involves real shadow protection.Finally,we introduced a shadow production algorithm technique and shades through its impacts on unreal items in the AR.The selected approach’s target is providing a fast shadow recognition technique without affecting the system’s accuracy.It achieved an average accuracy of 95.1%and an area under the curve(AUC)of 92.5%.The outputs demonstrated that the proposed approach had enhanced the reality of outside AR rendering.The results of the proposed method outperformed other state-of-the-art rendering shadow techniques’outcomes.
文摘1. Background The virtual reality （VR） technology is now at the frontier of modern information science. VR is based on computer graphics, computer vision, and other fresh air topics in today＇s computer technology. Nowadays the VR technology has been applied successfully in variety of fields such as military simulation, industry, medical training and visualization, environment protection and entertainment.
文摘The most important goal of virtual reality is to create a virtual world by computers where users are allowed to view the environment and control the virtual objects interactively. naditionally virtual reality systems use 3D computer graphics to model and render a virtual environment in real time. However, this approach usually requires laborious modeling and expensive special-purpose rendering hardware. Image-based rendering is a new approach in composing a virtual environment in which a set of panoramic images is used to compose the virtual environment and walking in the space is accomplished by 'hopping' to different panoramic points. This paper introduces an experimeatal image-based VR system. The techniques utilized in the system, in particular the authoring and interactive control tools of the system, are described in detail.
文摘三维模板跟踪旨在将预先构建的三维CAD模型与输入图像中的相应目标进行精确配准,在增强现实、机器人等领域具有重要的应用,也是计算机视觉领域的关键问题之一.近年来,三维模板跟踪的准确率和稳定性都得到了持续提升,但仅有少量的工作关注三维模板跟踪数据集的构建.随着深度学习的普及,各领域中大规模数据集的构建越来越被重视,为算法的训练、测试和评估奠定了基础,极大地推动了相关领域的发展.以往的三维模板跟踪数据集大多存在规模有限,画面不够自然、真实,多样性不足等问题.基于此,本文创建了一个大规模的基于真实感渲染的三维模板跟踪数据集(Render Dataset for Object Tracking,简称RDOT),其包含多种不同结构和材质的物体、复杂的运动模式,并且在场景、光照、噪声、运动模糊和遮挡等方面有丰富细致的设置,是目前三维模板跟踪领域最大的数据集,满足三维模板跟踪算法评估的各种需求.针对现有三维模板跟踪算法测评时使用的数据集不统一,测评结果难以客观全面地反映算法性能的问题,本文基于所构建的数据集,利用平均边缘距离、平均表面距离和重初始化率三种度量标准全面评估了目前主流的三维模板跟踪算法,并对评测结果进行了深入的分析讨论,给出了全面的分析报告和技术展望.此外,基于所构建的数据集,本文提出了对跟踪结果建立误差分析模型,并对结果进行校正的方法,有效改善了三维模版跟踪算法的准确率.
文摘针对增强现实应用中的复杂三维场景实时渲染问题,提出一种结合GPU加速的连续多细节层次(Levels of Detail,LOD)模型优化方法,以便提供更加流畅的用户感官体验。该方法采用并行局部处理架构,每个网格区域的生成均不依赖于已存在的其他网格,因此三维场景生成不使用任何层次结构,十分适合基于GPU的LOD处理,并且具有高度可扩展性。测试结果表明,相比其他模型优化方法,所提优化方法在流畅度方面表现出更好的性能,有效增加了场景模型的实时性。
