The theoretical framework of visual simulation in virtual reality is discussed. The new concept of visual image space is supposed. On the basis of visual image space, in visual perceptive sense, VR is considered as a ...The theoretical framework of visual simulation in virtual reality is discussed. The new concept of visual image space is supposed. On the basis of visual image space, in visual perceptive sense, VR is considered as a spatial simulation. The objective of the spatial simulation is to transform physical space to visual image space. Last, the prototype system, surveying & mapping virtual Reality (SMVR), is developed, and the space simulation above is realized. By use of SMVR, the real 3D representation, 3D visual analysis, virtual plan and designs can be implemented.展开更多
In free viewpoint video(FVV)and 3DTV,the depth image-based rendering method has been put forward for rendering virtual view video based on multi-view video plus depth(MVD) format.However,the projection with slightly d...In free viewpoint video(FVV)and 3DTV,the depth image-based rendering method has been put forward for rendering virtual view video based on multi-view video plus depth(MVD) format.However,the projection with slightly different perspective turns the covered background regions into hole regions in the rendered video.This paper presents a depth enhanced image summarization generation model for the hole-filling via exploiting the texture fidelity and the geometry consistency between the hole and the remaining nearby regions.The texture fidelity and the geometry consistency are enhanced by drawing texture details and pixel-wise depth information into the energy cost of similarity measure correspondingly.The proposed approach offers significant improvement in terms of 0.2dB PSNR gain,0.06 SSIM gain and subjective quality enhancement for the hole-filling images in virtual viewpoint video.展开更多
Log-polar mapping has been proposed as a very appropriate space-variant imaging model in active vision applications.There is no doubt about the importance of translation estimation in active visual tracking.In this pa...Log-polar mapping has been proposed as a very appropriate space-variant imaging model in active vision applications.There is no doubt about the importance of translation estimation in active visual tracking.In this paper an approach is presented,and its performances are evaluated.The approach uses a gradient descent for minimizing a dissimilarity measure.The experimental results reveal that this method is efficient for approaching active image translations.展开更多
Ray-space based arbitrary viewpoint rendering without complex object segmentation or model construction is the main technology to realize Free Viewpoint Video(FVV) system for complex scenes. Ray-space interpolation an...Ray-space based arbitrary viewpoint rendering without complex object segmentation or model construction is the main technology to realize Free Viewpoint Video(FVV) system for complex scenes. Ray-space interpolation and compression are two key techniques for the solution. In this paper,correlation among multiple epipolar lines in ray-space data is analyzed,and a new method of ray-space interpolation with multi-epipolar lines matching is proposed. Comparing with the pixel-based matching interpolation method and the block-based matching interpolation method,the proposed method can achieve higher Peak Signal to Noise Ratio(PSNR) in interpolating rayspace data and rendering arbitrary viewpoint images.展开更多
文摘The theoretical framework of visual simulation in virtual reality is discussed. The new concept of visual image space is supposed. On the basis of visual image space, in visual perceptive sense, VR is considered as a spatial simulation. The objective of the spatial simulation is to transform physical space to visual image space. Last, the prototype system, surveying & mapping virtual Reality (SMVR), is developed, and the space simulation above is realized. By use of SMVR, the real 3D representation, 3D visual analysis, virtual plan and designs can be implemented.
文摘In free viewpoint video(FVV)and 3DTV,the depth image-based rendering method has been put forward for rendering virtual view video based on multi-view video plus depth(MVD) format.However,the projection with slightly different perspective turns the covered background regions into hole regions in the rendered video.This paper presents a depth enhanced image summarization generation model for the hole-filling via exploiting the texture fidelity and the geometry consistency between the hole and the remaining nearby regions.The texture fidelity and the geometry consistency are enhanced by drawing texture details and pixel-wise depth information into the energy cost of similarity measure correspondingly.The proposed approach offers significant improvement in terms of 0.2dB PSNR gain,0.06 SSIM gain and subjective quality enhancement for the hole-filling images in virtual viewpoint video.
文摘Log-polar mapping has been proposed as a very appropriate space-variant imaging model in active vision applications.There is no doubt about the importance of translation estimation in active visual tracking.In this paper an approach is presented,and its performances are evaluated.The approach uses a gradient descent for minimizing a dissimilarity measure.The experimental results reveal that this method is efficient for approaching active image translations.
基金the National Natural Science Foundation of China (No.60472100)the Natural Science Foundation of Zhejiang Province (No.Y105577)the Key Project of Chinese Ministry of Education (No.206059).
文摘Ray-space based arbitrary viewpoint rendering without complex object segmentation or model construction is the main technology to realize Free Viewpoint Video(FVV) system for complex scenes. Ray-space interpolation and compression are two key techniques for the solution. In this paper,correlation among multiple epipolar lines in ray-space data is analyzed,and a new method of ray-space interpolation with multi-epipolar lines matching is proposed. Comparing with the pixel-based matching interpolation method and the block-based matching interpolation method,the proposed method can achieve higher Peak Signal to Noise Ratio(PSNR) in interpolating rayspace data and rendering arbitrary viewpoint images.
