In this paper,we present an interactive static image composition approach,namely color retargeting,to flexibly represent time-varying color editing effect based on time-lapse video sequences.Instead of performing prec...In this paper,we present an interactive static image composition approach,namely color retargeting,to flexibly represent time-varying color editing effect based on time-lapse video sequences.Instead of performing precise image matting or blending techniques,our approach treats the color composition as a pixel-level resampling problem. In order to both satisfy the user's editing requirements and avoid visual artifacts,we construct a globally optimized interpolation field. This field defines from which input video frames the output pixels should be resampled.Our proposed resampling solution ensures that(i) the global color transition in the output image is as smooth as possible,(ii) the desired colors/objects specified by the user from different video frames are well preserved,and(iii) additional local color transition directions in the image space assigned by the user are also satisfied.Various examples have been shown to demonstrate that our efficient solution enables the user to easily create time-varying color image composition results.展开更多
Multiview video can provide more immersive perception than traditional single 2-D video. It enables both interactive free navigation applications as well as high-end autostereoscopic displays on which multiple users c...Multiview video can provide more immersive perception than traditional single 2-D video. It enables both interactive free navigation applications as well as high-end autostereoscopic displays on which multiple users can perceive genuine 3-D content without glasses. The multiview format also comprises much more visual information than classical 2-D or stereo 3-D content, which makes it possible to perform various interesting editing operations both on pixel-level and object-level. This survey provides a comprehensive review of existing multiview video synthesis and editing algorithms and applications. For each topic, the related technologies in classical 2-D image and video processing are reviewed. We then continue to the discussion of recent advanced techniques for multiview video virtual view synthesis and various interactive editing applications. Due to the ongoing progress on multiview video synthesis and editing, we can foresee more and more immersive 3-D video applications will appear in the future.展开更多
Holographic displays have the promise to be the ultimate 3D display technology,able to account for all visual cues.Recent advances in photonics and electronics gave rise to high-resolution holographic display prototyp...Holographic displays have the promise to be the ultimate 3D display technology,able to account for all visual cues.Recent advances in photonics and electronics gave rise to high-resolution holographic display prototypes,indicating that they may become widely available in the near future.One major challenge in driving those display systems is computational:computer generated holography(CGH)consists of numerically simulating diffraction,which is very computationally intensive.Our goal in this paper is to give a broad overview of the state-of-the-art in CGH.We make a classification of modern CGH algorithms,we describe different algorithmic CGH acceleration techniques,discuss the latest dedicated hardware solutions and indicate how to evaluate the perceptual quality of CGH.We summarize our findings,discuss remaining challenges and make projections on the future of CGH.展开更多
While 60 years of successful application of holography is celebrated in this special issue,efficient representation and compression of holographic data has received relatively little attention in research.Notwithstand...While 60 years of successful application of holography is celebrated in this special issue,efficient representation and compression of holographic data has received relatively little attention in research.Notwithstanding this observation,and particularly due to the digitization that is also penetrating the holographic domain,interest is growing on how to efficiently compress holographic data such that interactive exchange of content,as well as digital storage can be facilitated proficiently.This is a particular challenge,not only because of its interferometric nature and the various representation formats,but also the often extremely large data volumes involved in pathological,tomographic,or high-end visualization applications.In this paper,we provide an overview of the state of the art in compression techniques and corresponding quality metrics for various practical applications in digital holography.We also consider the future by analyzing the emerging trends for addressing the key challenges in this domain.展开更多
基金supported by the iMinds visualization research program(HIVIZ)
文摘In this paper,we present an interactive static image composition approach,namely color retargeting,to flexibly represent time-varying color editing effect based on time-lapse video sequences.Instead of performing precise image matting or blending techniques,our approach treats the color composition as a pixel-level resampling problem. In order to both satisfy the user's editing requirements and avoid visual artifacts,we construct a globally optimized interpolation field. This field defines from which input video frames the output pixels should be resampled.Our proposed resampling solution ensures that(i) the global color transition in the output image is as smooth as possible,(ii) the desired colors/objects specified by the user from different video frames are well preserved,and(iii) additional local color transition directions in the image space assigned by the user are also satisfied.Various examples have been shown to demonstrate that our efficient solution enables the user to easily create time-varying color image composition results.
基金partially supported by Innoviris(3-DLicornea project)FWO(project G.0256.15)+3 种基金supported by the National Natural Science Foundation of China(Nos.61272226 and 61373069)Research Grant of Beijing Higher Institution Engineering Research CenterTsinghua-Tencent Joint Laboratory for Internet Innovation TechnologyTsinghua University Initiative Scientific Research Program
文摘Multiview video can provide more immersive perception than traditional single 2-D video. It enables both interactive free navigation applications as well as high-end autostereoscopic displays on which multiple users can perceive genuine 3-D content without glasses. The multiview format also comprises much more visual information than classical 2-D or stereo 3-D content, which makes it possible to perform various interesting editing operations both on pixel-level and object-level. This survey provides a comprehensive review of existing multiview video synthesis and editing algorithms and applications. For each topic, the related technologies in classical 2-D image and video processing are reviewed. We then continue to the discussion of recent advanced techniques for multiview video virtual view synthesis and various interactive editing applications. Due to the ongoing progress on multiview video synthesis and editing, we can foresee more and more immersive 3-D video applications will appear in the future.
基金This research was funded by the Research Foundation-Flanders(FWO),Junior postdoctoral fellowship(12ZQ220N),the joint JSPS-FWO scientific cooperation program(VS07820N)the Japan Society for the Promotion of Science(19H04132 and JPJSBP120202302)。
文摘Holographic displays have the promise to be the ultimate 3D display technology,able to account for all visual cues.Recent advances in photonics and electronics gave rise to high-resolution holographic display prototypes,indicating that they may become widely available in the near future.One major challenge in driving those display systems is computational:computer generated holography(CGH)consists of numerically simulating diffraction,which is very computationally intensive.Our goal in this paper is to give a broad overview of the state-of-the-art in CGH.We make a classification of modern CGH algorithms,we describe different algorithmic CGH acceleration techniques,discuss the latest dedicated hardware solutions and indicate how to evaluate the perceptual quality of CGH.We summarize our findings,discuss remaining challenges and make projections on the future of CGH.
文摘While 60 years of successful application of holography is celebrated in this special issue,efficient representation and compression of holographic data has received relatively little attention in research.Notwithstanding this observation,and particularly due to the digitization that is also penetrating the holographic domain,interest is growing on how to efficiently compress holographic data such that interactive exchange of content,as well as digital storage can be facilitated proficiently.This is a particular challenge,not only because of its interferometric nature and the various representation formats,but also the often extremely large data volumes involved in pathological,tomographic,or high-end visualization applications.In this paper,we provide an overview of the state of the art in compression techniques and corresponding quality metrics for various practical applications in digital holography.We also consider the future by analyzing the emerging trends for addressing the key challenges in this domain.
