Free-viewpoint video allows the user to view objects from any virtual perspective,creating an immersive visual experience.This technology enhances the interactivity and freedom of multimedia performances.However,many ...Free-viewpoint video allows the user to view objects from any virtual perspective,creating an immersive visual experience.This technology enhances the interactivity and freedom of multimedia performances.However,many free-viewpoint video synthesis methods hardly satisfy the requirement to work in real time with high precision,particularly for sports fields having large areas and numerous moving objects.To address these issues,we propose a freeviewpoint video synthesis method based on distance field acceleration.The central idea is to fuse multiview distance field information and use it to adjust the search step size adaptively.Adaptive step size search is used in two ways:for fast estimation of multiobject three-dimensional surfaces,and synthetic view rendering based on global occlusion judgement.We have implemented our ideas using parallel computing for interactive display,using CUDA and OpenGL frameworks,and have used real-world and simulated experimental datasets for evaluation.The results show that the proposed method can render free-viewpoint videos with multiple objects on large sports fields at 25 fps.Furthermore,the visual quality of our synthetic novel viewpoint images exceeds that of state-of-the-art neural-rendering-based methods.展开更多
首先,介绍在互联网技术加成下的中、大型体育赛事直播的电子现场制作(Electronic Field Production,EFP)系统的设计与应用。然后,以安徽广播电视台“皖美山水”骑行赛直播为案例,探讨了如何在优质的网络环境下,不采用高成本的转播车、...首先,介绍在互联网技术加成下的中、大型体育赛事直播的电子现场制作(Electronic Field Production,EFP)系统的设计与应用。然后,以安徽广播电视台“皖美山水”骑行赛直播为案例,探讨了如何在优质的网络环境下,不采用高成本的转播车、卫星车,转而搭建一套安全可靠实用的EFP系统,与演播室联动,顺利完成直播。展开更多
基金supported by the National Natural Science Foundation of China(Nos.62172315,62073262,and 61672429)the Fundamental Research Funds for the Central Universities,the Innovation Fund of Xidian University(No.20109205456)the Key Research and Development Program of Shaanxi(No.S2021-YF-ZDCXL-ZDLGY-0127),and HUAWEI.
文摘Free-viewpoint video allows the user to view objects from any virtual perspective,creating an immersive visual experience.This technology enhances the interactivity and freedom of multimedia performances.However,many free-viewpoint video synthesis methods hardly satisfy the requirement to work in real time with high precision,particularly for sports fields having large areas and numerous moving objects.To address these issues,we propose a freeviewpoint video synthesis method based on distance field acceleration.The central idea is to fuse multiview distance field information and use it to adjust the search step size adaptively.Adaptive step size search is used in two ways:for fast estimation of multiobject three-dimensional surfaces,and synthetic view rendering based on global occlusion judgement.We have implemented our ideas using parallel computing for interactive display,using CUDA and OpenGL frameworks,and have used real-world and simulated experimental datasets for evaluation.The results show that the proposed method can render free-viewpoint videos with multiple objects on large sports fields at 25 fps.Furthermore,the visual quality of our synthetic novel viewpoint images exceeds that of state-of-the-art neural-rendering-based methods.
文摘首先,介绍在互联网技术加成下的中、大型体育赛事直播的电子现场制作(Electronic Field Production,EFP)系统的设计与应用。然后,以安徽广播电视台“皖美山水”骑行赛直播为案例,探讨了如何在优质的网络环境下,不采用高成本的转播车、卫星车,转而搭建一套安全可靠实用的EFP系统,与演播室联动,顺利完成直播。