A semi-reference image quality assessment metric based on similarity measurement for synthesizedvirtual viewpoint image (WI) in free-viewpoint television system (FTV) is proposed in this paper. Thekey point of the pro...A semi-reference image quality assessment metric based on similarity measurement for synthesizedvirtual viewpoint image (WI) in free-viewpoint television system (FTV) is proposed in this paper. Thekey point of the proposed metric is taking resemblant information between WI and its neighbor view imagesfor quality assessment to make our metric to be extended to multi-semi-reference image quality assessmenteasily. The proposed metric first extracts impact factors from image features, then combines animage synthesis technique and similarity functions, in which, disparity information are taken into accountfor registering the resemblant regions. Experiments are divided into three phases. Phase Ⅰ is to verify thevalidation of the proposed metric by taking impaired images and original reference into account. The experimentalresults show the agreement between evaluation scores and bio-characteristic of human visualsystem. Phase Ⅱ shows the accordance with Phase Ⅰ by taking neighbor view as reference. The proposedmetric can be taken as a full reference one to evaluate the image quality even though the original referenceis absent. Phase Ⅲ is then performed to evaluate the quality of ⅤⅥ. Evaluation scores in the experimentalresults are able to evaluate the quality of ⅤⅥ.展开更多
Depth image based rendering(DIBR) is an effective approach for virtual view synthesis in free viewpoint television and 3D video.One of the important steps in DIBR is filling the holes caused by disocclusion regions an...Depth image based rendering(DIBR) is an effective approach for virtual view synthesis in free viewpoint television and 3D video.One of the important steps in DIBR is filling the holes caused by disocclusion regions and wrong depth values.Most of the existing hole-filling methods work well in areas of low spatial activity but fail to obtain satisfactory results in high spatial activity regions.In this paper,we combine the depth based hole-filling and the adaptive recursive interpolation algorithm which is capable of handling edges passing through the missing areas.Accoring to the experimental results,we confirm that the depth based adaptive recursive interpolation algorithm can provide better rendering quality objectively and subjectively.展开更多
The quality of virtual view based on multi-view video （MVD） plus depth format is often evaluated by PSNR or subjectively judged. However, due to synthesizing arbitrary view images, the virtual view images mostly hav...The quality of virtual view based on multi-view video （MVD） plus depth format is often evaluated by PSNR or subjectively judged. However, due to synthesizing arbitrary view images, the virtual view images mostly have no reference images and are only assessed using non-reference. Virtual view images synthesized by depth estimation reference software （DERS） and view synthesis reference software （VSRS） often accompanied with blockiness and other distortions on the edge. In addition, matching level for the depth map and the corresponding texture maps of left and right views also affects the quality of the virtual view. This paper compares the edge similarity of the depth and the corresponding texture maps which generate the intermediate virtual view and combined with the virtual view＇s blockiness which causing blur to evaluate the quality of the virtual view. Experiment results show that the proposed method can reflect the quality of the virtual view better.展开更多
基金Supported by the National Natural Science Foundation of China (No. 60672073,60872094)the Program for New Century Excellent Talents in University (NCET-06-0537)the Natural Science Foundation of Ningbo (No. 2007A610037).
文摘A semi-reference image quality assessment metric based on similarity measurement for synthesizedvirtual viewpoint image (WI) in free-viewpoint television system (FTV) is proposed in this paper. Thekey point of the proposed metric is taking resemblant information between WI and its neighbor view imagesfor quality assessment to make our metric to be extended to multi-semi-reference image quality assessmenteasily. The proposed metric first extracts impact factors from image features, then combines animage synthesis technique and similarity functions, in which, disparity information are taken into accountfor registering the resemblant regions. Experiments are divided into three phases. Phase Ⅰ is to verify thevalidation of the proposed metric by taking impaired images and original reference into account. The experimentalresults show the agreement between evaluation scores and bio-characteristic of human visualsystem. Phase Ⅱ shows the accordance with Phase Ⅰ by taking neighbor view as reference. The proposedmetric can be taken as a full reference one to evaluate the image quality even though the original referenceis absent. Phase Ⅲ is then performed to evaluate the quality of ⅤⅥ. Evaluation scores in the experimentalresults are able to evaluate the quality of ⅤⅥ.
基金The MSIP(Ministry of Science,ICT & Future Planning),Korea,under the ITRC(Information Technology Research Center)support program(NIPA-2013-H0301-13-2006)supervised by the NIPA(National IT Industry Promotion Agency)
文摘Depth image based rendering(DIBR) is an effective approach for virtual view synthesis in free viewpoint television and 3D video.One of the important steps in DIBR is filling the holes caused by disocclusion regions and wrong depth values.Most of the existing hole-filling methods work well in areas of low spatial activity but fail to obtain satisfactory results in high spatial activity regions.In this paper,we combine the depth based hole-filling and the adaptive recursive interpolation algorithm which is capable of handling edges passing through the missing areas.Accoring to the experimental results,we confirm that the depth based adaptive recursive interpolation algorithm can provide better rendering quality objectively and subjectively.
基金supported by the National Natural Science Foundation of China(Grant No.60832003)the Key Laboratory of Advanced Display and System Application(Shanghai University),Ministry of Education,China(Grant No.p200902)+1 种基金the Science and Technology Commission of Shanghai Municipality(Grant No.10510500500)the Natural Science Foundation of Anhui Higher Education Institutions of China(Grant No.KJ2011Z008)
文摘The quality of virtual view based on multi-view video （MVD） plus depth format is often evaluated by PSNR or subjectively judged. However, due to synthesizing arbitrary view images, the virtual view images mostly have no reference images and are only assessed using non-reference. Virtual view images synthesized by depth estimation reference software （DERS） and view synthesis reference software （VSRS） often accompanied with blockiness and other distortions on the edge. In addition, matching level for the depth map and the corresponding texture maps of left and right views also affects the quality of the virtual view. This paper compares the edge similarity of the depth and the corresponding texture maps which generate the intermediate virtual view and combined with the virtual view＇s blockiness which causing blur to evaluate the quality of the virtual view. Experiment results show that the proposed method can reflect the quality of the virtual view better.
