With the development of stereoscopic technology, more attention is attracted on the stereoscopic three-dimensional(S3 D) content and service, and researches on images and videos have emerged in large numbers. This pap...With the development of stereoscopic technology, more attention is attracted on the stereoscopic three-dimensional(S3 D) content and service, and researches on images and videos have emerged in large numbers. This paper focuses mainly on visual comfort affected by characteristics of disparity for multiple objects. To find the relationship between disparity distribution and visual comfort perception, several subject evaluation experiments are done. The study contains two spatial distribution types of disparity: 1) only one of the foreground objects has zero disparity; 2) one of the foreground objects has positive disparity, while the other one has negative disparity. The experimental results and relative regression analysis provide appropriate relationship between disparity distribution and visual comfort for both conditions, which is significant to meet the applicant field in S3 D content acquisition, display adjustment and quality evaluation.展开更多
In order to establish a stereoscopic image quality assessment method which is consistent with human visual perception,we propose an objective stereoscopic image quality assessment method.It takes into account the stro...In order to establish a stereoscopic image quality assessment method which is consistent with human visual perception,we propose an objective stereoscopic image quality assessment method.It takes into account the strong correlation and high degree of structural between pixels of image.This method contains two models.One is the quality synthetic assessment of left-right view images,which is based on human visual characteristics,we use the Singular Value Decomposition(SVD)that can represent the degree of the distortion,and combine the qualities of left and right images by the characteristics of binocular superposition.The other model is stereoscopic perception quality assessment,due to strong stability of image’s singular value characteristics,we calculate the distance of the singular values and structural characteristic similarity of the absolute difference maps,and utilize the statistical value of the global error to evaluate stereoscopic perception.Finally,we combine two models to describe the stereoscopic image quality.Experimental results show that the correlation coefficients of the proposed assessment method and the human subjective perception are above 0.93,and the mean square errors are all less than 6.2,under JPEG,JP2K compression,Gaussian blurring,Gaussian white noise,H.264 coding distortion,and hybrid cross distortion.It indicates that the proposed stereoscopic objective method is consistent with human visual properties and also of availability.展开更多
Recently, the popularity of 3D content is on the rise because of its immersive experience to view- ers. While demands for 3D contents and 3D technologies increase, only a few copyright protection methods for 3D conten...Recently, the popularity of 3D content is on the rise because of its immersive experience to view- ers. While demands for 3D contents and 3D technologies increase, only a few copyright protection methods for 3D contents have been proposed. The simplest infringement is the illegal distribution of the single 2D image from 3D content. The leaked image is still valuable as 2D content and the leakage can be occurred in DIBR system. To detect the leaked image, we focus on the hole-filled region which is caused by the hole-filling procedure mandatory in DIBR system. To estimate the hole-filled regions, two different procedures are conducted to extract edges and to estimate 3D warping traces, respectively. After that, the hole-filled regions are estimated and the left-right-eye image discrimination (LR discrimination) is also conducted. Experimental results demonstrate the effectiveness of the proposed method using quantitative measures.展开更多
目前立体图像质量评价算法缺乏可靠的预测性能,主要表现在研究人类视觉系统时生物学理论薄弱,并且已有的浅层模型无法模拟出视觉信息复杂的处理过程。针对上述问题,提出一种基于交互式卷积神经网络的无参考立体图像质量评价算法。根据...目前立体图像质量评价算法缺乏可靠的预测性能,主要表现在研究人类视觉系统时生物学理论薄弱,并且已有的浅层模型无法模拟出视觉信息复杂的处理过程。针对上述问题,提出一种基于交互式卷积神经网络的无参考立体图像质量评价算法。根据初级视觉区域的双目视觉机制,融合左、右视图生成独眼特征图,并采用高斯差分算法提取左、右视图边缘信息,计算边缘求和以及差分特征图;搭建交互式卷积神经网络,整合特征图,实现深度特征学习和质量回归预测。在LIVE立体图像库上的Pearson线性相关系数(Pearson Linear Correlation Coefficient,PLCC)达到0.95以上,结果表明采用该算法能有效地解决失真立体图像质量评价问题。展开更多
针对立体图像质量评价问题,基于人眼观测图像的感知特性,提出一种双通道立体图像质量评价算法。首先,获取双目视图的拉普拉斯金字塔序列构建融合图,采用并行域分解多权重化策略提取双目局部质量感知特征;然后,结合视觉平衡特性引入语义...针对立体图像质量评价问题,基于人眼观测图像的感知特性,提出一种双通道立体图像质量评价算法。首先,获取双目视图的拉普拉斯金字塔序列构建融合图,采用并行域分解多权重化策略提取双目局部质量感知特征;然后,结合视觉平衡特性引入语义特征通道提取双目高层次语义特征;最后,在支持向量回归的基础上得到双通道主客观图像质量评价值的关系映射。双通道网络集成了包含视差信息的多局部细节特征与全局语义特征,在LIVE 3D phaseⅠ与LIVE 3D phaseⅡ立体图像库进行性能测试。结果表明:所提算法所得预测值与主观评价值间具有良好的一致性。展开更多
基金Supported by the National Science and Technology Planning Project(No.2012BAH38F00)the Engineering Research Project of Communication University of China(No.3132016XN1622)
文摘With the development of stereoscopic technology, more attention is attracted on the stereoscopic three-dimensional(S3 D) content and service, and researches on images and videos have emerged in large numbers. This paper focuses mainly on visual comfort affected by characteristics of disparity for multiple objects. To find the relationship between disparity distribution and visual comfort perception, several subject evaluation experiments are done. The study contains two spatial distribution types of disparity: 1) only one of the foreground objects has zero disparity; 2) one of the foreground objects has positive disparity, while the other one has negative disparity. The experimental results and relative regression analysis provide appropriate relationship between disparity distribution and visual comfort for both conditions, which is significant to meet the applicant field in S3 D content acquisition, display adjustment and quality evaluation.
基金Supported by the National Natural Science Foundation of China(Nos.6117116361271270+2 种基金6127102161111140392)National Science and Technology Support Program(2012BAH67F01)
文摘In order to establish a stereoscopic image quality assessment method which is consistent with human visual perception,we propose an objective stereoscopic image quality assessment method.It takes into account the strong correlation and high degree of structural between pixels of image.This method contains two models.One is the quality synthetic assessment of left-right view images,which is based on human visual characteristics,we use the Singular Value Decomposition(SVD)that can represent the degree of the distortion,and combine the qualities of left and right images by the characteristics of binocular superposition.The other model is stereoscopic perception quality assessment,due to strong stability of image’s singular value characteristics,we calculate the distance of the singular values and structural characteristic similarity of the absolute difference maps,and utilize the statistical value of the global error to evaluate stereoscopic perception.Finally,we combine two models to describe the stereoscopic image quality.Experimental results show that the correlation coefficients of the proposed assessment method and the human subjective perception are above 0.93,and the mean square errors are all less than 6.2,under JPEG,JP2K compression,Gaussian blurring,Gaussian white noise,H.264 coding distortion,and hybrid cross distortion.It indicates that the proposed stereoscopic objective method is consistent with human visual properties and also of availability.
文摘Recently, the popularity of 3D content is on the rise because of its immersive experience to view- ers. While demands for 3D contents and 3D technologies increase, only a few copyright protection methods for 3D contents have been proposed. The simplest infringement is the illegal distribution of the single 2D image from 3D content. The leaked image is still valuable as 2D content and the leakage can be occurred in DIBR system. To detect the leaked image, we focus on the hole-filled region which is caused by the hole-filling procedure mandatory in DIBR system. To estimate the hole-filled regions, two different procedures are conducted to extract edges and to estimate 3D warping traces, respectively. After that, the hole-filled regions are estimated and the left-right-eye image discrimination (LR discrimination) is also conducted. Experimental results demonstrate the effectiveness of the proposed method using quantitative measures.
文摘目前立体图像质量评价算法缺乏可靠的预测性能,主要表现在研究人类视觉系统时生物学理论薄弱,并且已有的浅层模型无法模拟出视觉信息复杂的处理过程。针对上述问题,提出一种基于交互式卷积神经网络的无参考立体图像质量评价算法。根据初级视觉区域的双目视觉机制,融合左、右视图生成独眼特征图,并采用高斯差分算法提取左、右视图边缘信息,计算边缘求和以及差分特征图;搭建交互式卷积神经网络,整合特征图,实现深度特征学习和质量回归预测。在LIVE立体图像库上的Pearson线性相关系数(Pearson Linear Correlation Coefficient,PLCC)达到0.95以上,结果表明采用该算法能有效地解决失真立体图像质量评价问题。
文摘针对因图像采集系统或采集环境本身的限制导致的立体图像模糊、质量低下、感兴趣区域不显著等问题,在最新的基于立体注意力模块的立体图像超分辨算法的基础上,通过在单图超分辨(Single Image Super-Resolution,SISR)的深度网络中引入立体图像左右两个视点间的互补信息以及平滑损失(Smoothness Loss)函数,增强超分辨后立体图像的视觉效果。在该算法中,梯度更小、更加平滑的立体注意力图可以获得更好的立体图像超分辨效果。为证明引入的函数有效,对改进前后的基于立体注意力机制的立体图像超分辨算法进行对比实验和分析,结果表明,引入平滑损失后,SRCNN和SRResNet模型的峰值信噪比(Peak Signal to Noise Ratio,PSNR)值和结构相似性(Structural Similarity,SSIM)值有明显提高。
文摘针对立体图像质量评价问题,基于人眼观测图像的感知特性,提出一种双通道立体图像质量评价算法。首先,获取双目视图的拉普拉斯金字塔序列构建融合图,采用并行域分解多权重化策略提取双目局部质量感知特征;然后,结合视觉平衡特性引入语义特征通道提取双目高层次语义特征;最后,在支持向量回归的基础上得到双通道主客观图像质量评价值的关系映射。双通道网络集成了包含视差信息的多局部细节特征与全局语义特征,在LIVE 3D phaseⅠ与LIVE 3D phaseⅡ立体图像库进行性能测试。结果表明:所提算法所得预测值与主观评价值间具有良好的一致性。
