摘要
丰富的媒体内容和格式、异构的网络以及多样的终端设备,成为通用媒体访问的巨大障碍,媒体适配成为必要.文中分析了MPEG-21数字媒体适配DIA各实体之间的抽象关系,讨论了数字媒体适配的一般框架,建立了基于混合变量的约束优化模型.该模型统一了现有的媒体适配应用研究,能够用一致的算法进行求解.同时,文中从图像理解和视频分析角度,建立了媒体适配的层次结构,对媒体适配应用进行分类,并以当前的主要应用研究如图像适配、视频转码、位率适配、视频对象适配等举例说明.文中也探讨了混合媒体的多模态适配,指出了今后的研究热点和难点,如媒体语义抽取和适配、用户主观测度和媒体访问体验最大化等.
A growing variety of terminals and heterogeneous networks with dynamic throughputs make it a challenge in multimedia contents consumption. Media adaptation has been introduced in order to maximize user experiences and ensure quality of service (QoS) in universal media access environment. Based on the relations among entities such as resources, adaptation operators and utility in MPEG-21 digital items adaptation (DIA), and the general media adaptation framework, a mixed-variable constrained optimization model is proposed in this paper. The model unifies researches in this field, brings together the problem formulation and solution in a consistent way. A hierarchical adaptation structure is also constructed, from the viewpoints of image understanding and video analysis, and applied to classify some representative media adaptation applications. Leading pursuits such as image adaptation, scalable video transcoding, bit rate adaptation, video objects (VOs) adaptation, multi-modality conversion and fusion of mixed medias, etc. , are illustrated by examples. Hotspots such as semantic abstraction of media contents, measurements of subjective quality, and maximizing of user experiences, etc. , are also addressed.
出处
《计算机学报》
EI
CSCD
北大核心
2008年第7期1185-1199,共15页
Chinese Journal of Computers
基金
国家民族事务委员会科研项目基金(05XN09)资助