“数字媒体理解的理论与方法研究”项目立项报告

"The Theories and Methods on Digital Media Understanding" Project Initial Report

当前随着数字媒体应用的广泛化和深入化,数字媒体理解面临着媒体对象复杂性、媒体数据规模化、应用需求多样化等挑战问题,已成为制约数字媒体应用发展的瓶颈。为了解决这些难题,必须研究媒体内容的有效表示、建立符合人类媒体认知的计算模型、充分利用计算机处理的优势,并且实现三者的有机结合。为达到上述研究目标,需要重点解决3个关键科学问题:针对媒体认知具有的层次性、整体性,构建符合媒体理解层次性和整体性的理论框架;针对媒体对象固有的多义性、多态性,发展刻画媒体对象多义性和多态性的表示体系;针对媒体计算应有的协同性、高效性,突破制约媒体处理协同性和高效性的技术瓶颈。围绕这3个关键科学问题的解决,该项目将研究内容分为科学问题解决、关键技术攻关、典型应用示范等3个层次,认知机理与计算模型、表示框架与特征描述、融合机制与学习算法、验证平台与应用示范等4个方面,设置了以下6个课题:(1)视觉认知的层次性与整体性机制;(2)媒体认知的层次化计算理论与模型;(3)面向多义性对象的学习理论和方法;(4)多模态高维异构数据的特征提取与描述方法;(5)跨媒体分析的理论和方法;(6)数字媒体理解验证平台与应用示范。

With the development of digital media technology, how to understand the contents of the media data complexity, largescaled and application demands diversification has become a very serious problem which restricting the development of the digital media application. In order to solve these problems, the combination of the effectively presentation of media content; establishing the human cognitive media mode and the way to make full use of computer processing advantages is required. In order to solve the problem in a better way,we need to focus on three key scientific issues： how to construct and recognize the hierarchical integrity frame for media technology;how to shape and develop the polysemy、polymorphism frame for media technology; how to break through the media processing restrictions efficiently and cooperatively.To solve these three key issues, the project was divided into three different levels which are：Scientific problem solving, Key technology research and Typical application demonstration; and four different aspects which are： Knowing the principle and calculation model, Frame and feature description, Fusion principle and algorithm learning, Platform verification and application demonstration. We also set up the following six topics：（1）hierarchical and integrity of the visual cognition;（2）computation model and theory for the hierarchical media;（3）the method of multi-modal analysis;（4）description and extraction of the multi-modal high-dimensional data;（5）,the method of multi-media analysis;（6）digital media platform verification and application demonstration. This six different topics help us built up the hierarchical model which reveals the hierarchical and integrated characteristics of the media technology; also reveals the inherent law of the polysemy formation of the media technology; building up the multi-dimensional and multi-modal mechanism for the heterogeneous data. Give a new idea of the global and local feature extraction, contextual feature fusion, multi-granularity mapping of the low-level features and high-level semantics, hierarchical semantic analysis of the multi-media; also proposed a number of widely used, smart and high speed processing algorithms. Set up the global high standard media algorithm testing platform, demonstrate the secure and stable network intelligent video surveillance interactive television application to benefit of the public.