期刊文献+

基于上下文信息的新闻故事单元分割 被引量:2

News Story Segmentation Based on Contextual Information
下载PDF
导出
摘要 为了有效检索和管理新闻视频资源,提出了一种利用多模态特征、基于上下文信息的新闻故事单元分割方法.首先利用字幕变化、音频类型和视频镜头类型信息将新闻镜头序列转换成为相应的关键词序列,使新闻故事单元分割转换成为文体序列分割的问题;然后应用一种有效的序列分割模型——条件随机场,来分割新闻故事单元.对多段视频的测试结果证明了该方法的有效性,取得了查全率为72.9%、查准率为88.4%的较好结果. To effectively retrieve and manage news video archive, a news video story segmentation method based on con- textual information was proposed. Firstly, news video shot sequence was transformed into corresponding keyword sequences by using multimodality information, such as caption changing,audio type, and video shot category. And then news video was partitioned into stories with a powerful sequence segmentation model, conditional random fields. The algorithm was applied to multiple test videos, and the test results prove the effectiveness of the method, achieving a better performance with recall of 72.9% and precision of 88.4%.
出处 《天津大学学报》 EI CAS CSCD 北大核心 2009年第2期153-158,共6页 Journal of Tianjin University(Science and Technology)
基金 天津市应用基础及前沿技术研究计划重点资助项目(07JCZDJC05800)
关键词 新闻故事单元分割 上下文信息 条件随机场 视频内容分析 新闻视频 news story segmentation contextual information conditional random fields video content analysis news video
  • 相关文献

参考文献13

  • 1冀中,张春田,苏育挺.新闻视频故事单元分割技术综述[J].中国图象图形学报,2007,12(11):1952-1960. 被引量:9
  • 2Qi Wei, Gu Lie, Jiang Hao, et al. Integrating visual, audio and text analysis for news video[C]// International Conference on Image Processing. Vancouver, Canada, 2000: 520-523.
  • 3Hsu W, Kennedy L, Huang C W, et al. News video story segmentation using fusion of multi-level multi-modal features in TRECVID 2003 [C ] //IEEE International Conference on Acoustics, Speech, and Signal Processing. Montreal, Canada, 2004: Ⅲ645-Ⅲ648.
  • 4Chaisorn L, Chua T S, Koh C K, et al. A two-level multimodal approach for story segmentation of large news video corpus[C]//Proceedings of TRECVID Workshop on 2003. Gaithersburg, USA, 2003 : 1-6.
  • 5Janvier B, Bruno E, Marchand-Maillet S, et al. Performance evaluation of a contextual news story segmentation algorithm [C]//Multimedia Content Analysis, Management, and Retrieval 2006. San Jose, USA, 2006 : 60730X-1-60730X-10.
  • 6Arlandis J, Over P, Kraaij W, Boundary error analysis and categorization in the TRECVID news story segmen-tation task [C] //International Conference on Image and Video Retrieval, Singapore, 2005: 103-112.
  • 7Lafferty J, McCallum A, Pereira F. Conditional random fields: probabilistic models for segmenting and labeling sequence data [C ] //Proceedings of the Eighteenth International Conference on Machine Learning. Massachusetts, USA, 2001 : 282-289.
  • 8McCallum A, Freitag D, Pereira F. Maximum entropy Markov models for information extraction and segmentation[C] //International Conference on Machine Learning. California, USA, 2000 : 591-598.
  • 9Sha F, Pereira F. Shallow parsing with conditional random fields [C]//Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology. Edmonton, Canada, 2003 : 134-141.
  • 10Liu Manman, Su Yuting, Ji Zhong. Overlaid caption extraction in news videos based on SVM[C]//SPIE International Symposium on Multispectral Image Processing and Pattern Recognition. Wuhan, China, 2007: 67864O-1-67864O-7.

二级参考文献33

  • 1Lu L,Zhang H J,Li S Z.Content-based audio classification and segmentation by using support vector machines[J].Multimedia Systems,2003,8(6):482-492.
  • 2Hanjalic A,Lagensijk R L,Biemond J.Template-based detection of anchorperson shots in news programs[A].In:Proceedings of International Conference on Image Processing[C],Chicago,IL,US,1998:148-152.
  • 3Gao X B,Li J,Yang B.A graph-theoretical clustering based anchorperson shot detection for news video indexing[A].In:International Conference on Computational Intelligence and Multimedia Applications[C],Xi'an,China,2003:108-113.
  • 4Hsu W,Chang S F.Generative,discriminative,and ensemble learning on multi-modal perceptual fusion toward news video story segmentation[A].In:Proceedings of IEEE International Conference on Multimedia and Expo[C].Taipei,China,2006:1091-1094.
  • 5Shriberg E,Stolcke A,Hakkani-Tur D,et al.Prosody-based automatic segmentation of speech into sentences and topics[J].Speech Communication,2000,32(1):127-154.
  • 6Eichmann D,Park D J.Experiments in Boundaries Recognition at the University of Iowa[EB/OL].http://www.itl.nist.gov/iaui/894.02/projeets/tvpubs/tvpapers03/uiowa.paper.pdf.
  • 7Wang C,Wang Y,Liu H Y,et al.Automatic story segmentation of news video based on audio-visual features and text information[A].In:Proceedings of International Conference on Machine Learning and Cybernetics[C],Xi'an,China,2003:3008-3011.
  • 8Qi W,Gu L,Jiang H,et al.Integrating visual,audio and text analysis for news video[A].In:Proceedings of International Conference on Mage Processing[C],Vancouver,BC,Canada,2000:520-523.
  • 9Lan D J,Ma Y F,Zhang H J.Multi-level anchorperson detection using multimodal association[A].In:Proceedings of International Conference on Pattern Recognition[C],Cambridge,UK,2004:890-893.
  • 10Chua T S,Chang S F,Chaisorn L,et al.Story Boundary Detection in Large Broadcast News Video Archives-Techniques,Experience and Trends[A].In:Proceedings of ACM Multimedia ' 2004[C].New York,US,2004:656-659.

共引文献8

同被引文献16

  • 1刘文萍,李也白,张常年.视频镜头边缘检测技术[J].计算机工程与应用,2006,42(21):17-20. 被引量:10
  • 2Janvier B,Bruno E,Marchand-Maillet S,et al.Performance Evaluation of a Contextual News Story Segmentation Algorithm[C]∥Proc of Int’l Conf on Multimedia Content Analysis,Management,and Retrieval,2006:60730X-1-60730X-10.
  • 3Chaisorn L,Chua T S,Lee C H.The Segmentation of News Video into Story Units[C]∥Proc of Int’l Conf on Multimedia and Expo,2002:73-76.
  • 4De Santo M,Percannella G,Sansone C,et al.Unsupervised News Video Segmentation by Combined Audio-Video Analysis[C]∥Proc of the SSPR&SPR’06,2006:273-281.
  • 5Zhai Y,Yilmaz A,Shah M.Story Segmentation in News Videos Using Visual and Text Cues[C]∥Proc of CIVR’05,2005:92-102.
  • 6Wang Ce,Wang Yun,Liu Huayong.Automatic Story Segmentation of News Video Based on Audio-Visual Features and Text Information[C]∥Proc of the Second Int’l Conf on Machine Learning and Cybernetics,2003:2-5.
  • 7冀中,张春田,苏育挺.新闻视频故事单元分割技术综述[J].中国图象图形学报,2007,12(11):1952-1960. 被引量:9
  • 8刘扬,郑逢斌,樊卞玲.基于文本及视音频多模态信息的新闻分割[J].计算机工程与应用,2007,43(35):190-194. 被引量:3
  • 9徐新文,李国辉,甘亚莉.基于播音员识别的新闻视频故事分割方法[J].计算机工程与应用,2008,44(19):4-7. 被引量:4
  • 10梁学战,朱明.融合多特征的新闻故事自动分割[J].计算机应用,2009,29(4):959-961. 被引量:2

引证文献2

二级引证文献1

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部