体育视频中基于语义推理的事件检测方法

Event recognition by semantic inference in sports videos

为了对视频内容进行语义级别的事件分析和索引 ,进一步满足用户访问大规模体育视频库的需求 ,提出一种 3层次的视频语义推理方案。在最底层 ,提取视频特征 ,并提出一种视频语义片段自动分割算法 ;在第二层 ,把各语义片段映射到语义概念 ;在最高层 ,建立视频语义事件的有限状态自动机模型 ,进行事件推理和识别。实验结果表明 ,该方案可以有效地进行视频事件识别 。

Semantic event analysis and video content indexing will greatly facilitate user access to large digital video libraries. A three level semantic inference scheme was developed for video analysis and used for event recognition in sports videos. The bottom layer of the semantic inference framework extracts low level features at the frame level with a semantic clip segmentation algorithm based on the acceleration of the global motion. In the middle layer, the semantic clips are mapped to semantic concepts using neural network and decision tree methods. In the top layer, semantic inferences are made for event recognition using pre defined finite state machine models. Experimental results demonstrate the effectiveness and efficiency of the event recognition algorithm.