互联网存档中的视频采集研究--以国家图书馆为例

Research on Video Collection in Internet Archiving:Taking National Library of China as an Example

随着互联网的快速发展和网络带宽的逐年增加,网络上视频内容逐渐增多,更多的内容从纯文本网页发布变为文本加视频发布。但是,互联网存档很难采集到网络视频,这些视频通常使用非标准工具和协议。本文提供了该领域采集技术的概述。基于几年采集网络视频内容的经验,本文提供了HTTP协议和RTMP协议视频采集的示例,阐述了采集网络视频内容的问题和解决方案。本文还提出了一种外部下载器作为视频采集模块,用于扩展网络视频内容采集。

With the rapid development of the Internet and the increase in network bandwidth year by year,video content on the Internet has gradually increased,and more content has changed from publishing plain text web pages to publishing text plus video.However,it is difficult for Internet archives to capture network videos,which usually use nonstandard tools and protocols.This article provides an overview of acquisition techniques in this field.Based on years of experience in collecting network video content,this article provides examples of HTTP protocol and RTMP protocol video capture to illustrate the problems and solutions of collecting network video content.This article also proposes an external downloader for video capture module,which is used to expand network video content capture.