一个P2P IPTV多协议爬行器——TVCrawler

TVCrawler:Multi-protocol P2P IPTV crawler

P2PIPTV网络测量是研究P2PIPTV行为和特征的重要手段,不仅有利于设计出更符合真实网络环境的系统或协议,也是实现P2PIPTV监测、引导和控制等方面的重要依据和基础。爬行器是P2PIPTV网络的一种主动测量技术,也是目前P2PIPTV测量的主要方式之一。提出了一个P2PIPTV多协议爬行器——TVCrawler,能够对PPLive、PPStream和UUSee三个系统的直播频道进行测量。TVCrawler主要具有三个特点:1)采用基于反馈的引导节点集构造机制;2)采用主从结构,并行爬行获取拓扑数据;3)采用基于拓扑增长系数的自适应爬行时长控制。实验表明,TVCrawler的爬行测量速度达到20～100节点/秒和130～500边/秒。

Network measurement is a significant means of Peer-to-Peer（P2P）IPTV research.It can not only help design IPTV systems or protocols more fit for the network in reality,but also lays the foundation for the monitoring,directing and dominating of P2P IPTV.As an active network measurement technology,crawler is a principal method of P2P IPTV measurement.In this paper,a multi-protocol P2P IPTV crawler named TVCrawler was proposed,which can be used to measure and research the live channel of three P2P IPTV systems：PPLive,PPStream and UUSee.The TVCrawler has three characteristics：1）feedback-based construction mechanism of boot node sets;2）master-slave framework,and multiple crawler terminals can simultaneously run to gather data;3）topology increasing coefficient-based control of crawling interval.The experimental results demonstrate that TVCrawler can reach the speed of 20～100 peers per second and 130～500 edges per second.