• • 上一篇    下一篇

QVOD资源爬行系统的研究与实现

李卫%王文贤   

  • 基金资助:
    国家科技支撑计划(2012BAH18B05)

Research and Realization of Crawling System for QVOD Resources

LI Wei%WANG Wen-xian   

  • About author:四川大学计算机学院,四川成都,610065

摘要: 目前,互联网上大量QVOD网站通过QVOD资源服务器发布盗版、暴力低俗等违规视频节目。为对QVOD网站发布的资源进行监管,文章在研究了QVOD资源发布过程、发布方式以及QVOD资源播放链接在网站中的特征等内容后,实现了一款QVOD资源爬行系统,通过11天时间爬行了35个QVOD资源发布网站,获得了261万条QVOD播放链接。实验表明,QVOD资源爬行系统能够高效采集QVOD网站中的QVOD播放链接。本系统为QVOD资源发布网站的监管提供了可靠的基础,也可为其他Web爬虫的设计提供了参考。

Abstract: There are a lot of web sites providing illegal programs, such as pirated video, porn and violent vulgar, through QVOD Server. To supervise the resources of the QVOD website, realized a Crawling System of QVOD Resources after having studied the process and the way of publishing the QVOD resources and the feature of QVOD program links in QVOD web sites. The Crawling System of QVOD Resources crawled 2.61million QVOD program links in 11 days. Experimental results show that the Crawling System of QVOD Resources could collect the QVOD program links efficiently. The Crawling System of QVOD Resources could be the reliable basis for supervising QVOD web sites and also could be reference of design of other Web Crawlers.