Design and Implementation of Network Public Opinion Monitoring System for Forest Public Security Based on Hadoop

doi:10.3969/j.issn.1671-1122.2018.12.011

Abstract

Abstract:

The survey shows that the collection, analysis and reporting of network public opinion in the domestic forest public security application system is still in the original state of artificial mode, which leads the collection efficiency is low, the analysis time is long, and the accuracy of research and judgment is not high, specially conversion rate of effective public opinion is low. In order to improve the working mechanism of forest public security network public opinion monitoring, this paper designs a forest public security network public opinion monitoring system based on Hadoop according to the actual needs of forest public security network public opinion monitoring. The system realizes parallel crawling and analysis of forest public security network public opinion based on MapReduce distributed processing framework in Hadoop. The practice proves that forest public security network public opinion monitoring system based on Hadoop improves effectively the collection efficiency and analysis efficiency of forest public security network public opinion.

Key words: forest public security, network public opinion, Hadoop, MapReduce

CLC Number:

TP309

Chunxia ZHANG, Xinmeng WANG, Xiaoxi ZHANG. Design and Implementation of Network Public Opinion Monitoring System for Forest Public Security Based on Hadoop[J]. Netinfo Security, 2018, 18(12): 82-86.

Figures/Tables 5

References 13

[1]	Forest Public Security Bureau of the State Forestry Administration. News Publicity and Public Opinion Disposal System of Forest Police Issued and Implemented[J].Forest Public Security,2015(1):35.
	国家林业局森林公安局.森林公安新闻宣传和舆情处置制度印发实施[J].森林公安,2015(1):35.
[2]	JIAN Ling.Design and Implementation of Petabyte Data Processing System Based on Hadoop[J]. Netinfo Security,2013,13(11):87-89.
	简玲. 基于Hadoop的PB级海量数据处理系统的设计与实现[J].信息网络安全,2013,13(11):87-89.
[3]	W3C. Document Object Model (DOM) Level 2 HTML Specification [EB/OL]. ,2003-1-9.
[4]	JOB BOLE. Comparison of NoSQL Databases among MongoDB, Cassandra and HBase[EB/OL]., 2015-9-24.
	伯乐在线. MongoDB、Cassandra和HBase 三种NoSQL数据库比较[EB/OL]., 2015-9-24.
[5]	WANG Shufen,GAO Junli,ZOU Pu,et al.A Framework of WAN Distributed Topic Crawling System Based on Hadoop[J].Computer Engineering & Science,2015(37):670-675.
	王淑芬,高军礼,邹普,等. 基于Hadoop的广域网分布式主题爬虫系统框架[J]. 计算机工程与科学, 2015(37):670-675.
[6]	ZHU Zede,LI Miao,ZHANG Jian,et al.Web Content Extraction Based on Text Density Model[J]. Pattern Recognition and Artificial Intelligence,2013(26):667-672.
	朱泽德,李淼,张健,等.基于文本密度模型的Web正文抽取[J].模式识别与人工智能,2013(26):667-672.
[7]	JELGER C, NOEL T, Frey A.Gateway and Address Autoconfiguration for IPv6 Ad Hoc Networks[EB/OL]. ,2018-6-30.
[8]	WANG Shaokang,DONG Kejun,YAN Baoping.Web Content Information Extraction Using Density of Feature Text[J].Computer Engineering and Applicantions,2010(46):1-3.
	王少康,董科军,阎保平.使用特征文本密度的网页正文提取[J].计算机工程与应用,2010(46):1-3.
[9]	LU Xie,LUO Shoushan,ZHANG Yumei.Research on Hadoop-based Massive Security Log Clustering Algorithm[J].Netinfo Security,2018,18(8):56-63.
	陆勰,罗守山,张玉梅.基于Hadoop的海量安全日志聚类算法研究[J].信息网络安全,2018,18(8):56-63.
[10]	JerryLead. K-means Clustering Algorithm [EB/OL]., 2011-4-6.
	JerryLead. K-means聚类算法[EB/OL]., 2011-4-6.
[11]	LIU Yunheng,LIU Yaozong.Hadoop-based Public Security Video Big Data Processing Method[J].Computer Science, 2016(43):448-451.
	刘云恒,刘耀宗.基于Hadoop的公安视频大数据的处理方法[J].计算机科学,2016(43):448-451.
[12]	BAO Liang,LI Qian.Practical Big Data [M].Beijing:Tsinghua University Press,2015.
	鲍亮,李倩.实战大数据[M].北京:清华大学出版社,2015.
[13]	Beijing Municipal Landscape and Greening Bureau.Order of Replenting Trees [EB/OL]., 2014-1-7.
	北京市园林绿化局.责令补种林木[EB/OL]. , 2014-1-7.

[1]	Tianxiong WU, Xingshu CHEN, Yonggang LUO. Research and Implementation of Application Program Protection Mechanism under Big Data Platform [J]. Netinfo Security, 2019, 19(1): 68-75.
[2]	LU Xie, LUO Shoushan, ZHANG Yumei. Research on Hadoop-based Massive Security Log Clustering Algorithm [J]. 信息网络安全, 2018, 18(8): 56-63.
[3]	Junyan MA, Guosun ZENG. Research and Implementation on Parallel Crawl Method for Source Code Based on MapReduce [J]. Netinfo Security, 2018, 0(1): 58-66.
[4]	WANG Wei, LIAO Zhengyu, ZHANG Hui, GUO Dong. Design and Implementation on Data Storage and Analysis System of Railway Signal System Based on Big Data [J]. 信息网络安全, 2017, 17(1): 29-37.
[5]	JIANG Fengyan, JIANG Jin, JIANG Jiting. Research on Electronic Forensic Based on Big Data Environment [J]. 信息网络安全, 2016, 16(9): 60-63.
[6]	CHEN Xilin, MA Ding. Design of Storage Structure in HBase for Microblog Information Analysis [J]. 信息网络安全, 2016, 16(9): 267-271.
[7]	SUN Xiaodong, XIAO Ping. Internet Public Opinion Monitoring System Based on Active Mode [J]. 信息网络安全, 2016, 16(9): 272-277.
[8]	WANG Yuanyuan, LV Xiaodan, HU Qi, WU Hongchuan. Research and Design on the Storage Model for RDF Data Based on HBase [J]. 信息网络安全, 2016, 16(3): 59-63.
[9]	SUN Da-peng. Application and Implementation of Hadoop Cloud Computing Technology in Junk Message Filtering [J]. 信息网络安全, 2015, 15(7): 13-19.
[10]	. The Method of Classifying Network Public Opinion Text Based on Random Forest Algorithm [J]. , 2014, 14(11): 36-.
[11]	. A Lot of Log Storage and Retrieval Optimization based on Hadoop Architecture [J]. , 2013, 13(6): 0-0.
[12]	. Research on Authentication Method of Hadoop Cloud Computing Platform based on SAML [J]. , 2013, 13(12): 0-0.
[13]	. Hadoop DDos Attack Detection Algorithm Analysis [J]. , 2013, 13(12): 0-0.
[14]	. Design and Implementation of Petabyte Data Processing System based on Hadoop [J]. , 2013, 13(11): 0-0.
[15]	. Network Security Event Analysis based on Hadoop [J]. , 2013, 13(1): 0-0.