Research on Security Event Real-time Monitoring Framework Based on Micro-blog

doi:10.3969/j.issn.1671-1122.2015.01.004

Abstract

Abstract:

According to the discipline of event’s development and the social characteristic of event’s propagation, this paper proposes a framework of real-time monitoring events which propagating on micro-blog, based on the theory of social sensor network, and this framework includes several key algorithms, such as abnormal detection algorithm, geography location positioning algorithm, related events recommendation algorithm, and event correlation analysis algorithm. Based on this framework, this paper develops and implements a real-time monitoring system about micro-blog events. This system applies hybrid web crawler and the way of open API interface to capture micro-blog data, and also implements the event retrieval module, real-time monitoring module and hot topic module. This system also displays the result information of micro-blog event in multiple dimensions, and operates stably. In conclusion, this paper is to explore the field of spatial-temporal correlation between the virtual network and the physical world, monitor the specific "event", and position its location before outbreak, and provide early warning.

Key words: micro-blog events, real-time monitoring, anomaly detection, location

CLC Number:

TP309

LI Ling-yun, AO Ji, QIAO Zhi, LI Jian. Research on Security Event Real-time Monitoring Framework Based on Micro-blog[J]. Netinfo Security, 2015, 15(1): 16-23.

Figures/Tables 9

References 21

[1]	王先国,陈勇军. Web2.0时代网站建设特征、内容及其应用研究[J]. 软件导刊,2013,12(12):9-11.
[2]	李婧,刘志明,崔朝国. 基于微博的舆情监测与分析的研究[J]. 智能计算机与应用,2013,3(2):50-53.
[3]	林大云. 基于Hadoop的微博信息挖掘[J]. 计算机光盘软件与应用,2012,1(4):7-8.
[4]	廉捷,周欣,曹伟,等. 新浪微博数据挖掘方案[J]. 清华大学学报(自然科学版),2011,51(10):1300-1305.
[5]	田野. 基于微博平台的事件趋势分析及预测研究[D]. 武汉:武汉大学,2012.
[6]	SHAN D, ZHAO W X, CHEN R, et al.EventSearch: A System for Event Discovery and Retrieval on Multi-Type Historical Data[C]//Proceeding of the 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2012, Beijing: ACM Press, 2012.
[7]	LEE C H, YANG H C, CHIEN T F, et al.A Novel Approach for Event Detection by Mining Spatio-temporal Information on Microblogs[C]//International Conference on Advances in Social Networks Analysis and Mining, 2011, Songdo: IEEE Press, 2011.
[8]	TAKESHI S, MAKOTO O, MATSUO Y.Earthquake Shakes Twitter Users: Real-time Event Detection by Social Sensors[C]//World Wide Web, 2010, Raleigh: ACM Press, 2010.
[9]	ANDREW C, ARIE C, ANTHONY S, et al.Earthquake: Twitter as a Distributed Sensor System[J]. Transaction in CIS, 2013, 17(1): 124-147.
[10]	LEE R, WAKAMIYA S, SUMIYA K.Discovery of Unusual Regional Social Activities Using Geo-tagged Microblogs[C]// World Wide Web,Hyderabad, 2011.
[11]	SINGH V.From Multimedia Data to Situation Detection[C]//Proc.ACM Multimedia, 2011, Scottsdale: ACM Press, 2011.
[12]	SINGH V, JAIN R.Structural Analysis of the Emerging Event-Web[C]//World Wide Web, 2010, Raleigh: ACM Press, 2010.
[13]	CHOUDHURY S, BRESLIN J G.Extracting Semantic Entities and Events from Sports Tweets[C]// Workshop on Making Sense of Microposts, 2011: 22-32.
[14]	ANTOS A, WIVES L, ALVARES O.Location-based Events Detection on Microblogs, Augusto Dias Pereira dos Santos[J]. arXiv preprint arVic, 2012, 3(3): 1-10.
[15]	MARCUS A, BERNSTEIN M, BADAR O, et al.TwitInfo:Aggregating and Visualizing Microblogs for Event Exploration[C]// Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2011, Vancouver: ACM Press, 2011.
[16]	MACEACHREN A M, ROBINSON A C, JAISWAL A, et al.Geo-Twitter Analytics Applications in Crisis Management[C]//Proceeding of the 25th International Cartographic Conference, 2010, Paris: ACMPress, 2010.
[17]	ADOMAVICUYS G, TUZHILIN A.Toward the Next Generation of Recommender Systems: a Survey of the State-of-the Art and Possible Extensions[J]. IEEE Transactions on Knowledge and Data Engineering, 2005, 17(6): 734-749.
[18]	陈斌,陈松灿,潘志松,等. 异常检测综述[J]. 山东大学学报(工学报),2009,39(6):13-22.
[19]	王波,甄峰,席广亮,等. 基于微博用户关系的网络信息地理研究—以新浪微博为例[J]. 地理研究,2013,32(3):380-391.
[20]	周立柱,林玲. 聚焦爬虫技术研究综述[J]. 计算机应用,2005,25(9):1965-1969.
[21]	田董涛. 微博客数据的获取与分析方法研究[D]. 北京:北京交通大学,2011.