Netinfo Security

Netinfo Security ›› 2017, Vol. 17 ›› Issue (11): 44-49.doi: 10.3969/j.issn.1671-1122.2017.11.007

• Orginal Article • Previous Articles     Next Articles

Study of Message Data Subscription Based on Multi-Application Big Data Analysis

Ge FU1(), Xinhua ZHANG2, Chao LI1   

  1. 1.National Computer Network Emergency Response Technical Team/Coordination Center of China, Beijing 100029, China
    2. Jilin Branch of National Computer Network Emergency Response Technical Team/Coordination Center of China, Changchun Jilin 130061, China
  • Received:2017-08-01 Online:2017-11-20 Published:2020-05-12

RichHTML

1

PDF (PC)

527

Abstract:

Based on the problems of enterprise applications of multi-application big data analysis, in order to reduce the resource consumption for big data subscription, improve resource utilization, achieve the goal of "sustainable and intensive development" for enterprise big data platform, we proposes a resolution to complicated message data subscription for Kafka, which supports "row-level" and "column-level" message subscription for multi-application big data analysis. We also develop a complicated subscription prototype system. The experimental results show that the system has features of high throughput and high availability.

Key words: complicated message subscription, multi-application, big data analysis

CLC Number: