Research and Design on the Storage Model for RDF Data Based on HBase

doi:10.3969/j.issn.1671-1122.2016.03.010

Abstract

Abstract:

Aim ing at the storage of RDF data, this paper proposes an effective storage scheme based on the Rowkey and the distributed database HBase , which mainly use of the characteristics of HBase and RDF data. The method uses the classic BKDRHash algorithm to hash the predicate, and looks the hash value and the predicate as the primary key to enforce the data storage. Effective setting the Rowkey of HBase not only avoid the phenomenon of node accumulation, the use of BKDRHash algorithm also ensures the integrity of the data. In order to prove the validity of this storage mode, the experiment is to use MapReduce to load the data into HBase in parallel ways with the internal storage format HFile file. Experiments show that, for such a storage model, when the data quantity is large, the data loading can achieve better performance. The paper mainly uses the LUBM test set to carry on the simulation experiment, and it proves that the scheme is effective.

Key words: semantic Web, RDF data, HBase, MapReduce, HFile file

CLC Number:

TP309

Yuanyuan WANG, Xiaodan LV, Qi HU, Hongchuan WU. Research and Design on the Storage Model for RDF Data Based on HBase[J]. Netinfo Security, 2016, 16(3): 59-63.

Figures/Tables 7

References 18

[1]	王昊奋. 面向大规模RDF数据的语义搜索[D].上海:上海交通大学,2013.
[2]	易雅鑫,宋自林,尹康银.RDF数据存储模式研究及实现[J].情报科学,2007,25(8):1218-1243.
[3]	GRIGORIS A(希),PAUL G(荷)等著.语义网基础教程[M].胡伟,程龚,黄智生,译.3版.北京:机械工业出版社,2014.
[4]	朱敏,程佳,柏文阳.一种基于HBase的RDF数据存储模型[J].计算机研究与发展. 2013,50(增刊):23-31.
[5]	周品主编. Hadoop云计算实战[M].北京:清华大学出版社,2012.
[6]	杜小勇,王琰,吕彬.语义Web数据管理研究进展[J].软件学报,2009,20(11):2950-2964.
[7]	杜方,陈跃国,杜小勇.RDF数据查询处理技术综述[J].软件学报. 2013,24(6):1222-1242.
[8]	WANG H F, ZHANG K, LIU Q L, et al.Q2semantic: a Lightweight Keyword Interface to Semantic Search[C]//ESWC. 5th European Semantic Web Conference, June 1-5, 2008, Tenerife, Carary Islands, Spain. Berlin Heidelberg: Springer-Verlag, 2008: 584-598.
[9]	DANIEL J, ABADI A M, SAMUEL R, et al.SW-Store: a Vertically Partitioned Dbms for Semantic Web Data Management[J]. The VLDB Jouranl, 2009, 18(2): 385-406.
[10]	FRANKE C, MORIN S, CHEBOTKO A, et al.Distributed Semantic Web Data Management in HBase and MYSQL Cluster[C]//IEEE Computer Society. Cloud Computing 2011, July 4-9, 2011,Washington D.C. NJ: IEEE, 2011: 105-112.
[11]	HUSAIN M F, DOSHI P, Khan L, et al.Storage and Retrieval of Large RDF Graph Using Hadoop and Mapreduce[J]. Lecture Notes in Computer Science, 2009, 5931: 680-686.
[12]	ROHLOFF K,SCHANTZ R E.High-performance,Massively Scalable Distributed Systems Using the MapReduce Software Framework:the SHARD Triple-store[C]// ACM Special Interest Group on Programming Languages.SPLASH '10 Systems Programming Languages and Applications: Software for Humanity, October 17-21, 2010, Sparks, Nevada. New York:ACM, 2010:4.
[13]	ABRAHAM J,BRAZIER P,CHEBOTKO A,et al.Distributed Storage and Querying Techniques for a Semantic Web of Scientific Workflow Provenance[C]//IEEE Computer Society. Proc of Service Computing(SCC).July 5-10,2010,Miami, FL.NJ:IEEE,2010:178-185.
[14]	SUM J L,JIN Q.Scalable RDF Store Based on HBase and MapReduce[C]//IEEE Computer Society. 2010 3rd Advanced Computer Theory and Engineering (ICACTE2010), August 20-22,2010.Chengdu China.NJ:IEEE,2010:V1633-V1636.
[15]	宋纪成. 海量RDF数据存储与查询技术的研究与实现[D].北京:北京工业大学. 2013.
[16]	黄秋兰,程耀东,陈刚.分布式存储系统的哈希算法研究[J].计算机工程与应用. 2014,50(1):1-4.
[17]	郑周,张大军,李运发.云计算中面向数据存储的安全访问控制机制[J].信息网络安全,2015(9):221-226.
[18]	GUO Y, PAN Z X, JEFF H.LUBM:A Benchmark for OWL Knowledge Base Systems[J]. Web Semantic: Science,Services and Agents on the World Wide Web, 2005, 3(2-3): 158-182.