信息网络安全 ›› 2018, Vol. 18 ›› Issue (2): 20-26.doi: 10.3969/j.issn.1671-1122.2018.02.003

• • 上一篇    下一篇

一种基于wirehair码的高可靠分布式存储方案的研究与实现

邓凯1(), 田志宏2, 马丹阳1   

  1. 1.中国工程物理研究院计算机应用研究所, 四川绵阳 621900
    2. 广州大学网络空间先进技术研究院,广东广州 510006
  • 收稿日期:2017-10-16 出版日期:2018-02-20 发布日期:2020-05-11
  • 作者简介:

    作者简介:邓凯(1990—),男,陕西,助理工程师,硕士,主要研究方向为Web应用安全;田志宏(1978—),男,黑龙江,研究员,博士,主要研究方向为计算机网络与信息安全;马丹阳(1992—),女,陕西,助理工程师,硕士,主要研究方向为软件工程。

  • 基金资助:
    国家自然科学基金[61572153]

Research and Implementation of a Highly Reliable Distributed Storage Scheme Based on Wirehair Code

Kai DENG1(), Zhihong TIAN2, Danyang MA1   

  1. 1. Institute of Computer Applications, China Academy of Engineering Physics, Mianyang Sichuan 621900, China
    2. Cyberspace Institute of Advanced Technology, Guangzhou University, Guangzhou Guangdong 510006, China
  • Received:2017-10-16 Online:2018-02-20 Published:2020-05-11

摘要:

在分布式存储中,每一个分布式存储节点的数据可用性都是极其重要的。因此,必须加入相应的冗余措施来保障数据的可用性。而传统基于复制的冗余策略会随着数据可用性的提高而极大增加冗余开销。同时,随着分布式存储节点个数的增加,部分节点遭受物理攻击、窃取的可能性也相应增大,极大增加了对于敏感数据的安全威胁。文章在对Raptor码深入研究的基础上, 提出一种基于Raptor码的分布式存储方案。且通过大量实验测试,设计并实现了一种基于wirehair码(RaptorQ的开源实现)的分布式存储系统。该系统不仅能以较小的冗余实现较高的数据可用性,且通过编码过程增加了原始数据的安全性。

关键词: 分布式存储, wirehair码, 冗余, Raptor码

Abstract:

In the distributed storage, the data availability of each distributed storage node is very important. Therefore, the corresponding redundance measures must be taken to ensure the data availability. However, the redundance cost of the traditional redundance strategy based on duplication will greatly increase as data availability improves. Meanwhile, with the increasing of the number of distributed storage nodes, the possibility that some nodes suffer physical attack and theft also increases, which greatly increases the security threat to sensitive data. On the basis of deep research on Raptor code, this paper presents a distributed storage scheme based on Raptor code. And through a lot of experimental tests, a distributed storage system based on wirehair code (open source implementation of RaptorQ) is designed and implemented. The system can not only achieve higher data availability with smaller redundance, but also increase the security of the original data through the coding process.

Key words: distributed storage, wirehair code, redundance, Raptor code

中图分类号: