Abstract:

With the rapid development of the Internet and the cloud computing technology, the security problem of massive user privacies and data has caused more and more attentions, and encryption is the first choice to protect the data. In order to achieve the secure storage of massive data rapidly and effectively, on the basis of the research on the application of multi-core processor cluster in the massive data encryption storage, this paper proposes a scheme of dealing with massive data by using OpenMP&MPI hybrid technology on the multi-core Linux cluster, providing the parallel strategy for the multi-core cluster inside the node or between the nodes of the cluster, which realizes the hierarchical structured parallel processing of the massive data. This paper uses the parallel virtual file system PVFS2 as multi-core cluster file system and makes use of the characteristic of the parallel I/O to actually solve the problem of parallel storage of the massive data in the cluster system. This paper proposes a model of massive data encryption storage system based on multi-core cluster. The experimental results show that the model not only can achieve the storage of massive data effectively, but also can protect massive data to some extent.

Key words: multi-core cluster, massive data, encryption storage, OpenMP, MPI, PVFS2