In order to address the problems of the single encryption algorithm,such as low encryption efficiency and unreliable metadata for static data storage of big data platforms in the cloud computing environment,we propose...In order to address the problems of the single encryption algorithm,such as low encryption efficiency and unreliable metadata for static data storage of big data platforms in the cloud computing environment,we propose a Hadoop based big data secure storage scheme.Firstly,in order to disperse the NameNode service from a single server to multiple servers,we combine HDFS federation and HDFS high-availability mechanisms,and use the Zookeeper distributed coordination mechanism to coordinate each node to achieve dual-channel storage.Then,we improve the ECC encryption algorithm for the encryption of ordinary data,and adopt a homomorphic encryption algorithm to encrypt data that needs to be calculated.To accelerate the encryption,we adopt the dualthread encryption mode.Finally,the HDFS control module is designed to combine the encryption algorithm with the storage model.Experimental results show that the proposed solution solves the problem of a single point of failure of metadata,performs well in terms of metadata reliability,and can realize the fault tolerance of the server.The improved encryption algorithm integrates the dual-channel storage mode,and the encryption storage efficiency improves by 27.6% on average.展开更多
With the support of the Fundamental Reliability Theoretical Research (FRTR) Foundation of the Quality Control Bureau of Ministry of Astronautics (MOA), PRC, 9 Chinese institutes and universities have worked for years ...With the support of the Fundamental Reliability Theoretical Research (FRTR) Foundation of the Quality Control Bureau of Ministry of Astronautics (MOA), PRC, 9 Chinese institutes and universities have worked for years on reliability statistics problems pending to be solved in space research and development. This paper gives a brief review of our main research results, including (1) Results on Normal Distributions; (2) Results on Weibull Distributions; (3) Results on the Synthesisof System Reliability-Theoretical Method; (4) Results on the Synthesis of System Reliability-Approximation Method: Binomial Distribution, Exponential Distribution, Weibull Distribution, Parallel System, General Cases; (5) Structual Reliability; (6) Zero-Failure Reliability Estimation; (7) Storage Life and Others. All these results can be acquired from the Quality Control Bureau of the Ministry of Aero-Space Industry (MAS).展开更多
文摘In order to address the problems of the single encryption algorithm,such as low encryption efficiency and unreliable metadata for static data storage of big data platforms in the cloud computing environment,we propose a Hadoop based big data secure storage scheme.Firstly,in order to disperse the NameNode service from a single server to multiple servers,we combine HDFS federation and HDFS high-availability mechanisms,and use the Zookeeper distributed coordination mechanism to coordinate each node to achieve dual-channel storage.Then,we improve the ECC encryption algorithm for the encryption of ordinary data,and adopt a homomorphic encryption algorithm to encrypt data that needs to be calculated.To accelerate the encryption,we adopt the dualthread encryption mode.Finally,the HDFS control module is designed to combine the encryption algorithm with the storage model.Experimental results show that the proposed solution solves the problem of a single point of failure of metadata,performs well in terms of metadata reliability,and can realize the fault tolerance of the server.The improved encryption algorithm integrates the dual-channel storage mode,and the encryption storage efficiency improves by 27.6% on average.
文摘With the support of the Fundamental Reliability Theoretical Research (FRTR) Foundation of the Quality Control Bureau of Ministry of Astronautics (MOA), PRC, 9 Chinese institutes and universities have worked for years on reliability statistics problems pending to be solved in space research and development. This paper gives a brief review of our main research results, including (1) Results on Normal Distributions; (2) Results on Weibull Distributions; (3) Results on the Synthesisof System Reliability-Theoretical Method; (4) Results on the Synthesis of System Reliability-Approximation Method: Binomial Distribution, Exponential Distribution, Weibull Distribution, Parallel System, General Cases; (5) Structual Reliability; (6) Zero-Failure Reliability Estimation; (7) Storage Life and Others. All these results can be acquired from the Quality Control Bureau of the Ministry of Aero-Space Industry (MAS).
