基于Hadoop的数据云盘的设计与实现

Design and Implementation of Data Cloud Disk Based on Hadoop

目前绝大多数工作者使用U盘、移动硬盘进行数据存储,此方式存在数据易中毒、移动设备易丢失等弊端。为此,开发出一个运行在全分布式Hadoop集群上的数据云盘,使用HDFS分布式文件系统作为底层存储,使用MySQL、HDFS Java API、MapReduce等技术实现用户注册、登录,文件的查看、上传、下载、删除以及数据分析功能。

At present, most people use U disk or mobile hard disk to store data, this method is prone to poisoning and loss of mobile devices. To do this, develops a data cloud disk, running on a Hadoop cluster which is in the fully-distributed mode and uses the HDFS distributed file system as the underlying storage, uses MySQL, HDFS Java API. MapReduce technologies to achieve user registration, login, file management and data analysis functions.