大数据实验环境下自动化运维方法的研究

Research on automatic operation and maintenance method in big data experimental environment

大数据的实验环境涉及种类繁多的集群节点、软件系统和数据资源,导致大数据实验环境部署复杂,软件系统运维困难,教学过程难以监管。提出采用大型数据中心的自动化运维方法来管理大数据实验环节的方案,整理出实验工作中需要标准化、批量化、定时触发的管理任务,迁移至自动化运维平台,提升运维效率。介绍利用自动化运维手段来优化大数据实验中软件和数据的配置过程,并系统说明利用运维工具辅助校验大数据的实验过程和实验结果的方法。

A great variety of clusters,software and data source are required in big data experimental environments.It caused the difficulties which deploy the experimental environment and monitor the teaching process.So the scheme was proposed which adopt huge data center automatic method to oper-ate and maintain the big data experimental environments.Summarize the tasks which need to be stand-ardized,batch and scheduled from experimental work.It introduce use this method to improve the de-ployment efficiency of the big data experimental software,and use the IT automation tools to check and verify the big data experimental process and result.