大数据在线实训平台及综合实验课程体系设计

Design of online big data training platform and comprehensive experiment course

针对“大数据处理综合实验”课程教学中学生接触集群难、编程难度高、学习效率低等问题,设计实现了大数据在线教学实训平台。该平台集成了大数据存储、计算、查询、可交互式编程等模块,实现了包括并行编程实训、学生管理、资源调度、教学过程监控等功能的一体化大数据教学系统。基于该平台,还设计了一系列由浅入深的大数据分析案例和编程实验项目。教学实践表明,该平台在帮助学生直观理解并行处理技术和分布式系统、培养学生大数据应用并行处理编程能力等方面起到了很好的作用。

In view of the problems such as the difficulty of contacting clusters,high programming difficulty,low learning efficiency,etc.,in the“Big data processing comprehensive experiment”teaching,the online big data teaching and training platform is designed and realized.The platform integrates big data storage,computation,query,interactive programming and other modules,and realizes an integrated big data teaching system including parallel programming training,student management,resource scheduling,teaching process monitoring and other functions.Based on the platform,a series of big data analysis cases and programming experiments are designed.Teaching practice shows that the platform plays an important role in helping students to intuitively understand parallel processing technology and distributed system and cultivating their ability of big data application parallel processing programming.