基于Docker容器与Spark技术的分布式判题系统

Distributed Judge System Based on Docker Container and Spark Technology

依托Docker容器虚拟化技术与Spark分布式并行计算框架,提出智能在线判题系统解决方案,设计并实现了判题服务Docker容器、Spark RDD判题数据批处理计算、Spark Streaming判题流数据实时计算、Spark ML分布式题目推荐等模块。经实验分析,系统具备较强的稳定性和实用性。

Relying on the docker container virtualization technology and spark distributed parallel computing framework,the intelligent online judgment system solution is proposed.This article designed and implemented a module such as docker container,spark RDD judgment data batch processing calculation,spark streaming solution data real-time calculation,spark ML distributed topic recommendation and other modules.After experimental analysis,the system proposed in this article has strong stability and practicality and has certain promotion and application value.