摘要
以大数据时代为背景,以浙江国际海运职业技术学院船员培训系统为例,设计并实现了一套基于大数据的船员培训驾驶舱平台。通过引入Hadoop、Hive、Spark等大数据技术实现了船员培训数据的采集、分析和可视化展示。该平台的设计目标在于提升船员培训效果,通过大数据存储分析技术对培训项目、人次、计划等数据进行采集和分析,形成主题评估及数据对比,为管理层决策提供支撑。详细介绍了平台的总体架构、环境准备、数据导入、清洗、处理、持久化和可视化等关键步骤,强调了数据处理的全流程。
the context of big data,taking the crew training system of Zhejiang International Maritime College as an example,this essay discussed the design and implementation of a crew training cockpit platform.By introducing big data technologies such as Hadoop,Hive,and Spark,the collection,analysis,and visual display of crew training data are realized.The design goal of the platform is to improve the effectiveness of crew training.Through big data storage and analysis technology,data such as training projects,person-times,and plans are collected and analyzed to form topic assessments and data comparisons,providing support for management decision-making.The key steps of the platform's overall architecture,environment preparation,data import,cleaning,processing,persistence,and visualization are introduced in detail,emphasizing the whole process of data processing.
作者
舒伟权
朱俊彦
SHU Wei-quan;ZHU Jun-yan(Zhejiang International Maritime College,Zhoushan 316021,China)
出处
《武汉船舶职业技术学院学报》
2024年第3期104-110,共7页
Journal of Wuhan Institute of Shipbuilding Technology
基金
中国交通教育研究会“船员培训一体化数据多场景融合关键技术探究与研发”(项目编号:JT2022YB062)。
关键词
大数据技术
船员培训
平台设计
数据可视化
data technology
crew training
platform design
data visualization