基于文本挖掘的计算机类招聘数据分析与可视化系统设计

Design of Computer-based Recruitment Data Analysis and Visualization System Based on Text Mining

计算机技术更迭迅速,IT市场的用人需求也在快速变化,如何准确快速洞察市场对于人才的岗位需求和技能需求,对在校大学生和高校人才培养来说都非常重要。网络校园招聘信息更新快且市场需求趋势明显,是大学生人才招聘的重要形式。聚焦计算机类专业,对目前主流的招聘网站校园招聘数据进行爬取,采用jieba分词、LDA主题建模、词频分析等文本挖掘方法,对计算机类专业下的6大方向进行岗位和技能的统计分析,并实现系统的可视化展现。该系统支持数据的定时采集、更新和日志监测记录,能够有效服务高校和学生。

With the rapid development of computer technology,the demand for talents in the IT market is also changing rapidly.How to accurately and quickly understand the market's demand for professional skills is very important for college students and university discipline construction.Online campus recruitment information is updated quickly and the market demand trend is obvious,which is an important form of college student talent recruitment.This paper focuses on computer majors,crawls the campus recruitment data of the current mainstream recruitment websites,and adopts text mining methods such as jieba word segmentation,LDA theme modeling,and word frequency analysis to statistically analyze positions and skills in six major directions under computer majors,and realizes systematic visual display.The system supports regular data collection,update and log monitoring and recording,which can effectively serve universities and students.