基于Selenium+Python+Tableau的BOSS直聘数据的爬取与分析——以“软件”专业为例

Crawling and Analysis of BOSS Data Based on Selenium+Python+Tableau——A Case Study of Software Major

大数据背景下,从数据采集、数据预处理、数据可视化三维度出发,深入挖掘BOSS直聘网站的大规模招聘信息。首先阐明大数据爬取和分析的关键技术;再结合Selenium框架与Python语言进行爬虫算法设计与招聘数据的爬取与存储;进而利用Tableau工具,从岗位、薪资、经验及学历四个方面进行了用人单位对软件人才需求的数据可视化分析,以期为高职软件专业学生培养和就业提供参考和借鉴。

In the context of big data,the three dimensions of data collection,data pre⁃processing and data visualization are used to explore the large⁃scale recruitment information on BOSS Direct Recruitment Website.Firstly,the key technologies of big data crawling and analysis are clarified;then the Selenium framework and Python language are combined to design the crawling algorithm,and to crawl and store the recruitment data;finally the Tableau tool is used to carry out the data visualization analysis of employers􀆳demand for software talents from four aspects:position,salary,experience and education,with an aim to provide references for the training and employment of software majors in higher vocational colleges.