基于Python的职位画像系统

Job portrait system based on Python

为了汇总、归类和整合网络上杂乱无章的职位信息,设计基于Python的职位画像系统,该系统将招聘网站的招聘页面进行划分.利用Python使用Encode、Xpath和正则表达式的爬取规则设计网页爬取器,获得职位信息.利用MySQL数据库存储爬取的数据,并进行数据清洗及分析,使用Flask和Echarts实现数据可视化.该系统通过图表直观展现职位画像,帮助用户了解目前各个领域职位的需求情况,为用户提供参考,同时从各个维度搭建职位检索功能.测试结果表明,该系统具有高效的爬取效率.

In order to aggregate,categorize,and integrate the disorganized job information on the web,the job portrait system based on python is designed.The system divides the recruitment page of recruitment website,design web crawlers using Python′s crawl rules which include Encode,Xpath,and regular expressions,then get job information.It uses MySQL database to store crawled data,then cleans and analyzes the data,and visualizes the data with Flask and Echarts.The system visualizes job portraits through charts,helps users understand the current needs of positions in various fields,provides users with a reference.At the same time,the job search function is built from various dimensions.The test results show that the system has efficient crawling efficiency.