摘要
为了汇总、归类和整合网络上杂乱无章的职位信息,设计基于Python的职位画像系统,该系统将招聘网站的招聘页面进行划分.利用Python使用Encode、Xpath和正则表达式的爬取规则设计网页爬取器,获得职位信息.利用MySQL数据库存储爬取的数据,并进行数据清洗及分析,使用Flask和Echarts实现数据可视化.该系统通过图表直观展现职位画像,帮助用户了解目前各个领域职位的需求情况,为用户提供参考,同时从各个维度搭建职位检索功能.测试结果表明,该系统具有高效的爬取效率.
In order to aggregate,categorize,and integrate the disorganized job information on the web,the job portrait system based on python is designed.The system divides the recruitment page of recruitment website,design web crawlers using Python′s crawl rules which include Encode,Xpath,and regular expressions,then get job information.It uses MySQL database to store crawled data,then cleans and analyzes the data,and visualizes the data with Flask and Echarts.The system visualizes job portraits through charts,helps users understand the current needs of positions in various fields,provides users with a reference.At the same time,the job search function is built from various dimensions.The test results show that the system has efficient crawling efficiency.
作者
张浩鹏
范梅花
姜翠霞
杨欣宇
李诚
王红艳
ZHANG Hao-peng;FAN Mei-hua;JIANG Cui-xia;YANG Xin-yu;LI Cheng;WANG Hong-yan(School of Computer and Control Engineering,Qiqihar University,Qiqihar 161006,China;School of Mechanical and Electrical Engineering,Qiqihar University,Qiqihar 161006,China)
出处
《高师理科学刊》
2019年第6期39-42,80,共5页
Journal of Science of Teachers'College and University
基金
黑龙江省教育厅基本科研业务专项“齐齐哈尔大学科研项目资助”(135209233)
齐齐哈尔大学教育科学研究项目(2017094,2017020,2017019)