基于Hadoop平台的人才发现与推荐系统研究

A Discovered and Recommended System for Talents Based on Hadoop

随着互联网和社交网络的发展,个人信息越来越多地暴露在网络空间中,有效收集和挖掘这些信息可发现所需要的人才信息。设计了一个人才发现与推荐系统,该系统基于Hadoop平台,利用网络爬虫程序寻找网页,通过信息抽取技术获取页面内容,利用lucene的分词器提取文本中的关键词,根据关联规则算法挖掘出关联关键词,采用基于相似项的策略推荐人才。系统为企业提供了一种基于网页数据的技术人才发现和推荐工具,节约了大量时间和成本。

With the development of the Internet and social networks, there is more and more personal information exposed to the network space. Collecting and mining these information can help to find talents＇ information in need. In this paper, we design a discovered and recommended system for talents, which is based on the Hadoop platform. This system uses Web crawlers to search the websites, get access to page contents through information extracting, extract keywords in the texts by using lucene＇s analyzer, dine related keywords according to association rules algorithm, adopt a strategy based on similar items to recommend talents. This system provides enterprises with a tool of finding and recommending technical talents based on web data, saving a lot of time and cost.