大数据环境下竞争情报系统的研究与实现

Research and Implementation on Competitive Intelligence System Based on Big Data

为让企业在大数据的环境下及时获得准确和可靠的竞争情报,提出了基于大数据的企业竞争情报系统的构建.通过B/S(浏览器/服务器)架构,运用聚焦爬虫工作原理的网络爬虫进行情报信息的采集,并用基于Hadoop的KNN算法进行情报信息的处理和分类,克服了大数据下KNN分类算法时间复杂度高等问题,同时系统支持用户个性化定制.

To help enterprises to obtain timely , accurate and reliable intelligence information under the environment of big data , it proposed how to build an enterprise competitive intelligence system , based on big data .It used web crawlers of focused crawler works to collect intelligence information , and employed the Hadoop-based KNN algorithm to process and classify the intelligence information via the B /S （ Brow-ser/Server） framework, which can solve the problem of high time complexity of the KNN classification al-gorithm in a big data environment and other issues .The system also allows users some customization , making it more individualized .