摘要
为让企业在大数据的环境下及时获得准确和可靠的竞争情报,提出了基于大数据的企业竞争情报系统的构建.通过B/S(浏览器/服务器)架构,运用聚焦爬虫工作原理的网络爬虫进行情报信息的采集,并用基于Hadoop的KNN算法进行情报信息的处理和分类,克服了大数据下KNN分类算法时间复杂度高等问题,同时系统支持用户个性化定制.
To help enterprises to obtain timely , accurate and reliable intelligence information under the environment of big data , it proposed how to build an enterprise competitive intelligence system , based on big data .It used web crawlers of focused crawler works to collect intelligence information , and employed the Hadoop-based KNN algorithm to process and classify the intelligence information via the B /S ( Brow-ser/Server) framework, which can solve the problem of high time complexity of the KNN classification al-gorithm in a big data environment and other issues .The system also allows users some customization , making it more individualized .
出处
《广东工业大学学报》
CAS
2014年第3期27-31,共5页
Journal of Guangdong University of Technology
基金
广东省教育部产学研结合项目(2012B040500005)
广东省教育部产学研结合项目(2012B091100071)