基于遗传神经网络的相似重复记录检测方法研究

Study on Approximately Duplicate Record Detection Method Based on Genetic Neural Network

设计实现了一个相似重复记录检测系统,该系统包括预处理模块、聚类模块、字段匹配模块和记录匹配模块,支持聚类算法和字段匹配算法的定制扩充。并通过实验对比了几种著名的算法,实验结果表明该系统提高了相似重复记录检测的精确度。

An extensible duplicates detecting system is designed and implemented. This system includes data preparation module, clustering module, field matching module and record matching module. The working principle and implementa- tion mechanism in process of the four modules are given respectively in this dissertation. In our experiments, we compare the performance of our method with some famous approximately duplicate records detecting algorithms. The experiment results show that the system improved the precision.