期刊文献+

可视数据清洗综述 被引量:18

Survey of visualization data cleaning
原文传递
导出
摘要 目的数据清洗是一个长期存在并困扰人们的问题,随着可视化技术的发展,可视数据清洗必将成为数据清洗的重要方法之一。阐述数据的主要质量问题和可视数据清洗的过程,回顾可视数据清洗的研究现状(包括数据质量问题的来源、分类以及可视数据清洗方法),并根据已有文献总结可视数据清洗面临的主要挑战和机遇。方法由于数据清洗的方法和策略与具体的数据质量问题相关,因此本文以不同的数据质量问题为线索来归纳和评述可视数据清洗的方法和策略。结果根据数据质量问题的不同,将可视清洗方法归纳为直接可视清洗、可视缺失数据、可视不确定数据、可视数据转换和数据清洗资源共享等,并依据不同的数据质量问题归纳总结出相应问题所面临的挑战和可进一步研究的方向。结论对可视数据清洗的归纳、总结和展望,并指出在数据清洗领域中可视数据清洗将会是未来最有前景的研究方向之一。 Objective Many issues still exist in data cleaning despite extensive studies on this method. With visual interface and visualization, visual data cleaning has become one of the most important data cleaning methods. This study describes existing data quality problems and visual data cleaning processes, reviews state-of-the-art visual data cleaning methods ( including sources, categories of data quality issues, and visual data cleaning methods), and summarizes the challenges and opportunities associated with visual data cleaning problems. Method Data cleaning techniques are related to specific data quality issues. Thus, this study examines different data quality problems to summarize and review previous works on visual data cleaning. Result Based on data quality issues, Visual cleaning methods are summarized as direct visual cleaning, visu- al missing data, visual uncertainty data, visual data transformation, and data cleaning resource sharing. Challenges and further research directions are surveyed according to different data quality issues. Conclusion We introduce and provide an overview of visual data cleaning problems, as well as highlight research directions of visual data cleaning.
出处 《中国图象图形学报》 CSCD 北大核心 2015年第4期468-482,共15页 Journal of Image and Graphics
基金 国家自然科学基金项目(61202279) 浙江省自然科学基金项目(LR13F020001) 浙江省自然科学基金项目(LQ12F02003) 浙江省工业设计科技项目(2013D40046)
关键词 数据清洗 可视清洗 可视分析 信息可视化 数据分析 data cleaning visual cleaning visual analysis information visualization data analysis
  • 相关文献

参考文献51

  • 1Sean K, Jeffrey H, Catherine P, et al. Research directions in data wrangling: visualizations and transformations for usable and credible data [J]. Information Visualization, 2011, 10(4): 271-288. [DOI: 10.1177/147387161415994].
  • 2Bhattacharya I, Getoor L. Collective entity resolution in relational data [C]//Proceedings of ACM Transactions on Knowledge Discovery in Data. Berlin, Germany: Springer, 2007, 1(1). [DOI: 10.1145/1217299.1217 304].
  • 3Elmagarmid A K, Ipeirotis P G, Verykios V S. Duplicate record detection: a survey [J]. IEEE Transactions on Knowledge and Data Engineering, 2007, 19(1): 1-16. [DOI: 10.1109/TKDE.2007.9].
  • 4Gravano L, Ipeirotis P G, Jagadish H V, et al. Using qgrams in a dbms for approximate string processing [J]. IEEE Data Engineering Bulletin, 2001, 24(4): 28-34. [DOI: 10.1.1.14.6009].
  • 5Sarawagi S, Bhamidipaty A. Interactive deduplication using active learning [C]//Proceedings of the 8th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. Alberta, Canada: ACM, 2002: 1-10. [DOI: 10.1145/775047. 775087].
  • 6Robertson G G, Czerwinski M P, Churchill J E. Visualization of mappings between schemas [C]//Proceedings of SIGCHI Conference on Human Factors in Computing Systems. Portland, Oregon, USA: ACM, 2005: 431-439. [DOI:10.1145/10549 72. 1055032].
  • 7Kang H, Getoor L, Shneiderman B, et al. Interactive entity resolution in relational data: a visual analytic tool and its evaluation [J]. IEEE Trans. Vis. Comput. Graph., 2008, 14(5): 999-1014. [DOI: 10.1109/TVCG.2008.55].
  • 8Huynh D, Mazzocchi S. Freebase GridWorks [CP]. http://code.google.com/p/google-refine/.
  • 9Raman V, Hellerstein J M. Potter's wheel: an interactive data cleaning system [C]//Proceedings of the 27th International Conference on Very Large Data Bases. Roma, Italy: Morgan Kaufmann, 2001: 381-390.
  • 10Li L, Peng T, Kennedy J. Improving data quality in data warehousing applications [C]//Proceedings of the 12th International Conference on Enterprise Information Systems. Funchal, Madeira, Portugal: SciTePress, 2010: 211-219.

同被引文献120

引证文献18

二级引证文献45

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部