一种实现抽取数据的kettle插件开发

A kettle Plugin Development for Extracting Data

介绍Elasticsearch和ETL工具以及Kettle插件的开发流程,通过两个示例展示本文开发的一种从Elasticsearch抽取数据的Kettle插件,支持Elasticsearch集群模式和权限认证,并通过增加嵌套自增字段有效地解决嵌套数组字段的输出流无法区分的问题,实现数据迁移,从而为企业的商业智能分析奠定了数据基础,提升企业决策水平。

This article first introduces the development process of ES(Elasticsearch)and ETL(Extraction-Transformation-Loading)tools and the Kettle plug-in,and then uses two examples to show the Kettle plugin development solution that extracts data from ES,which supports ES cluster mode and authority authentication,and the problem of indistinguishable output stream of nested array fields is effectively solved by adding nested auto-increment fields,so that data migration between different databases can be achieved,which is able to lay a data foundation for business intelligence analysis of enterprises,and improve the level of enterprise decision-making.