elasticsearch导入导出工具elasticdump安装和使用小记

发布时间：2020-08-07 20:42:50 作者：chenfeng
来源：ITPUB博客阅读：564

首选需要安装npm工具，具体可参考:

https://www.runoob.com/nodejs/nodejs-npm.html

开始安装elasticdump:

# npm install elasticdump -g

/usr/bin/elasticdump -> /usr/lib/node_modules/elasticdump/bin/elasticdump

/usr/bin/multielasticdump -> /usr/lib/node_modules/elasticdump/bin/multielasticdump

/usr/lib

└─┬ elasticdump@3.3.19

├── async@2.6.1

├─┬ aws-sdk@2.303.0

│ ├─┬ buffer@4.9.1

│ │ ├── base64-js@1.3.0

│ │ └── isarray@1.0.0

│ ├── events@1.1.1

│ ├── ieee754@1.1.8

│ ├── jmespath@0.15.0

│ ├── querystring@0.2.0

│ ├── sax@1.2.1

│ ├─┬ url@0.10.3

│ │ └── punycode@1.3.2

│ ├── uuid@3.1.0

│ └─┬ xml2js@0.4.19

│ └── xmlbuilder@9.0.7

├── aws4@1.8.0

├── decimal.js@10.0.1

├── ini@1.3.5

├─┬ JSONStream@1.3.4

│ ├── jsonparse@1.3.1

│ └── through@2.3.8

├── lodash@4.17.10

├── lossless-json@1.0.3

├─┬ optimist@0.6.1

│ ├── minimist@0.0.10

│ └── wordwrap@0.0.3

└─┬ request@2.88.0

├── aws-sign2@0.7.0

├── caseless@0.12.0

├─┬ combined-stream@1.0.6

│ └── delayed-stream@1.0.0

├── extend@3.0.2

├── forever-agent@0.6.1

├─┬ form-data@2.3.2

│ └── asynckit@0.4.0

├─┬ har-validator@5.1.0

│ ├─┬ ajv@5.5.2

│ │ ├── co@4.6.0

│ │ ├── fast-deep-equal@1.1.0

│ │ ├── fast-json-stable-stringify@2.0.0

│ │ └── json-schema-traverse@0.3.1

│ └── har-schema@2.0.0

├─┬ http-signature@1.2.0

│ ├── assert-plus@1.0.0

│ ├─┬ jsprim@1.4.1

│ │ ├── extsprintf@1.3.0

│ │ ├── json-schema@0.2.3

│ │ └─┬ verror@1.10.0

│ │ └── core-util-is@1.0.2

│ └─┬ sshpk@1.14.2

│ ├── asn1@0.2.4

│ ├── bcrypt-pbkdf@1.0.2

│ ├── dashdash@1.14.1

│ ├── ecc-jsbn@0.1.2

│ ├── getpass@0.1.7

│ ├── jsbn@0.1.1

│ ├── safer-buffer@2.1.2

│ └── tweetnacl@0.14.5

├── is-typedarray@1.0.0

├── isstream@0.1.2

├── json-stringify-safe@5.0.1

├─┬ mime-types@2.1.20

│ └── mime-db@1.36.0

├── oauth-sign@0.9.0

├── performance-now@2.1.0

├── qs@6.5.2

├── safe-buffer@5.1.2

├─┬ tough-cookie@2.4.3

│ ├── psl@1.1.29

│ └── punycode@1.4.1

├── tunnel-agent@0.6.0

└── uuid@3.3.2

导出es数据方法例子:

# elasticdump --input=http://192.168.0.1:9200/test --output=/data/elas_backup/test.json --type=data

Tue, 28 Aug 2018 09:15:54 GMT | starting dump

Tue, 28 Aug 2018 09:15:55 GMT | got 100 objects from source elasticsearch (offset: 0)

Tue, 28 Aug 2018 09:15:55 GMT | sent 100 objects to destination file, wrote 100

Tue, 28 Aug 2018 09:15:55 GMT | got 100 objects from source elasticsearch (offset: 100)

Tue, 28 Aug 2018 09:15:55 GMT | sent 100 objects to destination file, wrote 100

Tue, 28 Aug 2018 09:15:55 GMT | got 100 objects from source elasticsearch (offset: 200)

Tue, 28 Aug 2018 09:15:55 GMT | sent 100 objects to destination file, wrote 100

................................................................................................................................................................................

导入es数据方法例子:

# elasticdump --input=/data/elas_backup/test.json --output=http://192.168.0.1:9200 --type=data

Tue, 28 Aug 2018 09:15:54 GMT | starting dump

Tue, 28 Aug 2018 09:15:55 GMT | got 100 objects from source elasticsearch (offset: 0)

Tue, 28 Aug 2018 09:15:55 GMT | sent 100 objects to destination file, wrote 100

................................................................................................................................................................................

从一个索引的数据迁移到另外一个索引的数据:

# elasticdump --ignore-errors=true --scrollTime=120m --bulk=true --input=http://192.168.0.1:9200/test --output=http://192.168.0.1:9200/chenfeng --type=data

备注:

--ignore-errors=true --scrollTime=120m --bulk=true 是批量导入参数

导出表结构mapping:

# elasticdump --input=http://192.168.0.1:9200/test --output=test-mapping.json --type=mapping

Wed, 29 Aug 2018 09:01:41 GMT | starting dump

Wed, 29 Aug 2018 09:01:42 GMT | got 1 objects from source elasticsearch (offset: 0)

Wed, 29 Aug 2018 09:01:42 GMT | sent 1 objects to destination file, wrote 1

Wed, 29 Aug 2018 09:01:42 GMT | got 0 objects from source elasticsearch (offset: 1)

Wed, 29 Aug 2018 09:01:42 GMT | Total Writes: 1

Wed, 29 Aug 2018 09:01:42 GMT | dump complete

elasticsearch导入导出工具elasticdump安装和使用小记

相关阅读