Transfer es index from dev environment to PROD

Elastic Stack Elasticsearch
1

current i am indexing 100GB of data in dev instance for testing. can i transfer this index to PROD and achieve the same search capabilities.

please advise.

2

You can use snapshot and restore, or you can reindex the data into the other cluster.

3

thanks, let me try out few these options. i used logstash to transfer from one index to other. but it is pretty slow.

input {
elasticsearch {
hosts => [ "aaa-bb-search-1:9200" ]
index => "type03"
scroll => "5m"
docinfo => true
scan => true
}
}

output {
elasticsearch {
hosts => ["localhost:9200"]
index => "type03"
}
stdout {
codec => "dots"
}
}

4

How slow?
Have you tried increasing the bulk size in the output, and/or adding workers?

5

pretty Slow i meant, the movement of index from one env to other takes the same time of the actual index.
indexing to dev es = 2 hours.
movement of the index from dev to other env = close to 2 hours.
i tired workers 5 for both the case.

but i haven't tried bulk size in the output. can you please let me know how to do that. thanks.

6

Because that is what is happening, you are reindexing.

7

Don't move the data, move the client.

Set up two clusters, and set up two client installations. If one is ready, turn that into production, and switch development to the other. If development is finished, turn development into production and switch back to the other for development, and so on. If you do this on the client installations, you don't have to move a single byte. This is blue-green deployment http://martinfowler.com/bliki/BlueGreenDeployment.html