Data migration during ES Upgrade

[Srivastavark (Raj)]

Hi All,

I have two different cluster ES 1.4.4 and ES 2.4.0 , want to migrate single index (250GB) from old cluster to new cluster with default mapping and settings. Any Suggestion.

Regards
raj

[warkolm (Mark Walkom)]

Do an in place upgrade, or use snapshot and restore?

Why not upgrade to 5.X?

[mnozawa (Makoto Nozawa)]

Hi

How about Logstash Input / Output elasticsearch Plugin?

https://www.elastic.co/guide/en/logstash/2.4/plugins-inputs-elasticsearch.html
https://www.elastic.co/guide/en/logstash/2.4/plugins-outputs-elasticsearch.html

But I don't know much about version dependency, sorry.

[Srivastavark (Raj)]

Thanks Makoto. I am trying to re-index using Logstash Input / Output elasticsearch Plugin but frequently getting SearchContextMissingException.

--
input {
elasticsearch {
hosts => "sourceip:9200" # A
index => "testindex"
query => '{ "query": { "match_all": {} } }'
size => 5000
scroll => "20m"
docinfo => true

}
}
filter {
mutate{
remove_field => ["@version","@timestamp"]
}
}
output {
elasticsearch {
hosts => "destip:9200" # B
index => "%{[@metadata][_index]}"
document_type => "%{[@metadata][_type]}"
document_id => "%{[@metadata][_id]}"
}
}