How to migrate data from v5.4 to v8.x.x

Elastic Stack Elasticsearch
1

Hi ES Community,

I have few question, i have to migrate ES v5.4 data into latest ES version(v8.x). What would be correct step for this kind data migration?

Should i use elasticdump tool to migrate data from old cluster(v5.4) to new cluster(v5.4) then perform the rolling upgrade?

Is there any other option to directly migrate data from old cluster(v5.4) to new cluster(v8.x.x)?

Thanks
Sonu

2

When moving to Elasticsearch 8.7 (latest as of writing) from such an old version you basically have 2 options as a lot has changed in the several major versions in between.

  1. Set everything (templates, mappings etc) up in a new Elasticsearch 8.7 cluster and run a reindex from remote. You can probably also use elasticdump if you prefer this. Note that you most likely also will need to upgrade client libraries at the same time so this will all require downtime.
  2. You can also migrate in place, although this gets complicated with so many jumps as Elasticsearch only supports one major version upgrade at a time after which data will need to be reindexed. This would therefore require quite a few steps (5.4 -> 6.8 -> (run migration assistant) -> (reindex) -> 7.17 -> (run migration assistant) -> (reindex) -> 8.7) and can be time consuming. In this scenario client libraries will also need to be upgraded/changed.
1 Like
3

Hi,

Thanks for suggesting the options. Let me follow the option2 because mostly to upgrade the ES version I have been using that way only. If i encounter any issue then again i will take your side advice.

Thanks
Sonu

4

I would recommend option 1 as it requires fewer steps and probably less changes to clients.

5

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.