Best way to copy very large index

Elastic Stack Elasticsearch
1

Hi all,

just a short question regarding copying a very large index.
The index has ca. 400,000,000 to 500,000,000 documents.

I tried it via _reindex but here it took 30 minutes for 4,000,000 documents.
Are there any methods to speed things up?

I am running on a elasticsearch version 5.2.2. :slight_smile:

Regards
Anna

2

Are you looking to create a copy in the same cluster?

3

Yes exactly :slight_smile:

4

I have done this in the past by creating a snapshot and then renaming the index as I restore it back. That will copy full segment files and should be faster than reindexing.

5

ah okay, nice idea :slight_smile:
Do you have kind of a tutorial of how to do this? :slight_smile:

6

It is all covered in the documentation. The second example under the restore section shows how you can rename the index you are restoring.

7

Thank you very much! I will test this one :slight_smile:

8

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.