Retreive all documents of specific index from ES with snapshot

Elastic Stack Elasticsearch
1

Hello, I want to extract all documents from ES index.

More than 6M documents are stored in target index.

In order to get all documents with scroll or search_after API, I have to send lots of search requests.

Many search requests caused high search latency of production search API and high data nodes JVMMemoryPressure.

I want to retrieve all the documents without affecting the production environment.

One of the methods I thought is using a snapshot of the ES cluster.

Is there any way to retrieve all documents of specific index from snapshot file?

Please help me!

2

Yes: restore the snapshot into a different cluster and use the regular search APIs. You could set up a dedicated cluster for this specific task.

3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.