Merge multiple Elasticsearch installations

Elastic Stack Elasticsearch
1

Greetings!

we have the current problem that for security reasons we have to run elk on premise without connection to the internet.
We now want to migrate the data of multiple installations to one "global" one .
Also the idea would be to do this on regular bases but only with the delta of the data since the last migration.
Is there a tool or concept for this kind of a problem ?

greetings
Mike

2

Hi Mike,

If you are able to mount an NFS directory to these nodes (maybe you have an internal one that isn't internet accessible?) then you could snapshot the data to this, and then add it as a repository and restore it to the new cluster.

If the global cluster is within your firewalls, you could also have the nodes join the global cluster, and then use allocation filtering to exclude the nodes you want to decommission, which will cause ES to move the data off of them onto your new cluster.

3

Hi Lee,

thanks for the reply.
Unfortunally there is no automated connection what so ever possible yet, we wanted to export the data and transfer it manual .
So for that szeanario you don´t see a possibilty ?

greetings

4

You could also use an external harddrive? (Depending on the size of the data for each node)

Sorry, sounds difficult with no connection.

5

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.