Migration

[barvepan]

We are using elasticsearch 1.5.3 with default configuration i.e. one cluster with one node. We are planning to migrate it to one cluster with 3 nodes.

Can someone please guide us on the steps. Is there any quick way to do this via Elastic to Elastic via using command line.

Thanks in advance

[Tek_Chand]

@barvepan, First You need to install the elasticserach (same version ) on all the new nodes. Then you can add the new node in your existing cluster. You can refer the below link:

https://logz.io/blog/elasticsearch-cluster-tutorial/

Let me know if you have any query.

Thanks.

[barvepan]

Thanks. is it possible to migrate data to entirely new cluster with new nodes instead of creating new node and attach it back to existing cluster.

[Tek_Chand]

@barvepan,

@barvepan

is it possible to migrate data to entirely new cluster with new nodes instead of creating new node and attach it back to existing cluster.

You can take snapshots and restore them its only way of backup your data in elasticserach. You need to check the compatibility also of your old elaticserach version and new elasticserach version.

Thanks.

[Christian_Dahlqvist]

You might also be able to reindex from remote.

[barvepan]

Thanks for response.

As, I explained earlier, we have (elasticsearch 1.5.2) with default configuration i.e. one cluster with one node. We are planning to migrate it to one cluster with 3 nodes.

We decided to add new nodes 1 master and 1 data node. I assume its just configurations in elasticsearch.yml file. Just have few questions,

1. what value we should give to discovery.zen.minimum_master_nodes . We want 3 nodes cluster ( 2 master +data nodes and 1 only data node )

2. While doing this configuration and settings do we need to take backup of existing data. Is there any chance of losing data in all these configurations.

3. I assume, after adding new nodes to existing cluster, elastic search will take care of distributing data across all nodes.

Please help.

Thanks,

[barvepan]

Thanks for response.

As, I explained earlier, we have (elasticsearch 1.5.2) with default configuration i.e. one cluster with one node. We are planning to migrate it to one cluster with 3 nodes.

We decided to add new nodes 1 master and 1 data node. I assume its just configurations in elasticsearch.yml file. Just have few questions,

1. what value we should give to discovery.zen.minimum_master_nodes . We want 3 nodes cluster ( 2 master +data nodes and 1 only data node )
2. While doing this configuration and settings do we need to take backup of existing data. Is there any chance of losing data in all these configurations.
3. I assume, after adding new nodes to existing cluster, elastic search will take care of distributing data across all nodes.

Please help.

Thanks,

[Tek_Chand]

@Barvepan,

@barvepan

what value we should give to discovery.zen.minimum_master_nodes . We want 3 nodes cluster ( 2 master +data nodes and 1 only data node )

Its value calculate using the formula N/2+1. Where N is the number of master node. To avoid from split brain problem we should have minimum 3 master node. Then discovery.zen.minimum_master_nodes value will be 2 (3/2+1=2).

@barvepan

While doing this configuration and settings do we need to take backup of existing data. Is there any chance of losing data in all these configurations.

Yes, you need to take the backup of your data. Because when you upgrade your ELK all data will be lost. I am not sure whether you can restore the elasticserach1.5.2 snapshots in latest elasticsearch or not. The latest elasticsearch version is 6.5.0.

@barvepan

I assume, after adding new nodes to existing cluster, Elasticsearch will take care of distributing data across all nodes.

Yes, when you have multiple data node in your cluster the elasticsearch itself take care of data distributing across all data nodes.

Kindly let me know if i can help you more.

Thanks.