# Methodology for merge data nodes to big one

**URL:** https://discuss.elastic.co/t/methodology-for-merge-data-nodes-to-big-one/323823
**Category:** Elasticsearch
**Tags:** docker
**Created:** [January 24, 2023, 12:29pm UTC](https://discuss.elastic.co/t/methodology-for-merge-data-nodes-to-big-one/323823 "2023-01-24T12:29:03Z")
**Posts on this page:** 5
**Page:** 1

<div class="post-metadata">

### Author: ![INS](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ins/32/92827_2.png) [@INS](https://discuss.elastic.co/u/INS)
#### Post date: [January 24, 2023, 12:29pm UTC](https://discuss.elastic.co/t/methodology-for-merge-data-nodes-to-big-one/323823/1 "2023-01-24T12:29:03Z")

</div>

Hi I need to change architecture of my cluster, thus I need to know Your's idea/approaches to do this.

So currently my cluster consist on 3 bare metal server with sdd and hdd disk.  
But I need to increase memory of these nodes therefore it's needed to merge the data nodes.  
Can You keep an eye on below schema of my cluster

 ![merge elasticsearch data node](https://us1.discourse-cdn.com/elastic/original/3X/e/1/e15a8a9f391f2d0cabc4a1df8bb5696f3dbca123.png)  
One node is releated to one physical disk ---\> this is the currently configuration.

As fist it will be changed file system to merge the disk but what should I do with data??? Do we have any dedicated plugin?

---

<div class="post-metadata">

### Author: ![leandrojmp](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/leandrojmp/32/107231_2.png) [@leandrojmp](https://discuss.elastic.co/u/leandrojmp)
#### Post date: [January 24, 2023, 1:07pm UTC](https://discuss.elastic.co/t/methodology-for-merge-data-nodes-to-big-one/323823/2 "2023-01-24T13:07:20Z")

</div>

Can you provide more context about your infrastructure?

You have 3 bare metals and the nodes you shared in this image are virtual machines running on those bare metals?

For example, if you need to remove the nodes `data hot1_1`, `data hot2_1` and `data hot3_1` to create a new node named `data hot123_1` you will need to first remove all the data from these 3 nodes and allocate the data in the remaining data hot nodes, when there is no shard on those nodes you can remove them from the cluster and add the new node.

This [documentation](https://www.elastic.co/guide/en/elasticsearch/reference/current/modules-cluster.html#cluster-shard-allocation-filtering).

This is the first thing you need to do, you can't merge the disks while the nodes are running and have data, if you do that you will lose data, you need to remove the nodes from allocation, remove them from cluster, create your new node, add the new node to the cluster, wait for the rebalance to finish and them repeat this for all your other nodes.

You also need to have enough available space in the other nodes to allocate the shards.

---

<div class="post-metadata">

### Author: ![INS](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ins/32/92827_2.png) [@INS](https://discuss.elastic.co/u/INS)
#### Post date: [January 24, 2023, 2:08pm UTC](https://discuss.elastic.co/t/methodology-for-merge-data-nodes-to-big-one/323823/3 "2023-01-24T14:08:26Z")

</div>

> [@leandrojmp](#):
>
> For example, if you need to remove the nodes `data hot1_1`, `data hot2_1` and `data hot3_1` to create a new node named `data hot123_1` you will need to first remove all the data from these 3 nodes

so theses nodes are docker containers, How can I exclude this for ex 3 nodes so as to smush the data for allocation to the other two sites.

```auto
PUT _cluster/settings
{
  "persistent" : {
    "cluster.routing.allocation.exclude._name" : "data hot1_1, data hot2_1, data hot3_1"
  }
}

```

Does elasticsearch in 8.1 support multidisk ? It means that on nodes can covers a few dir for store data from one node

---

<div class="post-metadata">

### Author: ![leandrojmp](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/leandrojmp/32/107231_2.png) [@leandrojmp](https://discuss.elastic.co/u/leandrojmp)
#### Post date: [January 24, 2023, 3:52pm UTC](https://discuss.elastic.co/t/methodology-for-merge-data-nodes-to-big-one/323823/4 "2023-01-24T15:52:10Z")

</div>

> [@INS](#):
>
> How can I exclude this for ex 3 nodes so as to smush the data for allocation to the other two sites.

I do not use docker, but the logic is the same you need to exclude from allocation the nodes you want to remove, you can exclude them by name or id as well, it is in the documentation.

> [@INS](#):
>
> Does elasticsearch in 8.1 support multidisk ? It means that on nodes can covers a few dir for store data from one node

This is multipath, it is still supported but it is deprecated and will be removed in the future you should avoid start using it now.

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [February 21, 2023, 3:52pm UTC](https://discuss.elastic.co/t/methodology-for-merge-data-nodes-to-big-one/323823/5 "2023-02-21T15:52:42Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
