# Three bigger data nodes or six smaller?

**URL:** <https://discuss.elastic.co/t/three-bigger-data-nodes-or-six-smaller/78694>\
**Category:** Elasticsearch\
**Created:** [March 15, 2017, 11:54am UTC](https://discuss.elastic.co/t/three-bigger-data-nodes-or-six-smaller/78694 "2017-03-15T11:54:18Z")\
**Posts on this page:** 8\
**Page:** 1

<div class="post-metadata">

**Author:** ![ivten](https://avatars.discourse-cdn.com/v4/letter/i/58956e/32.png) [@ivten](https://discuss.elastic.co/u/ivten)\
**Post date:** [March 15, 2017, 11:54am UTC](https://discuss.elastic.co/t/three-bigger-data-nodes-or-six-smaller/78694/1 "2017-03-15T11:54:18Z")

</div>

Hi,

I have the following dilemma. I've been provided with 3 hosts on which to run a virtualized Elasticsearch cluster. The problems is that if I want to run 3 masters and 6 datanodes each of the elasticsearch nodes ends up with just 2 vcpus and 16GB of RAM. Alternatively, I can run 3 masters and 3 datanodes thus ending up with more vcpus and more RAM per node, but less nodes in total.

1. Which is better in this case? More but less powerful nodes, or less but more powerful nodes?
2. Is 2 vcpus enough for elasticsearch node?
3. Will 8GB RAM for masters and 16GB for datanodes be enough?

I know I have to test the setup in order to know, but still any rough estimates will be of help.  
I will ingest between 300-500GB a day.

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [March 16, 2017, 7:51am UTC](https://discuss.elastic.co/t/three-bigger-data-nodes-or-six-smaller/78694/2 "2017-03-16T07:51:38Z")

</div>

Depends 😛

How large ate the physical nodes?

---

<div class="post-metadata">

**Author:** ![ivten](https://avatars.discourse-cdn.com/v4/letter/i/58956e/32.png) [@ivten](https://discuss.elastic.co/u/ivten)\
**Post date:** [March 16, 2017, 7:56am UTC](https://discuss.elastic.co/t/three-bigger-data-nodes-or-six-smaller/78694/3 "2017-03-16T07:56:28Z")

</div>

I have 3 hosts with 48GB RAM and 6 cores each.

The question is whether to put 1 master and 2 datanodes on each host. Or 1 master and 1 datanode. As said 300-500GB a day with no or little ingest transformation. I plan for the datanodes to do the ingesting.

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [March 16, 2017, 8:31am UTC](https://discuss.elastic.co/t/three-bigger-data-nodes-or-six-smaller/78694/4 "2017-03-16T08:31:29Z")

</div>

I'd say 1 master, 1 data.

---

<div class="post-metadata">

**Author:** ![ivten](https://avatars.discourse-cdn.com/v4/letter/i/58956e/32.png) [@ivten](https://discuss.elastic.co/u/ivten)\
**Post date:** [March 16, 2017, 12:31pm UTC](https://discuss.elastic.co/t/three-bigger-data-nodes-or-six-smaller/78694/5 "2017-03-16T12:31:40Z")

</div>

Okay, then I will consider running with 3 masters (2 cores 16 GB) and 3 datanodes (4 cores, 32 GB). Does it makes sense then to change the defaults 5 shards/1 replica? How many shard will be best then? 3 shards and 1 replica?

Also I assume it is alright for the masters and data to have different heap sizes.

One last question, should I make master and data nodes equal in terms of RAM and CPU if I can or should I give the datanodes more resources?

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [March 16, 2017, 7:04pm UTC](https://discuss.elastic.co/t/three-bigger-data-nodes-or-six-smaller/78694/6 "2017-03-16T19:04:29Z")

</div>

Your masters do not need to be that big, I wouldn't bother with anything more than 3-4GB of heap for them (ie 6-8GB RAM).

> [@ivten](#):
>
> Does it makes sense then to change the defaults 5 shards/1 replica? How many shard will be best then? 3 shards and 1 replica?

Depends, but 3 makes sense.

> [@ivten](#):
>
> One last question, should I make master and data nodes equal in terms of RAM and CPU if I can or should I give the datanodes more resources?

Give the data node more.

---

<div class="post-metadata">

**Author:** ![ivten](https://avatars.discourse-cdn.com/v4/letter/i/58956e/32.png) [@ivten](https://discuss.elastic.co/u/ivten)\
**Post date:** [March 27, 2017, 7:55am UTC](https://discuss.elastic.co/t/three-bigger-data-nodes-or-six-smaller/78694/7 "2017-03-27T07:55:22Z")

</div>

Okay, thanks! One last question (again):

Do you think 2 vcpus per master node will be enough?

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [April 24, 2017, 7:55am UTC](https://discuss.elastic.co/t/three-bigger-data-nodes-or-six-smaller/78694/8 "2017-04-24T07:55:40Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
