# Cluster hardware setup

**URL:** <https://discuss.elastic.co/t/cluster-hardware-setup/225082>\
**Category:** Elasticsearch\
**Created:** [March 25, 2020, 11:36pm UTC](https://discuss.elastic.co/t/cluster-hardware-setup/225082 "2020-03-25T23:36:23Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![Miguel\_Plazas](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/miguel_plazas/32/40038_2.png) [@Miguel\_Plazas](https://discuss.elastic.co/u/Miguel_Plazas)\
**Post date:** [March 25, 2020, 11:36pm UTC](https://discuss.elastic.co/t/cluster-hardware-setup/225082/1 "2020-03-25T23:36:24Z")

</div>

Currently in a proyect we have 4 nodes, eachone with this specs:

- 10TB of HD
- 1TB of RAM
- 20 Cores of CPU

I would like to confirm that:

**Question 1:** It is a good idea to buy 6 Elasticsearch Platinum licenses for this nodes? **Note:** As i understand 1 license per node, will be let 2 licenses without use.

**Question 2:** It is a good idea the following configuration?

**node1, node2, and node3:**  
master: true  
data: true  
ingest: true  
ml: true

**node4:**  
master: false  
data: true  
ingest: true  
ml: true

**heap size max (all nodes):** 30 GB

**node 1 and 3:** rack\_1 , hot  
**node 2 and 4:** rack\_2 , warm

**Question 3:** I must avoid running multiple instances of Elasticsearch in same physical node, right?

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [March 26, 2020, 7:28am UTC](https://discuss.elastic.co/t/cluster-hardware-setup/225082/2 "2020-03-26T07:28:44Z")

</div>

Q1: you don't have the choice. Each node of the cluster will count in the amount of nodes you pay for.

Q2 and Q3: as you have so much RAM on each physical machine, I'd run:

- 3 dedicated master nodes
- 8 data only nodes (2 per machine)

What kind of use case are you going to run?

But as your intention is to buy a license, I'd definitely ask an elastic solution architect to help you designing it right according to your use case. May ECE would make sense here..

---

<div class="post-metadata">

**Author:** ![Miguel\_Plazas](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/miguel_plazas/32/40038_2.png) [@Miguel\_Plazas](https://discuss.elastic.co/u/Miguel_Plazas)\
**Post date:** [March 26, 2020, 1:58pm UTC](https://discuss.elastic.co/t/cluster-hardware-setup/225082/3 "2020-03-26T13:58:44Z")

</div>

Thanks! I'm really curious about this:

> [@dadoonet](#):
>
> Q2 and Q3: as you have so much RAM on each physical machine, I'd run:
> 
> - 3 dedicated master nodes
> - 8 data only nodes (2 per machine)

**Q1:** Should I run 3 instances of elasticsearch as dedicated **master** node on each physcal machine?

**Q2:** Should I run 2 instances of elasticsearch as dedicated **data** node on each physcal machine?

I took the training on Elasticsearch and got the certification, and as I understand It is not recommended to run multiple instances of Elastic in the same physical node.

**Q3:** Would be a good idea to virtualize each physical node? The target will be use as much RAM as possible.

> What kind of use case are you going to run?

Indexing and querying government documents with hyperconvergence

> [@dadoonet](#):
>
> But as your intention is to buy a license, I'd definitely ask an elastic solution architect to help you designing it right according to your use case. May ECE would make sense here..

The client bought 6 Elasticsearch Platinum Onpremise licenses without asking me 😅

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [March 26, 2020, 3:17pm UTC](https://discuss.elastic.co/t/cluster-hardware-setup/225082/4 "2020-03-26T15:17:21Z")

</div>

> Should I run 3 instances of elasticsearch as dedicated **master** node on each physcal machine?

One instance per node.

> Should I run 2 instances of elasticsearch as dedicated **data** node on each physcal machine?

Yes.

> [@Miguel\_Plazas](#):
>
> It is not recommended to run multiple instances of Elastic in the same physical node.

That's true as normally you have machines with at most 64gb of RAM. But here you have so many RAM available that I'd probably use it.  
If you do run multiple instances on the same machine, you need to be careful with shard allocation and make sure that primaries and replicas are not allocated on the same physical machine. That's something covered by the training as well (and that's very good that you attended the trainings!)

> Would be a good idea to virtualize each physical node? The target will be use as much RAM as possible.

I honestly don't know what would be the advantage.

> [@Miguel\_Plazas](#):
>
> Indexing and querying government documents with hyperconvergence

So mostly a search use case than index use case. I mean it's not about IOT and logs...

> [@Miguel\_Plazas](#):
>
> The client bought 6 Elasticsearch Platinum Onpremise licenses without asking me

That's fine then. I guess they have been in touch with solution architects.

As you have 6 licences, I'd do then:

- 1 instances of elasticsearch as dedicated **master** node on each physical machine
- 1 instances of elasticsearch as dedicated **data** node on each physical machine

Which makes 6 nodes in total.

HTH

---

<div class="post-metadata">

**Author:** ![Miguel\_Plazas](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/miguel_plazas/32/40038_2.png) [@Miguel\_Plazas](https://discuss.elastic.co/u/Miguel_Plazas)\
**Post date:** [March 26, 2020, 7:36pm UTC](https://discuss.elastic.co/t/cluster-hardware-setup/225082/5 "2020-03-26T19:36:14Z")

</div>

Thanks.

> [@dadoonet](#):
>
> f you do run multiple instances on the same machine, you need to be careful with shard allocation and make sure that primaries and replicas are not allocated on the same physical machine

Sure, I'll use shard allocation awareness in the cluster settings. Also use the rack attribute.

> [@dadoonet](#):
>
> I honestly don't know what would be the advantage.

I'm thinking about use **docker** to run the cluster. It's a good idea? Currently I just running using **linux tar.gz** files

> [@dadoonet](#):
>
> So mostly a search use case than index use case. I mean it's not about IOT and logs...

True only search and index use case.

**Q1:** It's a good idea I run a logstash instance on each physical node? To make the ingest and processing the data.

> [@dadoonet](#):
>
> That's fine then. I guess they have been in touch with solution architects.
> 
> As you have 6 licences, I'd do then:
> 
> - 1 instances of elasticsearch as dedicated **master** node on each physical machine
> - 1 instances of elasticsearch as dedicated **data** node on each physical machine
> 
> Which makes 6 nodes in total.

As I understand:

( **1 master + 1 data instance ) \* 4 physical nodes = 8 instances**

I'm correct?

Thanks for your help! 🙏

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [April 23, 2020, 7:36pm UTC](https://discuss.elastic.co/t/cluster-hardware-setup/225082/6 "2020-04-23T19:36:15Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
