# Elastic Cluster planning - hardware

**URL:** <https://discuss.elastic.co/t/elastic-cluster-planning-hardware/146857>\
**Category:** Elasticsearch\
**Created:** [August 31, 2018, 11:24am UTC](https://discuss.elastic.co/t/elastic-cluster-planning-hardware/146857 "2018-08-31T11:24:17Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![varunarathinam](https://avatars.discourse-cdn.com/v4/letter/v/d07c76/32.png) [@varunarathinam](https://discuss.elastic.co/u/varunarathinam)\
**Post date:** [August 31, 2018, 11:24am UTC](https://discuss.elastic.co/t/elastic-cluster-planning-hardware/146857/1 "2018-08-31T11:24:17Z")

</div>

Hi,

Here we plan to create cluster of elk. Our current sceranio is;  
Daily data size would be 500 GB;  
Monthly around 15TB  
Data are generated and pushed to index.  
we need cluster of nodes and hardware requirements for this above scenario;  
Please help me how would i plan based on our requirement details;

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [August 31, 2018, 12:45pm UTC](https://discuss.elastic.co/t/elastic-cluster-planning-hardware/146857/2 "2018-08-31T12:45:23Z")

</div>

I suspect you have a type there as 500GB raw data per dat would result in about 15TB raw data per month, not 1.5TB. One important aspect when sizing a cluster is how long you are going to keep your data in the cluster as this drives the total amount of data that need to be stored. Please also have a look at [this blog post around sizing logging and metrics clusters](https://www.elastic.co/blog/sizing-hot-warm-architectures-for-logging-and-metrics-in-the-elasticsearch-service-on-elastic-cloud). It links to most of the additional resources I recommend on the topic.

---

<div class="post-metadata">

**Author:** ![varunarathinam](https://avatars.discourse-cdn.com/v4/letter/v/d07c76/32.png) [@varunarathinam](https://discuss.elastic.co/u/varunarathinam)\
**Post date:** [August 31, 2018, 12:51pm UTC](https://discuss.elastic.co/t/elastic-cluster-planning-hardware/146857/3 "2018-08-31T12:51:22Z")

</div>

Hi,

Thanks for the response christian!!!. Yeah we kept data around 1 month, we need to process the data machine learning prediction and future purpose. Can please give me some advice, i dont know, how to assign number master nodes and data nodes;  
pls help me;

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [August 31, 2018, 12:54pm UTC](https://discuss.elastic.co/t/elastic-cluster-planning-hardware/146857/4 "2018-08-31T12:54:28Z")

</div>

Did you go through the blog post I linked to?

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [September 28, 2018, 12:54pm UTC](https://discuss.elastic.co/t/elastic-cluster-planning-hardware/146857/5 "2018-09-28T12:54:36Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
