# How to determine optimum RAM for an elasticsearch node

**URL:** https://discuss.elastic.co/t/how-to-determine-optimum-ram-for-an-elasticsearch-node/14051
**Category:** Elasticsearch
**Created:** [October 22, 2013, 6:30am UTC](https://discuss.elastic.co/t/how-to-determine-optimum-ram-for-an-elasticsearch-node/14051 "2013-10-22T06:30:03Z")
**Posts on this page:** 6
**Page:** 1

<div class="post-metadata">

### Author: ![subin](https://avatars.discourse-cdn.com/v4/letter/s/58956e/32.png) [@subin](https://discuss.elastic.co/u/subin)
#### Post date: [October 22, 2013, 6:30am UTC](https://discuss.elastic.co/t/how-to-determine-optimum-ram-for-an-elasticsearch-node/14051/1 "2013-10-22T06:30:03Z")

</div>

Hello,

I've been pondering over this for some time. Obviously RAM will depend on  
the total amount of indexes to span over. But what else are the other  
factors to consider? Assuming that at any time, ES has to search through 30  
days of indexes, amounting to about 250G, how could I take up calculations  
from here? let's say a single node with 1 shard/0 replica?

Thanks,

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

### Author: ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)
#### Post date: [October 22, 2013, 6:39am UTC](https://discuss.elastic.co/t/how-to-determine-optimum-ram-for-an-elasticsearch-node/14051/2 "2013-10-22T06:39:49Z")

</div>

It depends! 🙂

Seriously, facets are memory intensive for example. Sorting as well.  
So the answer is always: test it with your queries.

## (I know: it does not really help ☹ )

David 😉  
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 22 oct. 2013 à 08:30, subin [ksubins321@gmail.com](mailto:ksubins321@gmail.com) a écrit :

Hello,

I've been pondering over this for some time. Obviously RAM will depend on the total amount of indexes to span over. But what else are the other factors to consider? Assuming that at any time, ES has to search through 30 days of indexes, amounting to about 250G, how could I take up calculations from here? let's say a single node with 1 shard/0 replica?

## Thanks,

You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

### Author: ![subin](https://avatars.discourse-cdn.com/v4/letter/s/58956e/32.png) [@subin](https://discuss.elastic.co/u/subin)
#### Post date: [October 24, 2013, 3:16pm UTC](https://discuss.elastic.co/t/how-to-determine-optimum-ram-for-an-elasticsearch-node/14051/3 "2013-10-24T15:16:09Z")

</div>

David, this is the template that I use -  
[@fields separated, date analyzed and 2 time-formats · GitHub](https://gist.github.com/osssubb/6774727). There is no faceting to transform  
my data. I use Kibana to search the logs and sorting, is done on @timestamp  
field. Now, could there by an clues or pointers, still? Because I see  
optimal usage when no searches are being done but the usage of Heap memory  
shoots up when searches are done and the events start getting queued up on  
REDIS. In normal cases, when REDIS's queues are cleared off the memory  
usage is like 4-5Mb. When searches are done on ES(from Kibana) it grows to  
30Mb+.

* * *

Subin  
\*  
\*

On Tue, Oct 22, 2013 at 12:09 PM, David Pilato [david@pilato.fr](mailto:david@pilato.fr) wrote:

> It depends! 🙂
> 
> Seriously, facets are memory intensive for example. Sorting as well.  
> So the answer is always: test it with your queries.
> 
> ## (I know: it does not really help ☹ )
> 
> David 😉  
> Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs
> 
> Le 22 oct. 2013 à 08:30, subin [ksubins321@gmail.com](mailto:ksubins321@gmail.com) a écrit :
> 
> Hello,
> 
> I've been pondering over this for some time. Obviously RAM will depend on  
> the total amount of indexes to span over. But what else are the other  
> factors to consider? Assuming that at any time, ES has to search through 30  
> days of indexes, amounting to about 250G, how could I take up calculations  
> from here? let's say a single node with 1 shard/0 replica?
> 
> Thanks,
> 
> --  
> You received this message because you are subscribed to the Google Groups  
> "elasticsearch" group.  
> To unsubscribe from this group and stop receiving emails from it, send an  
> email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).
> 
> For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).
> 
> --  
> You received this message because you are subscribed to a topic in the  
> Google Groups "elasticsearch" group.  
> To unsubscribe from this topic, visit  
> [https://groups.google.com/d/topic/elasticsearch/7o2ZjRUYziE/unsubscribe](https://groups.google.com/d/topic/elasticsearch/7o2ZjRUYziE/unsubscribe).  
> To unsubscribe from this group and all its topics, send an email to  
> [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

### Author: ![subin](https://avatars.discourse-cdn.com/v4/letter/s/58956e/32.png) [@subin](https://discuss.elastic.co/u/subin)
#### Post date: [October 24, 2013, 3:23pm UTC](https://discuss.elastic.co/t/how-to-determine-optimum-ram-for-an-elasticsearch-node/14051/4 "2013-10-24T15:23:15Z")

</div>

from bigdesk I'm able to see an average of 1000 for indexing requests/s...

Thanks!

* * *

Subin  
\*  
\*

On Thu, Oct 24, 2013 at 8:46 PM, subin ks [ksubins321@gmail.com](mailto:ksubins321@gmail.com) wrote:

> David, this is the template that I use -  
> [@fields separated, date analyzed and 2 time-formats · GitHub](https://gist.github.com/osssubb/6774727). There is no faceting to  
> transform my data. I use Kibana to search the logs and sorting, is done on  
> @timestamp field. Now, could there by an clues or pointers, still? Because  
> I see optimal usage when no searches are being done but the usage of Heap  
> memory shoots up when searches are done and the events start getting queued  
> up on REDIS. In normal cases, when REDIS's queues are cleared off the  
> memory usage is like 4-5Mb. When searches are done on ES(from Kibana) it  
> grows to 30Mb+.
> 
> * * *
> 
> Subin  
> \*  
> \*
> 
> On Tue, Oct 22, 2013 at 12:09 PM, David Pilato [david@pilato.fr](mailto:david@pilato.fr) wrote:
> 
> > It depends! 🙂
> > 
> > Seriously, facets are memory intensive for example. Sorting as well.  
> > So the answer is always: test it with your queries.
> > 
> > ## (I know: it does not really help ☹ )
> > 
> > David 😉  
> > Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs
> > 
> > Le 22 oct. 2013 à 08:30, subin [ksubins321@gmail.com](mailto:ksubins321@gmail.com) a écrit :
> > 
> > Hello,
> > 
> > I've been pondering over this for some time. Obviously RAM will depend on  
> > the total amount of indexes to span over. But what else are the other  
> > factors to consider? Assuming that at any time, ES has to search through 30  
> > days of indexes, amounting to about 250G, how could I take up calculations  
> > from here? let's say a single node with 1 shard/0 replica?
> > 
> > Thanks,
> > 
> > --  
> > You received this message because you are subscribed to the Google Groups  
> > "elasticsearch" group.  
> > To unsubscribe from this group and stop receiving emails from it, send an  
> > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).
> > 
> > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).
> > 
> > --  
> > You received this message because you are subscribed to a topic in the  
> > Google Groups "elasticsearch" group.  
> > To unsubscribe from this topic, visit  
> > [https://groups.google.com/d/topic/elasticsearch/7o2ZjRUYziE/unsubscribe](https://groups.google.com/d/topic/elasticsearch/7o2ZjRUYziE/unsubscribe).  
> > To unsubscribe from this group and all its topics, send an email to  
> > [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

### Author: ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)
#### Post date: [October 24, 2013, 5:31pm UTC](https://discuss.elastic.co/t/how-to-determine-optimum-ram-for-an-elasticsearch-node/14051/5 "2013-10-24T17:31:26Z")

</div>

So you use Kibana? Then probably behind the scene you use facets (histogram panel, terms panel…)  
Facets use a lot of memory.

--  
David Pilato | Technical Advocate | [Elasticsearch.com](http://Elasticsearch.com)  
@dadoonet | @elasticsearchfr | @scrutmydocs

Le 24 oct. 2013 à 17:16, subin ks [ksubins321@gmail.com](mailto:ksubins321@gmail.com) a écrit :

> David, this is the template that I use - [@fields separated, date analyzed and 2 time-formats · GitHub](https://gist.github.com/osssubb/6774727). There is no faceting to transform my data. I use Kibana to search the logs and sorting, is done on @timestamp field. Now, could there by an clues or pointers, still? Because I see optimal usage when no searches are being done but the usage of Heap memory shoots up when searches are done and the events start getting queued up on REDIS. In normal cases, when REDIS's queues are cleared off the memory usage is like 4-5Mb. When searches are done on ES(from Kibana) it grows to 30Mb+.
> 
> * * *
> 
> Subin
> 
> On Tue, Oct 22, 2013 at 12:09 PM, David Pilato [david@pilato.fr](mailto:david@pilato.fr) wrote:  
> It depends! 🙂
> 
> Seriously, facets are memory intensive for example. Sorting as well.  
> So the answer is always: test it with your queries.
> 
> ## (I know: it does not really help ☹ )
> 
> David 😉  
> Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs
> 
> Le 22 oct. 2013 à 08:30, subin [ksubins321@gmail.com](mailto:ksubins321@gmail.com) a écrit :
> 
> Hello,
> 
> I've been pondering over this for some time. Obviously RAM will depend on the total amount of indexes to span over. But what else are the other factors to consider? Assuming that at any time, ES has to search through 30 days of indexes, amounting to about 250G, how could I take up calculations from here? let's say a single node with 1 shard/0 replica?
> 
> Thanks,
> 
> --  
> You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
> To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).
> 
> For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).
> 
> --  
> You received this message because you are subscribed to a topic in the Google Groups "elasticsearch" group.  
> To unsubscribe from this topic, visit [https://groups.google.com/d/topic/elasticsearch/7o2ZjRUYziE/unsubscribe](https://groups.google.com/d/topic/elasticsearch/7o2ZjRUYziE/unsubscribe).  
> To unsubscribe from this group and all its topics, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).
> 
> --  
> You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
> To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [July 6, 2017, 2:10am UTC](https://discuss.elastic.co/t/how-to-determine-optimum-ram-for-an-elasticsearch-node/14051/6 "2017-07-06T02:10:44Z")

</div>


