ES_HEAP_SIZE Size with 10k Doc's (5 MB total)?

Elastic Stack Elasticsearch
1

I've read a lot of ES Performance Guides and most of them suggest setting
the ES_HEAP_SIZE to half the RAM, but not more than 32 GB.

ES is running on a Server with 32 GB of RAM, with nginx, php5-fpm and mysql
on this machine and i'm only indexing around 10.000 Documents with a total
size of 5 MB.

The Index will probably grow to around 20.000 - 30.000 (10 - 15 MB)
Documents in the near future, but thats - compared to other clusters - is
still a fairly small amount of data.

I dont have heavy traffic nor i'm doing crazy searches.

Most types are not_analyzed, because i'm primarily using ES for filtering,
aggregations and sorting, full text search is just a minor benefit for me,
but it would be crazy doing all the filtering with mysql and not with ES.

Setting the ES_HEAP_SIZE to around 16 GB seems a bit of an overkill for my
usecase, but since i'm using filters (which are cacheable) and doing
aggregations with sorting, setting the ES_HEAP_SIZE at around 2 GB feels
kinda right for me, but i'm not sure if i'm missing something here.

Any reccommendation on the ES_HEAP_SIZE with a small number of documents is
really appreciated, thanks!

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/f4a5b85b-d50e-4a29-837e-945c21fbd99f%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

2

Indeed. Start small 1gb or 2 and monitor your usage.
Increase if you see your HEAP usage going up to 75%/80%.

My 2 cents.

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 2 avr. 2015 à 15:28, Arno Nühm arkste@gmail.com a écrit :

I've read a lot of ES Performance Guides and most of them suggest setting the ES_HEAP_SIZE to half the RAM, but not more than 32 GB.

ES is running on a Server with 32 GB of RAM, with nginx, php5-fpm and mysql on this machine and i'm only indexing around 10.000 Documents with a total size of 5 MB.
The Index will probably grow to around 20.000 - 30.000 (10 - 15 MB) Documents in the near future, but thats - compared to other clusters - is still a fairly small amount of data.

I dont have heavy traffic nor i'm doing crazy searches.
Most types are not_analyzed, because i'm primarily using ES for filtering, aggregations and sorting, full text search is just a minor benefit for me, but it would be crazy doing all the filtering with mysql and not with ES.

Setting the ES_HEAP_SIZE to around 16 GB seems a bit of an overkill for my usecase, but since i'm using filters (which are cacheable) and doing aggregations with sorting, setting the ES_HEAP_SIZE at around 2 GB feels kinda right for me, but i'm not sure if i'm missing something here.

Any reccommendation on the ES_HEAP_SIZE with a small number of documents is really appreciated, thanks!

You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/f4a5b85b-d50e-4a29-837e-945c21fbd99f%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/3C2D6FEA-FF94-446B-9F35-A913C2C3F8DA%40pilato.fr.
For more options, visit https://groups.google.com/d/optout.