# Where is all my memory? Or how to estimate better **URL:** \ **Category:** Elasticsearch\ **Created:** [July 25, 2014, 2:10pm UTC](https://discuss.elastic.co/t/where-is-all-my-memory-or-how-to-estimate-better/18903 "2014-07-25T14:10:22Z")\ **Posts on this page:** 5\ **Page:** 1
**Author:** ![Daniel\_Schonfeld](https://avatars.discourse-cdn.com/v4/letter/d/b4bc9f/32.png) [@Daniel\_Schonfeld](https://discuss.elastic.co/u/Daniel_Schonfeld)\ **Post date:** [July 25, 2014, 2:10pm UTC](https://discuss.elastic.co/t/where-is-all-my-memory-or-how-to-estimate-better/18903/1 "2014-07-25T14:10:22Z")
Hello, So I've replaced some machines we had with more memory and it seems to have helped but I'm starting to see some high memory usage on one of the machines. What I don't understand and can't figure out is where that memory is being used? We have 26GB RAM, allocating 13.5G for the ES\_HEAP\_SIZE. Looking at `top` it currently shows the java process to be using (RES) 22G and using `free` I confirm that there is only 3172M available. One would conclude that ES is using it all as shown by top. And yes that makes sense, but it's not translating to performance of my queries by caching them and even more so, when I look in marvel I see the following stats for that one node. JVM Heap Usage: 36% OS Memory: 87% And here's the interesting parts: Indices Field Data: 427,577,836 Indices Filter Cache: 54,641,296 Indices Lucene Memory: 308,679,803 Field Data Circuit Breaker Estimated Size: 428,615,926 No field data evictions at all. 0.00 So where then is all my memory being used? This doesn't add up to 22GB - not even close. Thanks for all your help! Daniel -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/1300cc7b-016f-4a3b-8df9-7b041e80607a%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/1300cc7b-016f-4a3b-8df9-7b041e80607a%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![jprante](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jprante/32/44941_2.png) [@jprante](https://discuss.elastic.co/u/jprante)\ **Post date:** [July 25, 2014, 3:02pm UTC](https://discuss.elastic.co/t/where-is-all-my-memory-or-how-to-estimate-better/18903/2 "2014-07-25T15:02:28Z")
What OS / version is this? Jörg On Fri, Jul 25, 2014 at 4:10 PM, Daniel Schonfeld [downwindabeam@gmail.com](mailto:downwindabeam@gmail.com) wrote: > Hello, > > So I've replaced some machines we had with more memory and it seems to > have helped but I'm starting to see some high memory usage on one of the > machines. What I don't understand and can't figure out is where that > memory is being used? > > We have 26GB RAM, allocating 13.5G for the ES\_HEAP\_SIZE. Looking at `top` > it currently shows the java process to be using (RES) 22G and using `free` > I confirm that there is only 3172M available. > > One would conclude that ES is using it all as shown by top. And yes that > makes sense, but it's not translating to performance of my queries by > caching them and even more so, when I look in marvel I see the following > stats for that one node. > > JVM Heap Usage: 36% > OS Memory: 87% > > And here's the interesting parts: > > Indices Field Data: 427,577,836 > Indices Filter Cache: 54,641,296 > Indices Lucene Memory: 308,679,803 > > Field Data Circuit Breaker Estimated Size: 428,615,926 > No field data evictions at all. 0.00 > > So where then is all my memory being used? This doesn't add up to 22GB - > not even close. > > Thanks for all your help! > Daniel > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/1300cc7b-016f-4a3b-8df9-7b041e80607a%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/1300cc7b-016f-4a3b-8df9-7b041e80607a%40googlegroups.com) > [https://groups.google.com/d/msgid/elasticsearch/1300cc7b-016f-4a3b-8df9-7b041e80607a%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/1300cc7b-016f-4a3b-8df9-7b041e80607a%40googlegroups.com?utm_medium=email&utm_source=footer) > . > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAKdsXoGAuY2GDKJuUo9HQ\_iJ4bjLOYHZiUeWbkhQ13N81dhXSw%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAKdsXoGAuY2GDKJuUo9HQ_iJ4bjLOYHZiUeWbkhQ13N81dhXSw%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![Daniel\_Schonfeld](https://avatars.discourse-cdn.com/v4/letter/d/b4bc9f/32.png) [@Daniel\_Schonfeld](https://discuss.elastic.co/u/Daniel_Schonfeld)\ **Post date:** [July 25, 2014, 5:19pm UTC](https://discuss.elastic.co/t/where-is-all-my-memory-or-how-to-estimate-better/18903/3 "2014-07-25T17:19:24Z")
CoreOS, 367.1.0. Docker 1.0.1 and ES 1.2.2 I don't know if it matters but we are using this plugin which is not written by elasticsearch: [GitHub - Asquera/elasticsearch-http-basic: HTTP Basic Authentication for Elasticsearch (Discontinued)](https://github.com/Asquera/elasticsearch-http-basic) On Friday, July 25, 2014 11:02:40 AM UTC-4, Jörg Prante wrote: > What OS / version is this? > > Jörg > > On Fri, Jul 25, 2014 at 4:10 PM, Daniel Schonfeld \<[downwi...@gmail.com](mailto:downwi...@gmail.com) > \\> wrote: > > > Hello, > > > > So I've replaced some machines we had with more memory and it seems to > > have helped but I'm starting to see some high memory usage on one of the > > machines. What I don't understand and can't figure out is where that > > memory is being used? > > > > We have 26GB RAM, allocating 13.5G for the ES\_HEAP\_SIZE. Looking at > > `top` it currently shows the java process to be using (RES) 22G and using > > `free` I confirm that there is only 3172M available. > > > > One would conclude that ES is using it all as shown by top. And yes that > > makes sense, but it's not translating to performance of my queries by > > caching them and even more so, when I look in marvel I see the following > > stats for that one node. > > > > JVM Heap Usage: 36% > > OS Memory: 87% > > > > And here's the interesting parts: > > > > Indices Field Data: 427,577,836 > > Indices Filter Cache: 54,641,296 > > Indices Lucene Memory: 308,679,803 > > > > Field Data Circuit Breaker Estimated Size: 428,615,926 > > No field data evictions at all. 0.00 > > > > So where then is all my memory being used? This doesn't add up to 22GB - > > not even close. > > > > Thanks for all your help! > > Daniel > > > > -- > > You received this message because you are subscribed to the Google Groups > > "elasticsearch" group. > > To unsubscribe from this group and stop receiving emails from it, send an > > email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com) \. > > To view this discussion on the web visit > > [https://groups.google.com/d/msgid/elasticsearch/1300cc7b-016f-4a3b-8df9-7b041e80607a%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/1300cc7b-016f-4a3b-8df9-7b041e80607a%40googlegroups.com) > > [https://groups.google.com/d/msgid/elasticsearch/1300cc7b-016f-4a3b-8df9-7b041e80607a%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/1300cc7b-016f-4a3b-8df9-7b041e80607a%40googlegroups.com?utm_medium=email&utm_source=footer) > > . > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/000000af-cb3d-4075-a410-955bc8a96c74%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/000000af-cb3d-4075-a410-955bc8a96c74%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![Daniel\_Schonfeld](https://avatars.discourse-cdn.com/v4/letter/d/b4bc9f/32.png) [@Daniel\_Schonfeld](https://discuss.elastic.co/u/Daniel_Schonfeld)\ **Post date:** [July 25, 2014, 5:21pm UTC](https://discuss.elastic.co/t/where-is-all-my-memory-or-how-to-estimate-better/18903/4 "2014-07-25T17:21:40Z")
I should also mention that machine which is now low on memory and how gotten worse, is suffering form high CPU usage too which comes right on time with the memory getting low. It's a 4 core machine. Google compute engine - n1-highmem-4. On Friday, July 25, 2014 1:19:24 PM UTC-4, Daniel Schonfeld wrote: > CoreOS, 367.1.0. Docker 1.0.1 and ES 1.2.2 > > I don't know if it matters but we are using this plugin which is not > written by elasticsearch: > [GitHub - Asquera/elasticsearch-http-basic: HTTP Basic Authentication for Elasticsearch (Discontinued)](https://github.com/Asquera/elasticsearch-http-basic) > > On Friday, July 25, 2014 11:02:40 AM UTC-4, Jörg Prante wrote: > > > What OS / version is this? > > > > Jörg > > > > On Fri, Jul 25, 2014 at 4:10 PM, Daniel Schonfeld [downwi...@gmail.com](mailto:downwi...@gmail.com) > > wrote: > > > > > Hello, > > > > > > So I've replaced some machines we had with more memory and it seems to > > > have helped but I'm starting to see some high memory usage on one of the > > > machines. What I don't understand and can't figure out is where that > > > memory is being used? > > > > > > We have 26GB RAM, allocating 13.5G for the ES\_HEAP\_SIZE. Looking at > > > `top` it currently shows the java process to be using (RES) 22G and using > > > `free` I confirm that there is only 3172M available. > > > > > > One would conclude that ES is using it all as shown by top. And yes > > > that makes sense, but it's not translating to performance of my queries by > > > caching them and even more so, when I look in marvel I see the following > > > stats for that one node. > > > > > > JVM Heap Usage: 36% > > > OS Memory: 87% > > > > > > And here's the interesting parts: > > > > > > Indices Field Data: 427,577,836 > > > Indices Filter Cache: 54,641,296 > > > Indices Lucene Memory: 308,679,803 > > > > > > Field Data Circuit Breaker Estimated Size: 428,615,926 > > > No field data evictions at all. 0.00 > > > > > > So where then is all my memory being used? This doesn't add up to 22GB - > > > not even close. > > > > > > Thanks for all your help! > > > Daniel > > > > > > -- > > > You received this message because you are subscribed to the Google > > > Groups "elasticsearch" group. > > > To unsubscribe from this group and stop receiving emails from it, send > > > an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > > To view this discussion on the web visit > > > [https://groups.google.com/d/msgid/elasticsearch/1300cc7b-016f-4a3b-8df9-7b041e80607a%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/1300cc7b-016f-4a3b-8df9-7b041e80607a%40googlegroups.com) > > > [https://groups.google.com/d/msgid/elasticsearch/1300cc7b-016f-4a3b-8df9-7b041e80607a%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/1300cc7b-016f-4a3b-8df9-7b041e80607a%40googlegroups.com?utm_medium=email&utm_source=footer) > > > . > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/f7b80553-93d8-403b-803a-ef48b1a0c92f%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/f7b80553-93d8-403b-803a-ef48b1a0c92f%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 1:13am UTC](https://discuss.elastic.co/t/where-is-all-my-memory-or-how-to-estimate-better/18903/5 "2017-07-06T01:13:03Z")