# Total.store.size\_in\_bytes measures what? **URL:** \ **Category:** Elasticsearch\ **Created:** [January 15, 2014, 6:57pm UTC](https://discuss.elastic.co/t/total-store-size-in-bytes-measures-what/15253 "2014-01-15T18:57:05Z")\ **Posts on this page:** 7\ **Page:** 1
**Author:** ![Ryan\_Pedela](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ryan_pedela/32/27156_2.png) [@Ryan\_Pedela](https://discuss.elastic.co/u/Ryan_Pedela)\ **Post date:** [January 15, 2014, 6:57pm UTC](https://discuss.elastic.co/t/total-store-size-in-bytes-measures-what/15253/1 "2014-01-15T18:57:05Z")
What does "total.store.size\_in\_bytes" from the indices stats API[http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/indices-stats.html](http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/indices-stats.html)measure? Disk space for the Lucene index? Disk space for the \_source data? Disk space for logs and other metadata? Does it count shards? Does it count replicas? Anything else? I know this question has been asked multiple times, but I have not been able to find a succinct breakdown of what is exactly involved in the calculation. The actual equation would be even better! -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/08534879-a398-4ebf-890a-09ba7bac52c8%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/08534879-a398-4ebf-890a-09ba7bac52c8%40googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![Ryan\_Pedela](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ryan_pedela/32/27156_2.png) [@Ryan\_Pedela](https://discuss.elastic.co/u/Ryan_Pedela)\ **Post date:** [January 15, 2014, 7:03pm UTC](https://discuss.elastic.co/t/total-store-size-in-bytes-measures-what/15253/2 "2014-01-15T19:03:44Z")
If the calculation includes \_source data, does it use the uncompressed or compressed size? -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/ba08f741-42ac-4ff1-8439-3cbf582481ec%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/ba08f741-42ac-4ff1-8439-3cbf582481ec%40googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![spinscale](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/spinscale/32/25011_2.png) [@spinscale](https://discuss.elastic.co/u/spinscale)\ **Post date:** [January 16, 2014, 9:38am UTC](https://discuss.elastic.co/t/total-store-size-in-bytes-measures-what/15253/3 "2014-01-16T09:38:07Z")
Hey, from a quick peek in the source, the StoreStats are generated in Store.stats(), which uses the Lucene Index Directory to get its size. Which again calls file.length() for each file in that directory in the end. So it is the size used by a lucene index in bytes. The indices stats API shows the data for total shards, for primaries only or for replicas and the same per index - so you can decide which data is important to you to count in your monitoring system. Does it make more sense now? --Alex On Wed, Jan 15, 2014 at 7:57 PM, Ryan Pedela [rpedela@datalanche.com](mailto:rpedela@datalanche.com) wrote: > What does "total.store.size\_in\_bytes" from the indices stats API[http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/indices-stats.html](http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/indices-stats.html)measure? > > Disk space for the Lucene index? > Disk space for the \_source data? > Disk space for logs and other metadata? > Does it count shards? > Does it count replicas? > Anything else? > > I know this question has been asked multiple times, but I have not been > able to find a succinct breakdown of what is exactly involved in the > calculation. The actual equation would be even better! > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/08534879-a398-4ebf-890a-09ba7bac52c8%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/08534879-a398-4ebf-890a-09ba7bac52c8%40googlegroups.com) > . > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAGCwEM-FyicftTP-gS2jG1e31ZLejkOxq%2BvmvtsNf%3D6L6qXWKg%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAGCwEM-FyicftTP-gS2jG1e31ZLejkOxq%2BvmvtsNf%3D6L6qXWKg%40mail.gmail.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![Ryan\_Pedela](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ryan_pedela/32/27156_2.png) [@Ryan\_Pedela](https://discuss.elastic.co/u/Ryan_Pedela)\ **Post date:** [January 16, 2014, 2:54pm UTC](https://discuss.elastic.co/t/total-store-size-in-bytes-measures-what/15253/4 "2014-01-16T14:54:09Z")
Yes, it makes more sense. Thanks. Thanks, Ryan Pedela Datalanche CEO, co-founder [www.datalanche.com](http://www.datalanche.com) [rpedela@datalanche.com](mailto:rpedela@datalanche.com) 513-571-6837 On Thu, Jan 16, 2014 at 2:38 AM, Alexander Reelsen [alr@spinscale.de](mailto:alr@spinscale.de) wrote: > Hey, > > from a quick peek in the source, the StoreStats are generated in > Store.stats(), which uses the Lucene Index Directory to get its size. Which > again calls file.length() for each file in that directory in the end. So it > is the size used by a lucene index in bytes. > > The indices stats API shows the data for total shards, for primaries only > or for replicas and the same per index - so you can decide which data is > important to you to count in your monitoring system. > > Does it make more sense now? > > --Alex > > On Wed, Jan 15, 2014 at 7:57 PM, Ryan Pedela [rpedela@datalanche.com](mailto:rpedela@datalanche.com)wrote: > > > What does "total.store.size\_in\_bytes" from the indices stats API[http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/indices-stats.html](http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/indices-stats.html)measure? > > > > Disk space for the Lucene index? > > Disk space for the \_source data? > > Disk space for logs and other metadata? > > Does it count shards? > > Does it count replicas? > > Anything else? > > > > I know this question has been asked multiple times, but I have not been > > able to find a succinct breakdown of what is exactly involved in the > > calculation. The actual equation would be even better! > > > > -- > > You received this message because you are subscribed to the Google Groups > > "elasticsearch" group. > > To unsubscribe from this group and stop receiving emails from it, send an > > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > > To view this discussion on the web visit > > [https://groups.google.com/d/msgid/elasticsearch/08534879-a398-4ebf-890a-09ba7bac52c8%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/08534879-a398-4ebf-890a-09ba7bac52c8%40googlegroups.com) > > . > > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). > > -- > You received this message because you are subscribed to a topic in the > Google Groups "elasticsearch" group. > To unsubscribe from this topic, visit > [https://groups.google.com/d/topic/elasticsearch/ud9UAxFNMd0/unsubscribe](https://groups.google.com/d/topic/elasticsearch/ud9UAxFNMd0/unsubscribe). > To unsubscribe from this group and all its topics, send an email to > [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/CAGCwEM-FyicftTP-gS2jG1e31ZLejkOxq%2BvmvtsNf%3D6L6qXWKg%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAGCwEM-FyicftTP-gS2jG1e31ZLejkOxq%2BvmvtsNf%3D6L6qXWKg%40mail.gmail.com) > . > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CACu89FQ5CCSMc8zR8nrKj%2BACLrkd-ikMM6td7D37NfLoUXf5bQ%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CACu89FQ5CCSMc8zR8nrKj%2BACLrkd-ikMM6td7D37NfLoUXf5bQ%40mail.gmail.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![Ryan\_Pedela](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ryan_pedela/32/27156_2.png) [@Ryan\_Pedela](https://discuss.elastic.co/u/Ryan_Pedela)\ **Post date:** [January 16, 2014, 5:52pm UTC](https://discuss.elastic.co/t/total-store-size-in-bytes-measures-what/15253/5 "2014-01-16T17:52:18Z")
I did more digging. Turns out that using version 0.90.9, the \_source data is included in the calculation. In other words, the stats are the entire disk space used by an index including source data. And it is broken down by indices, primaries, etc as Alex said. I did not test to see if it takes into account source data compression, but it appears that it does. -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/5210cf67-4cf7-4695-89c3-0b3fb48a6290%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/5210cf67-4cf7-4695-89c3-0b3fb48a6290%40googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![spinscale](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/spinscale/32/25011_2.png) [@spinscale](https://discuss.elastic.co/u/spinscale)\ **Post date:** [January 20, 2014, 9:15am UTC](https://discuss.elastic.co/t/total-store-size-in-bytes-measures-what/15253/6 "2014-01-20T09:15:49Z")
Hey, the source is just a field in the index, thats the reason for being included. What is not included is the something like the translog, so it is not the entire disk space used by an index is in there iirc. --Alex On Thu, Jan 16, 2014 at 6:52 PM, Ryan Pedela [rpedela@datalanche.com](mailto:rpedela@datalanche.com) wrote: > I did more digging. Turns out that using version 0.90.9, the \_source data > is included in the calculation. In other words, the stats are the entire > disk space used by an index including source data. And it is broken down by > indices, primaries, etc as Alex said. > > I did not test to see if it takes into account source data compression, > but it appears that it does. > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/5210cf67-4cf7-4695-89c3-0b3fb48a6290%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/5210cf67-4cf7-4695-89c3-0b3fb48a6290%40googlegroups.com) > . > > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAGCwEM-xucydRcjJcZmb8zRcCQX2OzJHB%2BcDck8w%3Dq8FhHpHQA%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAGCwEM-xucydRcjJcZmb8zRcCQX2OzJHB%2BcDck8w%3Dq8FhHpHQA%40mail.gmail.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 1:55am UTC](https://discuss.elastic.co/t/total-store-size-in-bytes-measures-what/15253/7 "2017-07-06T01:55:56Z")