# How much overhead stuff is stored with each document? **URL:** \ **Category:** Elasticsearch\ **Created:** [March 18, 2018, 11:01am UTC](https://discuss.elastic.co/t/how-much-overhead-stuff-is-stored-with-each-document/124440 "2018-03-18T11:01:32Z")\ **Posts on this page:** 6\ **Page:** 1
**Author:** ![yishain11](https://avatars.discourse-cdn.com/v4/letter/y/df705f/32.png) [@yishain11](https://discuss.elastic.co/u/yishain11)\ **Post date:** [March 18, 2018, 11:01am UTC](https://discuss.elastic.co/t/how-much-overhead-stuff-is-stored-with-each-document/124440/1 "2018-03-18T11:01:33Z")
Hi, I have some quetions regarding the memory usage and storage of documents in Elasticsearch. Lets say I have JSON doc with the size of X kb. If I ship it to Elasticsearch with Logstash and analyze it as a JSON, In what size will it be when its inside Elasticsearch? How much data overhead will be added? I understand that it depends on multiple configurations, but let say I keep the defualt settings, what disk usage could I expect if I want to store millions of documents? Plus, what is the actual size of elasticsearch files themselves? Is there a difference between data nodes and master nodes regarding file size and doc storage size? These questions are asked in order to understand what will be the system requirments, memorywise, when I want to install a new Elastic stack. ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [March 18, 2018, 12:42pm UTC](https://discuss.elastic.co/t/how-much-overhead-stuff-is-stored-with-each-document/124440/2 "2018-03-18T12:42:06Z")
Try it a part of your data and you will get an idea. It should not take that long and it will be much better than guessing. ---
**Author:** ![yishain11](https://avatars.discourse-cdn.com/v4/letter/y/df705f/32.png) [@yishain11](https://discuss.elastic.co/u/yishain11)\ **Post date:** [March 18, 2018, 12:47pm UTC](https://discuss.elastic.co/t/how-much-overhead-stuff-is-stored-with-each-document/124440/3 "2018-03-18T12:47:09Z")
Hi, I tried that but I can't tell which part of Elastic gives what overhead component so that the file has this size after ingesting it into elasticsearch. Plus, when I do du -h in my Centos machine I don't see the same number that I see in the \_stats. ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [March 18, 2018, 1:48pm UTC](https://discuss.elastic.co/t/how-much-overhead-stuff-is-stored-with-each-document/124440/4 "2018-03-18T13:48:11Z")
How many documents did you try? 1 million? ---
**Author:** ![Itamar\_Syn\_Hershko](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/itamar_syn_hershko/32/725_2.png) [@Itamar\_Syn\_Hershko](https://discuss.elastic.co/u/Itamar_Syn_Hershko)\ **Post date:** [March 18, 2018, 2:53pm UTC](https://discuss.elastic.co/t/how-much-overhead-stuff-is-stored-with-each-document/124440/5 "2018-03-18T14:53:45Z")
There used to be a thumb rule saying index size is around 10% of your data, but it's almost impossible to estimate today given doc\_values, various analyzers and whether or not you use best\_compression. I usually go with a 1:1 estimation in sizing procedures to keep on the safe side. It will usually be smaller than this but it's a good place to start. Master nodes have no requirements of disk size. HTH, -- Itamar Syn-Hershko Elasticsearch Partner Founder, CTO BigData Boutique [http://bigdataboutique.com](http://bigdataboutique.com) [http://code972.com](http://code972.com) | @synhershko ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [April 15, 2018, 2:53pm UTC](https://discuss.elastic.co/t/how-much-overhead-stuff-is-stored-with-each-document/124440/6 "2018-04-15T14:53:48Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.