# Average size of data indices **URL:** \ **Category:** Elasticsearch\ **Created:** [December 20, 2022, 9:49am UTC](https://discuss.elastic.co/t/average-size-of-data-indices/321625 "2022-12-20T09:49:29Z")\ **Posts on this page:** 7\ **Page:** 1
**Author:** ![m3bgwad](https://avatars.discourse-cdn.com/v4/letter/m/a183cd/32.png) [@m3bgwad](https://discuss.elastic.co/u/m3bgwad)\ **Post date:** [December 20, 2022, 9:49am UTC](https://discuss.elastic.co/t/average-size-of-data-indices/321625/1 "2022-12-20T09:49:29Z")
I have more of questions regarding size of data. - what is average of data can Elasticsearch store par second? - if there is 1M document of data in log file and volume 1G after storing in elastic database what is the new volume? Is there over head of data adding by Elasticsearch can increase the volume? Thank you, ---
**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\ **Post date:** [December 20, 2022, 9:55am UTC](https://discuss.elastic.co/t/average-size-of-data-indices/321625/2 "2022-12-20T09:55:25Z")
> [@m3bgwad](#): > > what is average of data can Elasticsearch store par second? That depends entirely on the size and specification of the cluster. Have a look at the following resources: > **[Tune for indexing speed | Elasticsearch Guide \[7.17\] | Elastic](https://www.elastic.co/guide/en/elasticsearch/reference/7.17/tune-for-indexing-speed.html)** > **[Sizing Hot-Warm Architectures for Logging and Metrics in the Elasticsearch...](https://www.elastic.co/blog/sizing-hot-warm-architectures-for-logging-and-metrics-in-the-elasticsearch-service-on-elastic-cloud)** > [@m3bgwad](#): > > if there is 1M document of data in log file and volume 1G after storing in elastic database what is the new volume? Is there over head of data adding by Elasticsearch can increase the volume? The ratio between the size of the raw logs and the resulting index size in Elasticsearch depends on the size of the shards, index settings and the mappings used. Have a look at [this section in the docs](https://www.elastic.co/guide/en/elasticsearch/reference/7.17/tune-for-disk-usage.html) for information about how to best reduce the disk space required in Elasticsearch ---
**Author:** ![m3bgwad](https://avatars.discourse-cdn.com/v4/letter/m/a183cd/32.png) [@m3bgwad](https://discuss.elastic.co/u/m3bgwad)\ **Post date:** [December 21, 2022, 9:25am UTC](https://discuss.elastic.co/t/average-size-of-data-indices/321625/3 "2022-12-21T09:25:29Z")
> [@Christian\_Dahlqvist](#): > > That depends entirely on the size and specification of the cluster. > > Have a look at the following resources I have cluster from 3 nodes and the specs for each node is RAM 64 CPU 18 Disk storage 1T If I want to pull more 1M Data transaction per second in more then serves. does it have the ability to make this without happening any delays? ---
**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\ **Post date:** [December 21, 2022, 9:29am UTC](https://discuss.elastic.co/t/average-size-of-data-indices/321625/4 "2022-12-21T09:29:59Z")
> [@m3bgwad](#): > > If I want to pull more 1M Data transaction per second in more then serves. does it have the ability to make this without happening any delays? No. In order to index 1 million documents per second you will in my opinion need a considerably larger cluster with really fast local SSD disks. Wat is the average size of the documents you will be indexing? ---
**Author:** ![m3bgwad](https://avatars.discourse-cdn.com/v4/letter/m/a183cd/32.png) [@m3bgwad](https://discuss.elastic.co/u/m3bgwad)\ **Post date:** [December 21, 2022, 9:51am UTC](https://discuss.elastic.co/t/average-size-of-data-indices/321625/5 "2022-12-21T09:51:29Z")
> [@Christian\_Dahlqvist](#): > > No. In order to index 1 million documents per second you will in my opinion need a considerably larger cluster with really fast local SSD disks. Wat is the average size of the documents you will be indexing? if you mean the disk storage is few can I make retention period each day to over come the large volume and I can increase the storage in the future as far as the disk storage is HDD this is will impact the speed in the future? ---
**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\ **Post date:** [December 21, 2022, 10:03am UTC](https://discuss.elastic.co/t/average-size-of-data-indices/321625/6 "2022-12-21T10:03:36Z")
For high ingest throughput [you will need really fast local SSD](https://www.elastic.co/guide/en/elasticsearch/reference/8.5/tune-for-indexing-speed.html#_use_faster_hardware) - HDD will quickly become the bottleneck. Even with SSDs you will IMHO need a significantly larger cluster. I would recommend running a benchmark with realistic data and see what you get from your current cluster. ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [January 18, 2023, 10:03am UTC](https://discuss.elastic.co/t/average-size-of-data-indices/321625/7 "2023-01-18T10:03:58Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.