# Benchmarking ES using Rally store size metric increase and decrease **URL:** \ **Category:** Elasticsearch\ **Tags:** rally\ **Created:** [December 14, 2021, 12:58pm UTC](https://discuss.elastic.co/t/benchmarking-es-using-rally-store-size-metric-increase-and-decrease/291804 "2021-12-14T12:58:27Z")\ **Posts on this page:** 4\ **Page:** 1
**Author:** ![fargolk](https://avatars.discourse-cdn.com/v4/letter/f/a183cd/32.png) [@fargolk](https://discuss.elastic.co/u/fargolk)\ **Post date:** [December 14, 2021, 12:58pm UTC](https://discuss.elastic.co/t/benchmarking-es-using-rally-store-size-metric-increase-and-decrease/291804/1 "2021-12-14T12:58:27Z")
I was benchmarking an ES index with different shard numbers using esrally. to find the shard number with best throughput for the specific index. As I read in documents store size is index size (translog excluded) In the report summary of the tests that I performed when the shards count increases I expected to see that store size increases but it increased at first and at some point it suddenly decreased. I wanted to know the reason of such behavior? The track includes following operations: Running delete-index [100% done] Running create-index [100% done] Running cluster-health [100% done] Running bulk [100% done] **Race report summary with 1 shard:** Store size 0.0001169 GB **Race report summary with 2 shards:** Store size 5.12749 GB **Race report summary with 3 shards:** Store size 2.22465 GB **Race report summary with 4 shards:** Store size 1.93715 GB ---
**Author:** ![json](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/json/32/4125_2.png) [@json](https://discuss.elastic.co/u/json)\ **Post date:** [December 14, 2021, 4:03pm UTC](https://discuss.elastic.co/t/benchmarking-es-using-rally-store-size-metric-increase-and-decrease/291804/2 "2021-12-14T16:03:27Z")
Hi, welcome to the Elastic community, and thank you for your post! The race report values vary fairly broadly! The described behavior sounds like the normal ES segment merge cycle. Can you share the full race summary reports? I suspect merge throttling is causing it. Are you using a publicly available Rally track? What are the CPU, memory and storage specs of your target system? I could try reproducing it for a better perspective. Jason ---
**Author:** ![fargolk](https://avatars.discourse-cdn.com/v4/letter/f/a183cd/32.png) [@fargolk](https://discuss.elastic.co/u/fargolk)\ **Post date:** [December 14, 2021, 8:25pm UTC](https://discuss.elastic.co/t/benchmarking-es-using-rally-store-size-metric-increase-and-decrease/291804/3 "2021-12-14T20:25:13Z")
Thanks, yes the full report is attached ![1-2](https://us1.discourse-cdn.com/elastic/original/3X/3/9/39955a3636cbc88f2e02e0ae4250dcbd7ccf2256.jpeg) shards =1 vs shards =2 ![2-3](https://us1.discourse-cdn.com/elastic/original/3X/9/0/906e3d2206270babcbdeedfa73f27b167bad119c.jpeg) shards = 2 vs shards=3 ![3-4](https://us1.discourse-cdn.com/elastic/original/3X/0/0/00b87feb2644c6aa65ce7f36f98ef24717826749.jpeg) shards = 3 vs shards = 4 I created the track from my index that I want to find the optimal shard count for it. Actually I don't understand how segment merges can cause this fluctuation. it would be very helpful for me to know more about these merges and how much storage they may take, are there any specific documents I should read to know more about process of segment merges? Thanks ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [January 11, 2022, 8:25pm UTC](https://discuss.elastic.co/t/benchmarking-es-using-rally-store-size-metric-increase-and-decrease/291804/4 "2022-01-11T20:25:55Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.