# Throttled merge

**URL:** https://discuss.elastic.co/t/throttled-merge/314963
**Category:** Elasticsearch
**Created:** [September 22, 2022, 4:39pm UTC](https://discuss.elastic.co/t/throttled-merge/314963 "2022-09-22T16:39:42Z")
**Posts on this page:** 5
**Page:** 1

<div class="post-metadata">

### Author: ![Ariel\_Zach](https://avatars.discourse-cdn.com/v4/letter/a/a88e57/32.png) [@Ariel\_Zach](https://discuss.elastic.co/u/Ariel_Zach)
#### Post date: [September 22, 2022, 4:39pm UTC](https://discuss.elastic.co/t/throttled-merge/314963/1 "2022-09-22T16:39:42Z")

</div>

Hello,

Currently we have an index of 33TB (ES 7.8), 48 shards (16 primary, 32 replicas), two months ago we deleted a lot of documents and we noticed that one of the shards (the primary and the 2 replicas) has a very large size (5TB), looking at the detail of the index I notice that the merge has not been executed for 57 days:

```auto
  "merges": {
    "current": 0,
    "current_docs": 0,
    "current_size": "0b",
    "current_size_in_bytes": 0,
    "total": 4203366,
    "total_time": "96.1d",
    "total_time_in_millis": 8311549584,
    "total_docs": 15152680627,
    "total_size": "48.6tb",
    "total_size_in_bytes": 53517052444064,
    "total_stopped_time": "0s",
    "total_stopped_time_in_millis": 0,
    "total_throttled_time": "57.2d",
    "total_throttled_time_in_millis": 4942382248,
    "total_auto_throttle": "5mb",
    "total_auto_throttle_in_bytes": 5242880

Config:

      "index.merge.policy.reclaim_deletes_weight": "2.0",
      "index.merge.scheduler.max_merge_count": "5",
      "index.merge.scheduler.max_thread_count": "2",
      "index.merge.policy.deletes_pct_allowed": "33.0",
      "index.merge.policy.expunge_deletes_allowed": "10.0",
      "index.merge.policy.floor_segment": "2mb",
      "index.merge.policy.max_merge_at_once": "10",
      "index.merge.policy.max_merge_at_once_explicit": "30",
      "index.merge.policy.max_merged_segment": "5gb",
      "index.merge.policy.segments_per_tier": "10.0",
      "index.merge.scheduler.auto_throttle": "true",

```

The idea is not to force a merge, why is the merge not being executed in Elastic?

---

<div class="post-metadata">

### Author: ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)
#### Post date: [September 23, 2022, 3:06am UTC](https://discuss.elastic.co/t/throttled-merge/314963/2 "2022-09-23T03:06:24Z")

</div>

> [@Ariel\_Zach](#):
>
> ES 7.8

This is [EOL](https://www.elastic.co/support/eol), please upgrade as a matter of urgency as latest 7.X is 7.17 so you are a fair bit behind. I would definitely start there before digging further.

---

<div class="post-metadata">

### Author: ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)
#### Post date: [September 23, 2022, 6:30am UTC](https://discuss.elastic.co/t/throttled-merge/314963/3 "2022-09-23T06:30:08Z")

</div>

> [@Ariel\_Zach](#):
>
> ```auto
> Config:
> 
> "index.merge.policy.reclaim_deletes_weight": "2.0",
> "index.merge.scheduler.max_merge_count": "5",
> "index.merge.scheduler.max_thread_count": "2",
> "index.merge.policy.deletes_pct_allowed": "33.0",
> "index.merge.policy.expunge_deletes_allowed": "10.0",
> "index.merge.policy.floor_segment": "2mb",
> "index.merge.policy.max_merge_at_once": "10",
> "index.merge.policy.max_merge_at_once_explicit": "30",
> "index.merge.policy.max_merged_segment": "5gb",
> "index.merge.policy.segments_per_tier": "10.0",
> "index.merge.scheduler.auto_throttle": "true",
> 
> ```

It looks like you have overridden the default settings. How did you arrive at these configs? What happens if you revert to the defaults?

---

<div class="post-metadata">

### Author: ![Ariel\_Zach](https://avatars.discourse-cdn.com/v4/letter/a/a88e57/32.png) [@Ariel\_Zach](https://discuss.elastic.co/u/Ariel_Zach)
#### Post date: [September 23, 2022, 12:47pm UTC](https://discuss.elastic.co/t/throttled-merge/314963/4 "2022-09-23T12:47:18Z")

</div>

Hi Christian, this is the default configuration, we do not modify it when creating the index.

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [October 21, 2022, 12:47pm UTC](https://discuss.elastic.co/t/throttled-merge/314963/5 "2022-10-21T12:47:45Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
