# Reindex all documents merge configuration

**URL:** https://discuss.elastic.co/t/reindex-all-documents-merge-configuration/10459
**Category:** Elasticsearch
**Created:** [January 22, 2013, 7:01pm UTC](https://discuss.elastic.co/t/reindex-all-documents-merge-configuration/10459 "2013-01-22T19:01:38Z")
**Posts on this page:** 4
**Page:** 1

<div class="post-metadata">

### Author: ![y\_itay](https://avatars.discourse-cdn.com/v4/letter/y/76d3ee/32.png) [@y\_itay](https://discuss.elastic.co/u/y_itay)
#### Post date: [January 22, 2013, 7:01pm UTC](https://discuss.elastic.co/t/reindex-all-documents-merge-configuration/10459/1 "2013-01-22T19:01:38Z")

</div>

Hey,

We need support a functionality to reindex all our documents in a index.  
We ran scan/index for all our existing elasticsearch index which has about  
1 million documents and it looks like the size of the index doubles itself,  
this is concerning regarding running out of the space. (Production has over  
100 million documents)  
The reindex process ran for about 1-1.5 hours with 1 thread.  
After the index was done the merge policy kicked in and cleaned the old  
segments, is there a way to make the merge policy kick in more often?

Thanks,  
Itay

--

---

<div class="post-metadata">

### Author: ![radu\_gheorghe](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/radu_gheorghe/32/556_2.png) [@radu\_gheorghe](https://discuss.elastic.co/u/radu_gheorghe)
#### Post date: [January 23, 2013, 5:14pm UTC](https://discuss.elastic.co/t/reindex-all-documents-merge-configuration/10459/2 "2013-01-23T17:14:44Z")

</div>

Hello Itay,

I'd try to increase the thread count on ConcurrentMergeScheduler:

> **[Elastic — The Search AI Company](https://www.elastic.co)**
>
> Power insights and outcomes with The Elastic Search AI Platform. See into your data and find answers that matter with enterprise solutions designed to help you accelerate time to insight. Try Elastic ...

If that doesn't help, I think you'd have to either:

- throttle reindexing, to give merging more time
- add more disks

## Best regards, Radu

[http://sematext.com/](http://sematext.com/) -- Elasticsearch -- Solr -- Lucene

On Tue, Jan 22, 2013 at 9:01 PM, itay yahimovitz [itay1336@gmail.com](mailto:itay1336@gmail.com) wrote:

> Hey,
> 
> We need support a functionality to reindex all our documents in a index.  
> We ran scan/index for all our existing elasticsearch index which has about  
> 1 million documents and it looks like the size of the index doubles itself,  
> this is concerning regarding running out of the space. (Production has over  
> 100 million documents)  
> The reindex process ran for about 1-1.5 hours with 1 thread.  
> After the index was done the merge policy kicked in and cleaned the old  
> segments, is there a way to make the merge policy kick in more often?
> 
> Thanks,  
> Itay
> 
> --

--

---

<div class="post-metadata">

### Author: ![y\_itay](https://avatars.discourse-cdn.com/v4/letter/y/76d3ee/32.png) [@y\_itay](https://discuss.elastic.co/u/y_itay)
#### Post date: [January 23, 2013, 10:53pm UTC](https://discuss.elastic.co/t/reindex-all-documents-merge-configuration/10459/3 "2013-01-23T22:53:40Z")

</div>

thanks for the advise, we will try it out.

-Itay

On Tuesday, January 22, 2013 11:01:38 AM UTC-8, itay yahimovitz wrote:

> Hey,
> 
> We need support a functionality to reindex all our documents in a index.  
> We ran scan/index for all our existing elasticsearch index which has about  
> 1 million documents and it looks like the size of the index doubles itself,  
> this is concerning regarding running out of the space. (Production has over  
> 100 million documents)  
> The reindex process ran for about 1-1.5 hours with 1 thread.  
> After the index was done the merge policy kicked in and cleaned the old  
> segments, is there a way to make the merge policy kick in more often?
> 
> Thanks,  
> Itay

--

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [July 6, 2017, 2:54am UTC](https://discuss.elastic.co/t/reindex-all-documents-merge-configuration/10459/4 "2017-07-06T02:54:53Z")

</div>


