# Update ES2 to ES6 , it is very slowly when we reindex , there have any batter suggest for reindex?

**URL:** <https://discuss.elastic.co/t/update-es2-to-es6-it-is-very-slowly-when-we-reindex-there-have-any-batter-suggest-for-reindex/145745>\
**Category:** Elasticsearch\
**Created:** [August 23, 2018, 1:59pm UTC](https://discuss.elastic.co/t/update-es2-to-es6-it-is-very-slowly-when-we-reindex-there-have-any-batter-suggest-for-reindex/145745 "2018-08-23T13:59:19Z")\
**Posts on this page:** 11\
**Page:** 1

<div class="post-metadata">

**Author:** ![showmeall](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/showmeall/32/29507_2.png) [@showmeall](https://discuss.elastic.co/u/showmeall)\
**Post date:** [August 23, 2018, 1:59pm UTC](https://discuss.elastic.co/t/update-es2-to-es6-it-is-very-slowly-when-we-reindex-there-have-any-batter-suggest-for-reindex/145745/1 "2018-08-23T13:59:19Z")

</div>

update ES2 to ES6 , it is very slowly when we reindex , there have any batter suggest for reindex?  
we have two type in ES2 , and have 10T datas; we want update it to ES6 ; it is very slowly when we reindex each type in ES2 to ES6; there have any better way update the ES? please help us.

---

<div class="post-metadata">

**Author:** ![jpountz](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jpountz/32/45836_2.png) [@jpountz](https://discuss.elastic.co/u/jpountz)\
**Post date:** [August 23, 2018, 3:51pm UTC](https://discuss.elastic.co/t/update-es2-to-es6-it-is-very-slowly-when-we-reindex-there-have-any-batter-suggest-for-reindex/145745/2 "2018-08-23T15:51:04Z")

</div>

There are no better ways, sorry.

---

<div class="post-metadata">

**Author:** ![showmeall](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/showmeall/32/29507_2.png) [@showmeall](https://discuss.elastic.co/u/showmeall)\
**Post date:** [August 24, 2018, 6:26am UTC](https://discuss.elastic.co/t/update-es2-to-es6-it-is-very-slowly-when-we-reindex-there-have-any-batter-suggest-for-reindex/145745/3 "2018-08-24T06:26:38Z")

</div>

ok, there have any config for increase reindex speed ? about 10T , need 20 days for reindex finished. it is slowly than index new data; it is slowly due to rebuild data Structure when update to ES6 ?

---

<div class="post-metadata">

**Author:** ![showmeall](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/showmeall/32/29507_2.png) [@showmeall](https://discuss.elastic.co/u/showmeall)\
**Post date:** [August 24, 2018, 7:42am UTC](https://discuss.elastic.co/t/update-es2-to-es6-it-is-very-slowly-when-we-reindex-there-have-any-batter-suggest-for-reindex/145745/4 "2018-08-24T07:42:22Z")

</div>

and there have another problem; when we reindex get error  
{"error":{"root\_cause":[{"type":"illegal\_argument\_exception","reason":"Remote responded with a chunk that was too large. Use a smaller batch size."}],"type":"illegal\_argument\_exception","reason":"Remote responded with a chunk that was too large. Use a smaller batch size.","caused\_by":{"type":"content\_too\_long\_exception","reason":"entity content is too long [123362947] for the configured buffer limit [104857600]"}},"status":400}  
what is the problem? please help us .

---

<div class="post-metadata">

**Author:** ![Mojster](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/mojster/32/21209_2.png) [@Mojster](https://discuss.elastic.co/u/Mojster)\
**Post date:** [August 24, 2018, 7:50am UTC](https://discuss.elastic.co/t/update-es2-to-es6-it-is-very-slowly-when-we-reindex-there-have-any-batter-suggest-for-reindex/145745/5 "2018-08-24T07:50:06Z")

</div>

If you have still all data present, fill the new index from sratch.

---

<div class="post-metadata">

**Author:** ![Bernt\_Rostad](https://avatars.discourse-cdn.com/v4/letter/b/3ab097/32.png) [@Bernt\_Rostad](https://discuss.elastic.co/u/Bernt_Rostad)\
**Post date:** [August 24, 2018, 9:57am UTC](https://discuss.elastic.co/t/update-es2-to-es6-it-is-very-slowly-when-we-reindex-there-have-any-batter-suggest-for-reindex/145745/6 "2018-08-24T09:57:34Z")

</div>

> [@showmeall](#):
>
> it is very slowly when we reindex

There is a couple of things you can do to improve the speed (if you haven't done this already):

1. Turn off index refreshing, see [Bulk Indexing](https://www.elastic.co/guide/en/elasticsearch/reference/current/indices-update-settings.html#bulk), which lets Elasticsearch focus on writing data rather than reading it back every second to refresh the indices.
2. Turn off replica shards, see [Update Indices Settings](https://www.elastic.co/guide/en/elasticsearch/reference/current/indices-update-settings.html#indices-update-settings), so that Elasticsearch can focus on just writing data to the primary shards. Once the re-indexing is done you can add the replica shards to your indices.

Good luck!

---

<div class="post-metadata">

**Author:** ![showmeall](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/showmeall/32/29507_2.png) [@showmeall](https://discuss.elastic.co/u/showmeall)\
**Post date:** [August 24, 2018, 11:29am UTC](https://discuss.elastic.co/t/update-es2-to-es6-it-is-very-slowly-when-we-reindex-there-have-any-batter-suggest-for-reindex/145745/7 "2018-08-24T11:29:51Z")

</div>

thanks, yes, we have config like you say. but is slowly also. another question, should we stop ES index new docs when we do reindex?

---

<div class="post-metadata">

**Author:** ![showmeall](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/showmeall/32/29507_2.png) [@showmeall](https://discuss.elastic.co/u/showmeall)\
**Post date:** [August 24, 2018, 11:32am UTC](https://discuss.elastic.co/t/update-es2-to-es6-it-is-very-slowly-when-we-reindex-there-have-any-batter-suggest-for-reindex/145745/8 "2018-08-24T11:32:14Z")

</div>

sorry, what is your mean? can you explain for us.

---

<div class="post-metadata">

**Author:** ![Mojster](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/mojster/32/21209_2.png) [@Mojster](https://discuss.elastic.co/u/Mojster)\
**Post date:** [August 24, 2018, 11:45am UTC](https://discuss.elastic.co/t/update-es2-to-es6-it-is-very-slowly-when-we-reindex-there-have-any-batter-suggest-for-reindex/145745/9 "2018-08-24T11:45:37Z")

</div>

I've had a problem with our index, after upgrading 6.2.4 =\> 6.3.x.  
It was a issue with beats an rigid template.

So instead of reindexing it, I've just created a new index and filled it with data from the begging.  
So if you have your data still present than this is also an option.

---

<div class="post-metadata">

**Author:** ![Bernt\_Rostad](https://avatars.discourse-cdn.com/v4/letter/b/3ab097/32.png) [@Bernt\_Rostad](https://discuss.elastic.co/u/Bernt_Rostad)\
**Post date:** [August 24, 2018, 11:50am UTC](https://discuss.elastic.co/t/update-es2-to-es6-it-is-very-slowly-when-we-reindex-there-have-any-batter-suggest-for-reindex/145745/10 "2018-08-24T11:50:55Z")

</div>

> [@showmeall](#):
>
> should we stop ES index new docs when we do reindex?

I don't think indexing new documents to the old index will affect the reindex speed very much, unless you index heavily and to the same data nodes the original index is located. In that case the massive IPOS could have an impact. But you could check this yourself by pausing your index operations and just monitor the reindexing speed to see if it increases or not.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [September 21, 2018, 12:02pm UTC](https://discuss.elastic.co/t/update-es2-to-es6-it-is-very-slowly-when-we-reindex-there-have-any-batter-suggest-for-reindex/145745/11 "2018-09-21T12:02:40Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
