# I got much more sizes than base index after reindexation! **URL:** \ **Category:** Elasticsearch\ **Created:** [June 3, 2015, 11:08am UTC](https://discuss.elastic.co/t/i-got-much-more-sizes-than-base-index-after-reindexation/1816 "2015-06-03T11:08:32Z")\ **Posts on this page:** 14\ **Page:** 1
**Author:** ![Mehmet\_Ozer](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/mehmet_ozer/32/81567_2.png) [@Mehmet\_Ozer](https://discuss.elastic.co/u/Mehmet_Ozer)\ **Post date:** [June 3, 2015, 11:08am UTC](https://discuss.elastic.co/t/i-got-much-more-sizes-than-base-index-after-reindexation/1816/1 "2015-06-03T11:08:32Z")
Hello, I wrote an application who does the reindexation. It reads from one index with scan and scroll and send it to another index. Here I got two things on the new index: I have exactly the same size of the documents as the base index I have %50 more size than the base index ( I have the same number of shards and replica) Do you have any idea why I have more size while having the same number of documents and is this a problem? EDIT: I looked at the segments settings the only difference is here 1--- segments: { count: 97 memory\_in\_bytes: 42480824 index\_writer\_memory\_in\_bytes: 0 index\_writer\_max\_memory\_in\_bytes: 2634022912 version\_map\_memory\_in\_bytes: 0 fixed\_bit\_set\_memory\_in\_bytes: 0 2---- segments: { count: 42 memory\_in\_bytes: 23748772 index\_writer\_memory\_in\_bytes: 0 index\_writer\_max\_memory\_in\_bytes: 1024000 version\_map\_memory\_in\_bytes: 0 fixed\_bit\_set\_memory\_in\_bytes: 0 Thank you ---
**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Post date:** [June 3, 2015, 12:10pm UTC](https://discuss.elastic.co/t/i-got-much-more-sizes-than-base-index-after-reindexation/1816/2 "2015-06-03T12:10:59Z")
How can you tell there is this difference? Ultimately you'd have to compare the documents to see if there is a difference. ---
**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\ **Post date:** [June 3, 2015, 12:16pm UTC](https://discuss.elastic.co/t/i-got-much-more-sizes-than-base-index-after-reindexation/1816/3 "2015-06-03T12:16:10Z")
Have you changed any mappings between the two indices that could explain the size difference? Have you optimised any of the indices? ---
**Author:** ![Mehmet\_Ozer](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/mehmet_ozer/32/81567_2.png) [@Mehmet\_Ozer](https://discuss.elastic.co/u/Mehmet_Ozer)\ **Post date:** [June 3, 2015, 12:37pm UTC](https://discuss.elastic.co/t/i-got-much-more-sizes-than-base-index-after-reindexation/1816/4 "2015-06-03T12:37:29Z")
I am using the head plugin to visualize the indexes. So that I can see the number of documents and size. ---
**Author:** ![Mehmet\_Ozer](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/mehmet_ozer/32/81567_2.png) [@Mehmet\_Ozer](https://discuss.elastic.co/u/Mehmet_Ozer)\ **Post date:** [June 3, 2015, 12:37pm UTC](https://discuss.elastic.co/t/i-got-much-more-sizes-than-base-index-after-reindexation/1816/5 "2015-06-03T12:37:59Z")
If I am not wrong I did not use any optimize on the indexes but I will verify again. ---
**Author:** ![Mehmet\_Ozer](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/mehmet_ozer/32/81567_2.png) [@Mehmet\_Ozer](https://discuss.elastic.co/u/Mehmet_Ozer)\ **Post date:** [June 3, 2015, 12:55pm UTC](https://discuss.elastic.co/t/i-got-much-more-sizes-than-base-index-after-reindexation/1816/6 "2015-06-03T12:55:31Z")
Nope, I have done any optimization on the indexes. ---
**Author:** ![nik9000](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/nik9000/32/44947_2.png) [@nik9000](https://discuss.elastic.co/u/nik9000)\ **Post date:** [June 3, 2015, 2:16pm UTC](https://discuss.elastic.co/t/i-got-much-more-sizes-than-base-index-after-reindexation/1816/7 "2015-06-03T14:16:35Z")
How many segments? How many deleted docs? Those all have overhead. ---
**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\ **Post date:** [June 3, 2015, 4:13pm UTC](https://discuss.elastic.co/t/i-got-much-more-sizes-than-base-index-after-reindexation/1816/8 "2015-06-03T16:13:48Z")
Can you try to optimise both indices and see if the size difference changes? ---
**Author:** ![Mehmet\_Ozer](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/mehmet_ozer/32/81567_2.png) [@Mehmet\_Ozer](https://discuss.elastic.co/u/Mehmet_Ozer)\ **Post date:** [June 4, 2015, 3:34pm UTC](https://discuss.elastic.co/t/i-got-much-more-sizes-than-base-index-after-reindexation/1816/9 "2015-06-04T15:34:36Z")
I tried optimization too but no differences. Another question do we have to have exactly same size after reindexation ? ---
**Author:** ![Mehmet\_Ozer](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/mehmet_ozer/32/81567_2.png) [@Mehmet\_Ozer](https://discuss.elastic.co/u/Mehmet_Ozer)\ **Post date:** [June 4, 2015, 3:34pm UTC](https://discuss.elastic.co/t/i-got-much-more-sizes-than-base-index-after-reindexation/1816/10 "2015-06-04T15:34:50Z")
All of them identical ---
**Author:** ![Mehmet\_Ozer](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/mehmet_ozer/32/81567_2.png) [@Mehmet\_Ozer](https://discuss.elastic.co/u/Mehmet_Ozer)\ **Post date:** [June 4, 2015, 3:37pm UTC](https://discuss.elastic.co/t/i-got-much-more-sizes-than-base-index-after-reindexation/1816/11 "2015-06-04T15:37:16Z")
I have tried reindexation for many indexes. I got the same doc number every time, and nearly the same size for other indexes. But still got the difference for one of my indexes (%50 size difference), what can be the other possibilities ? ---
**Author:** ![mosiddi](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/mosiddi/32/577_2.png) [@mosiddi](https://discuss.elastic.co/u/mosiddi)\ **Post date:** [June 10, 2015, 4:13am UTC](https://discuss.elastic.co/t/i-got-much-more-sizes-than-base-index-after-reindexation/1816/12 "2015-06-10T04:13:26Z")
are u adding the content for the first time in that index? OR you are rewriting the same documents? What is the delete %age? If delete %age is different, try optimize (expunge delete) and compare sizes. It wont't be exact same size but not huge difference too. ---
**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\ **Post date:** [June 10, 2015, 6:37am UTC](https://discuss.elastic.co/t/i-got-much-more-sizes-than-base-index-after-reindexation/1816/13 "2015-06-10T06:37:36Z")
Have you compared the mappings between these two indices? Are there any differences that could result in this size difference? ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 12:08am UTC](https://discuss.elastic.co/t/i-got-much-more-sizes-than-base-index-after-reindexation/1816/14 "2017-07-06T00:08:42Z")