# Reindex not copying every document that exists on the source index

**URL:** <https://discuss.elastic.co/t/reindex-not-copying-every-document-that-exists-on-the-source-index/239313>\
**Category:** Elasticsearch\
**Created:** [June 30, 2020, 1:27pm UTC](https://discuss.elastic.co/t/reindex-not-copying-every-document-that-exists-on-the-source-index/239313 "2020-06-30T13:27:32Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![egibrajshori](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/egibrajshori/32/64749_2.png) [@egibrajshori](https://discuss.elastic.co/u/egibrajshori)\
**Post date:** [June 30, 2020, 1:27pm UTC](https://discuss.elastic.co/t/reindex-not-copying-every-document-that-exists-on-the-source-index/239313/1 "2020-06-30T13:27:32Z")

</div>

I have around 20 indexes to reindex after some mapping changes but on any index that has a high number of documents e.g 500.000 the reindexing process stops abruptly and only a random number of document is reindexed.

Let's take for example this one : s3-data-3006 is the source index and s3-data is the destination.

Doing this :

```auto
    POST _reindex?
     {
       
       "conflicts": "proceed",
       "source": {
         "index": "s3-data_3006"
       },
       "dest": {
         "index": "s3-data",
         "op_type": "create"
       }
    }

```

Only copies around 150k documents, here's the results :

```auto
 {
   "took" : 48644,
   "timed_out" : false,
   "total" : 152189,
   "updated" : 0,
   "created" : 0,
   "deleted" : 0,
   "batches" : 153,
   "version_conflicts" : 152189,
   "noops" : 0,
   "retries" : {
     "bulk" : 0,
     "search" : 0
   },
   "throttled_millis" : 0,
   "requests_per_second" : -1.0,
   "throttled_until_millis" : 0,
   "failures" : []
 }

```

If trying to compare the count or size here's what I get :

```auto
    health status index uuid pri rep docs.count docs.deleted store.size pri.store.size
    green open s3-data ucG_JHb6QVGuUoSqBupCiQ 5 1 152189 44553 725.7mb 362.8mb
    green open s3-data_3006 ig0sA_gAS_iQdXVTJ6N2fw 5 1 2461654 721888 1.2gb 619.5mb

```

And this is everytime I try to reindex this or any particular index, it just stops abruptly everytime with nothing returned. I'm trying to understand why would this happen. This is one of the smaller indexes with around 1.2GB of data, if I can't reindex this one than imagine trying to reindex one of the indexes that contains 35GB of data.

Please let me know if you need any further information

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 28, 2020, 1:27pm UTC](https://discuss.elastic.co/t/reindex-not-copying-every-document-that-exists-on-the-source-index/239313/2 "2020-07-28T13:27:34Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.