# Keep track of changes in documents after reindex

**URL:** https://discuss.elastic.co/t/keep-track-of-changes-in-documents-after-reindex/133006
**Category:** Elasticsearch
**Created:** [May 23, 2018, 2:35pm UTC](https://discuss.elastic.co/t/keep-track-of-changes-in-documents-after-reindex/133006 "2018-05-23T14:35:06Z")
**Posts on this page:** 5
**Page:** 1

<div class="post-metadata">

### Author: ![pedro\_brentan](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/pedro_brentan/32/4178_2.png) [@pedro\_brentan](https://discuss.elastic.co/u/pedro_brentan)
#### Post date: [May 23, 2018, 2:35pm UTC](https://discuss.elastic.co/t/keep-track-of-changes-in-documents-after-reindex/133006/1 "2018-05-23T14:35:07Z")

</div>

Hi,

We are using logstash to reindex from an Elasticsearch 2.4 cluster to an Elasticseearch 5.5 one.

It takes 12h to copy all the documents using 10 pipelines on logstash. Pretty fine.

The problem is that our documents lie all in the same index and they can be updated or deleted. So, after 12h and knowing that scroll is a snapshot, how can we apply the changes in the documents that happened during this time?

---

<div class="post-metadata">

### Author: ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)
#### Post date: [May 23, 2018, 10:21pm UTC](https://discuss.elastic.co/t/keep-track-of-changes-in-documents-after-reindex/133006/2 "2018-05-23T22:21:25Z")

</div>

There's nothing native to Elasticsearch that can handle this, you would need to do something like compare document versions in some external code.

---

<div class="post-metadata">

### Author: ![pedro\_brentan](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/pedro_brentan/32/4178_2.png) [@pedro\_brentan](https://discuss.elastic.co/u/pedro_brentan)
#### Post date: [May 23, 2018, 10:50pm UTC](https://discuss.elastic.co/t/keep-track-of-changes-in-documents-after-reindex/133006/3 "2018-05-23T22:50:50Z")

</div>

Thanks, Mark!

I guessed it would be manageable only via external tools, but tried this channel just hoping for someone with a related problem.

Best,  
Pedro.

---

<div class="post-metadata">

### Author: ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)
#### Post date: [May 23, 2018, 10:59pm UTC](https://discuss.elastic.co/t/keep-track-of-changes-in-documents-after-reindex/133006/4 "2018-05-23T22:59:21Z")

</div>

We are working towards a changes API off the back of sequence numbers, but I don't know the ETA of that/

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [June 20, 2018, 11:03pm UTC](https://discuss.elastic.co/t/keep-track-of-changes-in-documents-after-reindex/133006/5 "2018-06-20T23:03:34Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
