# Indice rollower duplicte docs

**URL:** <https://discuss.elastic.co/t/indice-rollower-duplicte-docs/202214>\
**Category:** Elasticsearch\
**Created:** [October 3, 2019, 4:20pm UTC](https://discuss.elastic.co/t/indice-rollower-duplicte-docs/202214 "2019-10-03T16:20:45Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![aniaks](https://avatars.discourse-cdn.com/v4/letter/a/ac8455/32.png) [@aniaks](https://discuss.elastic.co/u/aniaks)\
**Post date:** [October 3, 2019, 4:20pm UTC](https://discuss.elastic.co/t/indice-rollower-duplicte-docs/202214/1 "2019-10-03T16:20:45Z")

</div>

during the rollover - we notice the document count is already in the old index and when updating during that second the document count gets to the newly created indices as well. is there any way to prevent the duplication of data during the rollover? since it always the bulk upsert is there a way to avoid duplictes ?

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [October 3, 2019, 4:51pm UTC](https://discuss.elastic.co/t/indice-rollower-duplicte-docs/202214/2 "2019-10-03T16:51:02Z")

</div>

If you are doing updates and upsets I would recommend against using rollover. Why have you chosen this path?

---

<div class="post-metadata">

**Author:** ![aniaks](https://avatars.discourse-cdn.com/v4/letter/a/ac8455/32.png) [@aniaks](https://discuss.elastic.co/u/aniaks)\
**Post date:** [October 3, 2019, 4:53pm UTC](https://discuss.elastic.co/t/indice-rollower-duplicte-docs/202214/3 "2019-10-03T16:53:22Z")

</div>

We have huge volume of data coming in and hence want to rollover and keep certain number of indices for x hours.

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [October 3, 2019, 4:56pm UTC](https://discuss.elastic.co/t/indice-rollower-duplicte-docs/202214/4 "2019-10-03T16:56:27Z")

</div>

Why are you updating data? What is the use case and data model? Do you update all types of data?

---

<div class="post-metadata">

**Author:** ![aniaks](https://avatars.discourse-cdn.com/v4/letter/a/ac8455/32.png) [@aniaks](https://discuss.elastic.co/u/aniaks)\
**Post date:** [October 14, 2019, 1:57pm UTC](https://discuss.elastic.co/t/indice-rollower-duplicte-docs/202214/5 "2019-10-14T13:57:05Z")

</div>

We update the existing document as we get any update for that particular document. Our data is metrics data.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [November 11, 2019, 1:57pm UTC](https://discuss.elastic.co/t/indice-rollower-duplicte-docs/202214/6 "2019-11-11T13:57:08Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.