# Elasticsearch returns two documents with same ID but different versions

**URL:** <https://discuss.elastic.co/t/elasticsearch-returns-two-documents-with-same-id-but-different-versions/311802>\
**Category:** Elasticsearch\
**Created:** [August 10, 2022, 7:26am UTC](https://discuss.elastic.co/t/elasticsearch-returns-two-documents-with-same-id-but-different-versions/311802 "2022-08-10T07:26:44Z")\
**Posts on this page:** 13\
**Page:** 1

<div class="post-metadata">

**Author:** ![Andrey\_Tyutyunov](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/andrey_tyutyunov/32/98571_2.png) [@Andrey\_Tyutyunov](https://discuss.elastic.co/u/Andrey_Tyutyunov)\
**Post date:** [August 10, 2022, 7:26am UTC](https://discuss.elastic.co/t/elasticsearch-returns-two-documents-with-same-id-but-different-versions/311802/1 "2022-08-10T07:26:44Z")

</div>

ES version: 5.3.1

Some documents returns twice, updated and previous version

rq /purchases/payments/\_search?q=\_id:AYKCmqWVUjd1dFdxujwy&version=true

 ![Снимок экрана 2022-08-10 в 12.25.48](https://us1.discourse-cdn.com/elastic/original/3X/7/e/7ecfc3ce05247c1221fd047b749a60ae076995b4.jpeg)

Why it happens? How to fix it?

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [August 10, 2022, 7:32am UTC](https://discuss.elastic.co/t/elasticsearch-returns-two-documents-with-same-id-but-different-versions/311802/2 "2022-08-10T07:32:33Z")

</div>

That is a very old version that has been EOL for a long time. I would recommend you upgrade as soon as possible.

I have never seen this happen. How many nodes do you have in the cluster? How are these configured? Are you by any chance using routing?

If you at some point used routing and got the value wrong, you could end up writing the same document to multiple shards. To see if this is the case you could run the query you used to get these results with a few different routing values and see if you at some point only get one of the results.

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [August 10, 2022, 7:36am UTC](https://discuss.elastic.co/t/elasticsearch-returns-two-documents-with-same-id-but-different-versions/311802/3 "2022-08-10T07:36:22Z")

</div>

Welcome to our community! 😃

Please don't post pictures of text, logs or code. They are difficult to read, impossible to search and replicate (if it's code), and some people may not be even able to see them 🙂

---

<div class="post-metadata">

**Author:** ![Andrey\_Tyutyunov](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/andrey_tyutyunov/32/98571_2.png) [@Andrey\_Tyutyunov](https://discuss.elastic.co/u/Andrey_Tyutyunov)\
**Post date:** [August 10, 2022, 7:38am UTC](https://discuss.elastic.co/t/elasticsearch-returns-two-documents-with-same-id-but-different-versions/311802/4 "2022-08-10T07:38:39Z")

</div>

Thanks for the answer

Nodes: **3**  
Indices: **47**  
Memory: **46GB / 78GB**  
Total Shards: **326**  
Unassigned Shards: **0**  
Documents: **536,778,749**  
Data: **962GB**  
Version: **5.3.1**

26 GB on each node

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [August 10, 2022, 7:40am UTC](https://discuss.elastic.co/t/elasticsearch-returns-two-documents-with-same-id-but-different-versions/311802/5 "2022-08-10T07:40:29Z")

</div>

> [@Christian\_Dahlqvist](#):
>
> How are these configured?

What does your `elasticsearch.yml` file look like?

---

<div class="post-metadata">

**Author:** ![Andrey\_Tyutyunov](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/andrey_tyutyunov/32/98571_2.png) [@Andrey\_Tyutyunov](https://discuss.elastic.co/u/Andrey_Tyutyunov)\
**Post date:** [August 10, 2022, 7:43am UTC](https://discuss.elastic.co/t/elasticsearch-returns-two-documents-with-same-id-but-different-versions/311802/6 "2022-08-10T07:43:56Z")

</div>

One of node, others is the same

node.name: node1  
cluster.name: cluster  
network.host: ip1  
discovery.zen.ping.unicast.hosts: ["ip2", "ip3"]  
discovery.zen.minimum\_master\_nodes: 2  
path.repo: ["/opt/shares/es"]  
http.cors.enabled: true  
http.cors.allow-origin: "\*"  
indices.query.bool.max\_clause\_count: 10000  
xpack.security.enabled: false

Additional: search results is not stable, some request returns two documents, some returns only one document with the latest version

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [August 10, 2022, 7:47am UTC](https://discuss.elastic.co/t/elasticsearch-returns-two-documents-with-same-id-but-different-versions/311802/7 "2022-08-10T07:47:27Z")

</div>

Another thing you can try is to run the test with different [preference settings](https://www.elastic.co/guide/en/elasticsearch/reference/5.6/search-request-preference.html), potentially combined with different routing values. This could show if there is a difference between primaries and replicas.

---

<div class="post-metadata">

**Author:** ![Andrey\_Tyutyunov](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/andrey_tyutyunov/32/98571_2.png) [@Andrey\_Tyutyunov](https://discuss.elastic.co/u/Andrey_Tyutyunov)\
**Post date:** [August 10, 2022, 7:56am UTC](https://discuss.elastic.co/t/elasticsearch-returns-two-documents-with-same-id-but-different-versions/311802/8 "2022-08-10T07:56:05Z")

</div>

Thank you, it works

> preference=\_primary

Only one actual document, stable

> preference=\_replica

Only two documents like first my message, stable

> This could show if there is a difference between primaries and replicas

As I see, I have difference... Have I any chance to fix it?

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [August 10, 2022, 8:02am UTC](https://discuss.elastic.co/t/elasticsearch-returns-two-documents-with-same-id-but-different-versions/311802/9 "2022-08-10T08:02:45Z")

</div>

If you reduce the number of replicas for the index to 0 and then set it back to the original value the replica will be created as a copy of the primary. Note that a lot of improvements have been made to resiliency in newer version to avoid issues like this.

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [August 10, 2022, 8:07am UTC](https://discuss.elastic.co/t/elasticsearch-returns-two-documents-with-same-id-but-different-versions/311802/10 "2022-08-10T08:07:30Z")

</div>

Yes, you definitely need to upgrade to a version of Elasticsearch that is supported.

---

<div class="post-metadata">

**Author:** ![Andrey\_Tyutyunov](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/andrey_tyutyunov/32/98571_2.png) [@Andrey\_Tyutyunov](https://discuss.elastic.co/u/Andrey_Tyutyunov)\
**Post date:** [August 10, 2022, 8:12am UTC](https://discuss.elastic.co/t/elasticsearch-returns-two-documents-with-same-id-but-different-versions/311802/11 "2022-08-10T08:12:50Z")

</div>

Thank you, I will try this. Upgrade to new version in the future planned. Tell me please, how to reduce the chance of this problem? Add more nodes?

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [August 10, 2022, 8:13am UTC](https://discuss.elastic.co/t/elasticsearch-returns-two-documents-with-same-id-but-different-versions/311802/12 "2022-08-10T08:13:59Z")

</div>

You need to upgrade to improve resiliency for issues like this.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [September 7, 2022, 8:14am UTC](https://discuss.elastic.co/t/elasticsearch-returns-two-documents-with-same-id-but-different-versions/311802/13 "2022-09-07T08:14:59Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
