# Wrong documents' count after inserting

**URL:** <https://discuss.elastic.co/t/wrong-documents-count-after-inserting/330284>\
**Category:** Elasticsearch\
**Created:** [April 19, 2023, 9:16am UTC](https://discuss.elastic.co/t/wrong-documents-count-after-inserting/330284 "2023-04-19T09:16:17Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![Gregory\_Kovalchuk](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/gregory_kovalchuk/32/119993_2.png) [@Gregory\_Kovalchuk](https://discuss.elastic.co/u/Gregory_Kovalchuk)\
**Post date:** [April 19, 2023, 9:16am UTC](https://discuss.elastic.co/t/wrong-documents-count-after-inserting/330284/1 "2023-04-19T09:16:17Z")

</div>

Hello, please help, I inserted data with spark several times but the count was all the time bigger than expected, how it can be?  
The version of ES is `8.5.0`.  
The query that I used to check: `GET index/_count`.

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [April 19, 2023, 10:51am UTC](https://discuss.elastic.co/t/wrong-documents-count-after-inserting/330284/2 "2023-04-19T10:51:15Z")

</div>

How much bigger it is?  
Are you setting the id of each document or let Elasticsearch create one?  
Did you run the job multiple time or are you cleaning the index before starting a new job?

---

<div class="post-metadata">

**Author:** ![Gregory\_Kovalchuk](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/gregory_kovalchuk/32/119993_2.png) [@Gregory\_Kovalchuk](https://discuss.elastic.co/u/Gregory_Kovalchuk)\
**Post date:** [April 19, 2023, 11:40am UTC](https://discuss.elastic.co/t/wrong-documents-count-after-inserting/330284/3 "2023-04-19T11:40:04Z")

</div>

1. ES shows me 117 744 651 but in Spark, I have 115 925 542;
2. ES creates id;
3. For sure, each time before a new job I made `DELETE index`.

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [April 19, 2023, 4:59pm UTC](https://discuss.elastic.co/t/wrong-documents-count-after-inserting/330284/4 "2023-04-19T16:59:14Z")

</div>

IMO something like a "retry" or anything like that is happening. As Elasticsearch generates the id, it creates duplicates.

You should if possible, set the id from your documents which would avoid having duplicates.

---

<div class="post-metadata">

**Author:** ![Gregory\_Kovalchuk](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/gregory_kovalchuk/32/119993_2.png) [@Gregory\_Kovalchuk](https://discuss.elastic.co/u/Gregory_Kovalchuk)\
**Post date:** [April 27, 2023, 8:07am UTC](https://discuss.elastic.co/t/wrong-documents-count-after-inserting/330284/5 "2023-04-27T08:07:51Z")

</div>

Thank you, that was the case.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [May 25, 2023, 8:08am UTC](https://discuss.elastic.co/t/wrong-documents-count-after-inserting/330284/6 "2023-05-25T08:08:29Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.