# ElasticSearch when I index there is like a limit in which It stops indexing and increments the number of docs.deleted

**URL:** <https://discuss.elastic.co/t/elasticsearch-when-i-index-there-is-like-a-limit-in-which-it-stops-indexing-and-increments-the-number-of-docs-deleted/288797>\
**Category:** Elasticsearch\
**Created:** [November 9, 2021, 4:43pm UTC](https://discuss.elastic.co/t/elasticsearch-when-i-index-there-is-like-a-limit-in-which-it-stops-indexing-and-increments-the-number-of-docs-deleted/288797 "2021-11-09T16:43:49Z")\
**Posts on this page:** 7\
**Page:** 1

<div class="post-metadata">

**Author:** ![Juliito19](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/juliito19/32/102886_2.png) [@Juliito19](https://discuss.elastic.co/u/Juliito19)\
**Post date:** [November 9, 2021, 4:43pm UTC](https://discuss.elastic.co/t/elasticsearch-when-i-index-there-is-like-a-limit-in-which-it-stops-indexing-and-increments-the-number-of-docs-deleted/288797/1 "2021-11-09T16:43:49Z")

</div>

Hi,  
I have an Apliccation in which I have an Elasticsearch template and I Insert with the pattern of template+(yyyy-MM-dd),  
Well, So far, so good, I think, but for each Index I suppose that have like a Limit in which when you reach you can't index more in that Index, and I test and I can Index in another index,but less and less so.  
¿why I have like a limit per index?  
¿how can I solve It?

```auto
health status index uuid pri rep docs.count docs.deleted store.size pri.store.size
green open .kibana nP2yTlkuQxiBTFieX-K3wQ 1 0 2 1 14kb 14kb
green open log-dia-2021-11-14 DWz_kLNFRIeIun0a1PHcOQ 1 0 412420 151431 299.2mb 299.2mb
green open log-dia-2021-11-10 8E1ivgQ9Q2q3YOBldP-TnQ 1 0 1542586 0 766.7mb 766.7mb
green open log-dia-2021-11-12 AbVLbNdoSjSQ9THeUpP2hA 1 0 803606 0 420.3mb 420.3mb
green open log-dia-2021-11-16 lWh6uoW5QCOazvSsbnLQpQ 1 0 382653 11094 224.5mb 224.5mb
green open log-dia-2021-11-15 U2u4ZOCqTw6J9Hcn4H12VA 1 0 220177 0 120.2mb 120.2mb
green open log-dia-2021-11-9 ZcIC703RTuaZeTSXj0ilBg 1 0 981907 0 477.2mb 477.2mb
green open log-dia-2021-11-11 seXI_0D0TF2-IyLBJLzXYA 1 0 1119950 27668 586mb 586mb
green open log-dia-2021-11-08 PMAdP4ZpSqyg0gkgnOLg5Q 1 0 1489173 181958 798.7mb 798.7mb
green open log-dia-2021-11-13 pJuLYs8XTlKF8i7aPXM3CA 1 0 630403 72748 378.3mb 378.3mb

```

Best regards.  
Julio

---

<div class="post-metadata">

**Author:** ![alexdelcatadoiro](https://avatars.discourse-cdn.com/v4/letter/a/ac8455/32.png) [@alexdelcatadoiro](https://discuss.elastic.co/u/alexdelcatadoiro)\
**Post date:** [November 9, 2021, 5:07pm UTC](https://discuss.elastic.co/t/elasticsearch-when-i-index-there-is-like-a-limit-in-which-it-stops-indexing-and-increments-the-number-of-docs-deleted/288797/2 "2021-11-09T17:07:03Z")

</div>

(post deleted by author)

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [November 9, 2021, 5:15pm UTC](https://discuss.elastic.co/t/elasticsearch-when-i-index-there-is-like-a-limit-in-which-it-stops-indexing-and-increments-the-number-of-docs-deleted/288797/3 "2021-11-09T17:15:51Z")

</div>

How are you indexing into Elasticsearch? Are you by any chance specifying the document ID before indexing? The deleted documents can indicate updates, which can happen if multiple documents with the same ID are indexed.

Elasticsearch has a limit of around 2 billion documents per shard (not index) but at that point indexing results in an error and there are no deletes.

---

<div class="post-metadata">

**Author:** ![Juliito19](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/juliito19/32/102886_2.png) [@Juliito19](https://discuss.elastic.co/u/Juliito19)\
**Post date:** [November 10, 2021, 11:26am UTC](https://discuss.elastic.co/t/elasticsearch-when-i-index-there-is-like-a-limit-in-which-it-stops-indexing-and-increments-the-number-of-docs-deleted/288797/4 "2021-11-10T11:26:46Z")

</div>

Yeah, I specify the ID but each Id is a 4 UUID, the probability that they are being updated is practically 0, I think that is not the problem

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [November 10, 2021, 11:34am UTC](https://discuss.elastic.co/t/elasticsearch-when-i-index-there-is-like-a-limit-in-which-it-stops-indexing-and-increments-the-number-of-docs-deleted/288797/5 "2021-11-10T11:34:09Z")

</div>

If there are issues in the cluster this may force the sending party to have to resend bulk requests which in turn can result in updates that show up as deletes.

---

<div class="post-metadata">

**Author:** ![Juliito19](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/juliito19/32/102886_2.png) [@Juliito19](https://discuss.elastic.co/u/Juliito19)\
**Post date:** [November 10, 2021, 12:06pm UTC](https://discuss.elastic.co/t/elasticsearch-when-i-index-there-is-like-a-limit-in-which-it-stops-indexing-and-increments-the-number-of-docs-deleted/288797/6 "2021-11-10T12:06:27Z")

</div>

And how can I detect if I have a problem in the cluster?,  
Thanks

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [December 8, 2021, 12:07pm UTC](https://discuss.elastic.co/t/elasticsearch-when-i-index-there-is-like-a-limit-in-which-it-stops-indexing-and-increments-the-number-of-docs-deleted/288797/7 "2021-12-08T12:07:08Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
