# Incorrect Doc Count vs index total returns in ES

**URL:** https://discuss.elastic.co/t/incorrect-doc-count-vs-index-total-returns-in-es/222182
**Category:** Elasticsearch
**Created:** [March 5, 2020, 12:23am UTC](https://discuss.elastic.co/t/incorrect-doc-count-vs-index-total-returns-in-es/222182 "2020-03-05T00:23:05Z")
**Posts on this page:** 6
**Page:** 1

<div class="post-metadata">

### Author: ![Wayne\_Taylor](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/wayne_taylor/32/45984_2.png) [@Wayne\_Taylor](https://discuss.elastic.co/u/Wayne_Taylor)
#### Post date: [March 5, 2020, 12:23am UTC](https://discuss.elastic.co/t/incorrect-doc-count-vs-index-total-returns-in-es/222182/1 "2020-03-05T00:23:05Z")

</div>

Hi team,

Using ES 7.1.1 and noticing a weird count of documents shown in Kibana vs the reporting totals from ES APIs and Elastic HQ.

Specifically, I have an index pattern created daily for Jaeger spans. This is showing over 700 million entries (which is crazy). However, if I use Kibana I am more like 20 Million.

As i understand from : [Docs Count vs Index\_total](https://discuss.elastic.co/t/docs-count-vs-index-total/113511). That doc count is total documents where as total\_index = number of operations including deletes and updates.

 ![Screen Shot 2020-03-04 at 6.16.53 PM](https://us1.discourse-cdn.com/elastic/original/3X/c/7/c7610b25a946433885ff2c03ea17ea33b854c713.png)

Here is difference from raw ES Index stat API and ES count API. Notice ES count API seems more in line with whats expected

 ![Screen Shot 2020-03-04 at 6.25.13 PM](https://us1.discourse-cdn.com/elastic/original/3X/9/f/9fed067033c61d623f6d7be29e3b8f4188b7113d.png) ![Screen Shot 2020-03-04 at 6.25.34 PM](https://us1.discourse-cdn.com/elastic/original/3X/9/3/9315d193f8ac80ca04bbc38138560238d1fd4aa9.png)

Is this a known bug or did i miss something?

Wayne

---

<div class="post-metadata">

### Author: ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)
#### Post date: [March 5, 2020, 1:26pm UTC](https://discuss.elastic.co/t/incorrect-doc-count-vs-index-total-returns-in-es/222182/2 "2020-03-05T13:26:32Z")

</div>

Are you using `nested` data type in your mapping by any chance?

---

<div class="post-metadata">

### Author: ![Wayne\_Taylor](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/wayne_taylor/32/45984_2.png) [@Wayne\_Taylor](https://discuss.elastic.co/u/Wayne_Taylor)
#### Post date: [March 5, 2020, 1:54pm UTC](https://discuss.elastic.co/t/incorrect-doc-count-vs-index-total-returns-in-es/222182/3 "2020-03-05T13:54:42Z")

</div>

Hi @dadoonet - yes. Jaeger uses a lot of nested data types for key values pairs e.g. process has lots of sub items such as process.servicename and even sub nests in there.

Assuming based upon your response this count ?

Wayne

---

<div class="post-metadata">

### Author: ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)
#### Post date: [March 5, 2020, 2:10pm UTC](https://discuss.elastic.co/t/incorrect-doc-count-vs-index-total-returns-in-es/222182/4 "2020-03-05T14:10:31Z")

</div>

Every nested document is a Lucene document indeed. But from elasticsearch, only the "parent" document is reported when you search.

---

<div class="post-metadata">

### Author: ![Wayne\_Taylor](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/wayne_taylor/32/45984_2.png) [@Wayne\_Taylor](https://discuss.elastic.co/u/Wayne_Taylor)
#### Post date: [March 5, 2020, 2:13pm UTC](https://discuss.elastic.co/t/incorrect-doc-count-vs-index-total-returns-in-es/222182/5 "2020-03-05T14:13:59Z")

</div>

Thanks @dadoonet. This makes a lot more sense as to why our spans index reported this way then. Good to know. Marking as the resolution and appreciate your response 🙂

Wayne

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [April 2, 2020, 2:14pm UTC](https://discuss.elastic.co/t/incorrect-doc-count-vs-index-total-returns-in-es/222182/6 "2020-04-02T14:14:01Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
