# Background count in significant\_terms not consistent?

**URL:** <https://discuss.elastic.co/t/background-count-in-significant-terms-not-consistent/55824>\
**Category:** Elasticsearch\
**Created:** [July 19, 2016, 6:12am UTC](https://discuss.elastic.co/t/background-count-in-significant-terms-not-consistent/55824 "2016-07-19T06:12:33Z")\
**Posts on this page:** 1\
**Showing post:** 8

<div class="post-metadata">

**Author:** ![Mark\_Harwood](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/mark_harwood/32/10538_2.png) [@Mark\_Harwood](https://discuss.elastic.co/u/Mark_Harwood)\
**Post date:** [July 20, 2016, 1:05pm UTC](https://discuss.elastic.co/t/background-count-in-significant-terms-not-consistent/55824/8 "2016-07-20T13:05:10Z")

</div>

It's a general issue with distributed analytics 🙂

I always say it comes down to a pick 2-of-3 conundrum between **F** ast **A** ccurate and **B** ig. It's about trade-offs.

- If you wanted **BA** you'd use something like Hadoop and stream all term frequencies in a series of map-reduce phases until you got your answer. Accurate, but takes a while and may end up being the answer to yesterday's question.
- We do **BF** which means we do things fast but often using sketches of data from shards which can lose accuracy
- **FA** is the pre-big-data phase of computing when we had the luxury of doing everything on one machine.

So significant\_terms is one of these analytical functions that can suffer with accuracy because of the distribution of the data. Perhaps a worst-case scenario is one where you have time-based indices and you query across them all to find the most significant IP address visiting your website today. Shards outside of the chosen time range will match nothing and so are not going to report background stats for every IP address that they have seen. The results are then not seeing the whole picture.  
This is an extreme example where the physical distribution of the data is not conducive to the particular analysis you want to perform and so you would need to consider an alternative approach.

---

_[View the full topic](https://discuss.elastic.co/t/background-count-in-significant-terms-not-consistent/55824)._