# Metricbeat Data Missing Past Midnight

**URL:** <https://discuss.elastic.co/t/metricbeat-data-missing-past-midnight/114669>\
**Category:** Kibana\
**Created:** [January 9, 2018, 9:26am UTC](https://discuss.elastic.co/t/metricbeat-data-missing-past-midnight/114669 "2018-01-09T09:26:59Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![directRoot](https://avatars.discourse-cdn.com/v4/letter/d/eb9ed0/32.png) [@directRoot](https://discuss.elastic.co/u/directRoot)\
**Post date:** [January 9, 2018, 9:26am UTC](https://discuss.elastic.co/t/metricbeat-data-missing-past-midnight/114669/1 "2018-01-09T09:26:59Z")

</div>

Hi all,

I'm using Metricbeat for system metrics, but every now and then system.filesystem.used.pct returns 0% for 24hrs from midnight, but only when being visualised. This happens whether I use Kibana or 3rd party Grafana. If I query for documents using "Discover", then those documents covering the midnight boundary are non-zero.

My indexes for Metricbeat are created daily, and it seems too much of a coincidence that the data would be missing for precisely the length of an index. To make matters even more confusing, the same indexes visualise information on CPU and memory usage perfectly, whilst the filesystem.used.pct is 0!

Any ideas?

Thanks,  
Chris.

Elasticsearch: 6.1.0  
Lucene: 7.1.0  
Kibana: 6.1.1  
Grafana: 4.6.3

 ![kibana (docs) 2358 Saturday - 0002 Sunday](https://us1.discourse-cdn.com/elastic/original/3X/2/3/23823fee778471714f78a25a64bb7b5f3de569e7.png)

![kibana 2358 Saturday - 0002 Sunday](https://us1.discourse-cdn.com/elastic/original/3X/6/7/67a752cebe1ea966b6dd2441f21b64e9d02241c7.png)

![grafana 2358 Saturday - 0002 Sunday](https://us1.discourse-cdn.com/elastic/original/3X/2/f/2fcfc09f67e2c560f88f4d5831a69ba5416001e5.png)

---

<div class="post-metadata">

**Author:** ![thomasneirynck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/thomasneirynck/32/23313_2.png) [@thomasneirynck](https://discuss.elastic.co/u/thomasneirynck)\
**Post date:** [January 9, 2018, 4:48pm UTC](https://discuss.elastic.co/t/metricbeat-data-missing-past-midnight/114669/2 "2018-01-09T16:48:05Z")

</div>

hi @directRoot,

I'm not sure about this.

Is this with all graphs or just with line-charts? What if you create a data-table, bucketed by hour, do you also see missing data then?

---

<div class="post-metadata">

**Author:** ![directRoot](https://avatars.discourse-cdn.com/v4/letter/d/eb9ed0/32.png) [@directRoot](https://discuss.elastic.co/u/directRoot)\
**Post date:** [January 10, 2018, 9:22am UTC](https://discuss.elastic.co/t/metricbeat-data-missing-past-midnight/114669/3 "2018-01-10T09:22:41Z")

</div>

Hi Thomas,

Thanks for getting back to me.

Yes, the same thing occurs with data tables.

**Works for CPU**

 ![table (hour bucket, CPU works)](https://us1.discourse-cdn.com/elastic/original/3X/d/e/de57d1f42daf1e4950d96290e312ffef3899655a.png)

**Doesn't work for disk by the minute...**  
 ![table (minute bucket)](https://us1.discourse-cdn.com/elastic/original/3X/c/5/c5ea1c58a0161114db5b5d7829b9e6f99c26d498.png)

**...or hour**  
 ![table (hourly bucket)](https://us1.discourse-cdn.com/elastic/original/3X/3/1/31ec15e6cd380dae60bc056e0f4194cf497ac31b.png)

I've also tried the filesystem.used.pct without the "...type: ext4" query; this changes the 0.52 values because it's including other file systems, but the values after midnight remain stubbornly 0.

At least if they were "-" then I'd know Elasticsearch thought they were missing!

Let me know if you want me to try anything else, or need some more detail on setup. I should probably also point out that it is Logstash that's creating the new index at the stroke of midnight.

Thanks,  
Chris.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [February 7, 2018, 9:22am UTC](https://discuss.elastic.co/t/metricbeat-data-missing-past-midnight/114669/4 "2018-02-07T09:22:45Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
