# Not able to see latest logs in discover in kibana

**URL:** https://discuss.elastic.co/t/not-able-to-see-latest-logs-in-discover-in-kibana/257688
**Category:** Kibana
**Created:** [December 4, 2020, 6:12pm UTC](https://discuss.elastic.co/t/not-able-to-see-latest-logs-in-discover-in-kibana/257688 "2020-12-04T18:12:17Z")
**Posts on this page:** 12
**Page:** 1

<div class="post-metadata">

### Author: ![prat](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/prat/32/79978_2.png) [@prat](https://discuss.elastic.co/u/prat)
#### Post date: [December 4, 2020, 6:12pm UTC](https://discuss.elastic.co/t/not-able-to-see-latest-logs-in-discover-in-kibana/257688/1 "2020-12-04T18:12:17Z")

</div>

Hi Team,

I am not able to see latest logs in discover tab in kibana. the last logs I can see is of 1 Dec 2020 but not after that.

I can see folders getting created till today in /opt/elasticsearch/nodes/0/indices/, then why new logs are not shown in kibana.

(/opt/elasticsearch is path.data)

I checked all the services are up. What I need to check to fix this issue?

Can you please help

Thanks,

---

<div class="post-metadata">

### Author: ![aaron-nimocks](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/aaron-nimocks/32/73965_2.png) [@aaron-nimocks](https://discuss.elastic.co/u/aaron-nimocks)
#### Post date: [December 4, 2020, 6:18pm UTC](https://discuss.elastic.co/t/not-able-to-see-latest-logs-in-discover-in-kibana/257688/2 "2020-12-04T18:18:20Z")

</div>

Check date filter to ensure the correct range is correct?

If you look at the index under Management do you see the size or doc count increasing?  
Is the heath yellow or green?

 ![image](https://us1.discourse-cdn.com/elastic/original/3X/9/0/907f0ed812cf6dbbf6a2e0d63be6c523b0fec1e3.png)

How are you ingesting the data?

---

<div class="post-metadata">

### Author: ![prat](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/prat/32/79978_2.png) [@prat](https://discuss.elastic.co/u/prat)
#### Post date: [December 4, 2020, 6:35pm UTC](https://discuss.elastic.co/t/not-able-to-see-latest-logs-in-discover-in-kibana/257688/3 "2020-12-04T18:35:42Z")

</div>

Hi @aaron-nimocks,

Thanks for your reply.

Check date filter to ensure the correct range is correct

> How can I check this?

Data flow goes like,  
Filebeat to kafka , kafka to logstatsh and then to  
elasticsearch.

---

<div class="post-metadata">

### Author: ![aaron-nimocks](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/aaron-nimocks/32/73965_2.png) [@aaron-nimocks](https://discuss.elastic.co/u/aaron-nimocks)
#### Post date: [December 4, 2020, 6:37pm UTC](https://discuss.elastic.co/t/not-able-to-see-latest-logs-in-discover-in-kibana/257688/4 "2020-12-04T18:37:56Z")

</div>

Check that filter and just use last 24 or 48 hours. Something after December 1st.

 ![image](https://us1.discourse-cdn.com/elastic/original/3X/0/b/0b8a293efd3d14f614cd06fc5f57eafea1dcd97e.png)

---

<div class="post-metadata">

### Author: ![prat](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/prat/32/79978_2.png) [@prat](https://discuss.elastic.co/u/prat)
#### Post date: [December 4, 2020, 6:44pm UTC](https://discuss.elastic.co/t/not-able-to-see-latest-logs-in-discover-in-kibana/257688/5 "2020-12-04T18:44:20Z")

</div>

Hi @aaron-nimocks,

When I login to kibana and click on discover, 15 mins is by default selected and I see no logs. I have to change that to 7 days ago and then I see last logs of 1 dec.

---

<div class="post-metadata">

### Author: ![aaron-nimocks](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/aaron-nimocks/32/73965_2.png) [@aaron-nimocks](https://discuss.elastic.co/u/aaron-nimocks)
#### Post date: [December 4, 2020, 6:48pm UTC](https://discuss.elastic.co/t/not-able-to-see-latest-logs-in-discover-in-kibana/257688/6 "2020-12-04T18:48:18Z")

</div>

Do you have Stack Monitoring setup where you can see your Logstash ingestion stats? It would show if you have been receiving data.

Or I would check the logstash logs to see if anything is being processed.

---

<div class="post-metadata">

### Author: ![prat](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/prat/32/79978_2.png) [@prat](https://discuss.elastic.co/u/prat)
#### Post date: [December 6, 2020, 7:00am UTC](https://discuss.elastic.co/t/not-able-to-see-latest-logs-in-discover-in-kibana/257688/7 "2020-12-06T07:00:49Z")

</div>

Hi @aaron-nimocks,

Thanks for reply. yesterday I performed some housekeeping on /var,/opt to free up some space and also kafka service was down, I restarted it and was able to see logs in filebeat.

I saw some numbers in logstash in stack monitoring.

I will monitor if new logs are coming to kibana or not.

---

<div class="post-metadata">

### Author: ![prat](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/prat/32/79978_2.png) [@prat](https://discuss.elastic.co/u/prat)
#### Post date: [December 6, 2020, 7:07am UTC](https://discuss.elastic.co/t/not-able-to-see-latest-logs-in-discover-in-kibana/257688/8 "2020-12-06T07:07:36Z")

</div>

I can see yesterday's (5th Dec) index got created after making some space and restarting kafka.

below is the screen shot of filebeat indices.

 ![filebeat_indices](https://us1.discourse-cdn.com/elastic/original/3X/1/8/18c99b1a5b6eafc815a4ec5dda5533fc6eeafb46.png)

Why it is saying 7 indices have lifecycle errors? what it means?

for how many days, indices have retention period and do they get auto deleted after that period?

below screen shot is after clicking on `Show errors`

![lifecycle_errors](https://us1.discourse-cdn.com/elastic/original/3X/d/d/ddb1bf2d18dd69deb411744d1f240f8d9270298c.png)

Thanks,

---

<div class="post-metadata">

### Author: ![prat](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/prat/32/79978_2.png) [@prat](https://discuss.elastic.co/u/prat)
#### Post date: [December 8, 2020, 5:09pm UTC](https://discuss.elastic.co/t/not-able-to-see-latest-logs-in-discover-in-kibana/257688/9 "2020-12-08T17:09:08Z")

</div>

Hi @aaron-nimocks

Can you please reply.

---

<div class="post-metadata">

### Author: ![aaron-nimocks](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/aaron-nimocks/32/73965_2.png) [@aaron-nimocks](https://discuss.elastic.co/u/aaron-nimocks)
#### Post date: [December 8, 2020, 5:21pm UTC](https://discuss.elastic.co/t/not-able-to-see-latest-logs-in-discover-in-kibana/257688/10 "2020-12-08T17:21:26Z")

</div>

I am not sure for ILM policies. Might be best to make a new topic for this specific issue.

Most likely it was an error due to the disk being full?

---

<div class="post-metadata">

### Author: ![prat](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/prat/32/79978_2.png) [@prat](https://discuss.elastic.co/u/prat)
#### Post date: [December 8, 2020, 5:23pm UTC](https://discuss.elastic.co/t/not-able-to-see-latest-logs-in-discover-in-kibana/257688/11 "2020-12-08T17:23:20Z")

</div>

Hi @aaron-nimocks

Thanks for your quick response.

I will create new topic but its always there even if there is free space.

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [January 5, 2021, 5:23pm UTC](https://discuss.elastic.co/t/not-able-to-see-latest-logs-in-discover-in-kibana/257688/12 "2021-01-05T17:23:21Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
