Hi All, I see this issue where Kibana is not updating index on the "Discover" page while there is a definite increase in the size of the related index. Also for some reason Discover page shows data with one hour interval. Please see below: [image] The "Storage Size" keeps incrementing with no c…

Hi @zaeemmasood There are a couple of possible reasons this could happen. What is the refresh interval set to? The docs will not show until the refresh interval is past. More likely what is happening is that the incoming documents are outside your time selection... i.e. you have some old logs com…

Thanks. I am doing manual refresh after setting interval as last 5 hours. Even if I set it to last 15 minutes it doesnt show any data while the index size increases gradually. I know for sure that the data is continuously coming in.

[image] zaeemmasood: I am doing manual refresh after setting interval as last 5 hours. I am not talking about Refresh in Kibana .... I am talking about the refresh interval at the index level but that is probably not the issue... In short the most likely logs that are coming in ... are not w…

Storage can get reduced when a merges (compaction) happens... the doc count looks like it is increasing

Thanks! Looks like after I set the date range as per what you said I see continuous stream of messages. See below [image] Question is why is it showing time of 11:35AM EST when I refresh just now? Is there a lag somewhere?

That time stamp you highlighted is the time stamp converted to the Time Zone in the browser OR perhaps you changed a setting in Kibana Advanced Setting... Discover show relative to the Kibana Setting .. You can see the actual UTC in the document [Screenshot 2023-04-26 at 3.08.03 PM] [Screenshot…

thanks @stephenb This set up has been running fine for over 2 years now and this issue has cropped up all of sudden. Also browser setting in terms of Kibana has not changed ever since. Index refresh interval is set to default 1s. Servers health has been also showing ok. That leaves "lag" which c…

So Lag is most likely the case... Lag AKA Backpressure can come from many reason or combinations of reasons and can be hard to diagnose... you are going to need to look closely at every step... [image] zaeemmasood: That leaves "lag" which could be because of some "network issue". I am not s…

Thanks. There has not been any change lately in terms of logs. Logstash instance listening on port 5044 has around 20 applications pushing logs from various servers and indices getting created. Interestingly, the issue is in only 1 out of the 20 applications. Rest all the 19 apps have their indi…

Discuss the Elastic Stack

Kibana not updating index in Discover

Elastic Stack Elasticsearch

zaeemmasood April 26, 2023, 9:45pm 4

Also a very strange thing was noted. I see that the index size "Storage size" gets reduced now. Notice it was 123.1 gb earlier

Topic		Replies	Views
Kibana Discover not updating Kibana	2	434	December 7, 2018
Kibana discover not showing data Kibana	10	3570	April 12, 2021
Kibana Discover tab not displaying data for index pattern Kibana	9	5792	August 11, 2020
Multiple issues with Kibana Discover page Kibana	5	491	May 21, 2019
Kibana no documents in index showing in discover Kibana	3	1658	November 20, 2018

Elasticsearch is a trademark of Elasticsearch BV, registered in the U.S. and in other countries
Trademarks
Terms
Privacy
Brand
Code of Conduct

Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant logo are trademarks of the Apache Software Foundation in the United States and/or other countries.

Kibana not updating index in Discover

Related topics