# Kibana not showing the Latest logs **URL:** \ **Category:** Kibana\ **Created:** [October 10, 2018, 6:42pm UTC](https://discuss.elastic.co/t/kibana-not-showing-the-latest-logs/151918 "2018-10-10T18:42:36Z")\ **Posts on this page:** 7\ **Page:** 1
**Author:** ![JawadKM](https://avatars.discourse-cdn.com/v4/letter/j/dbc845/32.png) [@JawadKM](https://discuss.elastic.co/u/JawadKM)\ **Post date:** [October 10, 2018, 6:42pm UTC](https://discuss.elastic.co/t/kibana-not-showing-the-latest-logs/151918/1 "2018-10-10T18:42:36Z")
Hi, I am using Elasticsearch/Kibana v 6.4.1 I configured my environment in such a way that I am using syslog-ng to push logs into elasticsearch and then display in kibana. The problem I am facing right now is that I was able to view my logs up-till Oct 3rd, 2018 and after that it just stopped working. This is the first time I am working with Kibana and Elasticsearch. your help in this regards will be highly appreciated. Below are the logs I have elasticsearch]# sudo tail -f gc.log.0.current 2018-10-10T13:52:22.820-0400: 1286493.354: Total time for which application threads were stopped: 0.0062639 seconds, Stopping threads took: 0.0000711 seconds 2018-10-10T13:52:28.799-0400: 1286499.332: Total time for which application threads were stopped: 0.0007719 seconds, Stopping threads took: 0.0001206 seconds 2018-10-10T13:52:33.837-0400: 1286504.370: [GC (Allocation Failure) 2018-10-10T13:52:33.837-0400: 1286504.370: [ParNew Desired survivor size 8716288 bytes, new threshold 6 (max 6) - age 1: 483856 bytes, 483856 total - age 2: 32 bytes, 483888 total - age 3: 64 bytes, 483952 total - age 4: 6576 bytes, 490528 total - age 6: 576 bytes, 491104 total # curl -XGET [http://localhost:9200/\_cat/indices?v](http://localhost:9200/_cat/indices?v) health status index uuid pri rep docs.count docs.deleted store.size pri.store.size green open .kibana aibdk5WFTT65EiOh8ed0gg 1 0 3 0 19.8kb 19.8kb yellow open syslog-ng nKG09rgtTiumAW5vZPbySw 5 1 65378579 0 9.1gb 9.1gb # curl -XGET [http://localhost:9200/syslog-ng](http://localhost:9200/syslog-ng) {"syslog-ng":{"aliases":{},"mappings":{"test":{"properties":{"0":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"FACILITY":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"FILE\_NAME":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"HOST":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"HOST\_FROM":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"ISODATE":{"type":"date"},"LEGACY\_MSGHDR":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"MESSAGE":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"PID":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"PRIORITY":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"PROGRAM":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"SOURCE":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"\_SDATA":{"properties":{"meta":{"properties":{"sequenceId":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}}}}}},"amsg":{"properties":{"acct":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"addr":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"cipher":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"cmd":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"comm":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"cwd":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"default-context":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"direction":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"exe":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"fp":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"grantors":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"grp":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"hostname":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"id":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"kind":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"ksize":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"laddr":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"lport":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"mac":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"op":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"pfs":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"res":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"rport":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"selected-context":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"spid":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"suid":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"terminal":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"unit":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}}}},"auditd":{"properties":{"a0":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"a1":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"a2":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"a3":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"arch":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"auid":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"comm":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"dev":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"egid":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"euid":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"exe":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"exit":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"fsgid":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}}}}}}},"settings":{"index":{"number\_of\_shards":"5","blocks":{"read\_only\_allow\_delete":"true"},"provided\_name":"syslog-ng","creation\_date":"1537284866694","number\_of\_replicas":"1","uuid":"nKG09rgtTiumAW5vZPbySw","version":{"created":"6040099","upgraded":"6040199"}}}}} # curl -XGET [http://localhost:9200/syslog-ng-2018-10-10](http://localhost:9200/syslog-ng-2018-10-10) {"error":{"root\_cause":[{"type":"index\_not\_found\_exception","reason":"no such index","resource.type":"index\_or\_alias","resource.id":"syslog-ng-2018-10-10","index\_uuid":"_na_","index":"syslog-ng-2018-10-10"}],"type":"index\_not\_found\_exception","reason":"no such index","resource.type":"index\_or\_alias","resource.id":"syslog-ng-2018-10-10","index\_uuid":"_na_","index":"syslog-ng-2018-10-10"},"status":404} Looking forward to hearing from you soon. ---
**Author:** ![JawadKM](https://avatars.discourse-cdn.com/v4/letter/j/dbc845/32.png) [@JawadKM](https://discuss.elastic.co/u/JawadKM)\ **Post date:** [October 10, 2018, 6:46pm UTC](https://discuss.elastic.co/t/kibana-not-showing-the-latest-logs/151918/2 "2018-10-10T18:46:27Z")
curl -XGET [http://localhost:9200/syslog-ng](http://localhost:9200/syslog-ng) 2018-10-10 {"syslog-ng":{"aliases":{},"mappings":{"test":{"properties":{"0":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"FACILITY":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"FILE\_NAME":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"HOST":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"HOST\_FROM":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"ISODATE":{"type":"date"},"LEGACY\_MSGHDR":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"MESSAGE":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"PID":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"PRIORITY":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"PROGRAM":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"SOURCE":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"\_SDATA":{"properties":{"meta":{"properties":{"sequenceId":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}}}}}},"amsg":{"properties":{"acct":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"addr":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"cipher":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"cmd":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"comm":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"cwd":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"default-context":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"direction":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"exe":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"fp":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"grantors":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"grp":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"hostname":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"id":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"kind":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"ksize":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"laddr":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"lport":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"mac":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"op":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"pfs":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"res":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"rport":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"selected-context":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"spid":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"suid":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"terminal":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"unit":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}}}},"auditd":{"properties":{"a0":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"a1":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"a2":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"a3":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"arch":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"auid":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"comm":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"dev":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"egid":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"euid":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"exe":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"exit":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"fsgid":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"fsuid":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"gid":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"ino":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"items":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"key":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"msg":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"name":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"old-auid":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"old-ses":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"pid":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"ppid":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"proctitle":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"res":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"scontext":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"ses":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"sgid":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"subj":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"success":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"suid":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"syscall":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"tclass":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"tcontext":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"tty":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}},"uid":{"type":"text","fields":{"keyword":{"type":"keyword","ignore\_above":256}}}}}}}},"settings":{"index":{"number\_of\_shards":"5","blocks":{"read\_only\_allow\_delete":"true"},"provided\_name":"syslog-ng","creation\_date":"1537284866694","number\_of\_replicas":"1","uuid":"nKG09rgtTiumAW5vZPbySw","version":{"created":"6040099","upgraded":"6040199"}}}}}curl: (6) Could not resolve host: 2018-10-10; Unknown error ---
**Author:** ![Marius\_Dragomir](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/marius_dragomir/32/42087_2.png) [@Marius\_Dragomir](https://discuss.elastic.co/u/Marius_Dragomir)\ **Post date:** [October 11, 2018, 12:45pm UTC](https://discuss.elastic.co/t/kibana-not-showing-the-latest-logs/151918/3 "2018-10-11T12:45:25Z")
Sounds like there is a problem between syslog and Elasticsearch since the index doesn't sem to be present for October 10th (from your request). Any information in the Elasticsearch logs? Maybe the disk full watermark hit and closed the node for writing or some kind of connection problem. ---
**Author:** ![JawadKM](https://avatars.discourse-cdn.com/v4/letter/j/dbc845/32.png) [@JawadKM](https://discuss.elastic.co/u/JawadKM)\ **Post date:** [October 11, 2018, 3:14pm UTC](https://discuss.elastic.co/t/kibana-not-showing-the-latest-logs/151918/4 "2018-10-11T15:14:52Z")
Thanks Marius, I am having issue locating Elasticsearch logs can you guide me where can I find them? ---
**Author:** ![Marius\_Dragomir](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/marius_dragomir/32/42087_2.png) [@Marius\_Dragomir](https://discuss.elastic.co/u/Marius_Dragomir)\ **Post date:** [October 14, 2018, 2:38pm UTC](https://discuss.elastic.co/t/kibana-not-showing-the-latest-logs/151918/5 "2018-10-14T14:38:03Z")
it depends on what method you used to install Elasticsearch: [https://www.elastic.co/guide/en/elasticsearch/reference/current/settings.html](https://www.elastic.co/guide/en/elasticsearch/reference/current/settings.html) and if you set any specific path for the logs. ---
**Author:** ![JawadKM](https://avatars.discourse-cdn.com/v4/letter/j/dbc845/32.png) [@JawadKM](https://discuss.elastic.co/u/JawadKM)\ **Post date:** [October 22, 2018, 6:46pm UTC](https://discuss.elastic.co/t/kibana-not-showing-the-latest-logs/151918/6 "2018-10-22T18:46:06Z")
@Marius I uninstalled and re installed elasticsearch, deleted the index from kibana and added it again, and started getting the latest logs. What could be the reason to have caused the elasticsearch not to process the logs and display in Kibana. Also what I have notices is that there are a lot of dropped messages drop messages,even with the new install I am getting a lot of drop messages, would you be able to assist me with this issue. I believe this whole issue was caused by huge the number of dropped messages. (just my observation) **$ sudo syslog-ng-ctl stats** SourceName;SourceId;SourceInstance;State;Type;Number source;s\_network;;a;processed;545 destination;d\_elastic;;a;processed;545 dst.java;d\_elastic#0;java\_dst,ElasticSearch\_v2,syslog-ng \>\> /etc/elasticsearch/elasticsearch.yml,syslog-ng;a;dropped;37 dst.java;d\_elastic#0;java\_dst,ElasticSearch\_v2,syslog-ng \>\> /etc/elasticsearch/elasticsearch.yml,syslog-ng;a;processed;545 dst.java;d\_elastic#0;java\_dst,ElasticSearch\_v2,syslog-ng \>\> /etc/elasticsearch/elasticsearch.yml,syslog-ng;a;queued;0 dst.java;d\_elastic#0;java\_dst,ElasticSearch\_v2,syslog-ng \>\> /etc/elasticsearch/elasticsearch.yml,syslog-ng;a;written;508 center;;received;a;processed;545 center;;queued;a;processed;545 global;scratch\_buffers\_count;;a;queued;167503724576 global;payload\_reallocs;;a;processed;4 global;sdata\_updates;;a;processed;545 global;scratch\_buffers\_bytes;;a;queued;0 global;msg\_clones;;a;processed;0 looking forward to here from you soon. ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [November 19, 2018, 6:51pm UTC](https://discuss.elastic.co/t/kibana-not-showing-the-latest-logs/151918/7 "2018-11-19T18:51:06Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.