Hello there,
I have been playing around with Grok filters and I am using a static file that has logs and trying to use grok on the same. I have specified this log file's path in Filebeat config. Though i do not see any error in the logs, Kibana doesnt seem to show up any data. Can soemone please help me know where am i going wrong.
Filebeat logs:
=========================
2019-02-23T11:51:26Z INFO Home path: [/usr/share/filebeat] Config path: [/etc/filebeat] Data path: [/var/lib/filebeat] Logs path: [/var/log/filebeat]
2019-02-23T11:51:26Z INFO Setup Beat: filebeat; Version: 5.6.15
2019-02-23T11:51:26Z INFO Metrics logging every 30s
2019-02-23T11:51:26Z INFO Max Retries set to: 3
2019-02-23T11:51:26Z INFO Activated logstash as output plugin.
2019-02-23T11:51:26Z INFO Publisher name:
2019-02-23T11:51:26Z INFO Flush Interval set to: 1s
2019-02-23T11:51:26Z INFO Max Bulk Size set to: 2048
2019-02-23T11:51:26Z INFO filebeat start running.
2019-02-23T11:51:26Z INFO Registry file set to: /var/lib/filebeat/registry
2019-02-23T11:51:26Z INFO Loading registrar data from /var/lib/filebeat/registry
2019-02-23T11:51:26Z INFO States Loaded from registrar: 3
2019-02-23T11:51:26Z INFO Loading Prospectors: 1
2019-02-23T11:51:26Z INFO Prospector with previous states loaded: 0
2019-02-23T11:51:26Z INFO Starting prospector of type: log; id: 151738883052083998
2019-02-23T11:51:26Z INFO Loading and starting Prospectors completed. Enabled prospectors: 1
2019-02-23T11:51:26Z INFO Starting Registrar
2019-02-23T11:51:26Z INFO Start sending events to output
2019-02-23T11:51:26Z INFO Starting spooler: spool_size: 2048; idle_timeout: 5s
2019-02-23T11:51:26Z INFO Harvester started for file: /home/centos/gaia_api.log
2019-02-23T11:51:56Z INFO Non-zero metrics in the last 30s: filebeat.harvester.open_files=1 filebeat.harvester.running=1 filebeat.harvester.started=1 libbeat.logstash.call_count.PublishEvents=1 libbeat.logstash.publish.read_bytes=6 libbeat.logstash.publish.write_bytes=27602 libbeat.logstash.published_and_acked_events=591 libbeat.publisher.published_events=591 publish.events=592 registrar.states.current=4 registrar.states.update=592 registrar.writes=1
2019-02-23T11:52:26Z INFO No non-zero metrics in the last 30s
2019-02-23T11:52:56Z INFO No non-zero metrics in the last 30s
2019-02-23T11:53:26Z INFO No non-zero metrics in the last 30s
2019-02-23T11:53:56Z INFO No non-zero metrics in the last 30s
2019-02-23T11:54:26Z INFO No non-zero metrics in the last 30s
2019-02-23T11:54:56Z INFO No non-zero metrics in the last 30s
2019-02-23T11:55:26Z INFO No non-zero metrics in the last 30s
2019-02-23T11:55:56Z INFO No non-zero metrics in the last 30s
2019-02-23T11:56:26Z INFO No non-zero metrics in the last 30s
2019-02-23T11:56:31Z INFO File is inactive: /home/centos/agapi.log. Closing because close_inactive of 5m0s reached.
2019-02-23T11:56:56Z INFO Non-zero metrics in the last 30s: filebeat.harvester.closed=1 filebeat.harvester.open_files=-1 filebeat.harvester.running=-1 publish.events=1 registrar.states.update=1 registrar.writes=1
2019-02-23T11:57:26Z INFO No non-zero metrics in the last 30s
2019-02-23T11:57:56Z INFO No non-zero metrics in the last 30s
2019-02-23T11:58:26Z INFO No non-zero metrics in the last 30s
2019-02-23T11:58:56Z INFO No non-zero metrics in the last 30s
2019-02-23T11:59:26Z INFO No non-zero metrics in the last 30s
Thanks