# No results found in Kibana sample dashboards for Filebeat

**URL:** <https://discuss.elastic.co/t/no-results-found-in-kibana-sample-dashboards-for-filebeat/189350>\
**Category:** Beats\
**Tags:** filebeat\
**Created:** [July 8, 2019, 1:10pm UTC](https://discuss.elastic.co/t/no-results-found-in-kibana-sample-dashboards-for-filebeat/189350 "2019-07-08T13:10:12Z")\
**Posts on this page:** 9\
**Page:** 1

<div class="post-metadata">

**Author:** ![tng](https://avatars.discourse-cdn.com/v4/letter/t/c5a1d2/32.png) [@tng](https://discuss.elastic.co/u/tng)\
**Post date:** [July 8, 2019, 1:10pm UTC](https://discuss.elastic.co/t/no-results-found-in-kibana-sample-dashboards-for-filebeat/189350/1 "2019-07-08T13:10:12Z")

</div>

Hello,

I installed ELK 7.2 and Filebeat on the same host running on Debian 9 and I installed only Filebeat on another host running on Centos 7 . I enabled the Filebeat system module on both hosts and Logstash system logs pipelines on the host running ELK as described in [https://www.elastic.co/guide/en/logstash/current/logstash-config-for-filebeat-modules.html#parsing-system](https://www.elastic.co/guide/en/logstash/current/logstash-config-for-filebeat-modules.html#parsing-system). I modified the filter for removing the _geoip_ block since I'm using only private IPv4 addresses and in the filter section I used _if [event][module] == "system_" instead of _if [fileset][module] == "system"_ because when I used the latter, it seemed that messages relevant to authorization logs did not pass the condition and then were not parsed by the grok filter.

After that, I initiated an SSH connection to the two servers and created a new user on the server running on Centos.

However when I load Kibana for visualizing dashboards, most of the dashboards display "No result found". The only visualizations which are displaying results are :

- Syslog events by hostname [Filebeat System] ECS
- SSH login attempts [Filebeat System] ECS
- Successful SSH logins [Filebeat System] ECS

Also on the SIEM UI, the only valuable information displayed is the number of hosts known by ELK. The other dashboards display 0 results.

Do you know how I can fix that to get all the information in the dashboards ?

Thank you in advance

 ![pb1](https://us1.discourse-cdn.com/elastic/original/3X/5/a/5a1d3a73421adfc6e3624a91d5e9306ffdcfef87.png) ![pb2](https://us1.discourse-cdn.com/elastic/original/3X/f/d/fdee0112cbd95b06bdc53c34ccf3f52be394698a.png) ![pb3](https://us1.discourse-cdn.com/elastic/original/3X/d/c/dc19e01bd85f4aa0789b3bf147ab9f3956a1fec3.png) ![pb5](https://us1.discourse-cdn.com/elastic/original/3X/9/5/95b746541a4d5b1b9a02319b6469c2c83f757407.png) ![pb4](https://us1.discourse-cdn.com/elastic/original/3X/c/9/c94eef5515102ed64f70e3c84f21d514b9010c5e.png)

---

<div class="post-metadata">

**Author:** ![steffens](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/steffens/32/79630_2.png) [@steffens](https://discuss.elastic.co/u/steffens)\
**Post date:** [July 8, 2019, 11:54pm UTC](https://discuss.elastic.co/t/no-results-found-in-kibana-sample-dashboards-for-filebeat/189350/2 "2019-07-08T23:54:01Z")

</div>

Can you share your actual config files and filebeat log output? Please format configs and logs using the `</>` button in the editor window.

---

<div class="post-metadata">

**Author:** ![tng](https://avatars.discourse-cdn.com/v4/letter/t/c5a1d2/32.png) [@tng](https://discuss.elastic.co/u/tng)\
**Post date:** [July 9, 2019, 7:51am UTC](https://discuss.elastic.co/t/no-results-found-in-kibana-sample-dashboards-for-filebeat/189350/3 "2019-07-09T07:51:37Z")

</div>

I didn't modify Elasticsearch and Kibana configuration. Both are listening on the default ports on localhost.

Logstash configuration in _/etc/logstash/conf.d/logstash.conf_ is as below

```
input {
 beats {
   port => 5044
   ssl => true
   ssl_certificate => "/etc/ssl/elk-server.crt"
   ssl_key => "/etc/ssl/elk-server.key"
  }
}

filter {
  if [event][module] == "system" {
    if [fileset][name] == "auth" {
      grok {
        match => { "message" => ["%{SYSLOGTIMESTAMP:[system][auth][timestamp]} %{SYSLOGHOST:[system][auth][hostname]} sshd(?:\[%{POSINT:[system][auth][pid]}\])?: %{DATA:[system][auth][ssh][event]} %{DATA:[system][auth][ssh][method]} for (invalid user )?%{DATA:[system][auth][user]} from %{IPORHOST:[system][auth][ssh][ip]} port %{NUMBER:[system][auth][ssh][port]} ssh2(: %{GREEDYDATA:[system][auth][ssh][signature]})?",
                  "%{SYSLOGTIMESTAMP:[system][auth][timestamp]} %{SYSLOGHOST:[system][auth][hostname]} sshd(?:\[%{POSINT:[system][auth][pid]}\])?: %{DATA:[system][auth][ssh][event]} user %{DATA:[system][auth][user]} from %{IPORHOST:[system][auth][ssh][ip]}",
                  "%{SYSLOGTIMESTAMP:[system][auth][timestamp]} %{SYSLOGHOST:[system][auth][hostname]} sshd(?:\[%{POSINT:[system][auth][pid]}\])?: Did not receive identification string from %{IPORHOST:[system][auth][ssh][dropped_ip]}",
                  "%{SYSLOGTIMESTAMP:[system][auth][timestamp]} %{SYSLOGHOST:[system][auth][hostname]} sudo(?:\[%{POSINT:[system][auth][pid]}\])?: \s*%{DATA:[system][auth][user]} :( %{DATA:[system][auth][sudo][error]} ;)? TTY=%{DATA:[system][auth][sudo][tty]} ; PWD=%{DATA:[system][auth][sudo][pwd]} ; USER=%{DATA:[system][auth][sudo][user]} ; COMMAND=%{GREEDYDATA:[system][auth][sudo][command]}",
                  "%{SYSLOGTIMESTAMP:[system][auth][timestamp]} %{SYSLOGHOST:[system][auth][hostname]} groupadd(?:\[%{POSINT:[system][auth][pid]}\])?: new group: name=%{DATA:system.auth.groupadd.name}, GID=%{NUMBER:system.auth.groupadd.gid}",
                  "%{SYSLOGTIMESTAMP:[system][auth][timestamp]} %{SYSLOGHOST:[system][auth][hostname]} useradd(?:\[%{POSINT:[system][auth][pid]}\])?: new user: name=%{DATA:[system][auth][useradd][name]}, UID=%{NUMBER:[system][auth][useradd][uid]}, GID=%{NUMBER:[system][auth][useradd][gid]}, home=%{DATA:[system][auth][useradd][home]}, shell=%{DATA:[system][auth][useradd][shell]}$",
                  "%{SYSLOGTIMESTAMP:[system][auth][timestamp]} %{SYSLOGHOST:[system][auth][hostname]} %{DATA:[system][auth][program]}(?:\[%{POSINT:[system][auth][pid]}\])?: %{GREEDYMULTILINE:[system][auth][message]}"] }
        pattern_definitions => {
          "GREEDYMULTILINE"=> "(.|\n)*"
        }
        remove_field => "message"
      }
      date {
        match => ["[system][auth][timestamp]", "MMM d HH:mm:ss", "MMM dd HH:mm:ss" ]
      }
    }
    else if [fileset][name] == "syslog" {
      grok {
        match => { "message" => ["%{SYSLOGTIMESTAMP:[system][syslog][timestamp]} %{SYSLOGHOST:[system][syslog][hostname]} %{DATA:[system][syslog][program]}(?:\[%{POSINT:[system][syslog][pid]}\])?: %{GREEDYMULTILINE:[system][syslog][message]}"] }
        pattern_definitions => { "GREEDYMULTILINE" => "(.|\n)*" }
        remove_field => "message"
      }
      date {
        match => ["[system][syslog][timestamp]", "MMM d HH:mm:ss", "MMM dd HH:mm:ss" ]
      }
    }
  }
}

output {
  elasticsearch {
    hosts => localhost
    manage_template => false
    index => "%{[@metadata][beat]}-%{[@metadata][version]}-%{+YYYY.MM.dd}"
  }
}

```

Filebeat is configured in _/etc/filebeat/filebeat.yml_ on both servers as follows

```
- type: log
  enabled: false
  paths:
    - /var/log/*.log
filebeat.config.modules:
  path: ${path.config}/modules.d/*.yml
  reload.enabled: false
setup.template.settings:
  index.number_of_shards: 1
setup.kibana:
output.logstash:
  hosts: ["elk-server.domain.local:5044"]
  ssl.certificate_authorities: ["/etc/ssl/elk-server.crt"]
processors:
  - add_host_metadata: ~
  - add_cloud_metadata: ~

```

And when I run the _filebeat modules list_ command on both servers, I get the following output

```
Enabled:
system

Disabled:
apache
auditd
cisco
coredns
elasticsearch
envoyproxy
haproxy
icinga
iis
iptables
kafka
kibana
logstash
mongodb
mysql
nats
netflow
nginx
osquery
panw
postgresql
rabbitmq
redis
santa
suricata
traefik
zeek
```

---

<div class="post-metadata">

**Author:** ![tng](https://avatars.discourse-cdn.com/v4/letter/t/c5a1d2/32.png) [@tng](https://discuss.elastic.co/u/tng)\
**Post date:** [July 9, 2019, 8:02am UTC](https://discuss.elastic.co/t/no-results-found-in-kibana-sample-dashboards-for-filebeat/189350/4 "2019-07-09T08:02:41Z")

</div>

Here is an output of Filebeat log file _/var/log/filebeat_ on the ELK server running on Debian 9

```
Jul 09 10:25:26 elk-server filebeat[1067]: 2019-07-09T10:25:26.880+0200 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":82660,"time":{"ms":32}},"total":{"ticks":406760,"time":{"ms":56},"value":406760},"user":{"ticks":324100,"time":{"ms":24}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":8},"info":{"ephemeral_id":"b0efeb20-37e7-48ae-8f00-d94f245cc446","uptime":{"ms":323070109}},"memstats":{"gc_next":7002144,"memory_alloc":3630792,"memory_total":28479398600},"runtime":{"goroutines":47}},"filebeat":{"events":{"added":2,"done":2},"harvester":{"open_files":2,"running":2}},"libbeat":{"config":{"module":{"running":0}},"output":{"events":{"acked":2,"batches":2,"total":2},"read":{"bytes":70},"write":{"bytes":2164}},"pipeline":{"clients":4,"events":{"active":0,"published":2,"total":2},"queue":{"acked":2}}},"registrar":{"states":{"current":6,"update":2},"writes":{"success":2,"total":2}},"system":{"load":{"1":0.12,"15":0.15,"5":0.21,"norm":{"1":0.12,"15":0.15,"5":0.21}}}}}}
Jul 09 10:25:56 elk-server filebeat[1067]: 2019-07-09T10:25:56.872+0200 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":82680,"time":{"ms":20}},"total":{"ticks":406800,"time":{"ms":40},"value":406800},"user":{"ticks":324120,"time":{"ms":20}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":8},"info":{"ephemeral_id":"b0efeb20-37e7-48ae-8f00-d94f245cc446","uptime":{"ms":323100110}},"memstats":{"gc_next":7002912,"memory_alloc":3759168,"memory_total":28481528360},"runtime":{"goroutines":47}},"filebeat":{"events":{"added":1,"done":1},"harvester":{"open_files":2,"running":2}},"libbeat":{"config":{"module":{"running":0}},"output":{"events":{"acked":1,"batches":1,"total":1},"read":{"bytes":70},"write":{"bytes":1092}},"pipeline":{"clients":4,"events":{"active":0,"published":1,"total":1},"queue":{"acked":1}}},"registrar":{"states":{"current":6,"update":1},"writes":{"success":1,"total":1}},"system":{"load":{"1":0.07,"15":0.15,"5":0.19,"norm":{"1":0.07,"15":0.15,"5":0.19}}}}}}
Jul 09 10:26:26 elk-server filebeat[1067]: 2019-07-09T10:26:26.875+0200 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":82680},"total":{"ticks":406830,"time":{"ms":32},"value":406830},"user":{"ticks":324150,"time":{"ms":32}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":8},"info":{"ephemeral_id":"b0efeb20-37e7-48ae-8f00-d94f245cc446","uptime":{"ms":323130109}},"memstats":{"gc_next":7006016,"memory_alloc":5215696,"memory_total":28485038720},"runtime":{"goroutines":47}},"filebeat":{"events":{"added":2,"done":2},"harvester":{"open_files":2,"running":2}},"libbeat":{"config":{"module":{"running":0}},"output":{"events":{"acked":2,"batches":2,"total":2},"read":{"bytes":70},"write":{"bytes":2158}},"pipeline":{"clients":4,"events":{"active":0,"published":2,"total":2},"queue":{"acked":2}}},"registrar":{"states":{"current":6,"update":2},"writes":{"success":2,"total":2}},"system":{"load":{"1":0.04,"15":0.14,"5":0.17,"norm":{"1":0.04,"15":0.14,"5":0.17}}}}}}
Jul 09 10:26:56 elk-server filebeat[1067]: 2019-07-09T10:26:56.875+0200 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":82700,"time":{"ms":16}},"total":{"ticks":406870,"time":{"ms":40},"value":406870},"user":{"ticks":324170,"time":{"ms":24}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":8},"info":{"ephemeral_id":"b0efeb20-37e7-48ae-8f00-d94f245cc446","uptime":{"ms":323160110}},"memstats":{"gc_next":4381280,"memory_alloc":4032112,"memory_total":28487174528},"runtime":{"goroutines":47}},"filebeat":{"events":{"added":1,"done":1},"harvester":{"open_files":2,"running":2}},"libbeat":{"config":{"module":{"running":0}},"output":{"events":{"acked":1,"batches":1,"total":1},"read":{"bytes":35},"write":{"bytes":1095}},"pipeline":{"clients":4,"events":{"active":0,"published":1,"total":1},"queue":{"acked":1}}},"registrar":{"states":{"current":6,"update":1},"writes":{"success":1,"total":1}},"system":{"load":{"1":0.02,"15":0.14,"5":0.15,"norm":{"1":0.02,"15":0.14,"5":0.15}}}}}}

```

And an output of the same log file on the server running on Centos 7

```
Jul 09 10:28:37 centos filebeat[3544]: 2019-07-09T10:28:37.541-0400 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":236970,"time":{"ms":10}},"total":{"ticks":551420,"time":{"ms":52},"value":551420},"user":{"ticks":314450,"time":{"ms":42}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":7},"info":{"ephemeral_id":"6376c6ef-6550-4160-810d-9cecc6df0242","uptime":{"ms":320040044}},"memstats":{"gc_next":6901888,"memory_alloc":3607000,"memory_total":40919681920},"runtime":{"goroutines":42}},"filebeat":{"events":{"added":12,"done":12},"harvester":{"open_files":1,"running":1}},"libbeat":{"config":{"module":{"running":0}},"output":{"events":{"acked":12,"batches":2,"total":12},"read":{"bytes":70},"write":{"bytes":2547}},"pipeline":{"clients":4,"events":{"active":0,"published":12,"total":12},"queue":{"acked":12}}},"registrar":{"states":{"current":6,"update":12},"writes":{"success":2,"total":2}},"system":{"load":{"1":0,"15":0.05,"5":0.01,"norm":{"1":0,"15":0.05,"5":0.01}}}}}}
Jul 09 10:29:07 centos filebeat[3544]: 2019-07-09T10:29:07.559-0400 INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":237010,"time":{"ms":37}},"total":{"ticks":551470,"time":{"ms":51},"value":551470},"user":{"ticks":314460,"time":{"ms":14}}},"handles":{"limit":{"hard":4096,"soft":1024},"open":7},"info":{"ephemeral_id":"6376c6ef-6550-4160-810d-9cecc6df0242","uptime":{"ms":320070045}},"memstats":{"gc_next":4321264,"memory_alloc":3901472,"memory_total":40923355536},"runtime":{"goroutines":42}},"filebeat":{"events":{"added":12,"done":12},"harvester":{"open_files":1,"running":1}},"libbeat":{"config":{"module":{"running":0}},"output":{"events":{"acked":12,"batches":2,"total":12},"read":{"bytes":70},"write":{"bytes":2554}},"pipeline":{"clients":4,"events":{"active":0,"published":12,"total":12},"queue":{"acked":12}}},"registrar":{"states":{"current":6,"update":12},"writes":{"success":2,"total":2}},"system":{"load":{"1":0,"15":0.05,"5":0.01,"norm":{"1":0,"15":0.05,"5":0.01}}}}}}
```

---

<div class="post-metadata">

**Author:** ![steffens](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/steffens/32/79630_2.png) [@steffens](https://discuss.elastic.co/u/steffens)\
**Post date:** [July 10, 2019, 12:58pm UTC](https://discuss.elastic.co/t/no-results-found-in-kibana-sample-dashboards-for-filebeat/189350/5 "2019-07-10T12:58:55Z")

</div>

I don't see any error in the logs.

I presume you have written the logstash filters yourself, based on the original modules? Can you try without Logstash, but via Ingest node? I wonder if there is some difference between the events.

---

<div class="post-metadata">

**Author:** ![tng](https://avatars.discourse-cdn.com/v4/letter/t/c5a1d2/32.png) [@tng](https://discuss.elastic.co/u/tng)\
**Post date:** [July 10, 2019, 4:01pm UTC](https://discuss.elastic.co/t/no-results-found-in-kibana-sample-dashboards-for-filebeat/189350/6 "2019-07-10T16:01:36Z")

</div>

Regarding the Logstash filter, compared to the one defined on [https://www.elastic.co/guide/en/logstash/current/logstash-config-for-filebeat-modules.html#parsing-system](https://www.elastic.co/guide/en/logstash/current/logstash-config-for-filebeat-modules.html#parsing-system), I just replaced _[fileset][module]_ by _[event][module]_ and I deleted the geoip block. The rest of the filter remains untouched.

I will give a try with ingest node without Logstash. I am looking for ingest node definitions for parsing system logs but I cannot see any example related to that on [https://www.elastic.co](https://www.elastic.co). Could you please tell me how I can write these definitions ?

---

<div class="post-metadata">

**Author:** ![steffens](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/steffens/32/79630_2.png) [@steffens](https://discuss.elastic.co/u/steffens)\
**Post date:** [July 11, 2019, 11:56am UTC](https://discuss.elastic.co/t/no-results-found-in-kibana-sample-dashboards-for-filebeat/189350/7 "2019-07-11T11:56:09Z")

</div>

Filebeat modules are written to use Elasticsearch Ingest Node, out of the box. You are not supposed to write your own definition.

---

<div class="post-metadata">

**Author:** ![tng](https://avatars.discourse-cdn.com/v4/letter/t/c5a1d2/32.png) [@tng](https://discuss.elastic.co/u/tng)\
**Post date:** [July 12, 2019, 9:32am UTC](https://discuss.elastic.co/t/no-results-found-in-kibana-sample-dashboards-for-filebeat/189350/8 "2019-07-12T09:32:31Z")

</div>

Thank you, I used the following guide [https://www.elastic.co/guide/en/logstash/current/use-ingest-pipelines.html](https://www.elastic.co/guide/en/logstash/current/use-ingest-pipelines.html) for loading Filebeat ingest pipelines for the system module into Elasticsearch and I completely modified Logstash configuration as described in the guide. The dashboards are now displaying well in Kibana

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [August 9, 2019, 9:32am UTC](https://discuss.elastic.co/t/no-results-found-in-kibana-sample-dashboards-for-filebeat/189350/9 "2019-08-09T09:32:32Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
