# Beginner - metricbeat system dashboard with basic logstash output set

**URL:** <https://discuss.elastic.co/t/beginner-metricbeat-system-dashboard-with-basic-logstash-output-set/238635>\
**Category:** Beats\
**Tags:** docker, metricbeat\
**Created:** [June 25, 2020, 9:55am UTC](https://discuss.elastic.co/t/beginner-metricbeat-system-dashboard-with-basic-logstash-output-set/238635 "2020-06-25T09:55:11Z")\
**Posts on this page:** 7\
**Page:** 1

<div class="post-metadata">

**Author:** ![NeitoFR](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/neitofr/32/71098_2.png) [@NeitoFR](https://discuss.elastic.co/u/NeitoFR)\
**Post date:** [June 25, 2020, 9:55am UTC](https://discuss.elastic.co/t/beginner-metricbeat-system-dashboard-with-basic-logstash-output-set/238635/1 "2020-06-25T09:55:11Z")

</div>

Hi everyone,

I'm using ELK 7.5.2 with basic metricbeat modules (system, docker) I managed to load the Kibana dashboard to Kibana correctly. But now I'm making the logs pass through logstash (without any filter) and the dashboards are now empty (despite the fact that the log are visible in the discover tab under logstash-\* pattern)

I foudn this in the documentation [Set up dashboards for Logstash output](https://www.elastic.co/guide/en/beats/filebeat/current/load-kibana-dashboards.html#load-dashboards-logstash) and I tried to do it but the dashboard are still not filling with data.

What am I missing ?

Thanks

---

<div class="post-metadata">

**Author:** ![mtojek](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/mtojek/32/63863_2.png) [@mtojek](https://discuss.elastic.co/u/mtojek)\
**Post date:** [June 25, 2020, 2:13pm UTC](https://discuss.elastic.co/t/beginner-metricbeat-system-dashboard-with-basic-logstash-output-set/238635/2 "2020-06-25T14:13:54Z")

</div>

I think you need to share more details on the forum. Do you see any particular errors?

BTW You don't need to involve logstash in the middle while just playing with stuff around.

---

<div class="post-metadata">

**Author:** ![NeitoFR](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/neitofr/32/71098_2.png) [@NeitoFR](https://discuss.elastic.co/u/NeitoFR)\
**Post date:** [June 25, 2020, 3:55pm UTC](https://discuss.elastic.co/t/beginner-metricbeat-system-dashboard-with-basic-logstash-output-set/238635/3 "2020-06-25T15:55:46Z")

</div>

Thanks for the reply, I want to learn how to use logstash aswell that's why i'm trying to set it up.

There is no error on metricbeat log nor logstash log.

Here are complementary informations about my environment :

- Everything run on a CentOS 7 machine on AWS.
- Everything is inside Docker container (docker version is 19.03.12)
- ELK and metricbeat are deployed in 7.5.2 version

Here is the beginning of the .yml file for metricbeat :

```auto
    setup.kibana.host: kibana:5601
     
    # setup.dashboards.enabled: true
  
    output.logstash.hosts: ["logstash:5044"]
    ... module declarations

```

And here is the logstash conf file used :

```auto
input {
    beats {
        port => "5044"
    }
}
# filter {
#
# }
output {
    elasticsearch {
        hosts => ["elasticsearch:9200"]
    }
}

```

The `# setup.dashboards.enabled: true` line is commented because I manuaylly loaded the dashboard from metricbeat container using the following command :

```auto
filebeat setup -e \
  -E output.logstash.enabled=false \
  -E output.elasticsearch.hosts=['elasticsearch:9200'] \
  -E setup.kibana.host=kibana:5601

```

as specified [here](https://www.elastic.co/guide/en/beats/filebeat/current/load-kibana-dashboards.html#load-dashboards-logstash)

Logstash is ingesting the logs correctly but the dashboard stays empty

 ![image](https://us1.discourse-cdn.com/elastic/original/3X/8/4/84cf126beec1b88b5dee7a685e01bb6349cb74a9.png)

While those very same dashboard where correctly display data when logstach wasn't involved.

Maybe be reformulating the question would help :

Is there a specific manipulation to perform to make the metricbeat dashboard work when its logstash that send logs to elasticsearch ?

---

<div class="post-metadata">

**Author:** ![mtojek](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/mtojek/32/63863_2.png) [@mtojek](https://discuss.elastic.co/u/mtojek)\
**Post date:** [June 26, 2020, 8:48am UTC](https://discuss.elastic.co/t/beginner-metricbeat-system-dashboard-with-basic-logstash-output-set/238635/4 "2020-06-26T08:48:02Z")

</div>

If you consider that logstash consumes data correctly and doesn't pass them to the Elasticsearch, it might be a logstash issue. Did you try to set up the flow without logstash in the middle? Did it work for you? You might need to validate creation of index templates.

---

<div class="post-metadata">

**Author:** ![NeitoFR](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/neitofr/32/71098_2.png) [@NeitoFR](https://discuss.elastic.co/u/NeitoFR)\
**Post date:** [June 26, 2020, 9:03am UTC](https://discuss.elastic.co/t/beginner-metricbeat-system-dashboard-with-basic-logstash-output-set/238635/5 "2020-06-26T09:03:19Z")

</div>

Logstash does send the data to Elasticsearch correctly

I let it run over night and data keep flowing correctly, the same way it was without logstash :

 ![image](https://us1.discourse-cdn.com/elastic/original/3X/0/f/0fe21f57d78f6280b77ba3707ab836e41977c697.png)  
Here is the last piece of data I've got from logstash :  
 ![image](https://us1.discourse-cdn.com/elastic/original/3X/3/a/3a112f39055d4c70a7c0db5245abc47f1f74a9af.png)

And I just changed the output of metricbeat to elastic search and restarted it :

```auto
# output.logstash.hosts: ["logstash:5044"]
output.elasticsearch.hosts: ["elasticsearch:9200"]

```

And the dashboard is working instantly :

 ![image](https://us1.discourse-cdn.com/elastic/original/3X/8/7/87f52dc4b60f98e95f2f1bb294878008d1c8a752.png)

---

<div class="post-metadata">

**Author:** ![NeitoFR](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/neitofr/32/71098_2.png) [@NeitoFR](https://discuss.elastic.co/u/NeitoFR)\
**Post date:** [June 26, 2020, 9:08am UTC](https://discuss.elastic.co/t/beginner-metricbeat-system-dashboard-with-basic-logstash-output-set/238635/6 "2020-06-26T09:08:29Z")

</div>

Ok I found the reason, it's because the dashboard is set to 'listen' on the metricbeat-\* index pattern, but that's not obvious and I can't find a way to make every dashboard object to change which index pattern there 'listening' to.

I guess there is a way to setup the dashboards directly with the index pattern set to logstash-\*. I need to find how.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 24, 2020, 11:08am UTC](https://discuss.elastic.co/t/beginner-metricbeat-system-dashboard-with-basic-logstash-output-set/238635/7 "2020-07-24T11:08:31Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
