Filebat -> Logstash parsing

[ClubG]

Hi,
I'm using this ELK stack:

deviantony/docker-elk

It all works perfectly with default dashboards if I send logs from filebeat and metricbeat directly to elastic.
filebeat -> elastic -> kibana
metricbeat -> elastic -> kibana

now I want also custom logs sending from filebeat so I set up:
filebeat -> logstash -> elastic -> kibana
I also changed metricbeat to send via logstash
metricbeat -> logstash -> elastic -> kibana

I defined pipeline:

input {
        beats {
            port => 5044
        }
}
output {
	elasticsearch {
		hosts => "elasticsearch:9200"
		manage_template => false
		index => "%{[@metadata][beat]}-%{[@metadata][version]}"
		document_type => "%{[@metadata][type]}"
		user => "elastic"
		password => "changeme"
	}
}

than to be able to show dashboards I imported them as described here:
https://www.elastic.co/guide/en/beats/filebeat/current/load-kibana-dashboards.html#load-dashboards-logstash
https://www.elastic.co/guide/en/beats/metricbeat/current/load-kibana-dashboards.html#load-dashboards-logstash

Now the problem which I have is that filebeat doesn't parse the input for some reason. It creates index and everything inside discover but doesn't parse it:

on the other hand, metricbeat works perfectly.

Any idea how to solve this filebeat problem?

[ChrsMark (Chris Mark)]

Hey!

I guess that you have to set the pipelines accordingly too? See https://www.elastic.co/guide/en/logstash/current/use-ingest-pipelines.html

[ClubG]

It would be really great to add this note here https://www.elastic.co/guide/en/beats/metricbeat/current/load-kibana-dashboards.html#load-dashboards-logstash

[ChrsMark (Chris Mark)]

This could be something reasonable @ClubG! Feel free to open a pull request for this if you are willing to contribute to the docs, or you can just open a Github issue for this.

Regards,