Is beats information lost while sending logs from Beats --> Logstash --> Kafka --> Logstash --> Elasticsearch


(Mahesh S) #1

Hi,
I have implemented logstash as below:
Beats --> Logstash --> Kafka --> Logstash --> Elasticsearch+Kibana
However, While sending data directly from Beats --> Logstash --> Elasticsearch, I can see all fields related to beats like beat.hostname etc etc.
But when I am trying Beats --> Logstash --> Kafka --> Logstash --> Elasticsearch+Kibana.
I can't see any information related to beats.
Is beats information lost while sending logs from Beats --> Logstash --> Kafka --> Logstash --> Elasticsearch+Kibana
The only information I can see is original message i.e message, _type in Elasticsearch + kibana.
Anyone please help me whats happening here is ALL information not coming from Logstash+Kafka to ElasticSearch?
Thanks.