# Filebeat =\> Logstash Shipper=\>Kafka =\> logstash Parser =\> Elasticsearch =\>Kibana

**URL:** <https://discuss.elastic.co/t/filebeat-logstash-shipper-kafka-logstash-parser-elasticsearch-kibana/88007>\
**Category:** Logstash\
**Created:** [June 2, 2017, 2:09am UTC](https://discuss.elastic.co/t/filebeat-logstash-shipper-kafka-logstash-parser-elasticsearch-kibana/88007 "2017-06-02T02:09:49Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![Ravikumar\_G](https://avatars.discourse-cdn.com/v4/letter/r/71e660/32.png) [@Ravikumar\_G](https://discuss.elastic.co/u/Ravikumar_G)\
**Post date:** [June 2, 2017, 2:09am UTC](https://discuss.elastic.co/t/filebeat-logstash-shipper-kafka-logstash-parser-elasticsearch-kibana/88007/1 "2017-06-02T02:09:49Z")

</div>

Hi I'm really confuse with following architecture pipeline

My Goal is to send transport logs to filebeat =\> Logstash =\> Kafka =\> Logstash Parser =\> Elasticsearch =\> Kibana

also I would like to set up all individual servers for each processing as I have 600 client servers send 1tb ingesting every day so I'm blocked @kafka configuration I will go one step at time to explain my issue

filebeat =\> logstash server with following configuration ( Sucess )

#----------------------------- Logstash output --------------------------------  
output.logstash:

# The Logstash hosts

```
 hosts: ["10.146.134.15:5044"]

```

Logstash =\> kafka

input {  
beats {  
port =\> 5044  
type =\> "syslog"  
#ssl =\> true  
#ssl\_certificate =\> "/etc/pki/tls/certs/filebeat.crt"  
#ssl\_key =\> "/etc/pki/tls/private/filebeat.key"  
}  
}

output {  
kafka {  
bootstrap\_servers =\> "10.146.134.17:9092"  
topic\_id =\> ["beats"]  
}  
}

Kafka to Logstash not sure how to tell kafka to send logs to Logstash But I have setup logstash server to  
Kafka server runs perfect with out any error messeges

and finally my logstash parser to elasticsearch configuration

input {  
kafka {  
bootstrap\_servers =\> "10.146.134.17:9092"  
topics =\> ["beats"]  
}  
}  
output {  
elasticsearch {  
hosts =\> ["10.146.134.12:8888"]  
index =\> "elasticse"  
}  
}

Not sure were I have did wrong but any input would be help me to move forward.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [June 30, 2017, 2:10am UTC](https://discuss.elastic.co/t/filebeat-logstash-shipper-kafka-logstash-parser-elasticsearch-kibana/88007/2 "2017-06-30T02:10:26Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.