# Kafka -\> ES/HDFS with Logstash or Kafka Stream/Connect
**URL:** https://discuss.elastic.co/t/kafka-es-hdfs-with-logstash-or-kafka-stream-connect/64682
**Category:** Logstash
**Created:** [November 2, 2016, 8:40am UTC](https://discuss.elastic.co/t/kafka-es-hdfs-with-logstash-or-kafka-stream-connect/64682 "2016-11-02T08:40:06Z")
**Posts on this page:** 3
**Page:** 1
### Author:  [@imehl](https://discuss.elastic.co/u/imehl)
#### Post date: [November 2, 2016, 8:40am UTC](https://discuss.elastic.co/t/kafka-es-hdfs-with-logstash-or-kafka-stream-connect/64682/1 "2016-11-02T08:40:06Z")
Hi,
I use Kafka for message queue/processing. My question is about performance/best practice. I will do my own performance tests but maybe someone has results/experience already.
The data is raw in a Kafka (0.10) topic and I want to transfer it structured to ES and HDFS.
Now I see 2 possibilities:
- Logstash (Kafka input plugin, grok filter (parsing), ES/webhdfs output plugin)
- Kafka Stream (parsing), Kafka Connect (ES sink, HDFS sink)
Without any tests I would say that the second option is better/cleaner and more reliable?
EDIT: Moved to stackoverflow: [http://stackoverflow.com/questions/40379831/kafka-to-elasticsearch-hdfs-with-logstash-or-kafka-stream-connect](http://stackoverflow.com/questions/40379831/kafka-to-elasticsearch-hdfs-with-logstash-or-kafka-stream-connect)
---
### Author:  [@guyboertje](https://discuss.elastic.co/u/guyboertje)
#### Post date: [November 2, 2016, 10:46am UTC](https://discuss.elastic.co/t/kafka-es-hdfs-with-logstash-or-kafka-stream-connect/64682/2 "2016-11-02T10:46:59Z")
Try asking this question in Stack Overflow where people with Kafka Streaming experience could offer some of it. I doubt many people here could offer opinion on both sides of your comparison.
---
### Author:  [@system](https://discuss.elastic.co/u/system)
#### Post date: [July 6, 2017, 4:31am UTC](https://discuss.elastic.co/t/kafka-es-hdfs-with-logstash-or-kafka-stream-connect/64682/3 "2017-07-06T04:31:34Z")