# Kafka to Logstash pipeline not working **URL:** \ **Category:** Logstash\ **Created:** [May 8, 2016, 10:58am UTC](https://discuss.elastic.co/t/kafka-to-logstash-pipeline-not-working/49480 "2016-05-08T10:58:45Z")\ **Posts on this page:** 4\ **Page:** 1
**Author:** ![nateuni](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/nateuni/32/8512_2.png) [@nateuni](https://discuss.elastic.co/u/nateuni)\ **Post date:** [May 8, 2016, 10:58am UTC](https://discuss.elastic.co/t/kafka-to-logstash-pipeline-not-working/49480/1 "2016-05-08T10:58:45Z")
HI, I have this pipeline: Apache Webserver + Filebeats -\> Logstash1 (no filters) -\> Kafka -\> Logstash2 (Filters) -\> ES + Kibana Via my Kafka consumer, I can see the logs going to the Kafka channel. And in Kibana I can see the heart beat being indexed in ES. But for some reason, there is no longer any logs going Kafka-\>LS-\>ES. I look at the Logstash2's log file and there are no errors, and the config is ok. I have removed all the filters and the ips and ports are good. I created a new channel in Kafka and temporarily had logs arriving in ES but then it stopped again (the Heartbeats continued). Anyone have any idea what is going on? Thanks ---
**Author:** ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)\ **Post date:** [May 8, 2016, 7:32pm UTC](https://discuss.elastic.co/t/kafka-to-logstash-pipeline-not-working/49480/2 "2016-05-08T19:32:35Z")
In the second Logstash instance, replace the elasticsearch output with a simple `stdout { codec => rubydebug }` output so that you can see exactly what happens. Does it help? Increase the Logstash loglevel by starting it with `--verbose` or even `--debug`. Do you get any useful clues? Can you see if Logstash connects to Kafka? Et cetera. ---
**Author:** ![nateuni](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/nateuni/32/8512_2.png) [@nateuni](https://discuss.elastic.co/u/nateuni)\ **Post date:** [May 9, 2016, 2:46am UTC](https://discuss.elastic.co/t/kafka-to-logstash-pipeline-not-working/49480/3 "2016-05-09T02:46:05Z")
Ok, so I moved my groks from Ls1 to Ls2, but the mistake being that I didn't factor in that it was grok'ing on a modified bunch of text. In my troubleshooting, I opened a Kafka producer console and noted that the text was ending up in ES, which alluded to an issue with the grok. Wish I figured that out sooner! Thanks for your reply, I appreciate you trying to help me. ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 4:58am UTC](https://discuss.elastic.co/t/kafka-to-logstash-pipeline-not-working/49480/4 "2017-07-06T04:58:44Z")
Closed on July 6, 2017, 4:58am UTC