# Is it possible to send ES cluster logs over kafka pipeline? **URL:** \ **Category:** Elasticsearch\ **Created:** [November 11, 2014, 5:59am UTC](https://discuss.elastic.co/t/is-it-possible-to-send-es-cluster-logs-over-kafka-pipeline/20678 "2014-11-11T05:59:18Z")\ **Posts on this page:** 3\ **Page:** 1
**Author:** ![ddp](https://avatars.discourse-cdn.com/v4/letter/d/f6c823/32.png) [@ddp](https://discuss.elastic.co/u/ddp)\ **Post date:** [November 11, 2014, 5:59am UTC](https://discuss.elastic.co/t/is-it-possible-to-send-es-cluster-logs-over-kafka-pipeline/20678/1 "2014-11-11T05:59:18Z")
Is it possible to send ES cluster logs over kafka pipeline ? I want to send all ES cluster logs(Errors,Exceptions,connection issue etc in ES cluster itself) to our HDFS cluster for analysing. We already have a kafka pipeline setup for our apps to send their logs. I was wondering if ES allows to send its logs over Kakfa? -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/960c671c-b3ef-4f90-86e6-cd3823153e55%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/960c671c-b3ef-4f90-86e6-cd3823153e55%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Post date:** [November 11, 2014, 6:00am UTC](https://discuss.elastic.co/t/is-it-possible-to-send-es-cluster-logs-over-kafka-pipeline/20678/2 "2014-11-11T06:00:49Z")
You can use logstash to do this, there is a community plugin for kafka as well. On 11 November 2014 16:59, Darsh [darsh.patil@gmail.com](mailto:darsh.patil@gmail.com) wrote: > Is it possible to send ES cluster logs over kafka pipeline ? I want to > send all ES cluster logs(Errors,Exceptions,connection issue etc in ES > cluster itself) to our HDFS cluster for analysing. We already have a kafka > pipeline setup for our apps to send their logs. I was wondering if ES > allows to send its logs over Kakfa? > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/960c671c-b3ef-4f90-86e6-cd3823153e55%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/960c671c-b3ef-4f90-86e6-cd3823153e55%40googlegroups.com) > [https://groups.google.com/d/msgid/elasticsearch/960c671c-b3ef-4f90-86e6-cd3823153e55%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/960c671c-b3ef-4f90-86e6-cd3823153e55%40googlegroups.com?utm_medium=email&utm_source=footer) > . > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAF3ZnZkw3qKB9AkRD4E2\_nYi0zHejhweHrLRP9warBLXRAiiPw%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAF3ZnZkw3qKB9AkRD4E2_nYi0zHejhweHrLRP9warBLXRAiiPw%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 12:50am UTC](https://discuss.elastic.co/t/is-it-possible-to-send-es-cluster-logs-over-kafka-pipeline/20678/3 "2017-07-06T00:50:54Z")