# Testers wanted: Lumberjack integration with Hortonworks

**URL:** <https://discuss.elastic.co/t/testers-wanted-lumberjack-integration-with-hortonworks/44880>\
**Category:** Logstash\
**Created:** [March 19, 2016, 3:40am UTC](https://discuss.elastic.co/t/testers-wanted-lumberjack-integration-with-hortonworks/44880 "2016-03-19T03:40:56Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![trixpan](https://avatars.discourse-cdn.com/v4/letter/t/ba9def/32.png) [@trixpan](https://discuss.elastic.co/u/trixpan)\
**Post date:** [March 19, 2016, 3:40am UTC](https://discuss.elastic.co/t/testers-wanted-lumberjack-integration-with-hortonworks/44880/1 "2016-03-19T03:40:56Z")

</div>

Hi there,

For those using logstash-forwarder but also using Hortonworks stack (HDP and HDF)

I have baked an experimental listener that allows Hortonworks Dataflow (a.k.a. Apache NiFi) to accept connections from logstash-forwarder agents.

The rationale for that is to allow for a drop in replacement for simpler pipelines (e.g. logstash-forwarder -\> pipeline -\> HDFS / Kafka / whatever) while providing stronger delivery guarantees than Logstash currently offers (NiFi's documentation provides insight over its data provenance and guarantees).

The code is still experimental and I would strongly appreciate if people could assist by testing it against a more diverse set of environments.

> <https://github.com/apache/nifi/pull/290>

Cheers

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [March 19, 2016, 3:57am UTC](https://discuss.elastic.co/t/testers-wanted-lumberjack-integration-with-hortonworks/44880/2 "2016-03-19T03:57:27Z")

</div>

Interesting project!  
However you know that this forwarder has been deprecated? We are moving users over to Filebeat these days.

---

<div class="post-metadata">

**Author:** ![trixpan](https://avatars.discourse-cdn.com/v4/letter/t/ba9def/32.png) [@trixpan](https://discuss.elastic.co/u/trixpan)\
**Post date:** [March 19, 2016, 5:06am UTC](https://discuss.elastic.co/t/testers-wanted-lumberjack-integration-with-hortonworks/44880/3 "2016-03-19T05:06:12Z")

</div>

Mark,

Yes, I am aware of the deprecation, however its widespread use and the fact other applications make use of the protocol (e.g. node-lumberjack, python beaver, etc) means its use will continue for a while.

I plan to introduce support for libbeats once the protocol is formalised as its current implementation differs from its documentation

> <https://github.com/elastic/libbeat/issues/279>

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 5:06am UTC](https://discuss.elastic.co/t/testers-wanted-lumberjack-integration-with-hortonworks/44880/4 "2017-07-06T05:06:19Z")

</div>