# Can logstash push data into Hadoop? **URL:** \ **Category:** Logstash\ **Created:** [October 26, 2015, 7:40am UTC](https://discuss.elastic.co/t/can-logstash-push-data-into-hadoop/32961 "2015-10-26T07:40:03Z")\ **Posts on this page:** 10\ **Page:** 1
**Author:** ![asatsi](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/asatsi/32/28417_2.png) [@asatsi](https://discuss.elastic.co/u/asatsi)\ **Post date:** [October 26, 2015, 7:40am UTC](https://discuss.elastic.co/t/can-logstash-push-data-into-hadoop/32961/1 "2015-10-26T07:40:03Z")
Simple question as per the subject line. I need to push data from my source into Hadoop. Can this be done? If yes which supported output plugin could be used? ---
**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Post date:** [October 27, 2015, 1:07am UTC](https://discuss.elastic.co/t/can-logstash-push-data-into-hadoop/32961/2 "2015-10-27T01:07:19Z")
There's no plugin for this AFAIK. ---
**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\ **Post date:** [October 27, 2015, 3:29am UTC](https://discuss.elastic.co/t/can-logstash-push-data-into-hadoop/32961/3 "2015-10-27T03:29:58Z")
It seems like it should be possible to use the [webhdfs](https://www.elastic.co/guide/en/logstash/current/plugins-outputs-webhdfs.html) output plugin to do this. ---
**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Post date:** [October 27, 2015, 4:42am UTC](https://discuss.elastic.co/t/can-logstash-push-data-into-hadoop/32961/4 "2015-10-27T04:42:51Z")
Oh, nice 🙂 ---
**Author:** ![asatsi](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/asatsi/32/28417_2.png) [@asatsi](https://discuss.elastic.co/u/asatsi)\ **Post date:** [October 27, 2015, 7:41am UTC](https://discuss.elastic.co/t/can-logstash-push-data-into-hadoop/32961/5 "2015-10-27T07:41:32Z")
Thanks, I will try this out. Anybody did it already? Have any good/bad news about its usage? ---
**Author:** ![bigfootwalk](https://avatars.discourse-cdn.com/v4/letter/b/ea666f/32.png) [@bigfootwalk](https://discuss.elastic.co/u/bigfootwalk)\ **Post date:** [October 27, 2015, 8:03am UTC](https://discuss.elastic.co/t/can-logstash-push-data-into-hadoop/32961/6 "2015-10-27T08:03:15Z")
I'm using logstash1.5.4, but I can't install logstash-output-webhdfs with 'bin/plugin install logstash-output-webhdfs' or 'bin/plugin install logstash-output-webhdfs-2.0.2.gem', do you have any good way to solve this problem? ---
**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Post date:** [October 28, 2015, 12:24am UTC](https://discuss.elastic.co/t/can-logstash-push-data-into-hadoop/32961/7 "2015-10-28T00:24:09Z")
Please start your own thread 🙂 ---
**Author:** ![asatsi](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/asatsi/32/28417_2.png) [@asatsi](https://discuss.elastic.co/u/asatsi)\ **Post date:** [October 29, 2015, 6:41am UTC](https://discuss.elastic.co/t/can-logstash-push-data-into-hadoop/32961/8 "2015-10-29T06:41:51Z")
I was able to use it and test one log...this looks fine! ---
**Author:** ![asatsi](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/asatsi/32/28417_2.png) [@asatsi](https://discuss.elastic.co/u/asatsi)\ **Post date:** [November 2, 2015, 1:07pm UTC](https://discuss.elastic.co/t/can-logstash-push-data-into-hadoop/32961/9 "2015-11-02T13:07:48Z")
It is **not working** as expected if I drop the message altogether, since I need to index only few fields from the entire log. If I do remove\_field =\> "message", then the message logged to Hadoop is " %{message}" string. That is literally %{message} string. This looks like a bug! ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 5:24am UTC](https://discuss.elastic.co/t/can-logstash-push-data-into-hadoop/32961/10 "2017-07-06T05:24:25Z")