# Logstash web-hdfs plugin problem

**URL:** <https://discuss.elastic.co/t/logstash-web-hdfs-plugin-problem/147996>\
**Category:** Logstash\
**Created:** [September 10, 2018, 5:02pm UTC](https://discuss.elastic.co/t/logstash-web-hdfs-plugin-problem/147996 "2018-09-10T17:02:37Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![John\_McAfee1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/john_mcafee1/32/47236_2.png) [@John\_McAfee1](https://discuss.elastic.co/u/John_McAfee1)\
**Post date:** [September 10, 2018, 5:02pm UTC](https://discuss.elastic.co/t/logstash-web-hdfs-plugin-problem/147996/1 "2018-09-10T17:02:37Z")

</div>

Good morning:

I am using ELK 6.2.2 to parse many kinds of files. All the other plugins work just fine. But I am getting two errors when attempting to use the webhdfs output plugin. It's not very specific(at least to me), so I am struggling to debug. The error message and configuration file are listed below. Has anyone seen this before?

ERROR MESSAGES:  
[ERROR] 2018-09-10 16:40:26.109 [[main]-pipeline-manager] pipeline - Error registering plugin {:pipeline\_id=\>"main", :plugin=\>"#\<LogStash::OutputDelegator:0x65c653d3 @namespaced\_metric=#\<LogStash::Instrument::NamespacedMetric:0x5a159150 @metric=#\<LogStash::Instrument::Metric:0xd8679e4 @collector=#\<LogStash::Instrument::Collector:0x157227bb @agent=nil, @metric\_store=#\<LogStash::Instrument::MetricStore:0x427db60d @store=#\<Concurrent:🗺0x00000000000fac entries=3 default\_proc=nil\>, @structured\_lookup\_mutex=#Mutex:0x34143003, @fast\_lookup=#\<Concurrent:🗺0x00000000000fb0 entries=59 default\_proc=nil\>\>\>\>, @namespace\_name=[:stats, :pipelines, :main, :plugins, :outputs, :cvs\_webhdfs\_test]\>, @metric=#\<LogStash::Instrument::NamespacedMetric:0xea89734 @metric=#\<LogStash::Instrument::Metric:0xd8679e4 @collector=#\<LogStash::Instrument::Collector:0x157227bb @agent=nil, @metric\_store=#\<LogStash::Instrument::MetricStore:0x427db60d @store=#\<Concurrent:🗺0x00000000000fac entries=3 default\_proc=nil\>, @structured\_lookup  
\_mutex=#Mutex:0x34143003, @fast\_lookup=#\<Concurrent:🗺0x00000000000fb0 entries=59 default\_proc=nil\>\>\>\>, @namespace\_name=[:stats, :pipelines, :main, :plugins, :outputs]\>, @out\_counter=org.jruby.proxy.org.logstash.instrument.metrics.counter.LongCounter$Proxy2 - name: out value:0, @strategy=#\<LogStash::OutputDelegatorStrategies::Legacy:0x344b2d20 @worker\_count=1, @workers=[\<LogStash::Outputs::WebHdfs  
[ERROR] 2018-09-10 16:40:26.138 [Ruby-0-Thread-1: /usr/share/logstash/vendor/bundle/jruby/2.3.0/gems/stud-0.0.23/lib/stud/task.rb:22] agent - Failed to execute action {:id=\>:main, :action\_type=\>LogStash::ConvergeResult::FailedAction, :message=\>"Could not execute action: LogStash::PipelineAction::Create/pipeline\_id:main, action\_result: false", :backtrace=\>nil}

CONFIGUTATION FILE:  
input {  
file {  
id =\> "csv-hdfs"  
path =\> "/home/eda-cm-install.svc/directory19a/\*.csv"  
start\_position =\> beginning  
sincedb\_path =\> "/dev/null"  
ignore\_older =\> 0

```
}

```

}  
filter {  
csv {  
columns =\> ["Node UUID", "IP Address", "Node Name", "MIB Expression", "Time Stamp (ms)",  
"Poll Interval (ms)", "MIB Instance", "Metric Value", "Display Attribute", "Filter Value"]  
separator =\> ","  
remove\_field =\> ["message"]  
}  
}  
output {  
stdout { codec =\> rubydebug }  
webhdfs {  
host =\> "hostname-eda-local"  
port =\> 8888  
#port =\> 50070  
path =\> "/fdn/test\_webhdfs/dt=%{+YYYY-MM-dd}/logstash-%{+HH}.csv" # (required)  
user =\> "eda-cm-install.svc"  
ssl\_cert =\> "/home/eda-cm-install.svc/conf/jssecacerts"  
use\_ssl\_auth =\> true  
id =\> "cvs\_webhdfs\_test"  
}

}

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [October 8, 2018, 5:02pm UTC](https://discuss.elastic.co/t/logstash-web-hdfs-plugin-problem/147996/2 "2018-10-08T17:02:41Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.