# Connection refused to webhdfs

**URL:** <https://discuss.elastic.co/t/connection-refused-to-webhdfs/120012>\
**Category:** Logstash\
**Created:** [February 15, 2018, 2:57pm UTC](https://discuss.elastic.co/t/connection-refused-to-webhdfs/120012 "2018-02-15T14:57:09Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![ssasporta](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ssasporta/32/13695_2.png) [@ssasporta](https://discuss.elastic.co/u/ssasporta)\
**Post date:** [February 15, 2018, 2:57pm UTC](https://discuss.elastic.co/t/connection-refused-to-webhdfs/120012/1 "2018-02-15T14:57:10Z")

</div>

Hi,

**The Hadoop is up:**

vpwrk1@vpelastic:[/home/vpwrk1/var/log/logstash]$ **ps -ef | grep hadoop**  
root 7711 1 0 16:32 ? 00:00:04 /usr/java/jdk1.8.0\_74/bin/java -Dproc\_datanode -Xmx1000m -Djava.net.preferIPv4Stack=true -Djava.library.path=/usr/local/hadoop/lib/native -Dhadoop.log.dir=/usr/local/hadoop/logs -Dhadoop.log.file=hadoop.log -Dhadoop.home.dir=/usr/local/hadoop -Dhadoop.id.str=root -Dhadoop.root.logger=INFO,console -Dhadoop.policy.file=hadoop-policy.xml -Djava.net.preferIPv4Stack=true -Djava.net.preferIPv4Stack=true -Djava.library.path=/usr/local/hadoop/lib/native -Djava.net.preferIPv4Stack=true -Djava.library.path=/usr/local/hadoop/lib/native -Dhadoop.log.dir=/usr/local/hadoop/logs -Dhadoop.log.file=hadoop-root-datanode-vpelastic.log -Dhadoop.home.dir=/usr/local/hadoop -Dhadoop.id.str=root -Dhadoop.root.logger=INFO,RFA -Dhadoop.policy.file=hadoop-policy.xml -Djava.net.preferIPv4Stack=true -server -Dhadoop.security.logger=ERROR,RFAS -Dhadoop.security.logger=ERROR,RFAS -Dhadoop.security.logger=ERROR,RFAS -Dhadoop.security.logger=INFO,RFAS org.apache.hadoop.hdfs.server.datanode.DataNode  
root 7886 1 0 16:32 ? 00:00:03 /usr/java/jdk1.8.0\_74/bin/java -Dproc\_secondarynamenode -Xmx1000m -Djava.net.preferIPv4Stack=true -Djava.library.path=/usr/local/hadoop/lib/native -Dhadoop.log.dir=/usr/local/hadoop/logs -Dhadoop.log.file=hadoop.log -Dhadoop.home.dir=/usr/local/hadoop -Dhadoop.id.str=root -Dhadoop.root.logger=INFO,console -Dhadoop.policy.file=hadoop-policy.xml -Djava.net.preferIPv4Stack=true -Djava.net.preferIPv4Stack=true -Djava.library.path=/usr/local/hadoop/lib/native -Djava.net.preferIPv4Stack=true -Djava.library.path=/usr/local/hadoop/lib/native -Dhadoop.log.dir=/usr/local/hadoop/logs -Dhadoop.log.file=hadoop-root-secondarynamenode-vpelastic.log -Dhadoop.home.dir=/usr/local/hadoop -Dhadoop.id.str=root -Dhadoop.root.logger=INFO,RFA -Dhadoop.policy.file=hadoop-policy.xml -Djava.net.preferIPv4Stack=true -Dhadoop.security.logger=INFO,RFAS -Dhdfs.audit.logger=INFO,NullAppender -Dhadoop.security.logger=INFO,RFAS -Dhdfs.audit.logger=INFO,NullAppender -Dhadoop.security.logger=INFO,RFAS -Dhdfs.audit.logger=INFO,NullAppender -Dhadoop.security.logger=INFO,RFAS org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode

**Logstash Configuration:**

webhdfs {  
host =\> "127.0.0.1" # (required)  
port =\> 50070 # (optional, default: 50070)  
path =\> '/user/logstash/%{type}/logstash%{+yyyy.MM.dd.hh.mm}\_%{[@metadata][thread\_id]}.json'  
user =\> "vphadoop" # (required)  
compression =\> "snappy"  
codec =\> json  
single\_file\_per\_thread =\> true

When starting the logstash, is failing with following error:

[2018-02-15T16:52:40,710][INFO][logstash.outputs.elasticsearch] New Elasticsearch output {:class=\>"LogStash::Outputs::ElasticSearch", :hosts=\>[#\<URI::Generic:0x124a864e URL://localhost:9200\>]}  
[2018-02-15T16:52:40,952][**ERROR**][logstash.outputs.webhdfs] Webhdfs check request failed. ( **namenode: 127.0.0.1:50070, Exception: Failed to connect to host 127.0.0.1:50070** , **Connection refused - Connection refused)**  
[2018-02-15T16:52:40,953][ERROR][logstash.pipeline] Error registering plugin {:plugin=\>"#\<LogStash::OutputDelegator:0x524e9a9a @namespaced\_metric=#\<LogStash::Instrument::NamespacedMetric:0x2abc18b2 @metric=#\<LogStash::Instrument::Metric:0x5dd43576 @collector=#\<LogStash::Instrument::Collector:0x75c27335 @agent=nil, @metric\_store=#\<LogStash::Instrument::MetricStore:0x53febd5d @store=#\<Concurrent:🗺0x19cd4618 @default\_proc=nil\>, @structured\_lookup\_mutex=#Mutex:0x654ebfd2, @fast\_lookup=#\<Concurrent:🗺0x3f32395 @default\_proc=nil\>\>\>\>, @namespace\_name=[:stats, :pipelines, :main, :plugins, :outputs, :"36407af94811d744ffe3e94ce9f847a62c4800c9-100"]\>, @metric=#\<LogStash::Instrument::NamespacedMetric:0x56cf0dd5 @metric=#\<LogStash::Instrument::Metric:0x5dd43576 @collector=#\<LogStash::Instrument::Collector:0x75c27335 @agent=nil, @metric\_store=#\<LogStash::Instrument::MetricStore:0x53febd5d @store=#\<Concurrent:🗺0x19cd4618 @default\_proc=nil\>, @structured\_lookup\_mutex=#Mutex:0x654ebfd2, @fast\_lookup=#\<Concurrent:🗺0x3f32395 @default\_proc=nil\>\>\>\>, @namespace\_name=[:stats, :pipelines, :main, :plugins, :outputs]\>, @logger=#\<LogStash::Logging::Logger:0x5c9ae432 @logger=#Java::OrgApacheLoggingLog4jCore::Logger:0x5378b5ec\>, @strategy=#\<LogStash::OutputDelegatorStrategies::Legacy:0x5c6dd904 @worker\_count=1, @workers=[\<LogStash::Outputs::WebHdfs host=\>"127.0.0.1", port=\>50070, path=\>"/user/logstash/%{type}/logstash%{+yyyy.MM.dd.hh.mm}\_%{[@metadata][thread\_id]}.json", user=\>"vphadoop", compression=\>"snappy", codec=\>\<LogStash::Codecs::JSON id=\>"json\_5d658424-a5a8-4712-bcbe-65737d3f419b", enable\_metric=\>true, charset=\>"UTF-8"\>, single\_file\_per\_thread=\>true, id=\>"36407af94811d744ffe3e94ce9f847a62c4800c9-100", enable\_metric=\>true, workers=\>1, standby\_host=\>false, standby\_port=\>50070, idle\_flush\_time=\>1, flush\_size=\>500, open\_timeout=\>30, read\_timeout=\>30, use\_httpfs=\>false, retry\_known\_errors=\>true, retry\_interval=\>0.5, retry\_times=\>5, snappy\_bufsize=\>32768, snappy\_format=\>"stream"\>], @worker\_queue=#SizedQueue:0x6d4fb9e1\>, @id="36407af94811d744ffe3e94ce9f847a62c4800c9-100", @metric\_events=#\<LogStash::Instrument::NamespacedMetric:0x9d04c63 @metric=#\<LogStash::Instrument::Metric:0x5dd43576 @collector=#\<LogStash::Instrument::Collector:0x75c27335 @agent=nil, @metric\_store=#\<LogStash::Instrument::MetricStore:0x53febd5d @store=#\<Concurrent:🗺0x19cd4618 @default\_proc=nil\>, @structured\_lookup\_mutex=#Mutex:0x654ebfd2, @fast\_lookup=#\<Concurrent:🗺0x3f32395 @default\_proc=nil\>\>\>\>, @namespace\_name=[:stats, :pipelines, :main, :plugins, :outputs, :"36407af94811d744ffe3e94ce9f847a62c4800c9-100", :events]\>, @output\_class=LogStash::Outputs::WebHdfs\>", :error=\>"Failed to connect to host 127.0.0.1:50070, Connection refused - Connection refused"}  
[2018-02-15T16:52:41,682][ERROR][logstash.agent] Pipeline aborted due to error {:exception=\>#\<WebHDFS::ServerError: Failed to connect to host 127.0.0.1:50070, Connection refused - Connection refused\>, :backtrace=\>["/usr/share/logstash/vendor/bundle/jruby/1.9/gems/webhdfs-0.8.0/lib/webhdfs/client\_v1.rb:351:in `request'",  
.........  
[2018-02-15T16:52:41,711][INFO][logstash.agent] Successfully started Logstash API endpoint {:port=\>9600}  
[2018-02-15T16:52:44,699][WARN][logstash.agent] stopping pipeline {:id=\>"main"}

Any idea? What to check?  
**It was working till I rebooted the machine.**

Thanks  
Sharon.

---

<div class="post-metadata">

**Author:** ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)\
**Post date:** [February 18, 2018, 2:08pm UTC](https://discuss.elastic.co/t/connection-refused-to-webhdfs/120012/2 "2018-02-18T14:08:58Z")

</div>

Is the HDFS server _really_ listening on 127.0.0.1:50070? Check with e.g. netstat.

---

<div class="post-metadata">

**Author:** ![ssasporta](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ssasporta/32/13695_2.png) [@ssasporta](https://discuss.elastic.co/u/ssasporta)\
**Post date:** [February 18, 2018, 7:51pm UTC](https://discuss.elastic.co/t/connection-refused-to-webhdfs/120012/3 "2018-02-18T19:51:55Z")

</div>

Hi Magnus,  
Thanks!  
Issue was solved.

1. I had to run the hdfs with the same user as used in logstash output to webhdfs.
2. Had to run both: **start-dfs.sh** and **start-yarn.sh**

Sharon.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [March 18, 2018, 7:51pm UTC](https://discuss.elastic.co/t/connection-refused-to-webhdfs/120012/4 "2018-03-18T19:51:58Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.