# Webhdfs write path

**URL:** <https://discuss.elastic.co/t/webhdfs-write-path/205892>\
**Category:** Logstash\
**Created:** [October 30, 2019, 3:04pm UTC](https://discuss.elastic.co/t/webhdfs-write-path/205892 "2019-10-30T15:04:18Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![sidi](https://avatars.discourse-cdn.com/v4/letter/s/ecc23a/32.png) [@sidi](https://discuss.elastic.co/u/sidi)\
**Post date:** [October 30, 2019, 3:04pm UTC](https://discuss.elastic.co/t/webhdfs-write-path/205892/1 "2019-10-30T15:04:18Z")

</div>

Hi,

I'm using logstash to write data from elasticsearch to hdfs. Everything is going well but th eproblem is when logstash write data in hdfs there is the following exception:  
webhdfs write caused an exception: {"RemoteException":{"exception":"IOException","javaClassName":"java.io.IOException","message":"Failed to replace a bad datanode on the existing pipeline due to no more good datanodes being available to try.

My logstash config is the following:  
input {  
elasticsearch {  
hosts =\> "x.x.x.x"  
index =\>"my\_index"  
}  
}

filter{  
mutate{  
add\_field =\>{  
"message"=\>"%{status},%{msisdn},%{index}"  
}  
}  
}

output {  
webhdfs {  
host =\> "0.0.0.0"  
path =\> "/testLogstash/logstash-%{+yyyy-MM-dd}.log"  
user =\> "flume"  
flush\_size =\> 6000  
idle\_flush\_time =\> 60  
}

stdout {}

}

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [November 27, 2019, 3:04pm UTC](https://discuss.elastic.co/t/webhdfs-write-path/205892/2 "2019-11-27T15:04:24Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
