I am facing the following error while shipping data into hadoop.
[2019-02-11T17:45:49,731][WARN ][logstash.outputs.webhdfs ] Failed to flush outgoing items {:outgoing_count=>1, :exception=>"WebHDFS::IOError", :backtrace=>
My output configuration is
output {
stdout {
codec => rubydebug
}
webhdfs {
host => "192.168.1.64"
port => 9870
user => "username"
path => "/user/hive/warehouse/dt=%{+Y}-%{+M}-%{+d}/logstash-%{+H}.log"
flush_size => 500000000000
}
}
Please help me on this.