[WARN ][logstash.outputs.webhdfs ] Failed to flush outgoing items {:outgoing_count=>160, :exception=>"WebHDFS::IOError"


(zdf) #1

Dear all:
When I use logstash-output-webhdfs plugin to archive logs into hdfs, I met below error occasionly(not always). Does anyone know what happened and how to fix this ?

[WARN ][logstash.outputs.webhdfs ] Failed to flush outgoing items {:outgoing_count=>160, :exception=>"WebHDFS::IOError", :backtrace=>["/opt/logstash/logstash-5.2.2/vendor/bundle/jruby/1.9/gems/webhdfs-0.8.0/lib/webhdfs/client_v1.rb:401:in request'", "/opt/logstash/logstash-5.2.2/vendor/bundle/jruby/1.9/gems/webhdfs-0.8.0/lib/webhdfs/client_v1.rb:270:inoperate_requests'", "/opt/logstash/logstash-5.2.2/vendor/bundle/jruby/1.9/gems/webhdfs-0.8.0/lib/webhdfs/client_v1.rb:73:in create'", "/opt/logstash/logstash-5.2.2/vendor/bundle/jruby/1.9/gems/logstash-output-webhdfs-3.0.2/lib/logstash/outputs/webhdfs.rb:210:inwrite_data'", "/opt/logstash/logstash-5.2.2/vendor/bundle/jruby/1.9/gems/logstash-output-webhdfs-3.0.2/lib/logstash/outputs/webhdfs.rb:205:in write_data'", "/opt/logstash/logstash-5.2.2/vendor/bundle/jruby/1.9/gems/logstash-output-webhdfs-3.0.2/lib/logstash/outputs/webhdfs.rb:195:inflush'", "org/jruby/RubyHash.java:1342:in each'", "/opt/logstash/logstash-5.2.2/vendor/bundle/jruby/1.9/gems/logstash-output-webhdfs-3.0.2/lib/logstash/outputs/webhdfs.rb:183:inflush'", "/opt/logstash/logstash-5.2.2/vendor/bundle/jruby/1.9/gems/stud-0.0.22/lib/stud/buffer.rb:219:in buffer_flush'", "org/jruby/RubyHash.java:1342:ineach'", "/opt/logstash/logstash-5.2.2/vendor/bundle/jruby/1.9/gems/stud-0.0.22/lib/stud/buffer.rb:216:in buffer_flush'", "/opt/logstash/logstash-5.2.2/vendor/bundle/jruby/1.9/gems/stud-0.0.22/lib/stud/buffer.rb:193:inbuffer_flush'", "/opt/logstash/logstash-5.2.2/vendor/bundle/jruby/1.9/gems/stud-0.0.22/lib/stud/buffer.rb:112:in buffer_initialize'", "org/jruby/RubyKernel.java:1479:inloop'", "/opt/logstash/logstash-5.2.2/vendor/bundle/jruby/1.9/gems/stud-0.0.22/lib/stud/buffer.rb:110:in `buffer_initialize'"]}


(system) #2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.