Hello,
I am sending logs from Windows machine to fluentd using filebeat and then finally to elastic search.
Though the logs are sent on elastic search I am getting some errors on fluentd machine.
my fluentd conf file
<match beats.collect>
@type elasticsearch
<buffer>
flush_mode interval
@type file
path /ebs/td-agent/buffer/fluentd-buffer
chunk_limit_size 20m
queued_chunks_limit_size 512
flush_interval 20s
flush_thread_count 2
retry_wait 1
retry_exponential_backoff_base 2
retry_type exponential_backoff
retry_randomize true
retry_timeout 72h
retry_forever false
</buffer>
id_key _hash
request_timeout 15s
reconnect_on_error true
hosts xxx
port xxx
logstash_format true
include_tag_key true
</match>
errors that I am getting:
unexpected error error="invalid stored block lengths"
2019-06-30 14:42:51 +0000 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluent-plugin-beats-1.1.0/lib/lumberjack/beats/server.rb:300:in `inflate'
2019-06-30 14:42:51 +0000 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluent-plugin-beats-1.1.0/lib/lumberjack/beats/server.rb:300:in `compressed_payload'
2019-06-30 14:42:51 +0000 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluent-plugin-beats-1.1.0/lib/lumberjack/beats/server.rb:171:in `feed'
2019-06-30 14:42:51 +0000 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluent-plugin-beats-1.1.0/lib/lumberjack/beats/server.rb:353:in `read_socket'
2019-06-30 14:42:51 +0000 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluent-plugin-beats-1.1.0/lib/lumberjack/beats/server.rb:328:in `run'
2019-06-30 14:42:51 +0000 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/fluent-plugin-beats-1.1.0/lib/fluent/plugin/in_beats.rb:111:in `block in run'
2019-06-30 14:42:51 +0000 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/concurrent-ruby-1.1.5/lib/concurrent/executor/ruby_thread_pool_executor.rb:348:in `run_task'
2019-06-30 14:42:51 +0000 [error]: #0 /opt/td-agent/embedded/lib/ruby/gems/2.4.0/gems/concurrent-ruby-1.1.5/lib/concurrent/executor/ruby_thread_pool_executor.rb:337:in `block (3 levels) in create_worker
unexpected error error="invalid code lengths set"
unexpected error error="unsupported protocol 44"
unexpected error error="unsupported protocol 132"
unexpected error error="invalid literal/length code"