Temporarily failed to flush the buffer

Elastic Stack Elasticsearch
1

Can someone help me to solve the below issue. Below is the configuration and the error I am facing:

2017-09-04 05:38:06 +0000 [info]: following tail of /var/log/nginx/access.log
2017-09-04 05:38:06 +0000 [info]: following tail of /var/log/nginx/error.log
2017-09-04 05:38:12 +0000 [warn]: temporarily failed to flush the buffer. next_retry=2017-09-04 05:38:13 +0000 error_class="Elasticsearch::Transport::Transport::Errors::ServiceUnavailable" error="[503] " plugin_id="object:3f86a7b48328"
2017-09-04 05:38:12 +0000 [warn]: /opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/elasticsearch-transport-5.0.4/lib/elasticsearch/transport/transport/base.rb:202:in __raise_transport_error' 2017-09-04 05:38:12 +0000 [warn]: /opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/elasticsearch-transport-5.0.4/lib/elasticsearch/transport/transport/base.rb:319:inperform_request'
2017-09-04 05:38:12 +0000 [warn]: /opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/elasticsearch-transport-5.0.4/lib/elasticsearch/transport/transport/http/faraday.rb:20:in perform_request' 2017-09-04 05:38:12 +0000 [warn]: /opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/elasticsearch-transport-5.0.4/lib/elasticsearch/transport/client.rb:131:inperform_request'
2017-09-04 05:38:12 +0000 [warn]: /opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/elasticsearch-api-5.0.4/lib/elasticsearch/api/actions/ping.rb:20:in ping' 2017-09-04 05:38:12 +0000 [warn]: /opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluent-plugin-elasticsearch-1.9.5/lib/fluent/plugin/out_elasticsearch.rb:162:inclient'
2017-09-04 05:38:12 +0000 [warn]: /opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluent-plugin-elasticsearch-1.9.5/lib/fluent/plugin/out_elasticsearch.rb:359:in rescue in send_bulk' 2017-09-04 05:38:12 +0000 [warn]: /opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluent-plugin-elasticsearch-1.9.5/lib/fluent/plugin/out_elasticsearch.rb:354:insend_bulk'
2017-09-04 05:38:12 +0000 [warn]: /opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluent-plugin-elasticsearch-1.9.5/lib/fluent/plugin/out_elasticsearch.rb:341:in write_objects' 2017-09-04 05:38:12 +0000 [warn]: /opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluentd-0.12.35/lib/fluent/output.rb:490:inwrite'
2017-09-04 05:38:12 +0000 [warn]: /opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluentd-0.12.35/lib/fluent/buffer.rb:354:in write_chunk' 2017-09-04 05:38:12 +0000 [warn]: /opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluentd-0.12.35/lib/fluent/buffer.rb:333:inpop'
2017-09-04 05:38:12 +0000 [warn]: /opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluentd-0.12.35/lib/fluent/output.rb:342:in try_flush' 2017-09-04 05:38:12 +0000 [warn]: /opt/td-agent/embedded/lib/ruby/gems/2.1.0/gems/fluentd-0.12.35/lib/fluent/output.rb:149:inrun'
2017-09-04 05:38:13 +0000 [warn]: temporarily failed to flush the buffer. next_retry=2017-09-04 05:38:15 +0000 error_class="Elasticsearch::Transport::Transport::Errors::ServiceUnavailable" error="[503] " plugin_id="object:3f86a7b48328"

type tail path /var/log/nginx/access.log pos_file /etc/td-agent/nginx_access.pos refresh_interval 30s read_lines_limit 100 tag nginx.access.log format none type tail path /var/log/nginx/error.log pos_file /etc/td-agent/nginx_access.pos refresh_interval 30s read_lines_limit 100 tag nginx.error.log format none type record_transformer hostname ${hostname} log_file ${tag} type elasticsearch hosts logs-test-elk-455410.us-west-2.elb.amazonaws.com:9200 buffer_chunk_limit 1M buffer_queue_limit 16 flush_interval 5s max_retry_wait 30 disable_retry_limit reload_on_failure true reload_connections false resurrect_after 0 logstash_format true logstash_prefix test_nginxlogs
2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.