hello!
I have logstash, elastic verison 5.2
My elastic - there is cluster with two nodes (ip adress x.x.x.x and y.y.y.y).
My output logstash config:
> elasticsearch {
> hosts => "example.com:80"
> index => "223ab-xyz-%{+YYYY.MM}"
> template => "/opt/logstash/custom_patterns/elasticsearch-template_223.json"
> template_name => "223"
> user => "elastic"
> password => "changeme"
> sniffing => false
> flush_size => "2000"
> }
And I use nginx with next settings https://www.elastic.co/blog/playing-http-tricks-nginx
Result, I have periodically error in logstash log like this:
[2017-02-08T00:54:50,941][WARN ][logstash.outputs.elasticsearch] Marking url as dead. Last error: [LogStash::Outputs::ElasticSearch::
HttpClient::Pool::HostUnreachableError] Elasticsearch Unreachable: [http://elastic:xxxxxx@example.com/][Manticore::SocketTimeout] Read ti
med out {:url=>http://elastic:xxxxxx@example.com/, :error_message=>"Elasticsearch Unreachable: [http://elastic:xxxxxx@example.com/][Manticore
::SocketTimeout] Read timed out", :error_class=>"LogStash::Outputs::ElasticSearch::HttpClient::Pool::HostUnreachableError"}
[2017-02-08T00:54:50,941][ERROR][logstash.outputs.elasticsearch] Attempted to send a bulk request to elasticsearch' but Elasticsearch
appears to be unreachable or down! {:error_message=>"Elasticsearch Unreachable: [http://elastic:xxxxxx@example.com/][Manticore::SocketTi
meout] Read timed out", :class=>"LogStash::Outputs::ElasticSearch::HttpClient::Pool::HostUnreachableError", :will_retry_in_seconds=>2
}
[2017-02-08T00:54:51,268][WARN ][logstash.outputs.elasticsearch] UNEXPECTED POOL ERROR {:e=>#<LogStash::Outputs::ElasticSearch::HttpC
lient::Pool::NoConnectionAvailableError: No Available connections>}
[2017-02-08T00:54:52,336][INFO ][logstash.outputs.elasticsearch] Running health check to see if an Elasticsearch connection is working {:healthcheck_url=>http://elastic:xxxxxx@example.com/, :path=>"/"}
[2017-02-08T00:54:52,341][WARN ][logstash.outputs.elasticsearch] Restored connection to ES instance {:url=>#<URI::HTTP:0x42bc4340 URL:http://elastic:xxxxxx@example.com/>}
[2017-02-08T00:56:40,519][WARN ][logstash.outputs.elasticsearch] Marking url as dead. Last error: [LogStash::Outputs::ElasticSearch::HttpClient::Pool::HostUnreachableError] Elasticsearch Unreachable: [http://elastic:xxxxxx@example.com/][Manticore::SocketTimeout] Read timed out {:url=>http://elastic:xxxxxx@example.com/, :error_message=>"Elasticsearch Unreachable: [http://elastic:xxxxxx@example.com/][Manticore::SocketTimeout] Read timed out", :error_class=>"LogStash::Outputs::ElasticSearch::HttpClient::Pool::HostUnreachableError"}
And the next error in nginx error log:
2017/02/07 02:45:54 [error] 11371#11371: *29115 connect() failed (111: Connection refused) while connecting to upstream, client: x.x.x.x, server: example.com, request: "POST /_bulk HTTP/1.1", upstream: "http://y.y.y.y:9200/_bulk", host:
"example.com"
2017/02/07 02:45:55 [error] 11371#11371: *29119 no live upstreams while connecting to upstream, client: x.x.x.x, server: example.com, request: "POST /_bulk HTTP/1.1", upstream: "http://local/_bulk", host: "example.com"
2017/02/07 02:46:00 [error] 11371#11371: *29119 connect() failed (111: Connection refused) while connecting to upstream, client: x.x.x.x, server: example.com, request: "POST /_bulk HTTP/1.1", upstream: "http://x.x.x.x:9200/_bulk", host:
"example.com"
2017/02/07 02:46:00 [error] 11371#11371: *29119 connect() failed (111: Connection refused) while connecting to upstream, client: x.x.x.x, server: example.com, request: "POST /_bulk HTTP/1.1", upstream: "http://y.y.y.y:9200/_bulk", host:
"example.com"
2017/02/07 02:46:02 [error] 11371#11371: *29115 no live upstreams while connecting to upstream, client: x.x.x.x, server: example.com, request: "POST /_bulk HTTP/1.1", upstream: "http://local/_bulk", host: "example.com"
2017/02/07 02:46:05 [error] 11371#11371: *29119 connect() failed (111: Connection refused) while connecting to upstream, client: x.x.x.x, server: example.com, request: "POST /_bulk HTTP/1.1", upstream: "http://x.x.x.x:9200/_bulk", host:
"example.com"
2017/02/07 02:46:05 [error] 11371#11371: *29119 connect() failed (111: Connection refused) while connecting to upstream, client: x.x.x.x, server: example.com, request: "POST /_bulk HTTP/1.1", upstream: "http://y.y.y.y:9200/_bulk", host:
"example.com"
How can I fix it?