Intermittent ConnectionFailed errors from ElasticSearch filter


(Ed Ball) #1

Hi,

I've set up a Logstash pipeline with a filebeat input, a couple of ElasticSearch filters to retrieve previous events and an ElasticSearch ouput. I am getting the following errors intermittently in the logs:

[2018-06-13T09:11:13,376][WARN ][logstash.filters.elasticsearch] Failed to query elasticsearch for previous event {:index=>"my-index*", :query=>"request_id:248f7e42-a168-4d17-9eed-ce2eaa351619 AND log_message:\"My log message\"", :event=>#<LogStash::Event:0x21582863>, :error=>#<Faraday::ConnectionFailed>}

Here is my pipeline YML: https://gist.github.com/SequensisTest/694314d0303ebd0b52e0b74ba215b756

I've tried adjusting the sleep time and the number of Logstash pipeline workers in case multiple threads were hogging connections or something but still getting the intermittent errors with any configuration.

I am using Logstash 6.2.4 locally on Windows Server 2012 R2. The ElasticSearch instance is hosted on the Elastic Cloud.

Please help.

Thanks,
Ed


(system) #2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.