I'm trying to set up my test instance for Elastic Cloud so my team can make a presentation to our management team to help in the decision on whether or not to move to the cloud offering however I am having problems getting my logstash instance to connect to my cloud based Elasticsearch instance.
Here is a typical configuration from my logstash.conf file:
elasticsearch {
hosts => "https://8f56ccbee0b8ac7ff5520adc543852de.us-east-1.aws.found.io:9243"
user => "logstash_ingester"
password => "xxxxxxxxxx"
index => "requestlog-%{+YYYY.MM.dd}"
document_type => "requestlogs"
sniffing => false
}
logstash_ingester is a custom user that I created and assigned it to the Superuser role.
The specific error that I am getting is this
UNEXPECTED POOL ERROR {:e=>#<LogStash::Outputs::ElasticSearch::HttpClient::Pool::NoConnectionAvailableError: No Available connections>}
followed by these two messages:
-
Attempted to send a bulk request to elasticsearch, but no there are no living connections in the connection pool. Perhaps Elasticsearch is unreachable or down? {:error_message=>"No Available connections", :class=>"LogStash::Outputs::ElasticSearch::HttpClient::Pool::NoConnectionAvailableError", :will_retry_in_seconds=>64}
-
Attempted to resurrect connection to dead ES instance, but got an error. {:url=>#<URI::HTTP:0x7021d8f7 URL:http://logstash_system:xxxxxx@localhost:9200/_xpack/monitoring/?system_id=logstash&system_api_version=2&interval=1s>, :error_type=>LogStash::Outputs::ElasticSearch::HttpClient::Pool::HostUnreachableError, :error=>"Elasticsearch Unreachable: [http://logstash_system:xxxxxx@localhost:9200/][Manticore::SocketException] Connection refused: connect"}
My cluster id is 8f56cc