Aws ES Attempted to send a bulk request to elasticsearch' but Elasticsearch appears to be unreachable or down!

Elastic Stack Elasticsearch
1

HI
I am trying to push data from logstash to AWS ES and getting below error. Could anyone please me to fix this.

[2019-01-04T08:52:50,757][ERROR][logstash.outputs.elasticsearch] Attempted to send a bulk request to elasticsearch' but Elasticsearch appears to be unreachable or down! {:error_message=>"Elasticsearch Unreachable: [http://search-mb-production-app-.us-west-2.es.amazonaws.com:80/][Manticore::SocketTimeout] Read timed out", :class=>"LogStash::Outputs::ElasticSearch::HttpClient::Pool::HostUnreachableError", :will_retry_in_seconds=>64}
[2019-01-04T08:52:53,345][WARN ][logstash.outputs.elasticsearch] Restored connection to ES instance {:url=>"http://search-mb-production-app-**.us-west-2.es.amazonaws.com:80/"}

2

this is my conf file

input {
s3 {
bucket => "ecs-production-alb"
prefix => "AWSLogs"
region => "us-west-2"
type => "elblogs"
codec => "plain"
delete => "true"
secret_access_key => "Accesskey"
access_key_id => "Accesskeyid"
}
}

filter {
grok {
match => {"message" => '%{NOTSPACE:request_type} %{TIMESTAMP_ISO8601:log_timestamp} %{NOTSPACE:alb-name} %{NOTSPACE:client} %{NOTSPACE:target} %{NOTSPACE:request_processing_time:float} %{NOTSPACE:target_processing_time:float} %{NOTSPACE:response_processing_time:float} %{NOTSPACE:elb_status_code} %{NOTSPACE:target_status_code} %{NOTSPACE:received_bytes:float} %{NOTSPACE:sent_bytes:float} %{QUOTEDSTRING:request} %{QUOTEDSTRING:user_agent} %{NOTSPACE:ssl_cipher} %{NOTSPACE:ssl_protocol} %{NOTSPACE:target_group_arn} %{QUOTEDSTRING:trace_id}'}
}
grok {
match => ["request", "(%{NOTSPACE:http_method})? (%{NOTSPACE:http_uri})?"]
}

     grok{
         match => [ "target_group_arn","(?<target_group_arn>[/^])(?<target_group>.[^/]*)"]
         }	

mutate {
	 convert => {
          		    "elb_status_code" => "integer"
                    "target_status_code" => "integer"
         		    }

}
}

output {
file{
path => "/var/log/logstash/alb-accesslogs.log"
}

 elasticsearch {
		hosts => "http://search-mb-production-app-e.us-west-2.es.amazonaws.com:80"
		index => "alb-accesslog-%{+YYYY.MM.dd}"
	      }

}

3

This seems to be exactly the same issue as described in this thread. Please do not open multiple threads for the same issue.