Logstash Issue sending data to elasticseach cluster

[pdkgamage (Pradeep)]

I have upgraded ELK stack into 7.4 version ( filebeat, logstash, elasticalert, kibana). I am using elasticsearch cloud.

Once after the upgrade, following error shows in logstash log file. but few of records can see in kibana.

Blockquote
[2019-10-25T15:22:01,578][ERROR][logstash.outputs.elasticsearch][main] Attempted to send a bulk request to elasticsearch' but Elasticsearch appears to be unreachable or down! {:error_message=>"Elasticsearch Unreachable: [https://user:xxxxxx@:9243/][Manticore::ConnectTimeout] connect timed out", :class=>"LogStash::Outputs::Elasticsearch::HttpClient::Pool::HostUnreachableError", :will_retry_in_seconds=>2} [2019-10-25T15:22:01,595][WARN ][logstash.outputs.elasticsearch][main] Marking url as dead. Last error: [LogStash::Outputs::Elasticsearch::HttpClient::Pool::HostUnreachableError] Elasticsearch Unreachable: [https://user:xxxxxx@:9243/][Manticore::ConnectTimeout] connect timed out {:url=>https://user:xxxxxx@/, :error_message=>"Elasticsearch Unreachable: [https://user:xxxxxx@:9243/][Manticore::ConnectTimeout] connect timed out", :error_class=>"LogStash::Outputs::Elasticsearch::HttpClient::Pool::HostUnreachableError"}

How i can solve this issue?

[Tek_Chand]

@pdkgamage, first all check your elasticsaerch service is up and running? Because logs are showing that logstash is not able to connect elasticsaerch. Have you defined logstash output properly?

Please review you configuration again.
or please provide the output of following commands:

From elasticsaerch machine:

netstat -tunlp

From logstash machine:

telnet elasticsaerch_machine_ip 9200

Thanks.

[pdkgamage (Pradeep)]

hi @Tek_Chand,

Logstash is able to connect elasticsearch cluster. Also, I can see data in kibana. The issue still this error in the logstash log. I suspect , only partial indexes are publishing to elasticsearch cluster from logstash.

Thanks,