5 of 16 shards failed

[alexus]

Hello World!

I'm using Elastic Stack 6.6.1 and after enrolling beats into Central Management, I now seeing following message in Kibana:

5 of 16 shards failed

above message was not prior to enroll, also Infrastructure stopped showing data as well( maybe related to:

Failed to encode event: unsupported float value: NaN

Hello World! I'm using Elastic stack 6.6.0 and I'm seeing following message in: /var/log/metricbeat/metricbeat 2019-02-16T04:20:27.500Z ERROR elasticsearch/client.go:376 Failed to encode event: unsupported float value: NaN configuration block: type: output output type: elasticsearch hosts: localhost:9200 username: elastic password: ********

Please advise.

[warkolm (Mark Walkom)]

Can you please check your Elasticsearch logs for the error and then post it?

[alexus]

elasticsearch did not produce any errors even though kibana did.

[warkolm (Mark Walkom)]

It should have, those errors come from Elasticsearch.

[alexus]

i double checked and still nada... do I have to enable verbose logging in order to see those errors?

[warkolm (Mark Walkom)]

No, they should show up.

Is there anything else in the Kibana logs then?

[alexus]

I actually checked both elasticsearch nodes: coordinate only (kibana endpoint) and actual master node and Kibana for errors, but not seeing any...

I even tried to delete all filebeat-* & metricbeat-* indices, followed by deleting _template/filebeat-*, _termplate/metricbeat-*, followed by re-running setup, yet still seeing "shards failed" in Kibana(