Metric beat unable to write data

Elastic Stack Beats
1

When crossing the day, when the data needs to be written to the new index, the ES will be unable to write.
Then I stop some metricbeat instances and it will return to normal.

  • Metricbeat Version: 6.3.1
  • ES Version: 5.5.1
  • Operating System: Docker

metricbeat log：
2018-08-31T00:01:48.598ZRRORlasticsearch/client.go:299ailed to perform any bulk index operations: Post http://10.16.232.75:8200/_bulk: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
2018-08-31T00:01:49.598ZRRORipeline/output.go:92ailed to publish events: Post http://10.16.232.75:8200/_bulk: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
2018-08-31T00:01:50.688ZRRORipeline/output.go:92ailed to publish events: temporary bulk send failure
2018-08-31T00:01:51.774ZRRORipeline/output.go:92ailed to publish events: temporary bulk send failure

2

Is there anything in the Elasticsearch logs? What is the output of the cluster stats API? Is there something causing cluster updates to be slow, e.g. large mappings or very large number of indices/shards?

3

Thank you. The reason is in than our Elasticsearch cluster is creating new index at the time, but the cluster create new index is very slow (about 40 second).When we create the index in advance, everything will be normal.

4

How many indices are typically created at a time?

5

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.