HI Team,
my heartbeat collectors have stopped working in production environment since last few days, i am unable to understand what is the problem here.
Here is the log output:
2019-07-16T03:53:43.712-0700 INFO [publish] pipeline/retry.go:155 Drop batch
2019-07-16T03:53:44.712-0700 ERROR pipeline/output.go:121 Failed to publish events: temporary bulk send failure
2019-07-16T03:53:44.712-0700 INFO pipeline/output.go:95 Connecting to backoff(elasticsearch(http://xxxxxxxxx:9201))
2019-07-16T03:53:44.713-0700 INFO elasticsearch/client.go:712 Connected to Elasticsearch version 6.4.2
2019-07-16T03:53:44.715-0700 INFO template/load.go:129 Template already exists and will not be overwritten.
2019-07-16T03:53:44.715-0700 INFO pipeline/output.go:105 Connection to backoff(elasticsearch(http://xxxxxxxxxx:9201)) established
2019-07-16T03:53:49.743-0700 ERROR pipeline/output.go:121 Failed to publish events: temporary bulk send failure
2019-07-16T03:53:49.743-0700 INFO pipeline/output.go:95 Connecting to backoff(elasticsearch(http://xxxxxxxxxx:9201))
2019-07-16T03:53:49.744-0700 INFO elasticsearch/client.go:712 Connected to Elasticsearch version 6.4.2
2019-07-16T03:53:49.746-0700 INFO template/load.go:129 Template already exists and will not be overwritten.
2019-07-16T03:46:31.603-0700 WARN tlscommon/tls_config.go:79 SSL/TLS verifications disabled.
2019-07-16T03:46:31.606-0700 WARN tlscommon/tls_config.go:79 SSL/TLS verifications disabled.
2019-07-16T03:46:31.606-0700 WARN tlscommon/tls_config.go:79 SSL/TLS verifications disabled.
2019-07-16T03:46:31.621-0700 WARN tlscommon/tls_config.go:79 SSL/TLS verifications disabled.
2019-07-16T03:46:37.654-0700 ERROR pipeline/output.go:121 Failed to publish events: temporary bulk send failure
2019-07-16T03:46:37.654-0700 INFO pipeline/output.go:95 Connecting to backoff(elasticsearch(http://yyyyyyyyyyyyyyyy:9201))
2019-07-16T03:46:37.655-0700 INFO elasticsearch/client.go:712 Connected to Elasticsearch version 6.4.2
2019-07-16T03:46:37.659-0700 INFO template/load.go:129 Template already exists and will not be overwritten.
2019-07-16T03:46:37.659-0700 INFO pipeline/output.go:105 Connection to backoff(elasticsearch(http://yyyyyyyyyyyyy:9201)) established
2019-07-16T03:46:41.695-0700 INFO [publish] pipeline/retry.go:155 Drop batch
2019-07-16T03:46:42.695-0700 ERROR pipeline/output.go:121 Failed to publish events: temporary bulk send failure
2019-07-16T03:46:42.695-0700 INFO pipeline/output.go:95 Connecting to backoff(elasticsearch(http://xxxxxxxxxxxxx:9201))
Recent Change:
the particular was patched and could have possibly updated the beat version.