Not getting indices log data from Elasticsearch/Filebeat in Kibana

[FREDDIE2020 (FREDDIE LEWELLEN)]

Hello,

I am Not getting indices log data from Elasticsearch/Filebeat in Kibana to create my indexes any longer.

How can I rectify this issue or what do I need to look at to try and find out the issues?

Filebeat is deployed to all my EKS Clusters and EC2 instances.

Any help appreciated.

Thanks, FREDDIE2020

[warkolm (Mark Walkom)]

What do your Filebeat logs show?

[FREDDIE2020 (FREDDIE LEWELLEN)]

@warkolm
Here is error I see in my filebeat logs:
2020-12-09T19:51:15.481Z ERROR pipeline/output.go:100 Failed to connect to backoff(elasticsearch(https://logview-prd.tfs.toyota.com:443)): 401 Unauthorized: Unauthorized
2020-12-09T19:51:15.481Z INFO pipeline/output.go:93 Attempting to reconnect to backoff(elasticsearch(https://logview-prd.tfs.toyota.com:443)) with 4002 reconnect attempt(s)
2020-12-09T19:51:15.482Z INFO [publisher] pipeline/retry.go:196 retryer: send unwait-signal to consumer
2020-12-09T19:51:15.482Z INFO [publisher] pipeline/retry.go:198 done
2020-12-09T19:51:15.482Z INFO [publisher] pipeline/retry.go:173 retryer: send wait signal to consumer
2020-12-09T19:51:15.482Z INFO [publisher] pipeline/retry.go:175 done
2020-12-09T19:51:22.880Z INFO [monitoring] log/log.go:145 Non-zero metrics in the last 30s {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":5030},"total":{"ticks":141880,"time":{"ms":57},"value":141880},"user":{"ticks":136850,"time":{"ms":57}}},"handles":{"limit":{"hard":1048576,"soft":1048576},"open":40},"info":{"ephemeral_id":"f9fe3b7c-2dc1-4c6e-9f30-3e04d75d00ac","uptime":{"ms":180900031}},"memstats":{"gc_next":53721280,"memory_alloc":26907200,"memory_total":2452047344},"runtime":{"goroutines":204}},"filebeat":{"harvester":{"files":{"00c91a59-eee0-4a91-92b2-c7f85a319c4c":{"size":1287},"373f83c3-b956-4945-bbd5-ad2d947985ed":{"size":1288},"5e99b1c3-83be-435e-8b91-241ca0c470cf":{"size":122},"8e662437-7b88-495f-9e30-0997416b9ab5":{"size":923},"e7a1cb80-e824-4988-b866-82e88434e246":{"size":374}},"open_files":30,"running":54}},"libbeat":{"config":{"module":{"running":0}},"output":{"read":{"bytes":194},"write":{"bytes":212}},"pipeline":{"clients":1,"events":{"active":4117,"retry":50}}},"registrar":{"states":{"current":8}},"system":{"load":{"1":0.07,"15":0.32,"5":0.25,"norm":{"1":0.0175,"15":0.08,"5":0.0625}}}}}}

Any help appreciated.

Thanks,

FREDDIE2020

[warkolm (Mark Walkom)]

@FREDDIE2020

401 Unauthorized: Unauthorized

You might want to check your auth details then?