Hi ,
We have Kibana 6.8.2 setup with is working with elastic search 6.8.2.
We see every few days kibana process dies, not able to get any exception logs.
Today I was check logs after the process died and found below in logs.
{"type":"response","@timestamp":"2020-06-02T18:27:34Z","tags":[],"pid":38136,"method":"post","statusCode":200,"req":{"url":"/elasticsearch/_msearch?rest_total_hits_as_int=true&ignore_throttled=true","method":"post","headers":{"host":"ccwlogws-stg1-01:5610","user-agent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/-- Safari/537.36","content-length":"815","accept":"application/json, text/plain, */*","accept-encoding":"gzip, deflate","accept-language":"en-US,en;q=0.9","connection":"keep-alive","content-type":"application/x-ndjson","kbn-version":"6.8.2","origin":"http://ccwlogws-stg1-01:5610","referer":"http://ccwlogws-stg1-01:5610/app/kibana"},"remoteAddress":"---","userAgent":"---","referer":"http://ccwlogws-stg1-01:5610/app/kibana"},"res":{"statusCode":200,"responseTime":6179,"contentLength":9},"message":"POST /elasticsearch/_msearch?rest_total_hits_as_int=true&ignore_throttled=true 200 6179ms - 9.0B"}
{"type":"response","@timestamp":"2020-06-02T18:45:20Z","tags":[],"pid":38136,"method":"post","statusCode":200,"req":{"url":"/elasticsearch/_msearch?rest_total_hits_as_int=true&ignore_throttled=true","method":"post","headers":{"host":"ccwlogws-stg1-01:5610","user-agent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/--- Safari/537.36","content-length":"879","accept":"application/json, text/plain, */*","accept-encoding":"gzip, deflate","accept-language":"en-US,en;q=0.9","connection":"keep-alive","content-type":"application/x-ndjson","dnt":"1","kbn-version":"6.8.2","origin":"http://ccwlogws-stg1-01:5610","referer":"http://ccwlogws-stg1-01:5610/app/kibana"},"remoteAddress":"---","userAgent":"----","referer":"http://ccwlogws-stg1-01:5610/app/kibana"},"res":{"statusCode":200,"responseTime":3292,"contentLength":9},"message":"POST /elasticsearch/_msearch?rest_total_hits_as_int=true&ignore_throttled=true 200 3292ms - 9.0B"}
{"type":"log","@timestamp":"2020-06-02T18:45:27Z","tags":["info","monitoring-ui","kibana-monitoring"],"pid":38136,"message":"Re-initializing Kibana Monitoring due to SIGHUP"}
{"type":"log","@timestamp":"2020-06-02T18:45:27Z","tags":["info","cli","config"],"pid":38136,"message":"Reloading logging configuration due to SIGHUP."}
"Re-initializing Kibana Monitoring due to SIGHUP"
Can some you help finding out what is causing this behavior ?
Also, alternate option I was trying to setup cron job to check process is not running and start process again, but this seems not working as well.
Thanks,
Bharat