Kibana is throwing socket hang up exception very frequently and because of this problem kibana is unable to serve any search request. Every time due to below error socket hang up error occurs.
{"type":"log","@timestamp":"2018-06-12T00:01:07Z","tags":["error","elasticsearch","admin"],"pid":11447,"message":"Request error, retrying\nPOST https://x.x.x.x:9200/_xpack/monitoring/_bulk?system_id=kibana&system_api_version=2&interval=10000ms => socket hang up
Hey @meetdave2611997 can you check your Elasticsearch logs to see if any errors are being logged? It appears that monitoring is having issues communicating with your Elasticcsearch cluster, or the calls are taking too long.
@meetdave2611997 are you using a dedicated Elasticsearch cluster for your monitoring data? If you are, you should see xpack.monitoring.elasticsearch.url set in your kibana.yml
@Brandon_Kobel Yes, we do have a load balancer in-front of Elasticsearch. We can navigate each page in kibana but kibana is not showing any results. Every time we need to restart kibana and when we restart it, it works fine utill another socket hang up error occurs.
@meetdave2611997 from your description, it sounds like Kibana is having issues communicating with Elasticsearch in general, could you try pointing Kibana directly at an instance (removing the load balancer) to see if it starts working?
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.