Kibana log errors regarding plugin request timeout

Elastic Stack Kibana
1

Hi Elastic Team,

I am running Kibana 6.8.1 built from git source. When I look at kibana.stdout file, I saw lots of errors regarding some x-pack plugins with Request timeout errors like below.

{"type":"log","@timestamp":"2019-09-04T17:37:48Z","tags":["status","plugin:xpack_main@6.8.1","error"],"pid":18389,"state":"red","message":"Status changed from green to red - Request Timeout after 3000ms","prevState":"green","prevMsg":"Ready"}
{"type":"log","@timestamp":"2019-09-04T17:37:48Z","tags":["status","plugin:graph@6.8.1","error"],"pid":18389,"state":"red","message":"Status changed from green to red - Request Timeout after 3000ms","prevState":"green","prevMsg":"Ready"}
{"type":"log","@timestamp":"2019-09-04T17:37:48Z","tags":["status","plugin:spaces@6.8.1","error"],"pid":18389,"state":"red","message":"Status changed from green to red - Request Timeout after 3000ms","prevState":"green","prevMsg":"Ready"}
{"type":"log","@timestamp":"2019-09-04T17:37:48Z","tags":["status","plugin:security@6.8.1","error"],"pid":18389,"state":"red","message":"Status changed from green to red - Request Timeout after 3000ms","prevState":"green","prevMsg":"Ready"}
{"type":"log","@timestamp":"2019-09-04T17:37:48Z","tags":["status","plugin:searchprofiler@6.8.1","error"],"pid":18389,"state":"red","message":"Status changed from green to red - Request Timeout after 3000ms","prevState":"green","prevMsg":"Ready"}
{"type":"log","@timestamp":"2019-09-04T17:37:48Z","tags":["status","plugin:ml@6.8.1","error"],"pid":18389,"state":"red","message":"Status changed from green to red - Request Timeout after 3000ms","prevState":"green","prevMsg":"Ready"}
{"type":"log","@timestamp":"2019-09-04T17:37:48Z","tags":["status","plugin:tilemap@6.8.1","error"],"pid":18389,"state":"red","message":"Status changed from green to red - Request Timeout after 3000ms","prevState":"green","prevMsg":"Ready"}
{"type":"log","@timestamp":"2019-09-04T17:37:48Z","tags":["status","plugin:watcher@6.8.1","error"],"pid":18389,"state":"red","message":"Status changed from green to red - Request Timeout after 3000ms","prevState":"green","prevMsg":"Ready"}
{"type":"log","@timestamp":"2019-09-04T17:37:48Z","tags":["status","plugin:grokdebugger@6.8.1","error"],"pid":18389,"state":"red","message":"Status changed from green to red - Request Timeout after 3000ms","prevState":"green","prevMsg":"Ready"}
{"type":"log","@timestamp":"2019-09-04T17:37:48Z","tags":["status","plugin:logstash@6.8.1","error"],"pid":18389,"state":"red","message":"Status changed from green to red - Request Timeout after 3000ms","prevState":"green","prevMsg":"Ready"}
{"type":"log","@timestamp":"2019-09-04T17:37:48Z","tags":["status","plugin:beats_management@6.8.1","error"],"pid":18389,"state":"red","message":"Status changed from green to red - Request Timeout after 3000ms","prevState":"green","prevMsg":"Ready"}
{"type":"log","@timestamp":"2019-09-04T17:37:48Z","tags":["status","plugin:maps@6.8.1","error"],"pid":18389,"state":"red","message":"Status changed from green to red - Request Timeout after 3000ms","prevState":"green","prevMsg":"Ready"}
{"type":"log","@timestamp":"2019-09-04T17:37:48Z","tags":["status","plugin:index_management@6.8.1","error"],"pid":18389,"state":"red","message":"Status changed from green to red - Request Timeout after 3000ms","prevState":"green","prevMsg":"Ready"}
{"type":"log","@timestamp":"2019-09-04T17:37:48Z","tags":["status","plugin:index_lifecycle_management@6.8.1","error"],"pid":18389,"state":"red","message":"Status changed from green to red - Request Timeout after 3000ms","prevState":"green","prevMsg":"Ready"}
{"type":"log","@timestamp":"2019-09-04T17:37:48Z","tags":["status","plugin:rollup@6.8.1","error"],"pid":18389,"state":"red","message":"Status changed from green to red - Request Timeout after 3000ms","prevState":"green","prevMsg":"Ready"}
{"type":"log","@timestamp":"2019-09-04T17:37:48Z","tags":["status","plugin:remote_clusters@6.8.1","error"],"pid":18389,"state":"red","message":"Status changed from green to red - Request Timeout after 3000ms","prevState":"green","prevMsg":"Ready"}
{"type":"log","@timestamp":"2019-09-04T17:37:48Z","tags":["status","plugin:cross_cluster_replication@6.8.1","error"],"pid":18389,"state":"red","message":"Status changed from green to red - Request Timeout after 3000ms","prevState":"green","prevMsg":"Ready"}
{"type":"log","@timestamp":"2019-09-04T17:37:48Z","tags":["status","plugin:reporting@6.8.1","error"],"pid":18389,"state":"red","message":"Status changed from green to red - Request Timeout after 3000ms","prevState":"green","prevMsg":"Ready"}

I searched on google, someone mentioned maybe not configure Elasticsearch properly? But if I understand correctly, Elasticsearch 6.8 will automatically configure x-pack and no need for further configuration. And we want to use Basic license only. Did I miss anything?
The build command I am using is like below.

node scripts/build.js --release --rpm --no-oss

Could anybody help??

Thanks so much!!

2

Hello,

It looks like this could be the result of a JVM heap issue. See this related thread.

Regards,
Aaron

3

Thanks @Aaron_Caldwell. Let me try to increase JVM heap size. Meanwhile, if I understand correctly, the build command I use is correct right? And no further need to configure Elastisticsearch and Kibana to use basic license right?

Thanks a lot!!

4

Just check the jvm.options setting. It was set to 1g only. Just modified and will see. Thanks for your response!