Elastic Search Plugin Red - Kibana Timeout error request

Elastic Stack Elasticsearch
1

Hello All,

I started using the community catalog entry of elasticsearch under Rancher .

It is a cluster of 2 data nodes, 1 master node, 1 client node.

I started seeing a disconnect of Elasticsearch changing to status green to red with Request timeout.

work around followed:

By checking the forum,

  1. I changed my timeout parameter under EL to 60000ms.

Did not help that much.

  1. Under monitoring, I saw more usage of JVM and logs showed gc overhead.

So changed Java Xmx and Xms parameter to 8g from default of 2g.

Little bit of help it did.

and I saw a different error now whenever a POST request is sent to EL

9/14/2017 11:27:37 AM log [16:27:37.114] [error][admin][elasticsearch] Request error, retrying
9/14/2017 11:27:37 AMPOST http://elasticsearch:9200/.kibana/config/_search => socket hang up

Solution tried:

  1. set the following parameters in elasticsearch yml

http.cors.enabled: true
http.cors.allow-origin: "*"
http.max_header_size: 16kb

All of these workaround did not help that much. Still the response is very slow in Kibana. and EL plugin changes to red.

I just have only one index running. 6.4 GB data. Current JVM memory usage:

client: 51%
data1: 81%
data2: 68%
master: 44%

Any other possible causes for this kind of error?

Any workaround to solve this issue is much appreciated.

Thanks

1 Like
2

Where is Kibana running? Is it running on the master and/or data nodes? Or is it a different node?

3

It is running on docker container.

Same host as master and one of the data nodes.

4

Any update on this?

5

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.