Nodes API stuck

(Felka) #1

Hi Fooks,

We are suffering lately from very strange problem: nodes API stuck and kibana gives timeout because of it while trying to get nodes list.
Our setup:
ES 1.6
Kibana 4.1.1
Logstash 1.5.1
Both Kibana and logstash has local ES

6 data nodes with 64 GB of ram and 2TB data
kibana node
and about 14 indexers
Data pipeline is kafka

There are no logs showing a problem or exception on any ES node. Also once kibana got node list it keeps working well and data is indexed well.

curl -XGET 'http://localhost:9200/_cat/nodes' - stuck

but getting explicit node working well.

2015/08/05 05:07:15 [error] 1694#0: *2397 upstream prematurely closed connection while reading response header from upstream, client:, server: kibana.localhost, request: "GET /elasticsearch/nodes?=1438751114353 HTTP/1.1", upstream: "", host: "", referrer: ""

Please help

(Mark Walkom) #2

Is there anything in your ES logs?

(system) #3