Elasticsearch timeout after 30000ms

Elastic Stack Elasticsearch
1

Hello everyone, basically i'm importing several totalized indices into one indice, but after sometime I get this timeout, and it also totally freezes my elastic cluster.

I'm using a RestHighLevelClient like this:

	    RestHighLevelClient client = new RestHighLevelClient(
				RestClient.builder(new HttpHost(server, 9200, "http")));
2

Anything in elasticsearch server logs?

What is the output of:

GET /
GET /_cat/nodes?v
GET /_cat/health?v

If some outputs are too big, please share them on gist.github.com and link them here.

3

Should I re-run my agent to make it timeout again?

Because I restarted it and there's nothing really out of normal is these GETs

GET /
{
  "name": "vffr_QL",
  "cluster_name": "cluster_migration",
  "cluster_uuid": "2hQjSvZ-RRyPzjNaLYDU7g",
  "version": {
    "number": "6.4.0",
    "build_flavor": "default",
    "build_type": "tar",
    "build_hash": "595516e",
    "build_date": "2018-08-17T23:18:47.308994Z",
    "build_snapshot": false,
    "lucene_version": "7.4.0",
    "minimum_wire_compatibility_version": "5.6.0",
    "minimum_index_compatibility_version": "5.0.0"
  },
  "tagline": "You Know, for Search"
}
GET /_cat/nodes?v
ip        heap.percent ram.percent cpu load_1m load_5m load_15m node.role master name
127.0.0.1           58          99  17    0.20    0.54     0.85 mdi       *      vffr_QL

GET /_cat/health?v
epoch      timestamp cluster           status node.total node.data shards pri relo init unassign pending_tasks max_task_wait_time active_shards_percent
1559054584 14:43:04  cluster_migration yellow          1         1    377 377    0    0      348             0                  -                 52.0%
4

How much HEAP is allocated to your node?

Also could you use a more recent version than 6.4.0?

5

Disk Available

45.71%

359.5 GB / 786.4 GB

JVM Heap

61.60%

2.4 GB / 4.0 GB

Unfortunatelly i'm not able to change my version.

6

You probably have too many shards per node.

May I suggest you look at the following resources about sizing:

https://www.elastic.co/elasticon/conf/2016/sf/quantitative-cluster-sizing

And https://www.elastic.co/webinars/using-rally-to-get-your-elasticsearch-cluster-size-right

1 Like
7

I'll check it, thanks

8

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.