Cluster won't recover

Elastic Stack Elasticsearch
#1

IllegalIndexShardStateException[CurrentState[POST_RECOVERY] operation only allowed when started/recovering, origin [PRIMARY]]

We have 8 nodes, 4 are spots and 4 are on demand. The cluster keeps crashing when with the above error when we start our on demand instances which contain the primary shards of the cluster

We're using Elasticsearch 2.4
Nodes are r3.2xlarge, r4.2xlarge, r3.4xlarge
Heap is configured to 31GB (half of the node's RAM)

#2

Can you post the entire error?

#3

Having nodes come and go in a cluster will cause data to be redistributed. Using spot instances for data nodes can therefore be difficult. What is the reason behind using spot instances? How much data do you have and how many replicas does each index have? Are you using shard allocation filtering and or shard allocation awareness to control the distribution of primary and replica shards across the cluster?

#4

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.