I have a 3 nodes Elasticsearch cluster that exhausted the disk space in each node. Each node is an EC2 instance. The cluster is now completely irresponsive.
What solutions do I have to free up space?
Would adding a node in cluster free up space in the other node because now the cluster will re-distribute the information over the other nodes?
Or is my only solution but definitely not the preferred ones is to create a larger cluster on the side and migrate over the data from the first cluster?
Any other ideas/solutions is more than welcome.
The cluster configuration on each node(elasticsearch.yml) looks as follows:
cluster.name: AutoSearchCluster
node.name: i-asd4352
plugin.mandatory: cloud-aws
discovery.zen.ping.multicast.enabled: false
discovery.type: ec2
cloud.aws.region: us-west-2
discovery.ec2.groups: prod-group
gateway.recover_after_nodes: 2
gateway.expected_nodes: 3
gateway.recover_after_time: 5m
indices.fielddata.cache.size: 40%