My entire cluster that back-ends my graylog deployment stop working over the weekend. It complaining that /proj/graylog (The directory where I store ES data) is full. A df shows that it's only 50% full: Type Size Used Avail Use% Mounted on server:/graylog/graylog/ nfs 238G 117G 121G 50% /p…

ES FileSystemException (out of disk space)

shines2 (Shaun Hines) October 23, 2017, 5:05pm 3

Ok I figured out how to recover the cluster...the magical command was: curl -XPOST 'localhost:9200/_cluster/reroute?retry_failed'

Topic		Replies	Views
Out of space issue Elasticsearch	3	4400	July 5, 2017
Shard reallocation and disk space Elasticsearch	5	956	August 4, 2020
Elastic cluster running out of space, can't get cluster health to green Elasticsearch	7	1271	February 24, 2023
How to Cleanup Full Disk on Elasticsearch Node while Elasticsearch is not running Elasticsearch	6	10195	October 28, 2020
A node in my elasticsearch has full disk Elasticsearch	2	210	February 10, 2024