we are running a 7.4.1 cluster with 8 data nodes. These nodes have several data dirs, each of which are backed by dedicated disks (mounted directly to path.data dirs). Everything working like a charm so far, except lately a single directory on one node is becoming full (less than 5% free at times) and has been causing locked indices. The other 9 disk/dirs on that node are 40%-60% free.
What are the best options to remediate this situation?
If you need any further information, please let me know.