I'm starting a project with Elasticsearch (version 6.3.2), and I've got a disk which has a capacity of 100GB. I know that the disk has 40GB of free space, and the rest is occupied by Elasticsearch data (60GB). However, if I check the monitoring area, I can see that Elasticsearch claims that it is only occupying 33.2GB with index data. This means that there is almost 27GB of space which I do not know who is occupying.
I've done a few checks manually, and I've come accross some indexes which have deleted documents, that occupy far more disk space than Elasticsearch claims. For example, I have an idex with docs.count = 44173 and docs.deleted = 18287. Elasticsearch has a store.size = pri.store.size = 18.1MB, but on disk, I can see that this folder occupies approximately 1.4GB of disk space. I would like to know if there is any way of reclaiming this disk space. From what I've seen, this only happens for indices with deleted documents (I didn't check all the indices though). I've tried a forcemerge on the index, both with and without the max_num_segments = 1, and both with and without only_expunge_deletes = true, but I have not seen any significant changes.
Can anyone help me with this one?
Thanks a lot!