I'm trying to expunge deleted documents from our cluster. When I try to use the optimize API through curl, I usually get a 504 gateway timeout. And after the call, I usually see my store size grows in size. How long should I expect to wait until my deleted documents are expunged?
Depends on things like how big the index is, how many deleted docs you have, how big your cluster is, is the data static.
I deleted 6 indices (I used for learning) each is less than 2 MB, a week ago by:
$ curl -XDELETE 'http://localhost:9200/logstash-*'
they do not show up when
but the folder data still has them.
How to clean the data folder?
Is there anything in them?
There are all the stuff related to indices, with subfolders and plenty of files.
They are available in 4 nodes.
Each folder is 7-14 MB.
Here is the outcome of the
for the 4th node
-->1 -->index segments_6 write.lock _0.cfe _0.cfs _0.si _1.cfe _1.cfs _1.si _2.cfe _2.cfs _2.si -->translog translog-1.tlog translog.ckp -->_state state-0.st -->2 -->index segments_5 write.lock _0.cfe _0.cfs _0.si _1.cfe _1.cfs _1.si _2.cfe _2.cfs _2.si -->translog translog-1.tlog translog.ckp -->_state state-0.st -->_state state-1.st
We need the first six characters of your cluster ID to help you out. Also, what version of Elasticsearch are you running? (I can see the version once I get the cluster ID, but humor me in the mean time).
version[2.1.1], pid, build[40e2c53/2015-12-15T13:05:55Z]
This isn't a Elastic Cloud issue as I re-read the comments; you're able to run commands locally and we don't allow that
Moving to an appropriate forum.