How long does it take to expunge deleted documents?

I'm trying to expunge deleted documents from our cluster. When I try to use the optimize API through curl, I usually get a 504 gateway timeout. And after the call, I usually see my store size grows in size. How long should I expect to wait until my deleted documents are expunged?

Depends on things like how big the index is, how many deleted docs you have, how big your cluster is, is the data static.

Hi @warkolm
I deleted 6 indices (I used for learning) each is less than 2 MB, a week ago by:
$ curl -XDELETE 'http://localhost:9200/logstash-*'
they do not show up when
http://127.0.0.1:9200/_cat/indices

but the folder data still has them.

How to clean the data folder?

Is there anything in them?

Yes.
There are all the stuff related to indices, with subfolders and plenty of files.
They are available in 4 nodes.
Each folder is 7-14 MB.
For example:
Here is the outcome of the
tree /f
for the 4th node
starting form
cluster/nodes/4/indices/Shakespeare/

-->1
    -->index
            segments_6
            write.lock
            _0.cfe
            _0.cfs
            _0.si
            _1.cfe
            _1.cfs
            _1.si
            _2.cfe
            _2.cfs
            _2.si            
    -->translog
            translog-1.tlog
            translog.ckp            
    -->_state
            state-0.st     
-->2
    -->index
            segments_5
            write.lock
            _0.cfe
            _0.cfs
            _0.si
            _1.cfe
            _1.cfs
            _1.si
            _2.cfe
            _2.cfs
            _2.si        
    -->translog
            translog-1.tlog
            translog.ckp           
    -->_state
            state-0.st           
-->_state
        state-1.st

We need the first six characters of your cluster ID to help you out. Also, what version of Elasticsearch are you running? (I can see the version once I get the cluster ID, but humor me in the mean time).

version[2.1.1], pid[12988], build[40e2c53/2015-12-15T13:05:55Z]

TEST_my_app_clus-dev/rrLop79cRFCuo_HliN25wA

This isn't a Elastic Cloud issue as I re-read the comments; you're able to run commands locally and we don't allow that :slight_smile:

Moving to an appropriate forum.