How long does it take to expunge deleted documents?

Elastic Stack Elasticsearch
1

I'm trying to expunge deleted documents from our cluster. When I try to use the optimize API through curl, I usually get a 504 gateway timeout. And after the call, I usually see my store size grows in size. How long should I expect to wait until my deleted documents are expunged?

2

Depends on things like how big the index is, how many deleted docs you have, how big your cluster is, is the data static.

3

Hi @warkolm
I deleted 6 indices (I used for learning) each is less than 2 MB, a week ago by:
$ curl -XDELETE 'http://localhost:9200/logstash-*'
they do not show up when
http://127.0.0.1:9200/_cat/indices

but the folder data still has them.

How to clean the data folder?

4

Is there anything in them?

5

Yes.
There are all the stuff related to indices, with subfolders and plenty of files.
They are available in 4 nodes.
Each folder is 7-14 MB.
For example:
Here is the outcome of the
tree /f
for the 4th node
starting form
cluster/nodes/4/indices/Shakespeare/

-->1
    -->index
            segments_6
            write.lock
            _0.cfe
            _0.cfs
            _0.si
            _1.cfe
            _1.cfs
            _1.si
            _2.cfe
            _2.cfs
            _2.si            
    -->translog
            translog-1.tlog
            translog.ckp            
    -->_state
            state-0.st     
-->2
    -->index
            segments_5
            write.lock
            _0.cfe
            _0.cfs
            _0.si
            _1.cfe
            _1.cfs
            _1.si
            _2.cfe
            _2.cfs
            _2.si        
    -->translog
            translog-1.tlog
            translog.ckp           
    -->_state
            state-0.st           
-->_state
        state-1.st
6

We need the first six characters of your cluster ID to help you out. Also, what version of Elasticsearch are you running? (I can see the version once I get the cluster ID, but humor me in the mean time).

7

version[2.1.1], pid[12988], build[40e2c53/2015-12-15T13:05:55Z]

TEST_my_app_clus-dev/rrLop79cRFCuo_HliN25wA

8

This isn't a Elastic Cloud issue as I re-read the comments; you're able to run commands locally and we don't allow that :slight_smile:

Moving to an appropriate forum.