Purge the deleted documents on disk

Elastic Stack Elasticsearch
3

Hi Vineeth,

Thanks a lot for your response.

However I've tried setting max_num_segments to 1 and only_expunge_deletes
to true, using the command

curl -XPOST
'http://localhost:9200/_optimize?only_expunge_deletes=true&max_num_segments=1'

This only cleared some of the deleted documents. e.g, the number of deleted
documents reduced from 8k to 7k. But cannot merge all of them. I'm running
es v0.20.5. Is there a way I can force merge all deleted documents?

p.s. I'm upgrading the ES from 0.20.5 to 1.2.1, shards are damaged after
migration, complaining on the write handler to the .del files. I have a
feeling this is because of the un-merged deleted documents.
Thanks
Wei

On Friday, September 12, 2014 8:16:25 PM UTC-7, vineeth mohan wrote:

Hello Wei ,

You can use the in optimize API - max_num_segments as 1 or
only_expunge_deletes as true .
OPTIMIZE -
Elasticsearch Platform — Find real-time answers at scale | Elastic

Thanks
Vineeth

On Sat, Sep 13, 2014 at 5:32 AM, Wei <ws...@groupon.com <javascript:>>
wrote:

Hi all,

If there's any api to clear all the deleted documents on disk?
I read that
Deleting a document doesn’t immediately remove the document from disk —
it just marks it as deleted.
Elasticsearch will clean up deleted documents in the background as you
continue to index more data.

By request the index stats, it shows
"primaries": {

  • "docs": {
    • "count": 3268352,
    • "deleted": 71249
      } ....}

I run refresh, or optimize on my index, But it only cleaned a small
number of deleted documents from disk. Is there any way I can clean all the
deleted docs? to reduce this number to 0?

Thanks
Wei

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com <javascript:>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/adc8877e-dbc4-4751-bf4b-05f346e6c497%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/adc8877e-dbc4-4751-bf4b-05f346e6c497%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/3d566401-c82d-4ec8-bf91-6f4c0a3f2e96%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.