Elasticsearch: Delete by source

[Uwais_Ibrahim]

Hi,

I need to delete hits from elasticsearch for a specefic source file. I tried below curl commands. Nothing worked instead delete all contents from elastic search. Please help to make it work.

1. curl -XPOST "localhost:9200/filebeat-*/_delete_by_query?pretty" -H 'Content-Type: application/json' -d' { "query": { "match": { "source": "/path/to/filename.csv" } } }'

2. curl -XPOST "http://localhost:9200/filebeat-*/_delete_by_query?_source='/path/to/filename.csv'" -H 'Content-Type: application/json' -d' { "query": { "match_all": {} } }'

Thanks,

[polyfractal (Zachary Tong)]

@Uwais_Ibrahim

• curl -XPOST "localhost:9200/filebeat-*/_delete_by_query?pretty" -H 'Content-Type: application/json' -d' { "query": { "match": { "source": "/path/to/filename.csv" } } }'

How is the "source" field mapped? If it's a text field, it'll be analyzed and you may be running into issues due to analysis (e.g. /path/to/filename.csv could be tokenized into [path, to, filename, csv] and matching many documents).

@Uwais_Ibrahim

• curl -XPOST "http://localhost:9200/filebeat-*/_delete_by_query?_source='/path/to/filename.csv'" -H 'Content-Type: application/json' -d' { "query": { "match_all": {} } }'

This is just incorrect, and will delete all your data. You shouldn't specify the _source in the URL.

As a tip, you can run the DBQ query as a regular search first, to make sure it matches the correct documents before deleting.