Delete by query stuck after installing plugin

Elastic Stack Elasticsearch
1

I installed the delete-by-query plugin for elasticsearch 2.3. and I am running a time query and unable to get the query to run. It just gets stuck before timing out. Has anyone encountered something similar?

This is what my query looks like:

curl -XDELETE "http://localhost:9200/index/logline/_query" -d'
{
"query": {
"range" : {
"timestamp" : {
"gte" : "now-90d/d",
"lt" : "now-7d/d"
}
}
}
}'

I haven't been able to find any documentation to begin to debug this

2

May be @tlrx knows?

That said, you should better use daily indices instead of removing so many documents.
DELETE generates a lot of IO and could take a loooong time to run.
Dropping an index is instantaneous!

My 2 cents

3

Hi,

The delete-by-query plugin produces some TRACE message in log that can help you.

If you want to enable them, update your logging.yml file with:

logger:
  ...
  action.deletebyquery: TRACE

-- Tanguy

4

I've thought about that, but creating a kibana graph for trends over a week becomes difficult with that structure. Is there a way to get around that?

5

I think the usual way to group these is to use an alias that points to all of the indexes. I'm not sure if that is the right thing for Kibana but I think it is.

1 Like