Multiple range filters

vinny · May 26, 2011, 9:28pm

Hi,

I am trying to get a query similar to the one below working. The
ranges may not necessarily be consecutive so I need to be able to
retrieve all of the documents that satisify this requirement. Also,
potentially I will need to add other filters so this should work with
the "AND" filter or something equivalent.

{
"query": {"match_all":{} },
"filter" : {
"range" : {
"file_size" : [
{ "from" : 100, "to" : 10000 },
{ "from" : 1000001, "to" : 10000000 } ]
}
}
}

What I have tried is below:

bool filter with two must clauses with the range to search

{
"query": {"match_all":{} },
"filter" : {
"bool" : {
"must" : {"range" : {
"file_size" :
{ "from" : 10, "to" : 10000 }}},
"must" : {"range" : {
"file_size" :
{ "from" : 10001, "to" : 1000000 }
}}}
}
}

two separate "AND" queries in a single "FILTER"

{
"query": {"match_all":{} },
"filter" : {
"and" : [{"range" : {
"file_size" :
{ "from" : 10, "to" : 10000 }}}],
"and" : [{"range" : {
"file_size" :
{ "from" : 10001, "to" : 1000000 }}}]
}
}

Combo "AND" and "OR" in a single filter element

{
"query": {"match_all":{} },
"filter" : {
"and" : [{"term" :
{"file_stages_filetype_result_extension":"htm"}}],
"or" : [{"range" : {
"file_size" :
{ "from" : 10, "to" : 10000 }}},
{"range" : {
"file_size" :
{ "from" : 10001, "to" : 1000000 }}}]
}

}

Combo "AND" and "OR" with two different filters, the result seems
to OR both filters

{
"query": {"match_all":{} },
"filter" : {
"or" : [{"range" : {
"file_size" :
{ "from" : 10, "to" : 10000 }}},
{"range" : {
"file_size" :
{ "from" : 120001, "to" : 1000000 }}}]
} ,
"filter" : {
"and" : [{"term" :
{"file_stages_filetype_result_extension":"htm"}}]
}
}

Single "AND" query with multiple "RANGE" queries on the same field

{
"query": {"match_all":{} },
"filter" : {
"and" : [{"range" : {
"file_size" :
{ "from" : 10, "to" : 10000 }}},
{"range" : {
"file_size" :
{ "from" : 10001, "to" : 1000000 }}}
],
}
}

Nothing seems to work for what I want it to do. Is there a workaround
I can do to get the results I expect?

Vinny

kimchy · May 27, 2011, 11:07am

Try this: gist:995045 · GitHub.

On Friday, May 27, 2011 at 12:28 AM, vinny wrote:

Hi,

I am trying to get a query similar to the one below working. The
ranges may not necessarily be consecutive so I need to be able to
retrieve all of the documents that satisify this requirement. Also,
potentially I will need to add other filters so this should work with
the "AND" filter or something equivalent.

{
"query": {"match_all":{} },
"filter" : {
"range" : {
"file_size" : [
{ "from" : 100, "to" : 10000 },
{ "from" : 1000001, "to" : 10000000 } ]
}
}
}

What I have tried is below:

bool filter with two must clauses with the range to search

{
"query": {"match_all":{} },
"filter" : {
"bool" : {
"must" : {"range" : {
"file_size" :
{ "from" : 10, "to" : 10000 }}},
"must" : {"range" : {
"file_size" :
{ "from" : 10001, "to" : 1000000 }
}}}
}
}

two separate "AND" queries in a single "FILTER"

{
"query": {"match_all":{} },
"filter" : {
"and" : [{"range" : {
"file_size" :
{ "from" : 10, "to" : 10000 }}}],
"and" : [{"range" : {
"file_size" :
{ "from" : 10001, "to" : 1000000 }}}]
}
}

Combo "AND" and "OR" in a single filter element

{
"query": {"match_all":{} },
"filter" : {
"and" : [{"term" :
{"file_stages_filetype_result_extension":"htm"}}],
"or" : [{"range" : {
"file_size" :
{ "from" : 10, "to" : 10000 }}},
{"range" : {
"file_size" :
{ "from" : 10001, "to" : 1000000 }}}]
}

}

Combo "AND" and "OR" with two different filters, the result seems
to OR both filters

{
"query": {"match_all":{} },
"filter" : {
"or" : [{"range" : {
"file_size" :
{ "from" : 10, "to" : 10000 }}},
{"range" : {
"file_size" :
{ "from" : 120001, "to" : 1000000 }}}]
} ,
"filter" : {
"and" : [{"term" :
{"file_stages_filetype_result_extension":"htm"}}]
}
}

Single "AND" query with multiple "RANGE" queries on the same field

{
"query": {"match_all":{} },
"filter" : {
"and" : [{"range" : {
"file_size" :
{ "from" : 10, "to" : 10000 }}},
{"range" : {
"file_size" :
{ "from" : 10001, "to" : 1000000 }}}
],
}
}

Nothing seems to work for what I want it to do. Is there a workaround
I can do to get the results I expect?

Vinny

vinny · May 27, 2011, 8:44pm

Hi Shay,

I tried the gist and it doesn't work, here is the output:
{"took":3,"timed_out":false,"_shards":{"total":5,"successful":
5,"failed":0},"hits":{"total":0,"max_score":null,"hits":}}

As a sanity check I removed one of the range filters and it returns
the correct result. It just doesn't want to work when I give it
multiple ranges to filter by.

thanks for looking into this!

Vinny

On May 27, 7:07 am, Shay Banon shay.ba...@elasticsearch.com wrote:

Try this:gist:995045 · GitHub.

On Friday, May 27, 2011 at 12:28 AM, vinny wrote:

Hi,

I am trying to get a query similar to the one below working. The
ranges may not necessarily be consecutive so I need to be able to
retrieve all of the documents that satisify this requirement. Also,
potentially I will need to add other filters so this should work with
the "AND" filter or something equivalent.

{
"query": {"match_all":{} },
"filter" : {
"range" : {
"file_size" : [
{ "from" : 100, "to" : 10000 },
{ "from" : 1000001, "to" : 10000000 } ]
}
}
}

What I have tried is below:

bool filter with two must clauses with the range to search

{
"query": {"match_all":{} },
"filter" : {
"bool" : {
"must" : {"range" : {
"file_size" :
{ "from" : 10, "to" : 10000 }}},
"must" : {"range" : {
"file_size" :
{ "from" : 10001, "to" : 1000000 }
}}}
}
}

two separate "AND" queries in a single "FILTER"

{
"query": {"match_all":{} },
"filter" : {
"and" : [{"range" : {
"file_size" :
{ "from" : 10, "to" : 10000 }}}],
"and" : [{"range" : {
"file_size" :
{ "from" : 10001, "to" : 1000000 }}}]
}
}

Combo "AND" and "OR" in a single filter element

{
"query": {"match_all":{} },
"filter" : {
"and" : [{"term" :
{"file_stages_filetype_result_extension":"htm"}}],
"or" : [{"range" : {
"file_size" :
{ "from" : 10, "to" : 10000 }}},
{"range" : {
"file_size" :
{ "from" : 10001, "to" : 1000000 }}}]
}

}

Combo "AND" and "OR" with two different filters, the result seems
to OR both filters

{
"query": {"match_all":{} },
"filter" : {
"or" : [{"range" : {
"file_size" :
{ "from" : 10, "to" : 10000 }}},
{"range" : {
"file_size" :
{ "from" : 120001, "to" : 1000000 }}}]
} ,
"filter" : {
"and" : [{"term" :
{"file_stages_filetype_result_extension":"htm"}}]
}
}

Single "AND" query with multiple "RANGE" queries on the same field

{
"query": {"match_all":{} },
"filter" : {
"and" : [{"range" : {
"file_size" :
{ "from" : 10, "to" : 10000 }}},
{"range" : {
"file_size" :
{ "from" : 10001, "to" : 1000000 }}}
],
}
}

Nothing seems to work for what I want it to do. Is there a workaround
I can do to get the results I expect?

Vinny

plaflamme · May 27, 2011, 11:44pm

Isn't the filter saying "keep documents that have file_size between 10 to
10000 and file_size between 10001 to 100001" which, unless a file has two
different sizes will never happen?

What is it you are trying to achieve? It's not clear to me why you need to
filter on different ranges.

Philippe

On Fri, May 27, 2011 at 16:44, vinny agnellvj@gmail.com wrote:

Hi Shay,

I tried the gist and it doesn't work, here is the output:
{"took":3,"timed_out":false,"_shards":{"total":5,"successful":
5,"failed":0},"hits":{"total":0,"max_score":null,"hits":}}

As a sanity check I removed one of the range filters and it returns
the correct result. It just doesn't want to work when I give it
multiple ranges to filter by.

thanks for looking into this!

Vinny

On May 27, 7:07 am, Shay Banon shay.ba...@elasticsearch.com wrote:

Try this:gist:995045 · GitHub.

On Friday, May 27, 2011 at 12:28 AM, vinny wrote:

Hi,

I am trying to get a query similar to the one below working. The
ranges may not necessarily be consecutive so I need to be able to
retrieve all of the documents that satisify this requirement. Also,
potentially I will need to add other filters so this should work with
the "AND" filter or something equivalent.

{
"query": {"match_all":{} },
"filter" : {
"range" : {
"file_size" : [
{ "from" : 100, "to" : 10000 },
{ "from" : 1000001, "to" : 10000000 } ]
}
}
}

What I have tried is below:

bool filter with two must clauses with the range to search

{
"query": {"match_all":{} },
"filter" : {
"bool" : {
"must" : {"range" : {
"file_size" :
{ "from" : 10, "to" : 10000 }}},
"must" : {"range" : {
"file_size" :
{ "from" : 10001, "to" : 1000000 }
}}}
}
}

two separate "AND" queries in a single "FILTER"

{
"query": {"match_all":{} },
"filter" : {
"and" : [{"range" : {
"file_size" :
{ "from" : 10, "to" : 10000 }}}],
"and" : [{"range" : {
"file_size" :
{ "from" : 10001, "to" : 1000000 }}}]
}
}

Combo "AND" and "OR" in a single filter element

{
"query": {"match_all":{} },
"filter" : {
"and" : [{"term" :
{"file_stages_filetype_result_extension":"htm"}}],
"or" : [{"range" : {
"file_size" :
{ "from" : 10, "to" : 10000 }}},
{"range" : {
"file_size" :
{ "from" : 10001, "to" : 1000000 }}}]
}

}

Combo "AND" and "OR" with two different filters, the result seems
to OR both filters

{
"query": {"match_all":{} },
"filter" : {
"or" : [{"range" : {
"file_size" :
{ "from" : 10, "to" : 10000 }}},
{"range" : {
"file_size" :
{ "from" : 120001, "to" : 1000000 }}}]
} ,
"filter" : {
"and" : [{"term" :
{"file_stages_filetype_result_extension":"htm"}}]
}
}

Single "AND" query with multiple "RANGE" queries on the same field

{
"query": {"match_all":{} },
"filter" : {
"and" : [{"range" : {
"file_size" :
{ "from" : 10, "to" : 10000 }}},
{"range" : {
"file_size" :
{ "from" : 10001, "to" : 1000000 }}}
],
}
}

Nothing seems to work for what I want it to do. Is there a workaround
I can do to get the results I expect?

Vinny

vinny · May 28, 2011, 4:36am

I can create the facet for the ranges with no problem. What I want to
be able to do is if I select more than one facet I want to be able to
filter on it which doesn't seem to work properly. This what you would
do for pivoting on a data point. It doesn't necessarily have to be
file size, it could be monetary amounts like 1 to 50 dollars and 50.01
to 100.00 dollars. I want to be able to select the facets so that I
filter on those two or more terms / ranges. This is how you would do
a pivot for a facet.

On May 27, 7:44 pm, Philippe Laflamme philippe.lafla...@obiba.org
wrote:

Isn't the filter saying "keep documents that have file_size between 10 to
10000 and file_size between 10001 to 100001" which, unless a file has two
different sizes will never happen?

What is it you are trying to achieve? It's not clear to me why you need to
filter on different ranges.

Philippe

Ludovic_Levesque · May 28, 2011, 8:14am

Hi, so it's more a OR filter than a AND ?

On Sat, May 28, 2011 at 6:36 AM, vinny agnellvj@gmail.com wrote:

I can create the facet for the ranges with no problem. What I want to
be able to do is if I select more than one facet I want to be able to
filter on it which doesn't seem to work properly. This what you would
do for pivoting on a data point. It doesn't necessarily have to be
file size, it could be monetary amounts like 1 to 50 dollars and 50.01
to 100.00 dollars. I want to be able to select the facets so that I
filter on those two or more terms / ranges. This is how you would do
a pivot for a facet.

On May 27, 7:44 pm, Philippe Laflamme philippe.lafla...@obiba.org
wrote:

Isn't the filter saying "keep documents that have file_size between 10 to
10000 and file_size between 10001 to 100001" which, unless a file has two
different sizes will never happen?

What is it you are trying to achieve? It's not clear to me why you need to
filter on different ranges.

Philippe

plaflamme · May 28, 2011, 1:03pm

I would think that you need to combine filters of the same facet using an OR
and filters of different facets with an AND.

(file_size: [10, 1000[ OR file_size: [10000, 100000[) AND (price: [0, 50[ OR
price [50, 100[)

etc.

Here's the modified gist:

gist.github.com

https://gist.github.com/plaflamme/996843

gistfile1.txt

curl localhost:9200/_search -d '{
    "query" : {
        "filtered" : {
            "query" : {"match_all" : {}},
            "filter" : {
                "or" : [
                    {
                        "range" : {
                            "file_size" : {"from" : 10, "to" : 10000}
                        }

This file has been truncated. show original

You "should" get results with this one...

Philippe

On Sat, May 28, 2011 at 00:36, vinny agnellvj@gmail.com wrote:

I can create the facet for the ranges with no problem. What I want to
be able to do is if I select more than one facet I want to be able to
filter on it which doesn't seem to work properly. This what you would
do for pivoting on a data point. It doesn't necessarily have to be
file size, it could be monetary amounts like 1 to 50 dollars and 50.01
to 100.00 dollars. I want to be able to select the facets so that I
filter on those two or more terms / ranges. This is how you would do
a pivot for a facet.

On May 27, 7:44 pm, Philippe Laflamme philippe.lafla...@obiba.org
wrote:

Isn't the filter saying "keep documents that have file_size between 10 to
10000 and file_size between 10001 to 100001" which, unless a file has two
different sizes will never happen?

What is it you are trying to achieve? It's not clear to me why you need
to
filter on different ranges.

Philippe

fashionalwallet · June 10, 2011, 3:43am

deleted -

Topic		Replies	Views
Question regarding multiple filters Elasticsearch	3	546	July 5, 2017
Please help me with this query Elasticsearch	4	304	July 6, 2017
[bool] query does not support [range] Elasticsearch	2	4671	March 22, 2019
Query with multiple AND and OR clauses in a filter context? Elasticsearch	8	5861	November 28, 2019
How do I combine multiple filters with OR without affecting the score? Elasticsearch	3	7638	October 15, 2021

Multiple range filters

What I have tried is below:

{ "query": {"match_all":{} }, "filter" : { "bool" : { "must" : {"range" : { "file_size" : { "from" : 10, "to" : 10000 }}}, "must" : {"range" : { "file_size" : { "from" : 10001, "to" : 1000000 } }}} } }

What I have tried is below:

{ "query": {"match_all":{} }, "filter" : { "bool" : { "must" : {"range" : { "file_size" : { "from" : 10, "to" : 10000 }}}, "must" : {"range" : { "file_size" : { "from" : 10001, "to" : 1000000 } }}} } }

What I have tried is below:

{ "query": {"match_all":{} }, "filter" : { "bool" : { "must" : {"range" : { "file_size" : { "from" : 10, "to" : 10000 }}}, "must" : {"range" : { "file_size" : { "from" : 10001, "to" : 1000000 } }}} } }

What I have tried is below:

{ "query": {"match_all":{} }, "filter" : { "bool" : { "must" : {"range" : { "file_size" : { "from" : 10, "to" : 10000 }}}, "must" : {"range" : { "file_size" : { "from" : 10001, "to" : 1000000 } }}} } }

Related Topics

{
"query": {"match_all":{} },
"filter" : {
"bool" : {
"must" : {"range" : {
"file_size" :
{ "from" : 10, "to" : 10000 }}},
"must" : {"range" : {
"file_size" :
{ "from" : 10001, "to" : 1000000 }
}}}
}
}

{
"query": {"match_all":{} },
"filter" : {
"bool" : {
"must" : {"range" : {
"file_size" :
{ "from" : 10, "to" : 10000 }}},
"must" : {"range" : {
"file_size" :
{ "from" : 10001, "to" : 1000000 }
}}}
}
}

{
"query": {"match_all":{} },
"filter" : {
"bool" : {
"must" : {"range" : {
"file_size" :
{ "from" : 10, "to" : 10000 }}},
"must" : {"range" : {
"file_size" :
{ "from" : 10001, "to" : 1000000 }
}}}
}
}

{
"query": {"match_all":{} },
"filter" : {
"bool" : {
"must" : {"range" : {
"file_size" :
{ "from" : 10, "to" : 10000 }}},
"must" : {"range" : {
"file_size" :
{ "from" : 10001, "to" : 1000000 }
}}}
}
}