.
> > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).
---
### Author:  [@Ophir\_Michaeli](https://discuss.elastic.co/u/Ophir_Michaeli)
#### Post date: [May 9, 2013, 7:50am UTC](https://discuss.elastic.co/t/number-of-returned-results-and-search-time/11849/7 "2013-05-09T07:50:28Z")
David -
Thanks for the reply.
As I understand your suggestion I do a scan search for the 100,000, instead
of getting 100K results I get total number of hits and a scroll id.
How do I use this scroll id to query elasticsearch which of the 100k has
one of the fields of the other 2000 documents I have and return only those
documents?
On Tuesday, May 7, 2013 1:04:17 PM UTC+3, Ophir Michaeli wrote:
> Hi,
>
> I need to return 100,000 results and it really slows down the search time.
> Compared to straight lucene search, it takes 4 times more.
>
> Is there a way to improve search time with such big amounts of returned
> results?
>
> Thanks,
>
> Ophir
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).
---
### Author:  [@Nicolas\_Labrot](https://discuss.elastic.co/u/Nicolas_Labrot)
#### Post date: [May 9, 2013, 9:27am UTC](https://discuss.elastic.co/t/number-of-returned-results-and-search-time/11849/8 "2013-05-09T09:27:06Z")
Maybe you can use terms filter (
[Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/guide/reference/query-dsl/terms-filter/))
On Thu, May 9, 2013 at 9:50 AM, Ophir Michaeli [ophirmichaeli@gmail.com](mailto:ophirmichaeli@gmail.com)wrote:
> David -
>
> Thanks for the reply.\*\*\*\*\*\*
>
> As I understand your suggestion I do a scan search for the 100,000,
> instead of getting 100K results I get total number of hits and a scroll id.
>
> * * *
>
> How do I use this scroll id to query elasticsearch which of the 100k has
> one of the fields of the other 2000 documents I have and return only those
> documents?\*\*\*\*
>
> On Tuesday, May 7, 2013 1:04:17 PM UTC+3, Ophir Michaeli wrote:
>
> > Hi,
> >
> > I need to return 100,000 results and it really slows down the search
> > time. Compared to straight lucene search, it takes 4 times more.
> >
> > Is there a way to improve search time with such big amounts of returned
> > results?
> >
> > Thanks,
> >
> > Ophir
>
> --
> You received this message because you are subscribed to the Google Groups
> "elasticsearch" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).
> For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).
---
### Author:  [@jprante](https://discuss.elastic.co/u/jprante)
#### Post date: [May 9, 2013, 10:50am UTC](https://discuss.elastic.co/t/number-of-returned-results-and-search-time/11849/9 "2013-05-09T10:50:12Z")
Yes, ES can.
{
"query" : {
"match" : {
"\_all" : "car"
}
},
"filter" : {
"terms" : {
"IdField" : ["X1", "X2", ... "X2000"]
}
}
}
Note, because of a limit in Lucene, you have to break down your filter
terms into a sequence of 1024 terms (or 1000 for better counting
convencience):
{
"query" : {
"match" : {
"\_all" : "car"
}
},
"filter" : {
"terms" : {
"IdField" : ["X1", "X2", ... "X1000"]
}
}
}
and
{
"query" : {
"match" : {
"\_all" : "car"
}
},
"filter" : {
"terms" : {
"IdField" : ["X1001", "X1002", ... "X2000"]
}
}
}
Jörg
Am 09.05.13 09:13, schrieb Maxim Terletsky:
> It could be just another additional condition for the query, but it
> will be 2,000 conditions (for example : query="car" and (IdField="X1"
> or IdField=X2", ....." idField="X2000") ). I don't think Elastic
> Search could handle such a huge query in a straight forward fashion.
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).
---
### Author:  [@Nicolas\_Labrot](https://discuss.elastic.co/u/Nicolas_Labrot)
#### Post date: [May 9, 2013, 11:20am UTC](https://discuss.elastic.co/t/number-of-returned-results-and-search-time/11849/10 "2013-05-09T11:20:56Z")
Are you sure this limit even apply to term's filter?
On Thu, May 9, 2013 at 12:50 PM, Jörg Prante [joergprante@gmail.com](mailto:joergprante@gmail.com) wrote:
> Yes, ES can.
>
> {
> "query" : {
> "match" : {
> "\_all" : "car"
> }
> },
> "filter" : {
> "terms" : {
> "IdField" : ["X1", "X2", ... "X2000"]
> }
> }
> }
>
> Note, because of a limit in Lucene, you have to break down your filter
> terms into a sequence of 1024 terms (or 1000 for better counting
> convencience):
>
> {
> "query" : {
> "match" : {
> "\_all" : "car"
> }
> },
> "filter" : {
> "terms" : {
> "IdField" : ["X1", "X2", ... "X1000"]
> }
> }
> }
>
> and
>
> {
> "query" : {
> "match" : {
> "\_all" : "car"
> }
> },
> "filter" : {
> "terms" : {
> "IdField" : ["X1001", "X1002", ... "X2000"]
> }
> }
> }
>
> Jörg
>
> Am 09.05.13 09:13, schrieb Maxim Terletsky:
>
> It could be just another additional condition for the query, but it will
>
> > be 2,000 conditions (for example : query="car" and (IdField="X1" or
> > IdField=X2", ....." idField="X2000") ). I don't think Elastic Search could
> > handle such a huge query in a straight forward fashion.
>
> --
> You received this message because you are subscribed to the Google Groups
> "elasticsearch" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to elasticsearch+unsubscribe@\*\*[googlegroups.com](http://googlegroups.com)[elasticsearch%2Bunsubscribe@googlegroups.com](mailto:elasticsearch%2Bunsubscribe@googlegroups.com)
> .
> For more options, visit [https://groups.google.com/\*\*groups/opt\_out](https://groups.google.com/**groups/opt_out)[https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out)
> .
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).
---
### Author:  [@Clinton\_Gormley](https://discuss.elastic.co/u/Clinton_Gormley)
#### Post date: [May 9, 2013, 11:35am UTC](https://discuss.elastic.co/t/number-of-returned-results-and-search-time/11849/11 "2013-05-09T11:35:06Z")
It applies to the terms QUERY but not the terms filter
On Thu, May 9, 2013 at 1:20 PM, Nicolas Labrot [nithril@gmail.com](mailto:nithril@gmail.com) wrote:
> Are you sure this limit even apply to term's filter?
>
> On Thu, May 9, 2013 at 12:50 PM, Jörg Prante [joergprante@gmail.com](mailto:joergprante@gmail.com)wrote:
>
> > Yes, ES can.
> >
> > {
> > "query" : {
> > "match" : {
> > "\_all" : "car"
> > }
> > },
> > "filter" : {
> > "terms" : {
> > "IdField" : ["X1", "X2", ... "X2000"]
> > }
> > }
> > }
> >
> > Note, because of a limit in Lucene, you have to break down your filter
> > terms into a sequence of 1024 terms (or 1000 for better counting
> > convencience):
> >
> > {
> > "query" : {
> > "match" : {
> > "\_all" : "car"
> > }
> > },
> > "filter" : {
> > "terms" : {
> > "IdField" : ["X1", "X2", ... "X1000"]
> > }
> > }
> > }
> >
> > and
> >
> > {
> > "query" : {
> > "match" : {
> > "\_all" : "car"
> > }
> > },
> > "filter" : {
> > "terms" : {
> > "IdField" : ["X1001", "X1002", ... "X2000"]
> > }
> > }
> > }
> >
> > Jörg
> >
> > Am 09.05.13 09:13, schrieb Maxim Terletsky:
> >
> > It could be just another additional condition for the query, but it will
> >
> > > be 2,000 conditions (for example : query="car" and (IdField="X1" or
> > > IdField=X2", ....." idField="X2000") ). I don't think Elastic Search could
> > > handle such a huge query in a straight forward fashion.
> >
> > --
> > You received this message because you are subscribed to the Google Groups
> > "elasticsearch" group.
> > To unsubscribe from this group and stop receiving emails from it, send an
> > email to elasticsearch+unsubscribe@\*\*[googlegroups.com](http://googlegroups.com)[elasticsearch%2Bunsubscribe@googlegroups.com](mailto:elasticsearch%2Bunsubscribe@googlegroups.com)
> > .
> > For more options, visit [https://groups.google.com/\*\*groups/opt\_out](https://groups.google.com/**groups/opt_out)[https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out)
> > .
>
> --
> You received this message because you are subscribed to the Google Groups
> "elasticsearch" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).
> For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).
---
### Author:  [@Ophir\_Michaeli](https://discuss.elastic.co/u/Ophir_Michaeli)
#### Post date: [May 12, 2013, 7:20am UTC](https://discuss.elastic.co/t/number-of-returned-results-and-search-time/11849/12 "2013-05-12T07:20:24Z")
Thanks for all the replies, it works using the term filter:
{
"size": 2000,
"query": {
```
"query_string": {
"query": "air",
"fields": [
"board^5",
"user^1",
"description^10"
],
"analyzer": "snowball",
"phrase_slop": 1000.0
}
```
},
"filter": {
```
"terms": {
"iDPicture": [
"0x33381c1f5d80a787ab669e3a974fc67c",
"0xcd8c566cf3cd3d5a9b1a4d8216ed81ff"
]
}
```
},
"fields": [
```
"iDPin",
"iDPicture"
```
]
}
On Tuesday, May 7, 2013 1:04:17 PM UTC+3, Ophir Michaeli wrote:
> Hi,
>
> I need to return 100,000 results and it really slows down the search time.
> Compared to straight lucene search, it takes 4 times more.
>
> Is there a way to improve search time with such big amounts of returned
> results?
>
> Thanks,
>
> Ophir
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).
---
### Author:  [@system](https://discuss.elastic.co/u/system)
#### Post date: [July 6, 2017, 2:37am UTC](https://discuss.elastic.co/t/number-of-returned-results-and-search-time/11849/13 "2017-07-06T02:37:01Z")