Get all the records without the need of specifying the size

(Drole) #1

Hi,

I need to query all the URL in my index using terms since I only want to
get the unique URLs, but the number of returned record is determined by the
size, which for the example below is 10.
What should i do to query all URL in my index without specifying the size?

I actually just used the default query from Kibana below.

curl -XGET 'http://localhost//_search?pretty' -d '{
"facets": {
"terms": {
"terms": {
"field": "URL.not_analyzed",
"size": 10,
"order": "count"
},
"facet_filter": {
"fquery": {
"query": {
"filtered": {
"query": {
"bool": {
"should": [
{
"query_string": {
"query": "*"
}
}
]
}
},
"filter": {
"bool": {
"must": [
{
"range": {
"ArrivalTime": {
"from": 1409362530572,
"to": 1409535330572
}
}
}
]
}
}
}
}
}
}
}
},
"size": 0
}'

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/c3c7de5e-ffc9-4dc5-9af3-79309d9a7f94%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

(vineeth mohan-2) #2

Hello Drole ,

You will need to scan over all the documents.
This means that you will need to iterate over every N feeds at a time to
fetch all the documents , it might not be possible in a single call.

It is possible to do this in 2 calls , first to get the size of the index
and second by setting the size of the hits.
But this is highly not recommended and might lead to possible crash. -
http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/search-request-search-type.html#scan

Thanks
Vineeth

On Mon, Sep 1, 2014 at 7:32 AM, Drole rodelm@gmail.com wrote:

Hi,

I need to query all the URL in my index using terms since I only want to
get the unique URLs, but the number of returned record is determined by the
size, which for the example below is 10.
What should i do to query all URL in my index without specifying the size?

I actually just used the default query from Kibana below.

curl -XGET 'http://localhost//_search?pretty' -d '{
"facets": {
"terms": {
"terms": {
"field": "URL.not_analyzed",
"size": 10,
"order": "count"
},
"facet_filter": {
"fquery": {
"query": {
"filtered": {
"query": {
"bool": {
"should": [
{
"query_string": {
"query": "*"
}
}
]
}
},
"filter": {
"bool": {
"must": [
{
"range": {
"ArrivalTime": {
"from": 1409362530572,
"to": 1409535330572
}
}
}
]
}
}
}
}
}
}
}
},
"size": 0
}'

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/c3c7de5e-ffc9-4dc5-9af3-79309d9a7f94%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/c3c7de5e-ffc9-4dc5-9af3-79309d9a7f94%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAGdPd5mzo4zs-Wou5U32qCbkG%3DjbYkFbvRj_niHiaZp4xPRBew%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

(system) #3