I was trying Filtered query (default search type) to fetch first 8k out of
approx 170k matched records. I noticed that on an average query took around
500ms (response.getTookInMillis()). But, when I tried 4 concurrent searches
over same dataset (in ideal scenario dataset will be different), I noticed
that the performance degraded and each query took more than 1sec on
average. Is this degradation in search response expected?
I still haven't tried with scroll and scan as order is not important, but,
curious to know if anything wrong with query or the way I executed.
I am executing search on single index having around 850k docs (each doc
contains around 5 fields), with 1g allocated to ES and using java node
client to execute searches. Following is the query JSON:
I was trying Filtered query (default search type) to fetch first 8k out of
approx 170k matched records. I noticed that on an average query took around
500ms (response.getTookInMillis()). But, when I tried 4 concurrent searches
over same dataset (in ideal scenario dataset will be different), I noticed
that the performance degraded and each query took more than 1sec on
average. Is this degradation in search response expected?
I still haven't tried with scroll and scan as order is not important, but,
curious to know if anything wrong with query or the way I executed.
I am executing search on single index having around 850k docs (each doc
contains around 5 fields), with 1g allocated to ES and using java node
client to execute searches. Following is the query JSON:
I was trying Filtered query (default search type) to fetch first 8k out
of approx 170k matched records. I noticed that on an average query took
around 500ms (response.getTookInMillis()). But, when I tried 4 concurrent
searches over same dataset (in ideal scenario dataset will be different), I
noticed that the performance degraded and each query took more than 1sec on
average. Is this degradation in search response expected?
I still haven't tried with scroll and scan as order is not important,
but, curious to know if anything wrong with query or the way I executed.
I am executing search on single index having around 850k docs (each doc
contains around 5 fields), with 1g allocated to ES and using java node
client to execute searches. Following is the query JSON:
ES query time as given by search response object
(response.getTookInMillis())
Regards,
Vishal
On Friday, April 17, 2015 at 6:32:56 PM UTC+5:30, Jörg Prante wrote:
What time do you measure? The ES query time, or the network latency?
Jörg
On Fri, Apr 17, 2015 at 2:25 PM, Vishal Mahajan <vish...@gmail.com
<javascript:>> wrote:
Hi,
I was trying Filtered query (default search type) to fetch first 8k out
of approx 170k matched records. I noticed that on an average query took
around 500ms (response.getTookInMillis()). But, when I tried 4 concurrent
searches over same dataset (in ideal scenario dataset will be different), I
noticed that the performance degraded and each query took more than 1sec on
average. Is this degradation in search response expected?
I still haven't tried with scroll and scan as order is not important,
but, curious to know if anything wrong with query or the way I executed.
I am executing search on single index having around 850k docs (each doc
contains around 5 fields), with 1g allocated to ES and using java node
client to execute searches. Following is the query JSON:
What time do you measure? The ES query time, or the network latency?
Jörg
On Fri, Apr 17, 2015 at 2:25 PM, Vishal Mahajan <vish...@gmail.com
<javascript:>> wrote:
Hi,
I was trying Filtered query (default search type) to fetch first 8k out
of approx 170k matched records. I noticed that on an average query took
around 500ms (response.getTookInMillis()). But, when I tried 4 concurrent
searches over same dataset (in ideal scenario dataset will be different), I
noticed that the performance degraded and each query took more than 1sec on
average. Is this degradation in search response expected?
I still haven't tried with scroll and scan as order is not important,
but, curious to know if anything wrong with query or the way I executed.
I am executing search on single index having around 850k docs (each doc
contains around 5 fields), with 1g allocated to ES and using java node
client to execute searches. Following is the query JSON:
What time do you measure? The ES query time, or the network latency?
Jörg
On Fri, Apr 17, 2015 at 2:25 PM, Vishal Mahajan vish...@gmail.com
wrote:
Hi,
I was trying Filtered query (default search type) to fetch first 8k out
of approx 170k matched records. I noticed that on an average query took
around 500ms (response.getTookInMillis()). But, when I tried 4 concurrent
searches over same dataset (in ideal scenario dataset will be different), I
noticed that the performance degraded and each query took more than 1sec on
average. Is this degradation in search response expected?
I still haven't tried with scroll and scan as order is not important,
but, curious to know if anything wrong with query or the way I executed.
I am executing search on single index having around 850k docs (each doc
contains around 5 fields), with 1g allocated to ES and using java node
client to execute searches. Following is the query JSON:
What time do you measure? The ES query time, or the network latency?
Jörg
On Fri, Apr 17, 2015 at 2:25 PM, Vishal Mahajan vish...@gmail.com
wrote:
Hi,
I was trying Filtered query (default search type) to fetch first 8k
out of approx 170k matched records. I noticed that on an average query took
around 500ms (response.getTookInMillis()). But, when I tried 4 concurrent
searches over same dataset (in ideal scenario dataset will be different), I
noticed that the performance degraded and each query took more than 1sec on
average. Is this degradation in search response expected?
I still haven't tried with scroll and scan as order is not important,
but, curious to know if anything wrong with query or the way I executed.
I am executing search on single index having around 850k docs (each
doc contains around 5 fields), with 1g allocated to ES and using java node
client to execute searches. Following is the query JSON:
You can not expect a single node cluster can work faster when being
searched concurrently. Four concurrent searches require four times the
resources, such as CPU and memory.
What time do you measure? The ES query time, or the network latency?
Jörg
On Fri, Apr 17, 2015 at 2:25 PM, Vishal Mahajan vish...@gmail.com
wrote:
Hi,
I was trying Filtered query (default search type) to fetch first 8k
out of approx 170k matched records. I noticed that on an average query took
around 500ms (response.getTookInMillis()). But, when I tried 4 concurrent
searches over same dataset (in ideal scenario dataset will be different), I
noticed that the performance degraded and each query took more than 1sec on
average. Is this degradation in search response expected?
I still haven't tried with scroll and scan as order is not important,
but, curious to know if anything wrong with query or the way I executed.
I am executing search on single index having around 850k docs (each
doc contains around 5 fields), with 1g allocated to ES and using java node
client to execute searches. Following is the query JSON:
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.