1 index 10 shards vs 10 indexes 1 shard (performance point of view)


(Thibaut Britz) #1

Hi,

Is there a performance difference between querying 10 indexes with 1
shard, or 1 index with 10 shards?
How is the merging of the results be performed: Multithreaded in both
cases? Are there any low level differences when executing a search
between both cases, which could impact the speed?

Thanks,
Thibaut


(Shay Banon) #2

Searching on 1 index with 10 shards or 10 indices with 1 shard has exactly
the same cost. At the end, a search is broken down and executed on each
shard it corresponds to (on different threads / nodes), and merged.

On Thu, Jul 5, 2012 at 6:38 PM, Thibaut Britz <thibaut.britz@trendiction.com

wrote:

Hi,

Is there a performance difference between querying 10 indexes with 1
shard, or 1 index with 10 shards?
How is the merging of the results be performed: Multithreaded in both
cases? Are there any low level differences when executing a search
between both cases, which could impact the speed?

Thanks,
Thibaut


(Thibaut Britz) #3

Thanks!

On Fri, Jul 6, 2012 at 12:44 AM, Shay Banon kimchy@gmail.com wrote:

Searching on 1 index with 10 shards or 10 indices with 1 shard has exactly
the same cost. At the end, a search is broken down and executed on each
shard it corresponds to (on different threads / nodes), and merged.

On Thu, Jul 5, 2012 at 6:38 PM, Thibaut Britz
thibaut.britz@trendiction.com wrote:

Hi,

Is there a performance difference between querying 10 indexes with 1
shard, or 1 index with 10 shards?
How is the merging of the results be performed: Multithreaded in both
cases? Are there any low level differences when executing a search
between both cases, which could impact the speed?

Thanks,
Thibaut


(system) #4