Multiple Indices vs Multiple Shards


(ElasticSearch Users mailing list) #1

Hi,

What is the difference in performance or additional load on ElasticSearch
if I define an index with 50 shards or I define 50 indices with one shard.

I mean, technically, there are blogs that suggest that these are
equivalent? Of course without the shard rebalancing, replica, failover, etc.

But, performance-wise, if I am to do 50 indices with one shard, and
aggregate results from all 50, will I see a degradation in performance
compared to 1 index with 50 shards?

Thanks,
Sandeep

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/e3c4bba7-6de8-41af-9022-12ea31cef63a%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


(Mark Walkom) #2

Very little as you have found.
But you might find aggregating will take a fair bit of resources.

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: markw@campaignmonitor.com
web: www.campaignmonitor.com

On 21 August 2014 18:34, 'Sandeep Ramesh Khanzode' via elasticsearch <
elasticsearch@googlegroups.com> wrote:

Hi,

What is the difference in performance or additional load on ElasticSearch
if I define an index with 50 shards or I define 50 indices with one shard.

I mean, technically, there are blogs that suggest that these are
equivalent? Of course without the shard rebalancing, replica, failover, etc.

But, performance-wise, if I am to do 50 indices with one shard, and
aggregate results from all 50, will I see a degradation in performance
compared to 1 index with 50 shards?

Thanks,
Sandeep

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/e3c4bba7-6de8-41af-9022-12ea31cef63a%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/e3c4bba7-6de8-41af-9022-12ea31cef63a%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAEM624YrUojVadJHEDWRuyCggzq_5zKn1P8R5gc-7qi-0JEY3Q%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.


(system) #3