How many elastic search shards should I have for a physical node?


(Avinash Pandey) #1

There are many variables here like the number of documents, the size of
documents.
What I want to understand though, is that what are the downsides of having
of too many shards for a physical node?

--
Please update your bookmarks! We have moved to https://discuss.elastic.co/

You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/79e45b39-7980-4e40-a6c7-860132fd0a6d%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


(David Pilato) #2

Each shard is a Lucene instance.
It uses memory, file descriptors, CPU, IO...

You should keep its number per node small.

If you are a RDBMS user, you probably limit the number of databases you manage on a single physical machine, right?

HTH

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 1 juin 2015 à 13:04, Avinash Pandey avinashpandey.iitd@gmail.com a écrit :

There are many variables here like the number of documents, the size of documents.
What I want to understand though, is that what are the downsides of having of too many shards for a physical node?

Please update your bookmarks! We have moved to https://discuss.elastic.co/

You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/79e45b39-7980-4e40-a6c7-860132fd0a6d%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
Please update your bookmarks! We have moved to https://discuss.elastic.co/

You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/DCFC6890-A3EC-424E-9E32-011284BB8B43%40pilato.fr.
For more options, visit https://groups.google.com/d/optout.


(system) #3