Question: Regarding the Maximum Shard Size


(costya) #1

Hello,

We keep data in monthly indices that grew to be about 800 GB with 4.5
Million Documents each month.

Each index is built from 6 shards and we use 1 replica.

What should be the Average Shard size in an index ? and what is the maximum
? in order to get Great performance.

Any thoughts/suggestions?

Thanks,
Costya.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/1eeeba0c-ed98-45aa-a93f-ae367ec1095c%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Maximum Shard Size in ElasticSearch
(Mark Walkom) #2

The recommended max shard size is 40-50GB.
To figure out the best performance point though would require you to test a
number of things, as this is dependent on your setup.

On 22 December 2014 at 14:05, Costya Regev costya@totango.com wrote:

Hello,

We keep data in monthly indices that grew to be about 800 GB with 4.5
Million Documents each month.

Each index is built from 6 shards and we use 1 replica.

What should be the Average Shard size in an index ? and what is the
maximum ? in order to get Great performance.

Any thoughts/suggestions?

Thanks,
Costya.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/1eeeba0c-ed98-45aa-a93f-ae367ec1095c%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/1eeeba0c-ed98-45aa-a93f-ae367ec1095c%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAEYi1X9ALDBr5LKDcr4s_YpgNm0N_9_nh6%2Bd2HxntXXB2FDsfw%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.


(system) #3