# Recommended shard size and data node instance type in AWS

**URL:** <https://discuss.elastic.co/t/recommended-shard-size-and-data-node-instance-type-in-aws/169676>\
**Category:** Elasticsearch\
**Created:** [February 23, 2019, 6:22pm UTC](https://discuss.elastic.co/t/recommended-shard-size-and-data-node-instance-type-in-aws/169676 "2019-02-23T18:22:27Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![Ijas\_ahamed](https://avatars.discourse-cdn.com/v4/letter/i/c89c15/32.png) [@Ijas\_ahamed](https://discuss.elastic.co/u/Ijas_ahamed)\
**Post date:** [February 23, 2019, 6:22pm UTC](https://discuss.elastic.co/t/recommended-shard-size-and-data-node-instance-type-in-aws/169676/1 "2019-02-23T18:22:28Z")

</div>

I am developing elastic search with about 17B documents per index(daily index) and 90 indices in total. Each document will have a size of less than 1Kb.

Since we are using per day index, only one index will be hot write index. And this system is not a heavy read system.

I am planning to go with 30GB per shard and assuming average index size be 10TB, require about 334 shards per index.

What are the general recommendation on building this scale search system on type of instances and other things I need to take care. Should I go with 8 core machines or some 16+ core machines? Hoping different instance type for hot and warm nodes.

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [February 23, 2019, 6:44pm UTC](https://discuss.elastic.co/t/recommended-shard-size-and-data-node-instance-type-in-aws/169676/2 "2019-02-23T18:44:26Z")

</div>

May be you should use hourly indices?

May I suggest you look at the following resources about sizing:

[https://www.elastic.co/elasticon/conf/2016/sf/quantitative-cluster-sizing](https://www.elastic.co/elasticon/conf/2016/sf/quantitative-cluster-sizing)

> **[How many shards should I have in my Elasticsearch cluster?
	  	 | Elastic](https://www.elastic.co/blog/how-many-shards-should-i-have-in-my-elasticsearch-cluster)**
>
> Elasticsearch is a very versatile platform, that supports a variety of use cases, and provides great flexibility around data organisation and replication strategies. This flexibility can however somet...

https://www.slideshare.net/slideshow/embed_code/key/vR0XKDq4TGa77z

And [https://www.elastic.co/webinars/using-rally-to-get-your-elasticsearch-cluster-size-right](https://www.elastic.co/webinars/using-rally-to-get-your-elasticsearch-cluster-size-right)

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [March 23, 2019, 6:44pm UTC](https://discuss.elastic.co/t/recommended-shard-size-and-data-node-instance-type-in-aws/169676/3 "2019-03-23T18:44:31Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.