# Need help on Indexing and Sharding

**URL:** <https://discuss.elastic.co/t/need-help-on-indexing-and-sharding/142821>\
**Category:** Elasticsearch\
**Created:** [August 2, 2018, 11:23pm UTC](https://discuss.elastic.co/t/need-help-on-indexing-and-sharding/142821 "2018-08-02T23:23:32Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![pohsun.teh](https://avatars.discourse-cdn.com/v4/letter/p/f08c70/32.png) [@pohsun.teh](https://discuss.elastic.co/u/pohsun.teh)\
**Post date:** [August 2, 2018, 11:23pm UTC](https://discuss.elastic.co/t/need-help-on-indexing-and-sharding/142821/1 "2018-08-02T23:23:32Z")

</div>

Greetings

Right now I have Elasticsearch allocated with 8GB heap, 1 node, daily indexing, default 5 shards, estimated 15GB of documents per day.

The problem is that it keeps hitting the "request timeout 30000ms" every time I query.

What is the ideal Index and number of shards should I allocate for my case?

CPU 12 core  
RAM: 16GB  
HDD

Regards.

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [August 3, 2018, 5:05am UTC](https://discuss.elastic.co/t/need-help-on-indexing-and-sharding/142821/2 "2018-08-03T05:05:30Z")

</div>

May I suggest you look at the following resources about sizing:

[https://www.elastic.co/elasticon/conf/2016/sf/quantitative-cluster-sizing](https://www.elastic.co/elasticon/conf/2016/sf/quantitative-cluster-sizing)

> **[How many shards should I have in my Elasticsearch cluster?
	  	 | Elastic](https://www.elastic.co/blog/how-many-shards-should-i-have-in-my-elasticsearch-cluster)**
>
> Elasticsearch is a very versatile platform, that supports a variety of use cases, and provides great flexibility around data organisation and replication strategies. This flexibility can however somet...

> **[NetSecureDay: Managing your Black Friday Logs](https://speakerdeck.com/elastic/netsecureday-managing-your-black-friday-logs)**
>
> Surveiller une application complexe n’est pas une tâche aisée, mais avec les bons outils, ce n’est pas si sorcier. Néanmoins, des périodes fortes telles que les opérations de type « Black Friday » (Vendredi noir) ou période de Noël peuvent pousser...

---

<div class="post-metadata">

**Author:** ![pohsun.teh](https://avatars.discourse-cdn.com/v4/letter/p/f08c70/32.png) [@pohsun.teh](https://discuss.elastic.co/u/pohsun.teh)\
**Post date:** [August 3, 2018, 5:36am UTC](https://discuss.elastic.co/t/need-help-on-indexing-and-sharding/142821/3 "2018-08-03T05:36:20Z")

</div>

Interesting video.  
I've read the first link.

Right now I am testing with (8GB Heap \* 15shards = 120 shards) and monthly indices.  
Just that I want to know anyone experienced on such data can suggest the ideal type of indices, number of shards and Heap size to allocate.

I fear the lack of Heap size will prevent a smooth and fast query. Unfortunately, I couldn't change from HDD to SSD

Thanks for the links!

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [August 31, 2018, 5:50am UTC](https://discuss.elastic.co/t/need-help-on-indexing-and-sharding/142821/4 "2018-08-31T05:50:22Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.