Need help on Indexing and Sharding

Elastic Stack Elasticsearch
1

Greetings

Right now I have Elasticsearch allocated with 8GB heap, 1 node, daily indexing, default 5 shards, estimated 15GB of documents per day.

The problem is that it keeps hitting the "request timeout 30000ms" every time I query.

What is the ideal Index and number of shards should I allocate for my case?

CPU 12 core
RAM: 16GB
HDD

Regards.

2

May I suggest you look at the following resources about sizing:

https://www.elastic.co/elasticon/conf/2016/sf/quantitative-cluster-sizing

3

Interesting video.
I've read the first link.

Right now I am testing with (8GB Heap * 15shards = 120 shards) and monthly indices.
Just that I want to know anyone experienced on such data can suggest the ideal type of indices, number of shards and Heap size to allocate.

I fear the lack of Heap size will prevent a smooth and fast query. Unfortunately, I couldn't change from HDD to SSD

Thanks for the links!

4

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.