Elasticsearch Cluster for distributed mode


(Siva Puvvada) #1

I would like to setup an elastic cluster for 200 GB data per day with replication factor 2 and 1 month data retention period .. but my disk space is having only 1TB maximum per instance .. Could you please provide any suggestions on how many nodes , indices and shards need to configure .


(Mark Walkom) #2

The maths there is pretty easy.

200 * 2 * 30 = 12000GB = 12TB. So 12 nodes, but you probably want a few more cause otherwise these will be at 100% capacity, which won't work.


(Siva Puvvada) #3

Hi Warkolm ,

Thank you for your reply .

How much RAM and CPU we required for each node ? Also how much IOPS we need per node ?


(Mark Walkom) #4

That's harder to answer, you need to start up a node with that amount of disk and see how much memory a TB of data uses.


(system) #5