RAID10 VS Replica 1

Elastic Stack Elasticsearch
1

Hello.

In case of I have 30TB storage(6 spinning 5TB disks with stripe(raid 0)) and 64GB RAM x 4 nodes,
RAM is going insufficient but storage just used about 10%.

Indices have no replica.

To improve availability I have two options,

  1. set indices replica to 1.
  2. change disk raid to 1+0 ( 1mirror)

For 1, I worry about the lack of memory for the new replica shard.
(May replica shard will consume RAM amount of just like primary shard does, right?)
For 2, I heard mirroring is not recommend for es(they say just use replica!)

What is better option?

This is the current Heap status of one node.

image
image.png720×202 19.8 KB

image
image.png723×208 26.1 KB

image
image.png718×203 22.8 KB

2

hello jihun,
I do not have much to say about RAM usage. I guess there is no option to change the hardware? That is a lot of disk compared to the amount of RAM.

As for disk layout, RAID 10 will make the filesystem more reliable but does little to improve ES availability. If one node goes down, the shards allocated to that node are gone.
For any application where data loss is not tolerated you really should have at least 1 replica.

Just my 2c,
AB