# High Availablity on Elastic Search
**URL:** https://discuss.elastic.co/t/high-availablity-on-elastic-search/145199
**Category:** Elasticsearch
**Created:** [August 20, 2018, 3:14pm UTC](https://discuss.elastic.co/t/high-availablity-on-elastic-search/145199 "2018-08-20T15:14:22Z")
**Posts on this page:** 16
**Page:** 1
### Author:  [@amit.patra](https://discuss.elastic.co/u/amit.patra)
#### Post date: [August 20, 2018, 3:14pm UTC](https://discuss.elastic.co/t/high-availablity-on-elastic-search/145199/1 "2018-08-20T15:14:22Z")
Hi ,
I have installed and configured Elastic-search (Multi Node) Cluster on RHEL 6.9.
Master : 192.168.2.79
Data-Node1 : 192.168.2.80
Data-Node2 : 192.168.2.81
How I make ES high available ??
Question 1 : If Data node 2 goes down here , what will happen? How will I show all data ?
Question 2 : If Storage is full under datanode1 and datanode2, then how Can I increase storage without hampering the system ??
Question 3 : If we add a extra datanode3 when datanode1 and datanode2 space is full , What will happen??
Thanks
---
### Author:  [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)
#### Post date: [August 20, 2018, 6:07pm UTC](https://discuss.elastic.co/t/high-availablity-on-elastic-search/145199/2 "2018-08-20T18:07:33Z")
> [@amit.patra](#):
>
> How I make ES high available ??
You need to have at least 3 master-eligible nodes on separate hosts. This will allow 2 nodes to reach majority even if one node is unavailable assuming you have [configured minimum\_mster\_nodes correctly](https://www.elastic.co/guide/en/elasticsearch/reference/current/modules-node.html). You should therefore make your data nodes also master eligible.
> [@amit.patra](#):
>
> Question 1 : If Data node 2 goes down here , what will happen? How will I show all data ?
Assuming you have a replica configured for all indices, the cluster will still be able to serve data.
> [@amit.patra](#):
>
> Question 2 : If Storage is full under datanode1 and datanode2, then how Can I increase storage without hampering the system ??
You should monitor disk space and act before it gets full as indices will be made read-only and/or you may suffer from index corruption and data loss.
> [@amit.patra](#):
>
> Question 3 : If we add a extra datanode3 when datanode1 and datanode2 space is full , What will happen??
Elasticsearch will automatically redistribute data across all the data nodes available in the cluster.
---
### Author:  [@amit.patra](https://discuss.elastic.co/u/amit.patra)
#### Post date: [August 21, 2018, 2:58am UTC](https://discuss.elastic.co/t/high-availablity-on-elastic-search/145199/3 "2018-08-21T02:58:42Z")
Hi @Christian_Dahlqvist,
Thanks for your valuable response.
In question 1, if we configure replica, the storage will be huge. Suppose we have 5 nodes cluster . In general my cluster size is 50 TB without replica configuration. If we configured the replica the cluster size will be 50 x 5 = 250 TB (Approx) , is this a feasible solution ?
Correct me if I am wrong with the replica concept. Is there any other way to achieve nodes fail-over condition?
In question 2, Suppose we have 90% full storage and we want to add extra storage with out hampering the cluster. Do we need to backup all data directory and increase the storage ?
In question 3, Suppose we have 2 data nodes and in each node path.data size is 15 TB.
In the above scenario, If We add datanode3 , it will be automatically redistribute data and make each data node size is 10 TB??
Correct me if I am wrong.
Thanks,
---
### Author:  [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)
#### Post date: [August 21, 2018, 5:14am UTC](https://discuss.elastic.co/t/high-availablity-on-elastic-search/145199/4 "2018-08-21T05:14:34Z")
> [@amit.patra](#):
>
> In question 1, if we configure replica, the storage will be huge. Suppose we have 5 nodes cluster . In general my cluster size is 50 TB without replica configuration. If we configured the replica the cluster size will be 50 x 5 = 250 TB (Approx) , is this a feasible solution ?
> Correct me if I am wrong with the replica concept. Is there any other way to achieve nodes fail-over condition?
If your primary shards take up 50TB of storage, configuring 1 replica will double this to 100TB. If you do not have at least 1 replica configured you can not have high availability.
> [@amit.patra](#):
>
> In question 2, Suppose we have 90% full storage and we want to add extra storage with out hampering the cluster. Do we need to backup all data directory and increase the storage ?
Assuming you have a replica configured, you should be able to take down and modify/upgrade one node at a time while leaving the cluster operable.
> [@amit.patra](#):
>
> In question 3, Suppose we have 2 data nodes and in each node path.data size is 15 TB.
> In the above scenario, If We add datanode3 , it will be automatically redistribute data and make each data node size is 10 TB??
Yes, that is basically correct.
If you have 100TB of data you are likely to need more than 2 data nodes. Elasticsearch nodes can not hold an infinite amount of data as the amount of heap available limits this. Exactly how much a node can hold will depend on the use case. Have a look at the following resources:
> **[Quantitative Cluster Sizing](https://www.elastic.co/elasticon/conf/2016/sf/quantitative-cluster-sizing)**
> **[Sizing Hot-Warm Architectures for Logging and Metrics in the Elasticsearch...](https://www.elastic.co/blog/sizing-hot-warm-architectures-for-logging-and-metrics-in-the-elasticsearch-service-on-elastic-cloud)**
> **[How many shards should I have in my Elasticsearch cluster?](https://www.elastic.co/blog/how-many-shards-should-i-have-in-my-elasticsearch-cluster)**
---
### Author:  [@amit.patra](https://discuss.elastic.co/u/amit.patra)
#### Post date: [August 21, 2018, 6:03am UTC](https://discuss.elastic.co/t/high-availablity-on-elastic-search/145199/5 "2018-08-21T06:03:28Z")
Hi @Christian_Dahlqvist
Thanks for your valuable response.
In Replication, If we have set number\_of\_replicas : 1 , Is there any chance to slow down data insertion speed. We ingests data through logstash.
Thanks,
---
### Author:  [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)
#### Post date: [August 21, 2018, 6:05am UTC](https://discuss.elastic.co/t/high-availablity-on-elastic-search/145199/6 "2018-08-21T06:05:09Z")
Replication can slow down ingest as the same data need to be indexed twice, but that is the price to pay for increased availability and resilience.
---
### Author:  [@amit.patra](https://discuss.elastic.co/u/amit.patra)
#### Post date: [August 21, 2018, 6:29am UTC](https://discuss.elastic.co/t/high-availablity-on-elastic-search/145199/7 "2018-08-21T06:29:11Z")
Hi @Christian_Dahlqvist
Thanks for your valuable response.
Can we implement high availability through storage side using SAN or anything?
Thanks,
---
### Author:  [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)
#### Post date: [August 21, 2018, 6:43am UTC](https://discuss.elastic.co/t/high-availablity-on-elastic-search/145199/8 "2018-08-21T06:43:08Z")
Different Elasticsearch nodes need different copies of the data as they are managed separately, so using a SAN will not reduce storage requirements.
---
### Author:  [@amit.patra](https://discuss.elastic.co/u/amit.patra)
#### Post date: [August 21, 2018, 12:54pm UTC](https://discuss.elastic.co/t/high-availablity-on-elastic-search/145199/9 "2018-08-21T12:54:11Z")
Hi @Christian_Dahlqvist
Can you please suggest how I configure Elasticsearch 5 server cluster on shared storage.
Thanks,
---
### Author:  [@amit.patra](https://discuss.elastic.co/u/amit.patra)
#### Post date: [August 22, 2018, 4:42am UTC](https://discuss.elastic.co/t/high-availablity-on-elastic-search/145199/10 "2018-08-22T04:42:11Z")
Hi @Christian_Dahlqvist,
My concern is , I want 5 data nodes cluster and data will be mounted same path like /es-data/ in our storage. Is this possible ? then How ?
Thanks,
---
### Author:  [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)
#### Post date: [August 22, 2018, 4:44am UTC](https://discuss.elastic.co/t/high-availablity-on-elastic-search/145199/11 "2018-08-22T04:44:53Z")
What type of shared storage?
---
### Author:  [@amit.patra](https://discuss.elastic.co/u/amit.patra)
#### Post date: [August 22, 2018, 10:50am UTC](https://discuss.elastic.co/t/high-availablity-on-elastic-search/145199/12 "2018-08-22T10:50:19Z")
Hi @Christian_Dahlqvist,
SSD storage tier
A single RAID5 storage pool:
12 \* 200GB EFD
250GB LUN for parent images
500GB LUN for infrastructure
75GB LUNs for replica stores (1 per node pool cluster)
Thanks,
---
### Author:  [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)
#### Post date: [August 22, 2018, 10:53am UTC](https://discuss.elastic.co/t/high-availablity-on-elastic-search/145199/13 "2018-08-22T10:53:25Z")
How much data are you looking to store in the cluster? The size of that storage correlates badly with the 50-100TB you used as an example...
---
### Author:  [@surj08](https://discuss.elastic.co/u/surj08)
#### Post date: [August 23, 2018, 6:16pm UTC](https://discuss.elastic.co/t/high-availablity-on-elastic-search/145199/14 "2018-08-23T18:16:47Z")
> [@Christian\_Dahlqvist](#):
>
> Different Elasticsearch nodes need different copies of the data as they are managed separately, so using a SAN will not reduce storage requirements.
Do you know if this includes SANs with de-duplication? I have wondered if I could get redundancy on the application side without effecting space much
---
### Author:  [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)
#### Post date: [August 23, 2018, 6:19pm UTC](https://discuss.elastic.co/t/high-availablity-on-elastic-search/145199/15 "2018-08-23T18:19:55Z")
Yes, each Elasticsearch node need its own storage.
---
### Author:  [@system](https://discuss.elastic.co/u/system)
#### Post date: [September 20, 2018, 6:20pm UTC](https://discuss.elastic.co/t/high-availablity-on-elastic-search/145199/16 "2018-09-20T18:20:07Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.