# Questions of setting up elasticsearch server with 20 SSD on it

**URL:** <https://discuss.elastic.co/t/questions-of-setting-up-elasticsearch-server-with-20-ssd-on-it/59267>\
**Category:** Elasticsearch\
**Created:** [August 30, 2016, 4:03am UTC](https://discuss.elastic.co/t/questions-of-setting-up-elasticsearch-server-with-20-ssd-on-it/59267 "2016-08-30T04:03:11Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![macymin](https://avatars.discourse-cdn.com/v4/letter/m/8e7dd6/32.png) [@macymin](https://discuss.elastic.co/u/macymin)\
**Post date:** [August 30, 2016, 4:03am UTC](https://discuss.elastic.co/t/questions-of-setting-up-elasticsearch-server-with-20-ssd-on-it/59267/1 "2016-08-30T04:03:11Z")

</div>

hi, we are going to setup elasticsearch server with 20 SSD on it. but I am not sure how we gonna group those SSDs.

i read some material it says setup as RAID 0. Shall I group all 20 SSD into one file system or should separate each disk as one file system? our sysadmin says not suggest to group all SSD into one file system as one SSD dies it will affect the whole file system.

below are my questions if i setup separately as follows:  
/data/0/  
/data/1/  
/data/2/  
..  
/data/20/

1. how I should configure the path.data in elasticsearch conf?
2. how to make sure the shards (especially replica) are distributed on different disk evenly instead of 1 disk?

---

<div class="post-metadata">

**Author:** ![woodenmo](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/woodenmo/32/11691_2.png) [@woodenmo](https://discuss.elastic.co/u/woodenmo)\
**Post date:** [August 30, 2016, 7:08pm UTC](https://discuss.elastic.co/t/questions-of-setting-up-elasticsearch-server-with-20-ssd-on-it/59267/2 "2016-08-30T19:08:57Z")

</div>

Hello;  
Separate the list of directories with a comma, like  
path.data: /data/0,/data/1,/data/3  
There is obviously a risk of losing a whole file system after a single disk failure. However, splitting the storage up in to multiple smaller file systems brings a danger of one or more filling up quite soon possibly affecting multiple indices. I would probably rely on working replication and set up a single file system.  
If a shard is being written in to a directory, everything of that shard will be stored in there, as I understand. You could achieve better IO distribution through striping, though.  
Cheers,  
wodenmo

---

<div class="post-metadata">

**Author:** ![macymin](https://avatars.discourse-cdn.com/v4/letter/m/8e7dd6/32.png) [@macymin](https://discuss.elastic.co/u/macymin)\
**Post date:** [September 22, 2016, 3:22am UTC](https://discuss.elastic.co/t/questions-of-setting-up-elasticsearch-server-with-20-ssd-on-it/59267/3 "2016-09-22T03:22:11Z")

</div>

Thanks Wodenmo, my question on single file system is if one of the disk crash, everything on that file system including replica will all gone right?

---

<div class="post-metadata">

**Author:** ![nik9000](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/nik9000/32/44947_2.png) [@nik9000](https://discuss.elastic.co/u/nik9000)\
**Post date:** [September 22, 2016, 10:29am UTC](https://discuss.elastic.co/t/questions-of-setting-up-elasticsearch-server-with-20-ssd-on-it/59267/4 "2016-09-22T10:29:52Z")

</div>

> [@macymin](#):
>
> how to make sure the shards (especially replica) are distributed on different disk evenly instead of 1 disk?

Elasticsearch won't allocate a replica to the same node as the primary ever, even if the node has multiple data paths.

RAID 0 with 20 disks is silly because the mean time between failure become too high. You sys admin is right. The RAID 0 recommendation for Elasticsearch makes sense with 2 or 3 disks only. 4 is probably too many for comfort.

I'd go with either a single RAID 6 volume (most disk space without exciting disk losses), a single RAID 10 volume (most IO for a single volume), or 10 RAID 0 volumes (most disk space but you still have exciting disk losses which is probably not acceptable with 20 disks) and list them all in `data.path`. If you've spent the money to buy 20 SSDs you really should spend the time trying out those layouts with the most real performance tests you can think of.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 5, 2017, 10:18pm UTC](https://discuss.elastic.co/t/questions-of-setting-up-elasticsearch-server-with-20-ssd-on-it/59267/5 "2017-07-05T22:18:12Z")

</div>


