ES data on JBOD or RAID


(Ronny Vaningh-2) #1

Hi

I want to set up a small search cluster and I was wondering if raid is
really needed since ES already has replication built in.

Can I use multpile data paths in the ES config pointing to /mnt/disk1 ...
/mnt/disk12 since disk cost is a premium or do you recommend to put the
data on a raid volume ?

What are the pro and cons of both.

The first one would be similar to a hdfs setup.

Would the number of replicas also be an option ?

Which balance did you guys choose

Regards

Ronny

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/3a6604cd-1c28-4466-95a6-b6b4480b8535%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


(Jörg Prante) #2

I use RAID0 on data folder for speed. If RAID fails, the whole node is
decommissioned, there is one node per server. Replica level must be greater
0 or you will lose data sooner or later.

Multiple data paths will just scatter files, probably over partitions,
equal balancing over data paths is not guaranteed. And without RAID,
scattering is not faster for read/write so you don;t have any advantage.

Jörg

On Wed, May 14, 2014 at 5:13 PM, Ronny Vaningh ronny@guard-it.be wrote:

Hi

I want to set up a small search cluster and I was wondering if raid is
really needed since ES already has replication built in.

Can I use multpile data paths in the ES config pointing to /mnt/disk1 ...
/mnt/disk12 since disk cost is a premium or do you recommend to put the
data on a raid volume ?

What are the pro and cons of both.

The first one would be similar to a hdfs setup.

Would the number of replicas also be an option ?

Which balance did you guys choose

Regards

Ronny

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/3a6604cd-1c28-4466-95a6-b6b4480b8535%40googlegroups.comhttps://groups.google.com/d/msgid/elasticsearch/3a6604cd-1c28-4466-95a6-b6b4480b8535%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAKdsXoEufQL6ZBSL9W5vJ%3DzGxNo6mpUcV9%3DUD9myNn%2Bydy3bnA%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.


(system) #3