Different shards land in same path.data directory

Elastic Stack Elasticsearch
1

As I understand from the docs, data from a single shard goes to same path.data directory.

So, let's suppose, my path.data looks like ["/disk1", "/disk2"]. and I want maximum throughput for indexing. To achieve that, what I would ideally do is, assign 2 shards per node and expect ES to create these two shards on different path directories. However, I'm observing that both shards are created on "/disk1".

Why is that? Should this change? Is this an optimization that we can do in future versions?

Thanks in advance!

2

Do the two paths have same amount of free disk space? If not, then ES allocate shards to the one with more free space first.

How big is each shard? If it's too small, ES may ignore it.

3

It doesn't do it to that level. It just makes sure a shard, irrespective of the index it belongs to, is wholly on a path.

It's an interesting idea though, why not raise a feature request for it on github?