Slow snapshot to HDFS

Elastic Stack Elasticsearch
1

Hello there,
i tried today to backup my 1TB cluster to the HDFS for future snapshot on way bigger clusters (tons of TB).
but the process was very slow (more then an hour for 1TB, while on local FS it tooks 5 - 10 Minutes).
I've tried to increase the chunks to 5GB and the conccurent streams but this is still very slow.

There is optional settings to make the process faster? Any suggestions are welcome.

2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.