I am trying to increase
max_snapshot_bytes_per_sec to 1g but Elasticsearch snapshot API seems to be ignoring that parameter.
Taking snapshots for large indexes using
_snapshot API is taking a very long time.
ES Version: 7.2.0
Type of snapshot repo: NFS client
ES Instance type: 8 cores, 32GB
NFS Instanace type: 16 cores, 32Gb
I am not aware of any issues with the
To check/verify whether the setting being ignored is truly the issue here, you could set it to a lower value and check if the snapshots become slower.
More likely the bottle neck is in the write throughput you can achieve to your NFS system or the rate at which your data nodes are able to read the data at.
If you set the max snapshot write rate to
1G this means that the disks the data is read from have to provide
1G, your network has to be able to handle
1G and the NFS must be able to sustain writes at that rate.
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.