Snapshot API not honoring max_snapshot_bytes_per_sec

Elastic Stack Elasticsearch
1

I am trying to increase max_snapshot_bytes_per_sec to 1g but Elasticsearch snapshot API seems to be ignoring that parameter.

Taking snapshots for large indexes using _snapshot API is taking a very long time.

ES Version: 7.2.0
Type of snapshot repo: NFS client
ES Instance type: 8 cores, 32GB
NFS Instanace type: 16 cores, 32Gb

Please advice

2

Hi @Astro-es

I am not aware of any issues with the max_snapshot_bytes_per_sec setting.
To check/verify whether the setting being ignored is truly the issue here, you could set it to a lower value and check if the snapshots become slower.

More likely the bottle neck is in the write throughput you can achieve to your NFS system or the rate at which your data nodes are able to read the data at.

If you set the max snapshot write rate to 1G this means that the disks the data is read from have to provide 1G, your network has to be able to handle 1G and the NFS must be able to sustain writes at that rate.

3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.