Zstandard compression support

[Cornoualis]

Hi there!

I wanted to know if you planned to add support to Zstandard, an awesome (de)compression algorithm by Facebook?

The benchmarks show impressive speed/compression rate, compared to zlib.

It would be very nice to have the possibility to have an "algorithm" setting in the snapshot API...

Example:
PUT /_snapshot/my_backup
{
"type": "fs",
"type": "fs",
"settings": {
"location": "/mount/backups/my_backup",
"compress": true,
"algorithm": "zstd"
}
}

[warkolm (Mark Walkom)]

Please feel free to raise this as an issue on Github as well

[jpountz (Adrien Grand)]

One benefit of zlib is that it is already supported by the JVM. Supporting Zstandard would require to either reimplement it in Java or ship machine-specific binaries, which I am not sure we are willing to do at the moment.

[Cornoualis]

There are bindings provided for many languages and of course, for java.
The idea would be to let the user choose an algorithm, which implies that the user has the zstd binaries installed (like elastic requires the jre/jdk to be installed).

I'll open an issue to propose it!