Compression algorithm for best Search Performance in Elastic

Elastic Stack Elasticsearch
1

Hi Team,
Which is the best compression algorithm in Elastic for the best search performance.
We have 100 TB of data to be indexed in an Index. The idea is to have best search performance as a trade off with the index size.
What would be the approx. Index size for 100TB data (I know, a lot depends on the data type and other factors.).
I mean what's the compression ratio for that algorithm.

2

The default is LZ4 which is lower compression than best_compression and thus will use less CPU during search and index.

See index.codec in Index modules | Elasticsearch Guide [8.6] | Elastic.

3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.