Does elasticsearch have plans to support product quantization and SQ8 quantization? we have close to 10 Billion semantic vector index. The dense vector is 768 dimensional.
@myazi , Elasticsearch doesn't do any quantization. But, with version 8.6 (the next version to be released), we will support signed int8 quantized values for vectors. So, in 8.6.0, quantize your vectors to int8 and index them.
Be sure to set element_type to byte in the mapping.
Note: to be clear, 8.6.0 is not released at the time when I wrote this.
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.