What is the maximum dimensionality of a vector field?

Elastic Stack Elasticsearch
1

What is the maximum dimensionality of a vector field ?

I am using elastik version 8.9.1

The documentation says that the maximum vector size is 1000, but if you set the index: False property, the dimensionality can be up to 2000.

( dims
(Required, integer) Number of vector dimensions. Can’t exceed 1024 for indexed vectors ("index": true), or 2048 for non-indexed vectors.)

I set index: True and set the vector dimension to 1536 (openai), but Elastic successfully created such an index, although dimensionality higher than 1000 is not allowed.

Is there an error if you specify dims above 1024 if property index: True ?

2

Hi @panivan99pl

The next paragraph states that 2048 dimensions is in technical preview.

dims
(Required, integer) Number of vector dimensions. Can’t exceed 1024 for indexed vectors ("index": true), or 2048 for non-indexed vectors.

[preview] This functionality is in technical preview and may be changed or removed in a future release. Elastic will apply best effort to fix any issues, but features in technical preview are not subject to the support SLA of official GA features.The number of dimensions for indexed vectors can be extended up to 2048.

As you stated 1536 Dim is a pretty important number ... So I suspect we will want to support that...BUT as the doc says technical preview features can change

3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.