How to organise Elasticsearch indexes with too many dynamic fields

Elastic Stack Elasticsearch
1

I have a scenario where there are too many groups, and each group has numerous documents with few standard fields and few dynamic fields. So I have created an alias for every group for an index. Now, as these groups grow, these dynamic fields are also increasing. I just hit the default 1000 fields limit.
I plan to create an index for each group to solve too many fields issues, but I will have too many indexes problems.

Please let me know if someone knows a better way to handle this problem.

2

One option is the mid-way. Create an index for each tens or hundreds groups.

Another option is using flattened field type if it match your requirement.

Of course, you could raise the fields limit.

1 Like
3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.