Let's say I have an index called "Contacts"
Any contact belongs to a user, it'll have custom variables like this:
{
user_id: 684498,
name: "John Doe",
custom_age: 27,
custom_hobbies: ['painting'],
custom_source: 'flyers'
}
Users should be able to drill down by custom variables. Each user can have from a few contacts to 1M contacts.
There's a potential for unlimited custom variables per contact, each user uses different custom variables.
I was thinking of increasing the index.mapping.total_fields.limit
which is 2000 by default - but that will never be enough, if you sum up the number of different custom fields between different users, it'd amount to hundreds of thousands if not millions.
I was also thinking of creating an index per user, but I heard there's performance concerns.
How can we do this right?