We are using elasticsearch in our production environment for more 2 years now. Up until now it was more of permanent storage where updates to the data were minimal. Now we have a requirement of doing the user segmentation of our user set based on the data already stored in ES. The user data is in a different type and the segmentation rules is based on another time series data set which is stored in another type.
What are the best recommendations from ES team to update this kind of data regularly? Should an array against each member ID is something where in we keep on adding our segment values? or every time a new segment comes in picture, a new field should be created to store that segment values against all those users. Anyways both the above way would require fetching the document at application layer and updating it. Any help would be recommended.