I need help/suggestions in defining the right indexing/data migration strategy.
I have to create tenant based index storage. My use case covers around 100 tenants.
I need to allow user to search data for last 30 days. So that would mean that I would need to create a rolling indexes of 30 days. My estimate is that there will be around 4 million rows per tenant in 30 days.
I am thinking of creating an index per tenant per day and maintain an alias for 30 days. But that would mean 100 * 30 = 3000 active indexes at any point of time. Is this a huge number of indexes compared to amount of data that needs to be managed?
Another way can be to maintain just one index per tenant and move out a day worth of data every day so that active alias always have 30 days worth of data.
Please suggest me the right strategy to move forward here. If second option is better, I don't know the right way to selectively move a day's worth of data from an index to some another place.