We're trying to find which would be the best way to handle this case:
We are storing daily data from a remote source. This remote source updates the data several times per day, so we'd need to refresh the index too, for the last day.
Meanwhile, the data that needs to be refreshed, will be in use (graphs, etc), so we'd like to minimize the time required to switch between data updates, hiding the new data until it's completely indexed, and then hiding and removing the old data.
Any recommendation on how to manage this case?