Thanks. I have just started with 50 servers to test the infra, which is producing 70MB per hour. It will go to over 2000 servers and should produce 3GB per hour. That's why going for hourly index.
Is there a way we can add some tolerance to the delay of new index creation so that the error does not come up? Any metricbeat or logstash parameter I can use to wait for ES to be ready with the new index?