What is the recommendation for indexing and sharding in Elasticsearch in complex use case?

You should look at ILM - https://www.elastic.co/guide/en/elasticsearch///reference/current/index-lifecycle-management.html

It's the best way forward!