We are planning to have 1 index which will host ~150TB of data. Ideally it is suggested to have 1 shard per 50GB. So i may end up in 3000 Shards!!!
does ES really works with 3000 shards on 1 index? We don't have problem with resources like cores,memory and disk...We can scale any number of Elastic search nodes.
All we concerned is...Does ES supports at this scale? any standard guidelines for number of shards allowed per index?
Please help us on this for better decision making of our product.