It's actually 48 indices with 32 shards each. So there 3142 shards including the replicas... I'm doing index per day strategy.
We expect to grow 150% next year so I would expect the cluster to grow to a dozen pysical nodes maybe more.
So 150% of 2.5-3 billion documemts. So I'm now I'm trying to test with 2.5 billion, but expect that to grow next year by 150%.
At 800 million docs I lost the cluster because there was way to many pauses and no collections hapening so it kept trying to recover over and over. So I restarted re-indexing and reached 380 million. So now checking options...