When I start to take care one of our cluster. I found this cluster is too hugh.
Each shard 400GB data.
Total documents: 5 billions.
I tried to do a simple search on the cluster but the query just run forever until timeout.
I tried elasticdump from github but also got stuck when running. The search latency in my monitoring is bumping high.
The data is time based, is there a way to archive the data? Any ideas?