I'm building a private search engine.
There will be only 2 indexes. I have to store 63+ Billion docs this is around 2TB of raw CSV file.
My document is not that much complex, it has only two fields 1.Username 2.address
My question is for that type of setup how many nodes do I need? how many shards do I need to create? and other configure as well like how many RAM do I need and CPU core do I need.
Note:- It will be a managed server, I will buy a new PC according to this configuration.