Need pc configuration for large data

Elastic Stack Elasticsearch
1

Hi there,
I'm building a private search engine.

There will be only 2 indexes. I have to store 63+ Billion docs this is around 2TB of raw CSV file.
My document is not that much complex, it has only two fields 1.Username 2.address

My question is for that type of setup how many nodes do I need? how many shards do I need to create? and other configure as well like how many RAM do I need and CPU core do I need.

Note:- It will be a managed server, I will buy a new PC according to this configuration.

2

May I suggest you look at the following resources about sizing:

And Using Rally to Get Your Elasticsearch Cluster Size Right | Elastic Videos

1 Like
3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.