Hi everyone,
What are the cases where a higher CPU and/or faster CPU benefits the cluster more than higher memory?
I am currently running on 3 Nodes that are 8 CPU 16GB RAM configurations.
I will scale the cluster firstly by setting up up 3 dedicated master nodes as i will probably add more data nodes to the cluster.
I'm trying to figure out which of these (CPU or RAM) i should be increasing in my cluster and if i should make my current machines bigger or add new ones.
My searches mainly consist of google and bing-like searches where i query like a search engine to find the most relative documents and highlight the relative parts.
The cluster is a search heavy cluster and not an index heavy one.
I've read that the higher the number of shards the more memory should be available to the nodes so that it can hold the shard information. But does the CPU have to be raised as well in that case?
Does more CPU cores mean that more shards can be searched in parallel? Or would faster CPU's be better?
I currently have 3 indices with 5 primary shards each and each index is around 280GB in size.
My main idea is to split the indices into more shards (10 or 20) and that would probably require more RAM usage, but would the CPU requirements also need to be increased since it has to search more shards? In that case would more CPU cores be better or would a faster CPU be better.
The searches are quite slow at the moment hovering anywhere between 1s up to 20s depending on the sentence i put. I know that with my current hardware I'm not getting close to google and bing response time (and probably wont be anytime soon), but would like to figure out which direction i should focus on at the moment. (Make more nodes, invest in bigger nodes, split shards, increase CPU, increase RAM)
(I'm not looking for a definitive answer, just want to have a discussion about this topic as i can't seem to find any guides regarding it).
In the end I will test out multiple configurations (increase number of nodes with same config vs increase a single node hardware) of both CPU and RAM and will post the results i find here.
Thank you in advance