Node memory

Hi All,
Currently on our nodes we have 64GB RAM, with 30GB allocated to the heap, and the other 34GB for OS.

I understand that I shouldn't allocate more then 30GB to the heap, but will ES/OS benefit from 128GB or 256GB RAM within the system? So allocating 30GB to the heap and leaving the 98GB/226GB RAM for the OS.

Thanks

You can actually set heap to 31GB. The primary benefit of providing the OS with more RAM is having a larger page cache. This can reduce the number of disk reads necessary for completing queries, and thus improve performance. That said, there will be diminishing returns beyond 128GB total RAM.

If you have very large servers, e.g. 64 cores/128 theads and 256GB or more RAM, you will usually get better results running multiple ES nodes on the server. It is however important that each server has its own dedicated storage. If you run multiple nodes and really want to maximize performance, you can bind each node to specific cores, respecting socket and chiplet (on EPYC) boundaries.

Yes there may be benefits to doing that. The extra memory will be used for filesystem cache, which can give a big performance boost.