Hi All,
Currently on our nodes we have 64GB RAM, with 30GB allocated to the heap, and the other 34GB for OS.
I understand that I shouldn't allocate more then 30GB to the heap, but will ES/OS benefit from 128GB or 256GB RAM within the system? So allocating 30GB to the heap and leaving the 98GB/226GB RAM for the OS.
You can actually set heap to 31GB. The primary benefit of providing the OS with more RAM is having a larger page cache. This can reduce the number of disk reads necessary for completing queries, and thus improve performance. That said, there will be diminishing returns beyond 128GB total RAM.
If you have very large servers, e.g. 64 cores/128 theads and 256GB or more RAM, you will usually get better results running multiple ES nodes on the server. It is however important that each server has its own dedicated storage. If you run multiple nodes and really want to maximize performance, you can bind each node to specific cores, respecting socket and chiplet (on EPYC) boundaries.
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.