Java virtual memory usage

[John16 (John)]

Hello,

I setup ES cluster and started to load logs into it.
Almost all parameters are in default except
ES_JAVA_OPTS="-Xms10g -Xmx10g"

I see that virtual memory usage of java process (which runs ES) constantly increases. After about 12 hours of running it consumes 264GB:
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 21619 elastic+ 20 0 0.264t 0.018t 6.657g S 519.3 7.4 2565:39 java

And it continues to grow.

Is it normal?

Thanks.

[warkolm (Mark Walkom)]

Yes, see https://www.elastic.co/guide/en/elasticsearch/reference/5.2/heap-size.html

That's what the 50% rule is for

[John16 (John)]

@warkolm

That's what the 50% rule is for

I read this chapter. I don't quite understand you: I have 256GB RAM, 10g heap size and (at the moment) 351GB of virtual memory used. Virtual memory usage grows steady after ES startup.

[warkolm (Mark Walkom)]

Yes, it's the OS caching files.

[John16 (John)]

Ah, yes, I understand now: it is the size of index files which Lucene mmap()s.