Memory usage seems excessive


(George Kappel) #1

Using ES 19.3 and ES_HEAP_SIZE=1g

Node stats are here https://gist.github.com/2893236
Info is here https://gist.github.com/2893271

The longer this runs the more memory gets used, currently 2.5g.
Utilization of elasticsearch is very low, just 1 shard and a handful of
documents and searches

What are the recommended steps to determine if this is a real problem? and
if so is there anything that can be done to minimize memory use?


(Shay Banon) #2

It does not use memory at all on the JVM level (you can see the heap_used
part there). Do you have any special configuration or index level
configuration?

On Fri, Jun 8, 2012 at 5:02 AM, George Kappel george.kappel@gmail.comwrote:

Using ES 19.3 and ES_HEAP_SIZE=1g

Node stats are here https://gist.github.com/2893236
Info is here https://gist.github.com/2893271

The longer this runs the more memory gets used, currently 2.5g.
Utilization of elasticsearch is very low, just 1 shard and a handful of
documents and searches

What are the recommended steps to determine if this is a real problem? and
if so is there anything that can be done to minimize memory use?


(George Kappel) #3

Yes heap used appears low but "ps aux" report 2gb resident and 4gb virtual
for elasticsearch

No special configuration, on IRC it was recommended that I try a different
JVM. Currently using openjdk will be trying oracle 7

On Sun, Jun 10, 2012 at 4:45 PM, Shay Banon kimchy@gmail.com wrote:

It does not use memory at all on the JVM level (you can see the heap_used
part there). Do you have any special configuration or index level
configuration?

On Fri, Jun 8, 2012 at 5:02 AM, George Kappel george.kappel@gmail.comwrote:

Using ES 19.3 and ES_HEAP_SIZE=1g

Node stats are here https://gist.github.com/2893236
Info is here https://gist.github.com/2893271

The longer this runs the more memory gets used, currently 2.5g.
Utilization of elasticsearch is very low, just 1 shard and a handful of
documents and searches

What are the recommended steps to determine if this is a real problem?
and if so is there anything that can be done to minimize memory use?


(system) #4