Setting heap size in docker containers - can't get it to work

jamiejackson · May 17, 2019, 2:01am

I'm at a loss as to how to configure the heap in docker containers. Nothing seems to work as I'd expect:

Straightforward set to 2GB doesn't work:

$ docker run -it -e "ES_JAVA_OPTS=-Xms2g -Xms2g" docker.elastic.co/elasticsearch/elasticsearch:6.6.0
OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
Error occurred during initialization of VM
Initial heap size set to a larger value than the maximum heap size

Straightforward set to 512MB doesn't work:

gist.github.com

https://gist.github.com/jamiejackson/aca6b7327fd8711ef64c844e8d6543a3

512.md

Straightforward set to 512MB doesn't work:

```
$ docker run --rm -e "ES_JAVA_OPTS=-Xms512m -Xms512m" docker.elastic.co/elasticsearch/elasticsearch:6.6.0
OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[2019-05-17T01:43:17,857][INFO ][o.e.e.NodeEnvironment    ] [Ab_wy_n] using [1] data paths, mounts [[/ (overlay)]], net usable_space [9.1gb], net total_space [87.7gb], types [overlay]
[2019-05-17T01:43:17,860][INFO ][o.e.e.NodeEnvironment    ] [Ab_wy_n] heap size [1015.6mb], compressed ordinary object pointers [true]
...
[2019-05-17T01:43:17,871][INFO ][o.e.n.Node               ] [Ab_wy_n] JVM arguments [-Xms1g, -Xmx1g, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.io.tmpdir=/tmp/elasticsearch-4988010857367449349, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Djava.locale.providers=COMPAT, -XX:UseAVX=2, -Des.cgroups.hierarchy.override=/, -Xms512m, -Xms512m, -Des.path.home=/usr/share/elasticsearch, -Des.path.conf=/usr/share/elasticsearch/config, -Des.distribution.flavor=default, -Des.distribution.type=tar]
[2019-05-17T01:43:21,099][INFO ][o.e.p.PluginsService     ] [Ab_wy_n] loaded module [aggs-matrix-stats]

This file has been truncated. show original

Commenting out the options in the stock jvm.options and setting doesn't work:

gist.github.com

https://gist.github.com/jamiejackson/319f4a12a24222a7fa87ba8ed3ab23ea

comment.md

Commenting out the options in the stock `jvm.options` and setting doesn't work:
```
$ docker run -it -e "ES_JAVA_OPTS=-Xms512m -Xms512m" docker.elastic.co/elasticsearch/elasticsearch:6.6.0 bash -c "sed -i'' '/^-Xm\(s\|x\)/s/^/#/' /usr/share/elasticsearch/config/jvm.options && /usr/local/bin/docker-entrypoint.sh eswrapper"
OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[2019-05-17T01:43:49,043][INFO ][o.e.e.NodeEnvironment    ] [pWjpdwD] using [1] data paths, mounts [[/ (overlay)]], net usable_space [9.1gb], net total_space [87.7gb], types [overlay]
[2019-05-17T01:43:49,053][INFO ][o.e.e.NodeEnvironment    ] [pWjpdwD] heap size [1.2gb], compressed ordinary object pointers [true]
[2019-05-17T01:43:49,063][INFO ][o.e.n.Node               ] [pWjpdwD] node name derived from node ID [pWjpdwDgSji5LV5k6QxrrQ]; set [node.name] to override
[2019-05-17T01:43:49,069][INFO ][o.e.n.Node               ] [pWjpdwD] version[6.6.0], pid[9], build[default/tar/a9861f4/2019-01-24T11:27:09.439740Z], OS[Linux/4.9.125-linuxkit/amd64], JVM[Oracle Corporation/OpenJDK 64-Bit Server VM/11.0.1/11.0.1+13]
[2019-05-17T01:43:49,069][INFO ][o.e.n.Node               ] [pWjpdwD] JVM arguments [-XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.io.tmpdir=/tmp/elasticsearch-10833520116017359688, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Djava.locale.providers=COMPAT, -XX:UseAVX=2, -Des.cgroups.hierarchy.override=/, -Xms512m, -Xms512m, -Des.path.home=/usr/share/elasticsearch, -Des.path.conf=/usr/share/elasticsearch/config, -Des.distribution.flavor=default, -Des.distribution.type=tar]
[2019-05-17T01:43:52,513][INFO ][o.e.p.PluginsService     ] [pWjpdwD] loaded module [aggs-matrix-stats]

This file has been truncated. show original

How do you do it?

martinr_ubi · May 17, 2019, 2:42am

Hi,

All of your commands have the same typo.
Xms Xms

It’s Xms Xmx, else your repeating the same thing twice which makes no sense. And you end up overiding only one of the default setting for heap size.

Further reading:
https://www.elastic.co/guide/en/elasticsearch/reference/current/heap-size.html

I think you also need to bypass the bootstrap check if you want to run it quickly like that in single node mode. That’s unrelated to heap size though.

https://www.elastic.co/guide/en/elasticsearch/reference/current/docker.html#docker-cli-run-dev-mode

jamiejackson · May 17, 2019, 2:58am

Ah geez, thanks. My more complicated, real-life example didn't have that same duplication, but I'll fix my simple examples to see how that works.

Also, thanks for the tip about development mode.

martinr_ubi · May 17, 2019, 3:01am

BTW just realized my links are for the wrong version based your first command.
Do check the right doc, I don’t want to waste your time if something you read in there varies per versions or was updated.

system · June 14, 2019, 3:01am

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.