Running ES 5 on a low-memory server for testing


(Mark Hanford) #1

Hi folks. I'm seeing if I can get ES5 set up in a very limited environment (2Gb RAM)

I have a clean install of Ubuntu 16.04, and have installed ES 5.0.0.
I have configured ES to start with systemd.
In /etc/elasticsearch/elasticsearch.yml I have set bootstrap.memory_lock: false
In /etc/elasticsearch/jvm.options I have set -Xms1g and -Xmx1g
In /etc/default/elasticsearch I have set MAX_LOCKED_MEMORY=1g

When I start the service, the elasticsearch log shows some errors seemingly about memory:

[2016-11-08T10:22:52,717][INFO ][o.e.n.Node ] [linode1] initializing ...
[2016-11-08T10:22:52,867][INFO ][o.e.e.NodeEnvironment ] [linode1] using [1] data paths, mounts [[/ (/dev/root)]], net usable_space [21gb], net total_space [23.4gb], spins? [possibly], types [ext4]
[2016-11-08T10:22:52,868][INFO ][o.e.e.NodeEnvironment ] [linode1] heap size [1015.6mb], compressed ordinary object pointers [true]
[2016-11-08T10:22:52,872][INFO ][o.e.n.Node ] [linode1] version[5.0.0], pid[24456], build[253032b/2016-10-26T05:11:34.737Z], OS[Linux/4.8.3-x86_64-linode76/amd64], JVM[Oracle Corporation/OpenJDK 64-Bit Server VM/1.8.0_111/25.111-b14]
[2016-11-08T10:22:55,746][INFO ][o.e.p.PluginsService ] [linode1] loaded module [aggs-matrix-stats]
[2016-11-08T10:22:55,747][INFO ][o.e.p.PluginsService ] [linode1] loaded module [ingest-common]
[2016-11-08T10:22:55,747][INFO ][o.e.p.PluginsService ] [linode1] loaded module [lang-expression]
[2016-11-08T10:22:55,747][INFO ][o.e.p.PluginsService ] [linode1] loaded module [lang-groovy]
[2016-11-08T10:22:55,747][INFO ][o.e.p.PluginsService ] [linode1] loaded module [lang-mustache]
[2016-11-08T10:22:55,748][INFO ][o.e.p.PluginsService ] [linode1] loaded module [lang-painless]
[2016-11-08T10:22:55,748][INFO ][o.e.p.PluginsService ] [linode1] loaded module [percolator]
[2016-11-08T10:22:55,748][INFO ][o.e.p.PluginsService ] [linode1] loaded module [reindex]
[2016-11-08T10:22:55,749][INFO ][o.e.p.PluginsService ] [linode1] loaded module [transport-netty3]
[2016-11-08T10:22:55,749][INFO ][o.e.p.PluginsService ] [linode1] loaded module [transport-netty4]
[2016-11-08T10:22:55,750][INFO ][o.e.p.PluginsService ] [linode1] no plugins loaded
[2016-11-08T10:23:02,479][INFO ][o.e.n.Node ] [linode1] initialized
[2016-11-08T10:23:02,481][INFO ][o.e.n.Node ] [linode1] starting ...
[2016-11-08T10:23:03,015][INFO ][o.e.t.TransportService ] [linode1] publish_address {x.x.x.x:9300}, bound_addresses {x.x.x.x:9300}
[2016-11-08T10:23:03,023][INFO ][o.e.b.BootstrapCheck ] [linode1] bound or publishing to a non-loopback or non-link-local address, enforcing bootstrap checks
[2016-11-08T10:23:03,034][ERROR][o.e.b.Bootstrap ] [linode1] node validation exception
bootstrap checks failed
max virtual memory areas vm.max_map_count [65530] likely too low, increase to at least [262144]
[2016-11-08T10:23:03,041][INFO ][o.e.n.Node ] [linode1] stopping ...
[2016-11-08T10:23:03,082][INFO ][o.e.n.Node ] [linode1] stopped
[2016-11-08T10:23:03,083][INFO ][o.e.n.Node ] [linode1] closing ...
[2016-11-08T10:23:03,133][INFO ][o.e.n.Node ] [linode1] closed

I realise this will be slow and swappy, but I'm going to be pushing something like 200 records per day into this thing, so I doubt that will be a problem.


(David Pilato) #2

Read


(Mark Hanford) #3

Aah, it's the last one of those that I missed! Thank you.

sysctl vm.max_map_count=262144


(system) #4

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.