ElasticSearch docker container fails (FileRun documentation followed)

Elastic Stack Elasticsearch
1

Following the documentation of FileRun: https://docs.filerun.com/docker-tika
This is my docker-compose.yml, identical to the documentation. I am using Traefik as SSL reverse proxy but I have removed the labels from the FileRun container to keep it readable:

  filerun:
    image: afian/filerun
    container_name: filerun
    environment:
      PUID: ${PUID}
      PGID: ${PGID}
      TZ: ${TZ}
      FR_DB_HOST: mariadb
      FR_DB_PORT: 3306
      FR_DB_NAME: filerundb
      FR_DB_USER: myusername
      FR_DB_PASS: mydbpassword
      APACHE_RUN_USER: www-data
      APACHE_RUN_USER_ID: 33
      APACHE_RUN_GROUP: www-data
      APACHE_RUN_GROUP_ID: 33
    depends_on:
      - mariadb
    links:
      - mariadb
      - filerun-tika
      - filerun-elasticsearch
    ports:
      - "8000:80"
    volumes:
      - ${USERDIR}/docker/filerun/html:/var/www/html
      - ${USERDIR}/docker/filerun/user-files:/user-files
  filerun-tika:
    image: logicalspark/docker-tikaserver
    container_name: filerun-tika
  filerun-elasticsearch:
    image: docker.elastic.co/elasticsearch/elasticsearch:6.2.4
    container_name: filerun-elasticsearch
    environment:
      - PUID=${PUID}
      - PGID=${PGID}
      - TZ=${TZ}
      - cluster.name=docker-cluster
      - bootstrap.memory_lock=true
      - "ES_JAVA_OPTS=-Xms512m -Xmx512m"
    ulimits:
      memlock:
        soft: -1
        hard: -1
    mem_limit: 1g
    volumes:
      - ${USERDIR}/docker/filerun/esearch:/usr/share/elasticsearch/data

Problem:
ElasticSearch container stops after a few seconds. I do not see an error in the log, making it difficult for me to understand where to look for the problem.

[2020-05-14T13:55:27,867][INFO ][o.e.n.Node               ] [] initializing ...,
[2020-05-14T13:55:27,925][INFO ][o.e.e.NodeEnvironment    ] [qHf94dl] using [1] data paths, mounts [[/usr/share/elasticsearch/data (/dev/nvme0n1p2)]], net usable_space [709.8gb], net total_space [953.3gb], types [btrfs],
[2020-05-14T13:55:27,926][INFO ][o.e.e.NodeEnvironment    ] [qHf94dl] heap size [494.9mb], compressed ordinary object pointers [true],
[2020-05-14T13:55:27,927][INFO ][o.e.n.Node               ] node name [qHf94dl] derived from node ID [qHf94dlLTAOf3UGid6pBAw]; set [node.name] to override,
[2020-05-14T13:55:27,927][INFO ][o.e.n.Node               ] version[6.2.4], pid[1], build[ccec39f/2018-04-12T20:37:28.497551Z], OS[Linux/5.3.0-51-generic/amd64], JVM[Oracle Corporation/OpenJDK 64-Bit Server VM/1.8.0_161/25.161-b14],
[2020-05-14T13:55:27,927][INFO ][o.e.n.Node               ] JVM arguments [-Xms1g, -Xmx1g, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.io.tmpdir=/tmp/elasticsearch.TgEoKMQa, -XX:+HeapDumpOnOutOfMemoryError, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -XX:+PrintTenuringDistribution, -XX:+PrintGCApplicationStoppedTime, -Xloggc:logs/gc.log, -XX:+UseGCLogFileRotation, -XX:NumberOfGCLogFiles=32, -XX:GCLogFileSize=64m, -Des.cgroups.hierarchy.override=/, -Xms512m, -Xmx512m, -Des.path.home=/usr/share/elasticsearch, -Des.path.conf=/usr/share/elasticsearch/config],
[2020-05-14T13:55:29,967][INFO ][o.e.p.PluginsService     ] [qHf94dl] loaded module [aggs-matrix-stats],
[2020-05-14T13:55:29,967][INFO ][o.e.p.PluginsService     ] [qHf94dl] loaded module [analysis-common],
[2020-05-14T13:55:29,967][INFO ][o.e.p.PluginsService     ] [qHf94dl] loaded module [ingest-common],
[2020-05-14T13:55:29,967][INFO ][o.e.p.PluginsService     ] [qHf94dl] loaded module [lang-expression],
[2020-05-14T13:55:29,967][INFO ][o.e.p.PluginsService     ] [qHf94dl] loaded module [lang-mustache],
[2020-05-14T13:55:29,967][INFO ][o.e.p.PluginsService     ] [qHf94dl] loaded module [lang-painless],
[2020-05-14T13:55:29,967][INFO ][o.e.p.PluginsService     ] [qHf94dl] loaded module [mapper-extras],
[2020-05-14T13:55:29,967][INFO ][o.e.p.PluginsService     ] [qHf94dl] loaded module [parent-join],
[2020-05-14T13:55:29,967][INFO ][o.e.p.PluginsService     ] [qHf94dl] loaded module [percolator],
[2020-05-14T13:55:29,967][INFO ][o.e.p.PluginsService     ] [qHf94dl] loaded module [rank-eval],
[2020-05-14T13:55:29,967][INFO ][o.e.p.PluginsService     ] [qHf94dl] loaded module [reindex],
[2020-05-14T13:55:29,967][INFO ][o.e.p.PluginsService     ] [qHf94dl] loaded module [repository-url],
[2020-05-14T13:55:29,967][INFO ][o.e.p.PluginsService     ] [qHf94dl] loaded module [transport-netty4],
[2020-05-14T13:55:29,967][INFO ][o.e.p.PluginsService     ] [qHf94dl] loaded module [tribe],
[2020-05-14T13:55:29,968][INFO ][o.e.p.PluginsService     ] [qHf94dl] loaded plugin [ingest-geoip],
[2020-05-14T13:55:29,968][INFO ][o.e.p.PluginsService     ] [qHf94dl] loaded plugin [ingest-user-agent],
[2020-05-14T13:55:29,968][INFO ][o.e.p.PluginsService     ] [qHf94dl] loaded plugin [x-pack-core],
[2020-05-14T13:55:29,968][INFO ][o.e.p.PluginsService     ] [qHf94dl] loaded plugin [x-pack-deprecation],
[2020-05-14T13:55:29,968][INFO ][o.e.p.PluginsService     ] [qHf94dl] loaded plugin [x-pack-graph],
[2020-05-14T13:55:29,968][INFO ][o.e.p.PluginsService     ] [qHf94dl] loaded plugin [x-pack-logstash],
[2020-05-14T13:55:29,968][INFO ][o.e.p.PluginsService     ] [qHf94dl] loaded plugin [x-pack-ml],
[2020-05-14T13:55:29,968][INFO ][o.e.p.PluginsService     ] [qHf94dl] loaded plugin [x-pack-monitoring],
[2020-05-14T13:55:29,968][INFO ][o.e.p.PluginsService     ] [qHf94dl] loaded plugin [x-pack-security],
[2020-05-14T13:55:29,968][INFO ][o.e.p.PluginsService     ] [qHf94dl] loaded plugin [x-pack-upgrade],
[2020-05-14T13:55:29,969][INFO ][o.e.p.PluginsService     ] [qHf94dl] loaded plugin [x-pack-watcher],
[2020-05-14T13:55:32,781][INFO ][o.e.x.m.j.p.l.CppLogMessageHandler] [controller/118] [Main.cc@128] controller (64 bit): Version 6.2.4 (Build 524e7fe231abc1) Copyright (c) 2018 Elasticsearch BV,
[2020-05-14T13:55:34,285][INFO ][o.e.d.DiscoveryModule    ] [qHf94dl] using discovery type [zen],
[2020-05-14T13:55:35,007][INFO ][o.e.n.Node               ] initialized,
[2020-05-14T13:55:35,007][INFO ][o.e.n.Node               ] [qHf94dl] starting ...,
[2020-05-14T13:55:35,252][INFO ][o.e.t.TransportService   ] [qHf94dl] publish_address {172.18.0.11:9300}, bound_addresses {0.0.0.0:9300},
[2020-05-14T13:55:35,281][INFO ][o.e.b.BootstrapChecks    ] [qHf94dl] bound or publishing to a non-loopback address, enforcing bootstrap checks,
ERROR: [1] bootstrap checks failed,
[1]: max virtual memory areas vm.max_map_count [65530] is too low, increase to at least [262144],
[2020-05-14T13:55:35,312][INFO ][o.e.n.Node               ] [qHf94dl] stopping ...,
[2020-05-14T13:55:35,411][INFO ][o.e.n.Node               ] [qHf94dl] stopped,
[2020-05-14T13:55:35,411][INFO ][o.e.n.Node               ] [qHf94dl] closing ...,
[2020-05-14T13:55:35,418][INFO ][o.e.n.Node               ] [qHf94dl] closed,
[2020-05-14T13:55:35,420][INFO ][o.e.x.m.j.p.NativeController] Native controller process has stopped - no new native processes can be started

Why does it stop?

2

It clearly states that

[1]: max virtual memory areas vm.max_map_count [65530] is too low, increase to at least [262144],

Please read:
https://www.elastic.co/guide/en/elasticsearch/reference/current/vm-max-map-count.html

And set it on the host level.

1 Like
3

Thanks, I have suggested the FileRun team to add it to their documentation of ElasticSearch installation as well.

5

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.