Error Kibana container is unhealthy

Hello, We are trying to install and configure an Elasticsearch cluster in Ubuntu 20.04.4 LTS(x86-64) with the docker-compose.yml from https://www.elastic.co/guide/en/elasticsearch/reference/current/docker.html.

The command: sudo docker-compose up failed with message:
Error: for kibana Container "xxxxxx" is unhealthy

We checked that .env file is setting the environment variables.

Can you please help us with this problem?

1 Like

Welcome to our community! :smiley:

Please don't post pictures of text, logs or code. They are difficult to read, impossible to search and replicate (if it's code), and some people may not be even able to see them :slight_smile:

Hi @warkolm It is just a pic from the log, the code for replicate this issue is the same code in the guide that @Fabian_Crespo_Fernan have attached. I am facing the same problem in my windows 10 machine "kibana Container "*******" is unhealthy" replicating the same steps.

Please post the log as text, not as an image :slight_smile:

@warkolm thank you very much for your help ^^. Here is the log as text :grin:

Pulling setup (docker.elastic.co/elasticsearch/elasticsearch:8.0.1)...
8.0.1: Pulling from elasticsearch/elasticsearch
4fb807caa40a: Pull complete
939e6d6de1cd: Pull complete
c6e272a692c1: Pull complete
c35cf7d81655: Pull complete
00b951a3ddcb: Pull complete
c1686887c5ec: Pull complete
c9c4cd9d9e71: Pull complete
ff28b3874cac: Pull complete
d8fe9cb3f525: Pull complete
8287b1c3b76d: Pull complete
Digest: sha256:4d048cdee0f077666a299a4d11b85146dc8ec8d8a821bf3ea8b11e31b4189845
Status: Downloaded newer image for docker.elastic.co/elasticsearch/elasticsearch:8.0.1
Pulling kibana (docker.elastic.co/kibana/kibana:8.0.1)...
8.0.1: Pulling from kibana/kibana
4fb807caa40a: Already exists
03e3b3540e66: Pull complete
5f7e3fa31b3c: Pull complete
71ec090c1366: Pull complete
4d551456e20e: Pull complete
f4b85e0f3e12: Pull complete
04c37d9fec8c: Pull complete
dcac08932718: Pull complete
dc9287ce077e: Pull complete
c9b8bc01ee18: Pull complete
412d87990e2c: Pull complete
d3397604a21d: Pull complete
d1f5888777e3: Pull complete
Digest: sha256:45119d29e350387deea645a89d239424cd15f83efb9d75c4c8e8270c72f734fd
Status: Downloaded newer image for docker.elastic.co/kibana/kibana:8.0.1
Creating human_names_matching_setup_1 ... done
Creating human_names_matching_es01_1  ... done
Creating human_names_matching_es02_1  ... done
Creating human_names_matching_es03_1  ... done

ERROR: for kibana  Container "9c1027dce7cf" is unhealthy.
ERROR: Encountered errors while bringing up the project.

1 Like

Thanks.
What do the actual Kibana process logs from in the container say?

Thanks @Fernando_Canizares.

In order to replicate the error:

1-We filled the .env file like this:

# Password for the 'elastic' user (at least 6 characters)

ELASTIC_PASSWORD=elastic_pass

KIBANA_PASSWORD=kibana_pass

STACK_VERSION=8.0.1

CLUSTER_NAME=docker-cluster

LICENSE=basic

ES_PORT=9200

KIBANA_PORT=5601

MEM_LIMIT=1073741824

2-We donwloaded the docker-compose.yml from: https://www.elastic.co/guide/en/elasticsearch/reference/current/docker.html
3- We ran the command: sudo docker-compose up

 {"@timestamp":"2022-04-27T11:38:41.417Z", "log.level": "INFO", "message":"version[8.0.1], pid[8], build[default/docker/801d9ccc7c2ee0f2cb121bbe22ab5af77a902372/2022-02-24T13:55:40.601285296Z], OS[Linux/5.13.0-1017-azure/amd64], JVM[Eclipse Adoptium/OpenJDK 64-Bit Server VM/17.0.2/17.0.2+8]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.node.Node","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-27T11:38:41.422Z", "log.level": "INFO", "message":"JVM home [/usr/share/elasticsearch/jdk], using bundled JDK [true]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.node.Node","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-27T11:38:41.423Z", "log.level": "INFO", "message":"JVM arguments [-Xshare:auto, -Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -Djava.security.manager=allow, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -XX:+ShowCodeDetailsInExceptionMessages, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Dlog4j2.formatMsgNoLookups=true, -Djava.locale.providers=SPI,COMPAT, --add-opens=java.base/java.io=ALL-UNNAMED, -XX:+UseG1GC, -Djava.io.tmpdir=/tmp/elasticsearch-522194639199829924, -XX:+HeapDumpOnOutOfMemoryError, -XX:+ExitOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Des.cgroups.hierarchy.override=/, -Xms512m, -Xmx512m, -XX:MaxDirectMemorySize=268435456, -XX:G1HeapRegionSize=4m, -XX:InitiatingHeapOccupancyPercent=30, -XX:G1ReservePercent=15, -Des.path.home=/usr/share/elasticsearch, -Des.path.conf=/usr/share/elasticsearch/config, -Des.distribution.flavor=default, -Des.distribution.type=docker, -Des.bundled_jdk=true]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.node.Node","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-27T11:38:47.922Z", "log.level": "INFO", "message":"loaded module [aggs-matrix-stats]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-27T11:38:47.925Z", "log.level": "INFO", "message":"loaded module [analysis-common]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-27T11:38:47.926Z", "log.level": "INFO", "message":"loaded module [constant-keyword]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-27T11:38:47.926Z", "log.level": "INFO", "message":"loaded module [frozen-indices]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-27T11:38:47.927Z", "log.level": "INFO", "message":"loaded module [ingest-common]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-27T11:38:47.927Z", "log.level": "INFO", "message":"loaded module [ingest-geoip]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-27T11:38:47.927Z", "log.level": "INFO", "message":"loaded module [ingest-user-agent]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-27T11:38:47.928Z", "log.level": "INFO", "message":"loaded module [kibana]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-27T11:38:47.928Z", "log.level": "INFO", "message":"loaded module [lang-expression]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-27T11:38:47.928Z", "log.level": "INFO", "message":"loaded module [lang-mustache]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-27T11:38:47.929Z", "log.level": "INFO", "message":"loaded module [lang-painless]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-27T11:38:47.929Z", "log.level": "INFO", "message":"loaded module [legacy-geo]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-27T11:38:47.929Z", "log.level": "INFO", "message":"loaded module [mapper-extras]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-27T11:38:47.930Z", "log.level": "INFO", "message":"loaded module [mapper-version]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-27T11:38:47.930Z", "log.level": "INFO", "message":"loaded module [parent-join]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-27T11:38:47.938Z", "log.level": "INFO", "message":"loaded module [percolator]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-27T11:38:47.938Z", "log.level": "INFO", "message":"loaded module [rank-eval]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-27T11:38:47.939Z", "log.level": "INFO", "message":"lo...

It'd be handy if you could share all of it please.

Body is limited to 35000 characters; you entered 67194. Here is the first part

 {"@timestamp":"2022-04-27T11:38:41.417Z", "log.level": "INFO", "message":"version[8.0.1], pid[8], build[default/docker/801d9ccc7c2ee0f2cb121bbe22ab5af77a902372/2022-02-24T13:55:40.601285296Z], OS[Linux/5.13.0-1017-azure/amd64], JVM[Eclipse Adoptium/OpenJDK 64-Bit Server VM/17.0.2/17.0.2+8]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.node.Node","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-27T11:38:41.422Z", "log.level": "INFO", "message":"JVM home [/usr/share/elasticsearch/jdk], using bundled JDK [true]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.node.Node","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-27T11:38:41.423Z", "log.level": "INFO", "message":"JVM arguments [-Xshare:auto, -Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -Djava.security.manager=allow, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -XX:+ShowCodeDetailsInExceptionMessages, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Dlog4j2.formatMsgNoLookups=true, -Djava.locale.providers=SPI,COMPAT, --add-opens=java.base/java.io=ALL-UNNAMED, -XX:+UseG1GC, -Djava.io.tmpdir=/tmp/elasticsearch-522194639199829924, -XX:+HeapDumpOnOutOfMemoryError, -XX:+ExitOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Des.cgroups.hierarchy.override=/, -Xms512m, -Xmx512m, -XX:MaxDirectMemorySize=268435456, -XX:G1HeapRegionSize=4m, -XX:InitiatingHeapOccupancyPercent=30, -XX:G1ReservePercent=15, -Des.path.home=/usr/share/elasticsearch, -Des.path.conf=/usr/share/elasticsearch/config, -Des.distribution.flavor=default, -Des.distribution.type=docker, -Des.bundled_jdk=true]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.node.Node","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-27T11:38:47.922Z", "log.level": "INFO", "message":"loaded module [aggs-matrix-stats]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-27T11:38:47.925Z", "log.level": "INFO", "message":"loaded module [analysis-common]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-27T11:38:47.926Z", "log.level": "INFO", "message":"loaded module [constant-keyword]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-27T11:38:47.926Z", "log.level": "INFO", "message":"loaded module [frozen-indices]", "ecs.version":

and another part with "Error" message

{"@timestamp":"2022-04-27T11:39:05.281Z", "log.level": "INFO", "message":"bound or publishing to a non-loopback address, enforcing bootstrap checks", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.bootstrap.BootstrapChecks","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}

 ERROR: [1] bootstrap checks failed. You must address the points described in the following [1] lines before starting Elasticsearch.
 bootstrap check failure [1] of [1]: max virtual memory areas vm.max_map_count [65530] is too low, increase to at least [262144]
 ERROR: Elasticsearch did not exit normally - check the logs at /usr/share/elasticsearch/logs/docker-cluster.log
 {"@timestamp":"2022-04-27T11:39:05.307Z", "log.level": "INFO", "message":"stopping ...", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"Thread-2","log.logger":"org.elasticsearch.node.Node","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}

 {"@timestamp":"2022-04-29T08:29:19.596Z", "log.level": "INFO", "message":"version[8.0.1], pid[8], build[default/docker/801d9ccc7c2ee0f2cb121bbe22ab5af77a902372/2022-02-24T13:55:40.601285296Z], OS[Linux/5.13.0-1017-azure/amd64], JVM[Eclipse Adoptium/OpenJDK 64-Bit Server VM/17.0.2/17.0.2+8]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.node.Node","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:19.601Z", "log.level": "INFO", "message":"JVM home [/usr/share/elasticsearch/jdk], using bundled JDK [true]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.node.Node","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:19.602Z", "log.level": "INFO", "message":"JVM arguments [-Xshare:auto, -Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -Djava.security.manager=allow, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -XX:+ShowCodeDetailsInExceptionMessages, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Dlog4j2.formatMsgNoLookups=true, -Djava.locale.providers=SPI,COMPAT, --add-opens=java.base/java.io=ALL-UNNAMED, -XX:+UseG1GC, -Djava.io.tmpdir=/tmp/elasticsearch-15678077487643720600, -XX:+HeapDumpOnOutOfMemoryError, -XX:+ExitOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Des.cgroups.hierarchy.override=/, -Xms512m, -Xmx512m, -XX:MaxDirectMemorySize=268435456, -XX:G1HeapRegionSize=4m, -XX:InitiatingHeapOccupancyPercent=30, -XX:G1ReservePercent=15, -Des.path.home=/usr/share/elasticsearch, -Des.path.conf=/usr/share/elasticsearch/config, -Des.distribution.flavor=default, -Des.distribution.type=docker, -Des.bundled_jdk=true]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.node.Node","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:24.926Z", "log.level": "INFO", "message":"loaded module [repository-s3]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:24.927Z", "log.level": "INFO", "message":"loaded module [repository-url]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:24.927Z", "log.level": "INFO", "message":"loaded module [runtime-fields-common]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:24.927Z", "log.level": "INFO", "message":"loaded module [search-business-rules]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:24.927Z", "log.level": "INFO", "message":"loaded module [searchable-snapshots]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:24.928Z", "log.level": "INFO", "message":"loaded module [snapshot-based-recoveries]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:24.928Z", "log.level": "INFO", "message":"loaded module [snapshot-repo-test-kit]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:24.928Z", "log.level": "INFO", "message":"loaded module [spatial]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:24.928Z", "log.level": "INFO", "message":"loaded module [transform]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:24.928Z", "log.level": "INFO", "message":"loaded module [transport-netty4]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:24.929Z", "log.level": "INFO", "message":"loaded module [unsigned-long]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:24.934Z", "log.level": "INFO", "message":"loaded module [vector-tile]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:24.934Z", "log.level": "INFO", "message":"loaded module [vectors]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:24.934Z", "log.level": "INFO", "message":"loaded module [wildcard]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:24.935Z", "log.level": "INFO", "message":"loaded module [x-pack-aggregate-metric]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:24.935Z", "log.level": "INFO", "message":"loaded module [x-pack-analytics]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:24.935Z", "log.level": "INFO", "message":"loaded module [x-pack-async]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:24.935Z", "log.level": "INFO", "message":"loaded module [x-pack-async-search]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:24.936Z", "log.level": "INFO", "message":"loaded module [x-pack-autoscaling]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:24.936Z", "log.level": "INFO", "message":"loaded module [x-pack-ccr]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:24.936Z", "log.level": "INFO", "message":"loaded module [x-pack-core]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:24.937Z", "log.level": "INFO", "message":"loaded module [x-pack-data-streams]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:24.937Z", "log.level": "INFO", "message":"loaded module [x-pack-deprecation]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:24.937Z", "log.level": "INFO", "message":"loaded module [x-pack-enrich]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:24.937Z", "log.level": "INFO", "message":"loaded module [x-pack-eql]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:24.937Z", "log.level": "INFO", "message":"loaded module [x-pack-fleet]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:24.938Z", "log.level": "INFO", "message":"loaded module [x-pack-graph]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:24.938Z", "log.level": "INFO", "message":"loaded module [x-pack-identity-provider]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:24.938Z", "log.level": "INFO", "message":"loaded module [x-pack-ilm]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:24.939Z", "log.level": "INFO", "message":"loaded module [x-pack-logstash]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:24.939Z", "log.level": "INFO", "message":"loaded module [x-pack-ml]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:24.942Z", "log.level": "INFO", "message":"loaded module [x-pack-monitoring]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:24.942Z", "log.level": "INFO", "message":"loaded module [x-pack-ql]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:24.942Z", "log.level": "INFO", "message":"loaded module [x-pack-rollup]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:24.942Z", "log.level": "INFO", "message":"loaded module [x-pack-security]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:24.943Z", "log.level": "INFO", "message":"loaded module [x-pack-shutdown]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:24.943Z", "log.level": "INFO", "message":"loaded module [x-pack-sql]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:24.943Z", "log.level": "INFO", "message":"loaded module [x-pack-stack]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:24.943Z", "log.level": "INFO", "message":"loaded module [x-pack-text-structure]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:24.945Z", "log.level": "INFO", "message":"loaded module [x-pack-voting-only-node]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:24.945Z", "log.level": "INFO", "message":"loaded module [x-pack-watcher]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:24.948Z", "log.level": "INFO", "message":"no plugins loaded", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.plugins.PluginsService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:25.036Z", "log.level": "INFO", "message":"using [1] data paths, mounts [[/usr/share/elasticsearch/data (/dev/root)]], net usable_space [13.2gb], net total_space [28.9gb], types [ext4]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.env.NodeEnvironment","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:25.036Z", "log.level": "INFO", "message":"heap size [512mb], compressed ordinary object pointers [true]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.env.NodeEnvironment","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:25.149Z", "log.level": "INFO", "message":"node name [es03], node ID [rvkc3yzYTPiD9pP242Xcfw], cluster name [docker-cluster], roles [ml, data_hot, transform, data_content, data_warm, master, remote_cluster_client, data, data_cold, ingest, data_frozen]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.node.Node","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:34.520Z", "log.level": "INFO", "message":"[controller/264] [Main.cc@123] controller (64 bit): Version 8.0.1 (Build e8dee7fcd7a31a) Copyright (c) 2022 Elasticsearch BV", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"ml-cpp-log-tail-thread","log.logger":"org.elasticsearch.xpack.ml.process.logging.CppLogMessageHandler","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:35.087Z", "log.level": "INFO", "message":"Security is enabled", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.xpack.security.Security","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:36.251Z", "log.level": "INFO", "message":"license mode is [trial], currently licensed security realms are [reserved/reserved,file/default_file,native/default_native]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.xpack.security.authc.Realms","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:36.275Z", "log.level": "INFO", "message":"parsed [0] roles from file [/usr/share/elasticsearch/config/roles.yml]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.xpack.security.authz.store.FileRolesStore","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:38.414Z", "log.level": "INFO", "message":"creating NettyAllocator with the following configs: [name=unpooled, suggested_max_allocation_size=1mb, factors={es.unsafe.use_unpooled_allocator=null, g1gc_enabled=true, g1gc_region_size=4mb, heap_size=512mb}]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.transport.netty4.NettyAllocator","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:38.495Z", "log.level": "INFO", "message":"using rate limit [40mb] with [default=40mb, read=0b, write=0b, max=0b]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.indices.recovery.RecoverySettings","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:38.576Z", "log.level": "INFO", "message":"using discovery type [zen] and seed hosts providers [settings]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.discovery.DiscoveryModule","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:40.562Z", "log.level": "INFO", "message":"initialized", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.node.Node","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:40.562Z", "log.level": "INFO", "message":"starting ...", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.node.Node","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:40.597Z", "log.level": "INFO", "message":"persistent cache index loaded", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.xpack.searchablesnapshots.cache.full.PersistentCache","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:40.598Z", "log.level": "INFO", "message":"deprecation component started", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.xpack.deprecation.logging.DeprecationIndexingComponent","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:40.918Z", "log.level": "INFO", "message":"publish_address {172.24.0.5:9300}, bound_addresses {0.0.0.0:9300}", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.transport.TransportService","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}
 {"@timestamp":"2022-04-29T08:29:41.262Z", "log.level": "INFO", "message":"bound or publishing to a non-loopback address, enforcing bootstrap checks", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"main","log.logger":"org.elasticsearch.bootstrap.BootstrapChecks","elasticsearch.node.name":"es03","elasticsearch.cluster.name":"docker-cluster"}

 ERROR: [1] bootstrap checks failed. You must address the points described in the following [1] lines before starting Elasticsearch.
 bootstrap check failure [1] of [1]: max virtual memory areas vm.max_map_count [65530] is too low, increase to at least [262144]
 ERROR: Elasticsearch did not exit normally - check the logs at /usr/share/elasticsearch/logs/docker-cluster.log



Did you resolve that?

Hello @warkolm, I ran

sudo sysctl -w vm.max_map_count=262144

But now I am getting a different error:

ERROR: write /var/lib/docker/tmp/GetImageBlob190687677: no space left on device

I have tried

docker system prune --all --force --volumes

(https://forums.docker.com/t/docker-no-space-left-on-device/69205/7)

But I am getting the same error. Could you please give us some hint on how to fix this?

You need to check the device space left on your ubuntu machine. You can try removing extra stuff or increase the disk space. If you are using an ec2 instance you can always increase the EBS volume size.