Hello community,
we are upgrading our elasticsearch to version 8.15 running in Kubernetes based on Alpine Linux Container. Unfortunately it looks like the Bootstrapcheck is using a library (libsystemd) which is not available on alpine-linux.
Any suggestions how to fix this?
Short log output:
2024-08-29 16:45:54,087|INFO |Thread-1| MAIN_CONSOLE - Command line: /bin/bash /elasticsearch/bin/elasticsearch
2024-08-29 16:45:54,108|INFO |Thread-1| MAIN_CONSOLE - /|warning: ignoring JAVA_HOME=/opt/jre; using ES_JAVA_HOME
2024-08-29 16:45:55,615|INFO |Thread-1| MAIN_CONSOLE - /|[2024-08-29T16:45:55,613][WARN ][o.e.c.l.LogConfigurator ] [elasticsearch-default-0] Some logging configurations have %marker but don't have %node_name. We will automatically add %node_name to the pattern to ease the migration for users who customize log4j2.properties but will stop this behavior in 7.0. You should manually replace `%node_name` with `[%node_name]%marker ` in these locations:
2024-08-29 16:45:55,615|INFO |Thread-1| MAIN_CONSOLE - /| /elasticsearch/config/log4j2.properties
2024-08-29 16:45:55,721|INFO |Thread-1| MAIN_CONSOLE - /|[2024-08-29T16:45:55,718][WARN ][o.e.n.NativeAccess ] [elasticsearch-default-0] Unable to load native provider. Native methods will be disabled.
2024-08-29 16:45:55,721|INFO |Thread-1| MAIN_CONSOLE - /|java.lang.UnsatisfiedLinkError: Unable to load library 'libsystemd.so.0':
2024-08-29 16:45:55,721|INFO |Thread-1| MAIN_CONSOLE - /|Error loading shared library libsystemd.so.0: No such file or directory
2024-08-29 16:45:55,722|INFO |Thread-1| MAIN_CONSOLE - /|Error loading shared library libsystemd.so.0: No such file or directory
2024-08-29 16:45:55,722|INFO |Thread-1| MAIN_CONSOLE - /|Native library (linux-x86-64/libsystemd.so.0) not found in resource path ()
2024-08-29 16:45:55,722|INFO |Thread-1| MAIN_CONSOLE - /| at com.sun.jna.NativeLibrary.loadLibrary(NativeLibrary.java:307) ~[jna-5.12.1.jar:?]
2024-08-29 16:45:55,722|INFO |Thread-1| MAIN_CONSOLE - /| at com.sun.jna.NativeLibrary.getInstance(NativeLibrary.java:467) ~[jna-5.12.1.jar:?]
2024-08-29 16:45:55,722|INFO |Thread-1| MAIN_CONSOLE - /| at com.sun.jna.Library$Handler.<init>(Library.java:192) ~[jna-5.12.1.jar:?]
2024-08-29 16:45:55,722|INFO |Thread-1| MAIN_CONSOLE - /| at com.sun.jna.Native.load(Native.java:622) ~[jna-5.12.1.jar:?]
2024-08-29 16:45:55,722|INFO |Thread-1| MAIN_CONSOLE - /| at com.sun.jna.Native.load(Native.java:596) ~[jna-5.12.1.jar:?]
2024-08-29 16:45:55,722|INFO |Thread-1| MAIN_CONSOLE - /| at org.elasticsearch.nativeaccess.jna.JnaSystemdLibrary.<init>(JnaSystemdLibrary.java:24) ~[?:?]
2024-08-29 16:45:55,722|INFO |Thread-1| MAIN_CONSOLE - /| at org.elasticsearch.nativeaccess.lib.NativeLibraryProvider.getLibrary(NativeLibraryProvider.java:58) ~[elasticsearch-native-8.15.0.jar:?]
2024-08-29 16:45:55,722|INFO |Thread-1| MAIN_CONSOLE - /| at org.elasticsearch.nativeaccess.LinuxNativeAccess.<init>(LinuxNativeAccess.java:20) ~[elasticsearch-native-8.15.0.jar:?]
2024-08-29 16:45:55,722|INFO |Thread-1| MAIN_CONSOLE - /| at org.elasticsearch.nativeaccess.NativeAccessHolder.<clinit>(NativeAccessHolder.java:28) ~[elasticsearch-native-8.15.0.jar:?]
2024-08-29 16:45:55,722|INFO |Thread-1| MAIN_CONSOLE - /| at org.elasticsearch.nativeaccess.NativeAccess.instance(NativeAccess.java:22) ~[elasticsearch-native-8.15.0.jar:?]
2024-08-29 16:45:55,722|INFO |Thread-1| MAIN_CONSOLE - /| at org.elasticsearch.bootstrap.Elasticsearch.initializeNatives(Elasticsearch.java:285) ~[elasticsearch-8.15.0.jar:?]
2024-08-29 16:45:55,722|INFO |Thread-1| MAIN_CONSOLE - /| at org.elasticsearch.bootstrap.Elasticsearch.initPhase2(Elasticsearch.java:170) ~[elasticsearch-8.15.0.jar:?]
2024-08-29 16:45:55,722|INFO |Thread-1| MAIN_CONSOLE - /| at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:75) ~[elasticsearch-8.15.0.jar:?]
2024-08-29 16:45:55,723|INFO |Thread-1| MAIN_CONSOLE - /| Suppressed: java.lang.UnsatisfiedLinkError: Error loading shared library libsystemd.so.0: No such file or directory
2024-08-29 16:45:55,723|INFO |Thread-1| MAIN_CONSOLE - /| at com.sun.jna.Native.open(Native Method) ~[jna-5.12.1.jar:?]
2024-08-29 16:45:55,723|INFO |Thread-1| MAIN_CONSOLE - /| at com.sun.jna.NativeLibrary.loadLibrary(NativeLibrary.java:197) ~[jna-5.12.1.jar:?]
2024-08-29 16:45:55,723|INFO |Thread-1| MAIN_CONSOLE - /| at com.sun.jna.NativeLibrary.getInstance(NativeLibrary.java:467) ~[jna-5.12.1.jar:?]
2024-08-29 16:45:55,723|INFO |Thread-1| MAIN_CONSOLE - /| at com.sun.jna.Library$Handler.<init>(Library.java:192) ~[jna-5.12.1.jar:?]
2024-08-29 16:45:55,723|INFO |Thread-1| MAIN_CONSOLE - /| at com.sun.jna.Native.load(Native.java:622) ~[jna-5.12.1.jar:?]
2024-08-29 16:45:55,723|INFO |Thread-1| MAIN_CONSOLE - /| at com.sun.jna.Native.load(Native.java:596) ~[jna-5.12.1.jar:?]
2024-08-29 16:45:55,723|INFO |Thread-1| MAIN_CONSOLE - /| at org.elasticsearch.nativeaccess.jna.JnaSystemdLibrary.<init>(JnaSystemdLibrary.java:24) ~[?:?]
2024-08-29 16:45:55,723|INFO |Thread-1| MAIN_CONSOLE - /| at org.elasticsearch.nativeaccess.lib.NativeLibraryProvider.getLibrary(NativeLibraryProvider.java:58) ~[elasticsearch-native-8.15.0.jar:?]
2024-08-29 16:45:55,723|INFO |Thread-1| MAIN_CONSOLE - /| at org.elasticsearch.nativeaccess.LinuxNativeAccess.<init>(LinuxNativeAccess.java:20) ~[elasticsearch-native-8.15.0.jar:?]
2024-08-29 16:45:55,723|INFO |Thread-1| MAIN_CONSOLE - /| at org.elasticsearch.nativeaccess.NativeAccessHolder.<clinit>(NativeAccessHolder.java:28) ~[elasticsearch-native-8.15.0.jar:?]
2024-08-29 16:45:55,723|INFO |Thread-1| MAIN_CONSOLE - /| at org.elasticsearch.nativeaccess.NativeAccess.instance(NativeAccess.java:22) ~[elasticsearch-native-8.15.0.jar:?]
2024-08-29 16:45:55,723|INFO |Thread-1| MAIN_CONSOLE - /| at org.elasticsearch.bootstrap.Elasticsearch.initializeNatives(Elasticsearch.java:285) ~[elasticsearch-8.15.0.jar:?]
2024-08-29 16:45:55,723|INFO |Thread-1| MAIN_CONSOLE - /| at org.elasticsearch.bootstrap.Elasticsearch.initPhase2(Elasticsearch.java:170) ~[elasticsearch-8.15.0.jar:?]
2024-08-29 16:45:55,723|INFO |Thread-1| MAIN_CONSOLE - /| at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:75) ~[elasticsearch-8.15.0.jar:?]
2024-08-29 16:45:55,723|INFO |Thread-1| MAIN_CONSOLE - /| Suppressed: java.lang.UnsatisfiedLinkError: Error loading shared library libsystemd.so.0: No such file or directory
2024-08-29 16:45:55,723|INFO |Thread-1| MAIN_CONSOLE - /| at com.sun.jna.Native.open(Native Method) ~[jna-5.12.1.jar:?]
2024-08-29 16:45:55,724|INFO |Thread-1| MAIN_CONSOLE - /| at com.sun.jna.NativeLibrary.loadLibrary(NativeLibrary.java:210) ~[jna-5.12.1.jar:?]
2024-08-29 16:45:55,724|INFO |Thread-1| MAIN_CONSOLE - /| at com.sun.jna.NativeLibrary.getInstance(NativeLibrary.java:467) ~[jna-5.12.1.jar:?]
2024-08-29 16:45:55,724|INFO |Thread-1| MAIN_CONSOLE - /| at com.sun.jna.Library$Handler.<init>(Library.java:192) ~[jna-5.12.1.jar:?]
2024-08-29 16:45:55,724|INFO |Thread-1| MAIN_CONSOLE - /| at com.sun.jna.Native.load(Native.java:622) ~[jna-5.12.1.jar:?]
2024-08-29 16:45:55,724|INFO |Thread-1| MAIN_CONSOLE - /| at com.sun.jna.Native.load(Native.java:596) ~[jna-5.12.1.jar:?]
2024-08-29 16:45:55,724|INFO |Thread-1| MAIN_CONSOLE - /| at org.elasticsearch.nativeaccess.jna.JnaSystemdLibrary.<init>(JnaSystemdLibrary.java:24) ~[?:?]
2024-08-29 16:45:55,724|INFO |Thread-1| MAIN_CONSOLE - /| at org.elasticsearch.nativeaccess.lib.NativeLibraryProvider.getLibrary(NativeLibraryProvider.java:58) ~[elasticsearch-native-8.15.0.jar:?]
2024-08-29 16:45:55,724|INFO |Thread-1| MAIN_CONSOLE - /| at org.elasticsearch.nativeaccess.LinuxNativeAccess.<init>(LinuxNativeAccess.java:20) ~[elasticsearch-native-8.15.0.jar:?]
2024-08-29 16:45:55,724|INFO |Thread-1| MAIN_CONSOLE - /| at org.elasticsearch.nativeaccess.NativeAccessHolder.<clinit>(NativeAccessHolder.java:28) ~[elasticsearch-native-8.15.0.jar:?]
2024-08-29 16:45:55,724|INFO |Thread-1| MAIN_CONSOLE - /| at org.elasticsearch.nativeaccess.NativeAccess.instance(NativeAccess.java:22) ~[elasticsearch-native-8.15.0.jar:?]
2024-08-29 16:45:55,724|INFO |Thread-1| MAIN_CONSOLE - /| at org.elasticsearch.bootstrap.Elasticsearch.initializeNatives(Elasticsearch.java:285) ~[elasticsearch-8.15.0.jar:?]
2024-08-29 16:45:55,724|INFO |Thread-1| MAIN_CONSOLE - /| at org.elasticsearch.bootstrap.Elasticsearch.initPhase2(Elasticsearch.java:170) ~[elasticsearch-8.15.0.jar:?]
2024-08-29 16:45:55,724|INFO |Thread-1| MAIN_CONSOLE - /| at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:75) ~[elasticsearch-8.15.0.jar:?]
2024-08-29 16:45:55,724|INFO |Thread-1| MAIN_CONSOLE - /| Suppressed: java.io.IOException: Native library (linux-x86-64/libsystemd.so.0) not found in resource path ()
2024-08-29 16:45:55,724|INFO |Thread-1| MAIN_CONSOLE - /| at com.sun.jna.Native.extractFromResourcePath(Native.java:1145) ~[jna-5.12.1.jar:?]
2024-08-29 16:45:55,724|INFO |Thread-1| MAIN_CONSOLE - /| at com.sun.jna.NativeLibrary.loadLibrary(NativeLibrary.java:281) ~[jna-5.12.1.jar:?]
2024-08-29 16:45:55,724|INFO |Thread-1| MAIN_CONSOLE - /| at com.sun.jna.NativeLibrary.getInstance(NativeLibrary.java:467) ~[jna-5.12.1.jar:?]
2024-08-29 16:45:55,724|INFO |Thread-1| MAIN_CONSOLE - /| at com.sun.jna.Library$Handler.<init>(Library.java:192) ~[jna-5.12.1.jar:?]
2024-08-29 16:45:55,725|INFO |Thread-1| MAIN_CONSOLE - /| at com.sun.jna.Native.load(Native.java:622) ~[jna-5.12.1.jar:?]
2024-08-29 16:45:55,725|INFO |Thread-1| MAIN_CONSOLE - /| at com.sun.jna.Native.load(Native.java:596) ~[jna-5.12.1.jar:?]
2024-08-29 16:45:55,725|INFO |Thread-1| MAIN_CONSOLE - /| at org.elasticsearch.nativeaccess.jna.JnaSystemdLibrary.<init>(JnaSystemdLibrary.java:24) ~[?:?]
2024-08-29 16:45:55,725|INFO |Thread-1| MAIN_CONSOLE - /| at org.elasticsearch.nativeaccess.lib.NativeLibraryProvider.getLibrary(NativeLibraryProvider.java:58) ~[elasticsearch-native-8.15.0.jar:?]
2024-08-29 16:45:55,725|INFO |Thread-1| MAIN_CONSOLE - /| at org.elasticsearch.nativeaccess.LinuxNativeAccess.<init>(LinuxNativeAccess.java:20) ~[elasticsearch-native-8.15.0.jar:?]
2024-08-29 16:45:55,725|INFO |Thread-1| MAIN_CONSOLE - /| at org.elasticsearch.nativeaccess.NativeAccessHolder.<clinit>(NativeAccessHolder.java:28) ~[elasticsearch-native-8.15.0.jar:?]
2024-08-29 16:45:55,725|INFO |Thread-1| MAIN_CONSOLE - /| at org.elasticsearch.nativeaccess.NativeAccess.instance(NativeAccess.java:22) ~[elasticsearch-native-8.15.0.jar:?]
2024-08-29 16:45:55,725|INFO |Thread-1| MAIN_CONSOLE - /| at org.elasticsearch.bootstrap.Elasticsearch.initializeNatives(Elasticsearch.java:285) ~[elasticsearch-8.15.0.jar:?]
2024-08-29 16:45:55,725|INFO |Thread-1| MAIN_CONSOLE - /| at org.elasticsearch.bootstrap.Elasticsearch.initPhase2(Elasticsearch.java:170) ~[elasticsearch-8.15.0.jar:?]
2024-08-29 16:45:55,725|INFO |Thread-1| MAIN_CONSOLE - /| at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:75) ~[elasticsearch-8.15.0.jar:?]
2024-08-29 16:45:55,725|INFO |Thread-1| MAIN_CONSOLE - /|[2024-08-29T16:45:55,721][WARN ][o.e.n.NativeAccess ] [elasticsearch-default-0] Cannot check if running as root because native access is not available
2024-08-29 16:45:56,487|INFO |Thread-1| MAIN_CONSOLE - /|[2024-08-29T16:45:56,487][INFO ][o.e.n.Node ] [elasticsearch-default-0] version[8.15.0], pid[263], build[zip/1a77947f34deddb41af25e6f0ddb8e830159c179/2024-08-05T10:05:34.233336849Z], OS[Linux/5.10.57/amd64], JVM[Azul Systems, Inc./OpenJDK 64-Bit Server VM/17.0.12/17.0.12+7-LTS]
2024-08-29 16:45:56,488|INFO |Thread-1| MAIN_CONSOLE - /|[2024-08-29T16:45:56,487][INFO ][o.e.n.Node ] [elasticsearch-default-0] JVM home [/opt/jre], using bundled JDK [false]
2024-08-29 16:45:56,488|INFO |Thread-1| MAIN_CONSOLE - /|[2024-08-29T16:45:56,487][INFO ][o.e.n.Node ] [elasticsearch-default-0] JVM arguments [-Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -Djava.security.manager=allow, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Dlog4j2.formatMsgNoLookups=true, -Djava.locale.providers=SPI,COMPAT, --add-opens=java.base/java.io=org.elasticsearch.preallocate, -XX:ReplayDataFile=logs/replay_pid%p.log, -Djava.library.path=/elasticsearch/lib/platform/linux-x64:/opt/jre/lib/server:/opt/jre/lib:/opt/jre/../lib:/usr/java/packages/lib:/usr/lib64:/lib64:/lib:/usr/lib, -Djna.library.path=/elasticsearch/lib/platform/linux-x64:/opt/jre/lib/server:/opt/jre/lib:/opt/jre/../lib:/usr/java/packages/lib:/usr/lib64:/lib64:/lib:/usr/lib, -Des.distribution.type=zip, -XX:+UseG1GC, -XX:G1ReservePercent=25, -XX:InitiatingHeapOccupancyPercent=30, -Djava.io.tmpdir=/tmp/elasticsearch-10129343132002079505, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=/elasticsearch/dumps, -XX:ErrorFile=/elasticsearch/logs/hs_err_pid%p.log, -Xmx256M, -Xms256M, -Xss1m, -XX:MaxDirectMemorySize=134217728, -XX:G1HeapRegionSize=4m, --module-path=/elasticsearch/lib, --add-modules=jdk.net, --add-modules=ALL-MODULE-PATH, -Djdk.module.main=org.elasticsearch.server]
2024-08-29 16:45:56,488|INFO |Thread-1| MAIN_CONSOLE - /|[2024-08-29T16:45:56,488][INFO ][o.e.n.Node ] [elasticsearch-default-0] Default Locale [en_US]
2024-08-29 16:45:56,940|INFO |Thread-1| MAIN_CONSOLE - /|[2024-08-29T16:45:56,938][WARN ][c.a.a.p.i.BasicProfileConfigFileLoader] [elasticsearch-default-0] Unable to load config file null
2024-08-29 16:45:56,940|INFO |Thread-1| MAIN_CONSOLE - /|java.security.AccessControlException: access denied ("java.io.FilePermission" "/home/arisuser/.aws/config" "read")
2024-08-29 16:45:56,940|INFO |Thread-1| MAIN_CONSOLE - /| at java.security.AccessControlContext.checkPermission(Unknown Source) ~[?:?]
2024-08-29 16:45:56,940|INFO |Thread-1| MAIN_CONSOLE - /| at java.security.AccessController.checkPermission(Unknown Source) ~[?:?]
2024-08-29 16:45:56,940|INFO |Thread-1| MAIN_CONSOLE - /| at java.lang.SecurityManager.checkPermission(Unknown Source) ~[?:?]
2024-08-29 16:45:56,940|INFO |Thread-1| MAIN_CONSOLE - /| at java.lang.SecurityManager.checkRead(Unknown Source) ~[?:?]
2024-08-29 16:45:56,940|INFO |Thread-1| MAIN_CONSOLE - /| at java.io.File.exists(Unknown Source) ~[?:?]
2024-08-29 16:45:56,940|INFO |Thread-1| MAIN_CONSOLE - /| at com.amazonaws.profile.path.config.SharedConfigDefaultLocationProvider.getLocation(SharedConfigDefaultLocationProvider.java:36) ~[aws-java-sdk-core-1.12.270.jar:?]
2024-08-29 16:45:56,940|INFO |Thread-1| MAIN_CONSOLE - /| at com.amazonaws.profile.path.AwsProfileFileLocationProviderChain.getLocation(AwsProfileFileLocationProviderChain.java:41) ~[aws-java-sdk-core-1.12.270.jar:?]
2024-08-29 16:45:56,940|INFO |Thread-1| MAIN_CONSOLE - /| at com.amazonaws.auth.profile.internal.BasicProfileConfigFileLoader.getProfilesConfigFile(BasicProfileConfigFileLoader.java:69) ~[aws-java-sdk-core-1.12.270.jar:?]
2024-08-29 16:45:56,940|INFO |Thread-1| MAIN_CONSOLE - /| at com.amazonaws.auth.profile.internal.BasicProfileConfigFileLoader.getProfile(BasicProfileConfigFileLoader.java:55) ~[aws-java-sdk-core-1.12.270.jar:?]
2024-08-29 16:45:56,940|INFO |Thread-1| MAIN_CONSOLE - /| at com.amazonaws.retry.internal.RetryModeResolver.profile(RetryModeResolver.java:103) ~[aws-java-sdk-core-1.12.270.jar:?]
2024-08-29 16:45:56,940|INFO |Thread-1| MAIN_CONSOLE - /| at com.amazonaws.retry.internal.RetryModeResolver.resolveRetryMode(RetryModeResolver.java:89) ~[aws-java-sdk-core-1.12.270.jar:?]
2024-08-29 16:45:56,940|INFO |Thread-1| MAIN_CONSOLE - /| at com.amazonaws.retry.internal.RetryModeResolver.<init>(RetryModeResolver.java:55) ~[aws-java-sdk-core-1.12.270.jar:?]
2024-08-29 16:45:56,941|INFO |Thread-1| MAIN_CONSOLE - /| at com.amazonaws.retry.internal.RetryModeResolver.<init>(RetryModeResolver.java:48) ~[aws-java-sdk-core-1.12.270.jar:?]
2024-08-29 16:45:56,941|INFO |Thread-1| MAIN_CONSOLE - /| at com.amazonaws.retry.RetryPolicy.<clinit>(RetryPolicy.java:35) ~[aws-java-sdk-core-1.12.270.jar:?]
2024-08-29 16:45:56,941|INFO |Thread-1| MAIN_CONSOLE - /| at com.amazonaws.retry.PredefinedRetryPolicies.<clinit>(PredefinedRetryPolicies.java:32) ~[aws-java-sdk-core-1.12.270.jar:?]
2024-08-29 16:45:56,941|INFO |Thread-1| MAIN_CONSOLE - /| at com.amazonaws.ClientConfiguration.<clinit>(ClientConfiguration.java:89) ~[aws-java-sdk-core-1.12.270.jar:?]
2024-08-29 16:45:56,941|INFO |Thread-1| MAIN_CONSOLE - /| at java.lang.Class.forName0(Native Method) ~[?:?]
2024-08-29 16:45:56,941|INFO |Thread-1| MAIN_CONSOLE - /| at java.lang.Class.forName(Unknown Source) ~[?:?]
2024-08-29 16:45:56,941|INFO |Thread-1| MAIN_CONSOLE - /| at org.elasticsearch.repositories.s3.S3RepositoryPlugin.lambda$static$0(S3RepositoryPlugin.java:53) ~[repository-s3-8.15.0.jar:8.15.0]
2024-08-29 16:45:56,941|INFO |Thread-1| MAIN_CONSOLE - /| at java.security.AccessController.doPrivileged(Unknown Source) ~[?:?]
2024-08-29 16:45:56,941|INFO |Thread-1| MAIN_CONSOLE - /| at org.elasticsearch.repositories.s3.S3RepositoryPlugin.<clinit>(S3RepositoryPlugin.java:47) ~[repository-s3-8.15.0.jar:8.15.0]
2024-08-29 16:45:56,941|INFO |Thread-1| MAIN_CONSOLE - /| at jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) ~[?:?]
2024-08-29 16:45:56,941|INFO |Thread-1| MAIN_CONSOLE - /| at jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance(Unknown Source) ~[?:?]
2024-08-29 16:45:56,941|INFO |Thread-1| MAIN_CONSOLE - /| at jdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown Source) ~[?:?]
2024-08-29 16:45:56,941|INFO |Thread-1| MAIN_CONSOLE - /| at java.lang.reflect.Constructor.newInstanceWithCaller(Unknown Source) ~[?:?]
2024-08-29 16:45:56,941|INFO |Thread-1| MAIN_CONSOLE - /| at java.lang.reflect.Constructor.newInstance(Unknown Source) ~[?:?]
2024-08-29 16:45:56,941|INFO |Thread-1| MAIN_CONSOLE - /| at org.elasticsearch.plugins.PluginsService.loadPlugin(PluginsService.java:681) ~[elasticsearch-8.15.0.jar:?]
2024-08-29 16:45:56,941|INFO |Thread-1| MAIN_CONSOLE - /| at org.elasticsearch.plugins.PluginsService.loadBundle(PluginsService.java:531) ~[elasticsearch-8.15.0.jar:?]
2024-08-29 16:45:56,941|INFO |Thread-1| MAIN_CONSOLE - /| at org.elasticsearch.plugins.PluginsService.loadBundles(PluginsService.java:295) ~[elasticsearch-8.15.0.jar:?]
2024-08-29 16:45:56,941|INFO |Thread-1| MAIN_CONSOLE - /| at org.elasticsearch.plugins.PluginsService.<init>(PluginsService.java:165) ~[elasticsearch-8.15.0.jar:?]
2024-08-29 16:45:56,941|INFO |Thread-1| MAIN_CONSOLE - /| at org.elasticsearch.node.NodeServiceProvider.newPluginService(NodeServiceProvider.java:55) ~[elasticsearch-8.15.0.jar:?]
2024-08-29 16:45:56,941|INFO |Thread-1| MAIN_CONSOLE - /| at org.elasticsearch.node.NodeConstruction.createEnvironment(NodeConstruction.java:455) ~[elasticsearch-8.15.0.jar:?]
2024-08-29 16:45:56,942|INFO |Thread-1| MAIN_CONSOLE - /| at org.elasticsearch.node.NodeConstruction.prepareConstruction(NodeConstruction.java:256) ~[elasticsearch-8.15.0.jar:?]
2024-08-29 16:45:56,942|INFO |Thread-1| MAIN_CONSOLE - /| at org.elasticsearch.node.Node.<init>(Node.java:192) ~[elasticsearch-8.15.0.jar:?]
2024-08-29 16:45:56,942|INFO |Thread-1| MAIN_CONSOLE - /| at org.elasticsearch.bootstrap.Elasticsearch$2.<init>(Elasticsearch.java:242) ~[elasticsearch-8.15.0.jar:?]
2024-08-29 16:45:56,942|INFO |Thread-1| MAIN_CONSOLE - /| at org.elasticsearch.bootstrap.Elasticsearch.initPhase3(Elasticsearch.java:242) ~[elasticsearch-8.15.0.jar:?]
2024-08-29 16:45:56,942|INFO |Thread-1| MAIN_CONSOLE - /| at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:76) ~[elasticsearch-8.15.0.jar:?]
2024-08-29 16:45:58,724|INFO |Thread-1| MAIN_CONSOLE - /|[2024-08-29T16:45:58,724][INFO ][o.e.p.p.PrometheusExporterPlugin] [elasticsearch-default-0] starting Prometheus exporter plugin
LE - /|[2024-08-29T16:45:58,800][INFO ][o.e.p.PluginsService ] [elasticsearch-default-0] loaded module [x-pack-eql]
...
2024-08-29 16:45:58,800|INFO |Thread-1| MAIN_CONSOLE - /|[2024-08-29T16:45:58,800][INFO ][o.e.p.PluginsService ] [elasticsearch-default-0] loaded plugin [prometheus-exporter]
2024-08-29 16:45:59,605|INFO |Thread-1| MAIN_CONSOLE - /|[2024-08-29T16:45:59,605][INFO ][o.e.e.NodeEnvironment ] [elasticsearch-default-0] using [1] data paths, mounts [[/elasticsearch/data (/dev/sda1)]], net usable_space [32.6gb], net total_space [43.4gb], types [ext4]
2024-08-29 16:45:59,605|INFO |Thread-1| MAIN_CONSOLE - /|[2024-08-29T16:45:59,605][INFO ][o.e.e.NodeEnvironment ] [elasticsearch-default-0] heap size [256mb], compressed ordinary object pointers [true]
2024-08-29 16:45:59,647|INFO |Thread-1| MAIN_CONSOLE - /|[2024-08-29T16:45:59,647][INFO ][o.e.n.Node ] [elasticsearch-default-0] node name [elasticsearch-default-0], node ID [e5DFbdkQSCGrWcG4vVSgLQ], cluster name [aris_cluster], roles [ingest, data_frozen, ml, data_hot, transform, data_content, data_warm, master, remote_cluster_client, data, data_cold]
2024-08-29 16:46:02,831|INFO |Thread-1| MAIN_CONSOLE - /|[2024-08-29T16:46:02,830][INFO ][o.e.i.r.RecoverySettings ] [elasticsearch-default-0] using rate limit [40mb] with [default=40mb, read=0b, write=0b, max=0b]
2024-08-29 16:46:02,953|INFO |Thread-1| MAIN_CONSOLE - /|[2024-08-29T16:46:02,952][INFO ][o.e.f.FeatureService ] [elasticsearch-default-0] Registered local node features [data_stream.auto_sharding, data_stream.lifecycle.global_retention, data_stream.rollover.lazy, desired_node.version_deprecated, esql.agg_values, esql.async_query, esql.base64_decode_encode, esql.casting_operator, esql.counter_types, esql.disable_nullable_opts, esql.from_options, esql.metadata_fields, esql.metrics_counter_fields, esql.mv_ordering_sorted_ascending, esql.mv_sort, esql.spatial_points_from_source, esql.spatial_shapes, esql.st_centroid_agg, esql.st_contains_within, esql.st_disjoint, esql.st_intersects, esql.st_x_y, esql.string_literal_auto_casting, esql.string_literal_auto_casting_extended, esql.timespan_abbreviations, features_supported, file_settings, geoip.downloader.database.configuration, health.dsl.info, health.extended_repository_indicator, knn_retriever_supported, license-trial-independent-version, mapper.index_sorting_on_nested, mapper.keyword_dimension_ignore_above, mapper.pass_through_priority, mapper.range.null_values_off_by_one_fix, mapper.source.synthetic_source_fallback, mapper.track_ignored_source, mapper.vectors.bit_vectors, mapper.vectors.int4_quantization, rest.capabilities_action, retrievers_supported, rrf_retriever_supported, script.hamming, search.vectors.k_param_supported, security.migration_framework, security.roles_metadata_flattened, standard_retriever_supported, stats.include_disk_thresholds, text_similarity_reranker_retriever_supported, unified_highlighter_matched_fields, usage.data_tiers.precalculate_stats]
2024-08-29 16:46:03,265|INFO |Thread-1| MAIN_CONSOLE - /|[2024-08-29T16:46:03,265][INFO ][o.e.t.a.APM ] [elasticsearch-default-0] Sending apm metrics is disabled
2024-08-29 16:46:03,265|INFO |Thread-1| MAIN_CONSOLE - /|[2024-08-29T16:46:03,265][INFO ][o.e.t.a.APM ] [elasticsearch-default-0] Sending apm tracing is disabled
2024-08-29 16:46:03,287|INFO |Thread-1| MAIN_CONSOLE - /|[2024-08-29T16:46:03,287][INFO ][o.e.x.s.Security ] [elasticsearch-default-0] Security is enabled
2024-08-29 16:46:03,638|INFO |Thread-1| MAIN_CONSOLE - /|[2024-08-29T16:46:03,638][INFO ][o.e.x.s.a.s.FileRolesStore] [elasticsearch-default-0] parsed [0] roles from file [/elasticsearch/config/roles.yml]
2024-08-29 16:46:03,767|INFO |Thread-1| MAIN_CONSOLE - /|[2024-08-29T16:46:03,766][INFO ][o.e.x.s.InitialNodeSecurityAutoConfiguration] [elasticsearch-default-0] Auto-configuration will not generate a password for the elastic built-in superuser, as we cannot determine if there is a terminal attached to the elasticsearch process. You can use the `bin/elasticsearch-reset-password` tool to set the password for the elastic user.
2024-08-29 16:46:03,906|INFO |Thread-1| MAIN_CONSOLE - /|[2024-08-29T16:46:03,906][INFO ][o.e.x.p.ProfilingPlugin ] [elasticsearch-default-0] Profiling is enabled
2024-08-29 16:46:03,920|INFO |Thread-1| MAIN_CONSOLE - /|[2024-08-29T16:46:03,919][INFO ][o.e.x.p.ProfilingPlugin ] [elasticsearch-default-0] profiling index templates will not be installed or reinstalled
2024-08-29 16:46:03,923|INFO |Thread-1| MAIN_CONSOLE - /|[2024-08-29T16:46:03,923][INFO ][o.e.x.a.APMPlugin ] [elasticsearch-default-0] APM ingest plugin is enabled
2024-08-29 16:46:03,949|INFO |Thread-1| MAIN_CONSOLE - /|[2024-08-29T16:46:03,949][INFO ][o.e.x.a.APMIndexTemplateRegistry] [elasticsearch-default-0] APM index template registry is enabled
2024-08-29 16:46:04,210|INFO |Thread-1| MAIN_CONSOLE - /|[2024-08-29T16:46:04,210][DEBUG][o.e.a.ActionModule ] [elasticsearch-default-0] Using custom REST interceptor from plugin org.elasticsearch.xpack.security.Security
2024-08-29 16:46:04,255|INFO |Thread-1| MAIN_CONSOLE - /|[2024-08-29T16:46:04,255][INFO ][o.e.t.n.NettyAllocator ] [elasticsearch-default-0] creating NettyAllocator with the following configs: [name=unpooled, suggested_max_allocation_size=1mb, factors={es.unsafe.use_unpooled_allocator=null, g1gc_enabled=true, g1gc_region_size=4mb, heap_size=256mb}]
2024-08-29 16:46:04,298|INFO |Thread-1| MAIN_CONSOLE - /|[2024-08-29T16:46:04,298][INFO ][o.e.d.DiscoveryModule ] [elasticsearch-default-0] using discovery type [multi-node] and seed hosts providers [settings, file]
2024-08-29 16:46:05,044|INFO |Thread-1| MAIN_CONSOLE - /|[2024-08-29T16:46:05,044][INFO ][o.e.n.Node ] [elasticsearch-default-0] initialized
2024-08-29 16:46:05,045|INFO |Thread-1| MAIN_CONSOLE - /|[2024-08-29T16:46:05,045][INFO ][o.e.n.Node ] [elasticsearch-default-0] starting ...
2024-08-29 16:46:05,057|INFO |Thread-1| MAIN_CONSOLE - /|[2024-08-29T16:46:05,057][INFO ][o.e.x.s.c.f.PersistentCache] [elasticsearch-default-0] persistent cache index loaded
2024-08-29 16:46:05,058|INFO |Thread-1| MAIN_CONSOLE - /|[2024-08-29T16:46:05,057][INFO ][o.e.x.d.l.DeprecationIndexingComponent] [elasticsearch-default-0] deprecation component started
2024-08-29 16:46:05,122|INFO |Thread-1| MAIN_CONSOLE - /|[2024-08-29T16:46:05,122][INFO ][o.e.t.TransportService ] [elasticsearch-default-0] publish_address {10.244.0.70:14230}, bound_addresses {0.0.0.0:14230}
2024-08-29 16:46:05,223|INFO |Thread-1| MAIN_CONSOLE - /|[2024-08-29T16:46:05,223][INFO ][o.e.b.BootstrapChecks ] [elasticsearch-default-0] bound or publishing to a non-loopback address, enforcing bootstrap checks
2024-08-29 16:46:05,224|INFO |Thread-1| MAIN_CONSOLE - /|[2024-08-29T16:46:05,224][WARN ][o.e.n.NativeAccess ] [elasticsearch-default-0] Cannot get process limits because native access is not available
2024-08-29 16:46:05,224|INFO |Thread-1| MAIN_CONSOLE - /|[2024-08-29T16:46:05,224][WARN ][o.e.n.NativeAccess ] [elasticsearch-default-0] Cannot get process limits because native access is not available
2024-08-29 16:46:05,224|INFO |Thread-1| MAIN_CONSOLE - /|[2024-08-29T16:46:05,224][WARN ][o.e.n.NativeAccess ] [elasticsearch-default-0] Cannot get process limits because native access is not available
2024-08-29 16:46:05,224|INFO |Thread-1| MAIN_CONSOLE - /|[2024-08-29T16:46:05,224][WARN ][o.e.n.NativeAccess ] [elasticsearch-default-0] Cannot get process limits because native access is not available
2024-08-29 16:46:05,224|INFO |Thread-1| MAIN_CONSOLE - /|[2024-08-29T16:46:05,224][WARN ][o.e.n.NativeAccess ] [elasticsearch-default-0] Cannot get process limits because native access is not available
2024-08-29 16:46:05,224|INFO |Thread-1| MAIN_CONSOLE - /|[2024-08-29T16:46:05,224][WARN ][o.e.n.NativeAccess ] [elasticsearch-default-0] Cannot get process limits because native access is not available
2024-08-29 16:46:05,228|INFO |Thread-1| MAIN_CONSOLE - /|[2024-08-29T16:46:05,227][ERROR][o.e.b.Elasticsearch ] [elasticsearch-default-0] node validation exception
2024-08-29 16:46:05,228|INFO |Thread-1| MAIN_CONSOLE - /|[2] bootstrap checks failed. You must address the points described in the following [2] lines before starting Elasticsearch. For more information see [https://www.elastic.co/guide/en/elasticsearch/reference/8.15/bootstrap-checks.html]
2024-08-29 16:46:05,228|INFO |Thread-1| MAIN_CONSOLE - /|bootstrap check failure [1] of [2]: max size virtual memory [-1] for user [arisuser] is too low, increase to [unlimited]; for more information see [https://www.elastic.co/guide/en/elasticsearch/reference/8.15/max-size-virtual-memory-check.html]
2024-08-29 16:46:05,228|INFO |Thread-1| MAIN_CONSOLE - /|bootstrap check failure [2] of [2]: max file size [-1] for user [arisuser] is too low, increase to [unlimited]; for more information see [https://www.elastic.co/guide/en/elasticsearch/reference/8.15/_max_file_size_check.html]
2024-08-29 16:46:05,228|INFO |Thread-1| MAIN_CONSOLE - /|ERROR: Elasticsearch did not exit normally - check the logs at /elasticsearch/logs/aris_cluster.log
2024-08-29 16:46:05,231|INFO |Thread-1| MAIN_CONSOLE - /|[2024-08-29T16:46:05,231][INFO ][o.e.n.Node ] [elasticsearch-default-0] stopping ...
2024-08-29 16:46:05,245|INFO |Thread-1| MAIN_CONSOLE - /|[2024-08-29T16:46:05,245][INFO ][o.e.n.Node ] [elasticsearch-default-0] stopped
2024-08-29 16:46:05,246|INFO |Thread-1| MAIN_CONSOLE - /|[2024-08-29T16:46:05,245][INFO ][o.e.n.Node ] [elasticsearch-default-0] closing ...
2024-08-29 16:46:05,254|INFO |Thread-1| MAIN_CONSOLE - /|[2024-08-29T16:46:05,254][INFO ][o.e.n.Node ] [elasticsearch-default-0] closed
2024-08-29 16:46:07,279|INFO |Thread-1| MAIN_CONSOLE - /|
2024-08-29 16:46:07,280|INFO |Thread-1| MAIN_CONSOLE - /|ERROR: Elasticsearch died while starting up, with exit code 78