Cannot start ES 6.4


(Josh) #1

I am working on a new Elastic stack cluster and I am unable to start Elastic. I am assuming it is a filesystem/permissions issue, but I cant pin it down. I have a 1TB Samba share that is mounted to /home/elastic/esstorage and in the elasticsearch.yml i have "path.data: /home/elastic/esstorage". there was a permissions issue, but i corrected it and cleared out the files that were created under the wrong credentials, but now I am running into this error when i try to start elastic

[2018-11-05T09:41:39,477][INFO ][o.e.n.Node               ] [Masternode-1] initializing ...
[2018-11-05T09:41:39,527][INFO ][o.e.e.NodeEnvironment    ] [Masternode-1] using [1] data paths, mounts [[/home/elastic/esstorage (//x.x.x.x/esstorage)]], net usable_space [1.7tb], net total_space [1.8tb], types [cifs]
[2018-11-05T09:41:39,527][INFO ][o.e.e.NodeEnvironment    ] [Masternode-1] heap size [7.9gb], compressed ordinary object pointers [true]
[2018-11-05T09:41:39,529][INFO ][o.e.n.Node               ] [Masternode-1] node name [Masternode-1], node ID [x8rfaepQQESbhkg7PkK1Ww]
[2018-11-05T09:41:39,529][INFO ][o.e.n.Node               ] [Masternode-1] version[6.4.2], pid[11461], build[default/rpm/04711c2/2018-09-26T13:34:09.098244Z], OS[Linux/3.10.0-862.14.4.el7.x86_64/amd64], JVM[Oracle Corporation/OpenJDK 64-Bit Server VM/1.8.0_181/25.181-b13]
[2018-11-05T09:41:39,530][INFO ][o.e.n.Node               ] [Masternode-1] JVM arguments [-Xms8g, -Xmx8g, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.io.tmpdir=/tmp/elasticsearch.aOdz7kqm, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=/etc/esstorage, -XX:ErrorFile=/var/log/elasticsearch/hs_err_pid%p.log, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -XX:+PrintTenuringDistribution, -XX:+PrintGCApplicationStoppedTime, -Xloggc:/var/log/elasticsearch/gc.log, -XX:+UseGCLogFileRotation, -XX:NumberOfGCLogFiles=32, -XX:GCLogFileSize=64m, -Des.path.home=/usr/share/elasticsearch, -Des.path.conf=/etc/elasticsearch, -Des.distribution.flavor=default, -Des.distribution.type=rpm]
[2018-11-05T09:41:40,783][INFO ][o.e.p.PluginsService     ] [Masternode-1] loaded module [aggs-matrix-stats]
[2018-11-05T09:41:40,783][INFO ][o.e.p.PluginsService     ] [Masternode-1] loaded module [analysis-common]
[2018-11-05T09:41:40,783][INFO ][o.e.p.PluginsService     ] [Masternode-1] loaded module [ingest-common]
[2018-11-05T09:41:40,783][INFO ][o.e.p.PluginsService     ] [Masternode-1] loaded module [lang-expression]
[2018-11-05T09:41:40,783][INFO ][o.e.p.PluginsService     ] [Masternode-1] loaded module [lang-mustache]
[2018-11-05T09:41:40,783][INFO ][o.e.p.PluginsService     ] [Masternode-1] loaded module [lang-painless]
[2018-11-05T09:41:40,783][INFO ][o.e.p.PluginsService     ] [Masternode-1] loaded module [mapper-extras]
[2018-11-05T09:41:40,783][INFO ][o.e.p.PluginsService     ] [Masternode-1] loaded module [parent-join]
[2018-11-05T09:41:40,783][INFO ][o.e.p.PluginsService     ] [Masternode-1] loaded module [percolator]
[2018-11-05T09:41:40,783][INFO ][o.e.p.PluginsService     ] [Masternode-1] loaded module [rank-eval]
[2018-11-05T09:41:40,783][INFO ][o.e.p.PluginsService     ] [Masternode-1] loaded module [reindex]
[2018-11-05T09:41:40,783][INFO ][o.e.p.PluginsService     ] [Masternode-1] loaded module [repository-url]
[2018-11-05T09:41:40,783][INFO ][o.e.p.PluginsService     ] [Masternode-1] loaded module [transport-netty4]
[2018-11-05T09:41:40,783][INFO ][o.e.p.PluginsService     ] [Masternode-1] loaded module [tribe]
[2018-11-05T09:41:40,783][INFO ][o.e.p.PluginsService     ] [Masternode-1] loaded module [x-pack-core]
[2018-11-05T09:41:40,784][INFO ][o.e.p.PluginsService     ] [Masternode-1] loaded module [x-pack-deprecation]
[2018-11-05T09:41:40,784][INFO ][o.e.p.PluginsService     ] [Masternode-1] loaded module [x-pack-graph]
[2018-11-05T09:41:40,784][INFO ][o.e.p.PluginsService     ] [Masternode-1] loaded module [x-pack-logstash]
[2018-11-05T09:41:40,784][INFO ][o.e.p.PluginsService     ] [Masternode-1] loaded module [x-pack-ml]
[2018-11-05T09:41:40,784][INFO ][o.e.p.PluginsService     ] [Masternode-1] loaded module [x-pack-monitoring]
[2018-11-05T09:41:40,784][INFO ][o.e.p.PluginsService     ] [Masternode-1] loaded module [x-pack-rollup]
[2018-11-05T09:41:40,784][INFO ][o.e.p.PluginsService     ] [Masternode-1] loaded module [x-pack-security]
[2018-11-05T09:41:40,784][INFO ][o.e.p.PluginsService     ] [Masternode-1] loaded module [x-pack-sql]
[2018-11-05T09:41:40,784][INFO ][o.e.p.PluginsService     ] [Masternode-1] loaded module [x-pack-upgrade]
[2018-11-05T09:41:40,784][INFO ][o.e.p.PluginsService     ] [Masternode-1] loaded module [x-pack-watcher]
[2018-11-05T09:41:40,784][INFO ][o.e.p.PluginsService     ] [Masternode-1] no plugins loaded
[2018-11-05T09:41:40,802][ERROR][o.e.b.Bootstrap          ] Exception
java.lang.NullPointerException: null
        at sun.nio.fs.UnixFileSystem.getPath(UnixFileSystem.java:273) ~[?:?]
        at org.elasticsearch.common.io.PathUtils.get(PathUtils.java:60) ~[elasticsearch-core-6.4.2.jar:6.4.2]
        at org.elasticsearch.monitor.os.OsProbe.readSysFsCgroupMemoryLimitInBytes(OsProbe.java:408) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.monitor.os.OsProbe.getCgroupMemoryLimitInBytes(OsProbe.java:395) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.monitor.os.OsProbe.getCgroup(OsProbe.java:488) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.monitor.os.OsProbe.osStats(OsProbe.java:531) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.xpack.ml.MachineLearning.additionalSettings(MachineLearning.java:319) ~[?:?]
        at org.elasticsearch.plugins.PluginsService.updatedSettings(PluginsService.java:203) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.node.Node.<init>(Node.java:316) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.node.Node.<init>(Node.java:256) ~[elasticsearch-6.4.2.jar:6.4.2]
        at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:213) ~[elasticsearch-6.4.2.jar:6.4.2]

I assume that the "sun.nio.fs.UnixFileSystem.getPath(UnixFileSystem.java:273)" means it is a filesystem error of some kind, but for the life of me i can't figure out what it is.

I appreciate any help.


(David Pilato) #2

I'd open an issue as getting a NPE is never a good thing.

However it's absolutely not recommended to use a network drive to store elasticsearch data. You should not do that IMHO.


(Josh) #3

Thank you, I Went over it with Management and we're moving away from the CIFS share.


(system) #4

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.