Elasticsearch 6.7.0 Homebrew install macOS 10.14.4 fails to run ERROR: Cluster name [elasticsearch_nathan] subdirectory exists in data paths

Nathan_Sowatskey · April 1, 2019, 9:38am

I have installed ES on an iMac with macOS 10.14.4, then tried to run it. That failed as shown below. I was expecting this to run as is, as previous installs have run without any configuration required. This is the first install of ES on this machine.

Any ideas please?

Many thanks

Nathan

 elasticsearch
Java HotSpot(TM) 64-Bit Server VM warning: Cannot open file logs/gc.log due to No such file or directory

[2019-04-01T11:28:42,799][INFO ][o.e.e.NodeEnvironment    ] [nmyt00Q] using [1] data paths, mounts [[/ (/dev/disk2s1)]], net usable_space [1.8tb], net total_space [2.8tb], types [apfs]
[2019-04-01T11:28:42,801][INFO ][o.e.e.NodeEnvironment    ] [nmyt00Q] heap size [989.8mb], compressed ordinary object pointers [true]
[2019-04-01T11:28:42,803][INFO ][o.e.n.Node               ] [nmyt00Q] node name derived from node ID [nmyt00QiQ5yore9mUO-nCQ]; set [node.name] to override
[2019-04-01T11:28:42,803][INFO ][o.e.n.Node               ] [nmyt00Q] version[6.7.0], pid[66760], build[oss/tar/8453f77/2019-03-21T15:32:29.844721Z], OS[Mac OS X/10.14.4/x86_64], JVM[Oracle Corporation/Java HotSpot(TM) 64-Bit Server VM/1.8.0_121/25.121-b13]
[2019-04-01T11:28:42,804][INFO ][o.e.n.Node               ] [nmyt00Q] JVM arguments [-Xms1g, -Xmx1g, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.io.tmpdir=/var/folders/7l/0fwd_7ls1m19q3_z1_tgg1w80000gn/T/elasticsearch-1618616902183114739, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -XX:+PrintTenuringDistribution, -XX:+PrintGCApplicationStoppedTime, -Xloggc:logs/gc.log, -XX:+UseGCLogFileRotation, -XX:NumberOfGCLogFiles=32, -XX:GCLogFileSize=64m, -Des.path.home=/usr/local/Cellar/elasticsearch/6.7.0/libexec, -Des.path.conf=/usr/local/etc/elasticsearch, -Des.distribution.flavor=oss, -Des.distribution.type=tar]
[2019-04-01T11:28:43,729][INFO ][o.e.p.PluginsService     ] [nmyt00Q] loaded module [aggs-matrix-stats]
[2019-04-01T11:28:43,730][INFO ][o.e.p.PluginsService     ] [nmyt00Q] loaded module [analysis-common]
[2019-04-01T11:28:43,730][INFO ][o.e.p.PluginsService     ] [nmyt00Q] loaded module [ingest-common]
[2019-04-01T11:28:43,730][INFO ][o.e.p.PluginsService     ] [nmyt00Q] loaded module [ingest-geoip]
[2019-04-01T11:28:43,730][INFO ][o.e.p.PluginsService     ] [nmyt00Q] loaded module [ingest-user-agent]
[2019-04-01T11:28:43,730][INFO ][o.e.p.PluginsService     ] [nmyt00Q] loaded module [lang-expression]
[2019-04-01T11:28:43,730][INFO ][o.e.p.PluginsService     ] [nmyt00Q] loaded module [lang-mustache]
[2019-04-01T11:28:43,730][INFO ][o.e.p.PluginsService     ] [nmyt00Q] loaded module [lang-painless]
[2019-04-01T11:28:43,731][INFO ][o.e.p.PluginsService     ] [nmyt00Q] loaded module [mapper-extras]
[2019-04-01T11:28:43,731][INFO ][o.e.p.PluginsService     ] [nmyt00Q] loaded module [parent-join]
[2019-04-01T11:28:43,731][INFO ][o.e.p.PluginsService     ] [nmyt00Q] loaded module [percolator]
[2019-04-01T11:28:43,731][INFO ][o.e.p.PluginsService     ] [nmyt00Q] loaded module [rank-eval]
[2019-04-01T11:28:43,731][INFO ][o.e.p.PluginsService     ] [nmyt00Q] loaded module [reindex]
[2019-04-01T11:28:43,731][INFO ][o.e.p.PluginsService     ] [nmyt00Q] loaded module [repository-url]
[2019-04-01T11:28:43,731][INFO ][o.e.p.PluginsService     ] [nmyt00Q] loaded module [transport-netty4]
[2019-04-01T11:28:43,731][INFO ][o.e.p.PluginsService     ] [nmyt00Q] loaded module [tribe]
[2019-04-01T11:28:43,732][INFO ][o.e.p.PluginsService     ] [nmyt00Q] no plugins loaded
[2019-04-01T11:28:46,751][INFO ][o.e.d.DiscoveryModule    ] [nmyt00Q] using discovery type [zen] and host providers [settings]
[2019-04-01T11:28:47,216][INFO ][o.e.n.Node               ] [nmyt00Q] initialized
[2019-04-01T11:28:47,217][INFO ][o.e.n.Node               ] [nmyt00Q] starting ...
[2019-04-01T11:28:47,391][INFO ][o.e.t.TransportService   ] [nmyt00Q] publish_address {127.0.0.1:9300}, bound_addresses {[::1]:9300}, {127.0.0.1:9300}
ERROR: Cluster name [elasticsearch_nathan] subdirectory exists in data paths [/usr/local/var/lib/elasticsearch/elasticsearch_nathan]. All data under these paths must be moved up one directory to paths [/usr/local/var/lib/elasticsearch]
[2019-04-01T11:28:47,434][INFO ][o.e.n.Node               ] [nmyt00Q] stopping ...
[2019-04-01T11:28:47,449][INFO ][o.e.n.Node               ] [nmyt00Q] stopped
[2019-04-01T11:28:47,449][INFO ][o.e.n.Node               ] [nmyt00Q] closing ...
[2019-04-01T11:28:47,458][INFO ][o.e.n.Node               ] [nmyt00Q] closed
Nathans-iMac:notebooks nathan$ ls /usr/local/var/lib/elasticsearch/elasticsearch_nathan
Nathans-iMac:notebooks nathan$ ls -la /usr/local/var/lib/elasticsearch/elasticsearch_nathan
total 0
drwxr-xr-x  2 nathan  admin   64  1 Apr 11:27 .
drwxr-xr-x  4 nathan  admin  128  1 Apr 11:28 ..
Nathans-iMac:notebooks nathan$ ls -la /usr/local/var/lib/elasticsearch
total 0
drwxr-xr-x  4 nathan  admin  128  1 Apr 11:28 .
drwxr-xr-x  3 nathan  admin   96  1 Apr 11:27 ..
drwxr-xr-x  2 nathan  admin   64  1 Apr 11:27 elasticsearch_nathan
drwxr-xr-x  3 nathan  admin   96  1 Apr 11:28 nodes
Nathans-iMac:notebooks nathan$

dadoonet · April 1, 2019, 9:58am

The error message you shared in Unable to start Elasticsearch - java.lang.IllegalStateException: Duplicate key org.elasticsearch.plugins.PluginsService$Bundle@e3623fe is different.

Which one is the most accurate now?

Here the message seems to indicate that you upgraded from an old version, did you?
If you don't have important old data and are ok to drop it, you can just delete the elasticsearch_nathan dir.

Nathan_Sowatskey · April 1, 2019, 10:05am

These are two different machines. This is my iMac, the other is my MBP. I wanted to test a clean install, i.e. not an upgrade, on the iMac to see if the problem on the MBP could be replicated. But I hit this problem instead.

Thanks

Nathan

Nathan_Sowatskey · April 1, 2019, 10:08am

I did delete the directory as you suggested, and that seems to work. I am pretty certain that ES has never been installed on the iMac before, so this was not a directory left over from a previous install as far as I can tell.

To test, I removed the install brew remove elasticsearch, and then installed again. Note hat the remove does not remove the /usr/local/var/lib/elasticsearch/elasticsearch_nathan/ directory, or the containing directory, or any other directories.

During the brew install these directories are created. When ES is started, the presence of the /usr/local/var/lib/elasticsearch/elasticsearch_nathan/ created during install stops ES starting.

So, to fix this, after the install, remove the directory manually, and then start ES.

Thanks

Nathan

system · April 29, 2019, 10:08am

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.