Elasticsearch Service Fails to create Node Environment (5.5.6)

Elastic Stack Elasticsearch
1

Hello,

I'm running Elasticsearch 5.5.2 on Windows Server 2012 R2. The service has been working for months with no change to the machine or the service (config, bin, etc.) as far as I know. Here are the log messages generated when I attempt to start the service. It stops immediately after starting.

[2018-08-28T09:11:35,464][INFO ][o.e.e.NodeEnvironment    ] [AADCWEB609D] using [1] data paths, mounts [[DATA (E:)]], net usable_space [99.3gb], net total_space [99.9gb], spins? [unknown], types [NTFS]
[2018-08-28T09:11:35,480][INFO ][o.e.e.NodeEnvironment    ] [AADCWEB609D] heap size [1.9gb], compressed ordinary object pointers [true]
[2018-08-28T09:11:35,980][ERROR][o.e.b.Bootstrap          ] Exception
java.lang.IllegalStateException: Failed to create node environment
	at org.elasticsearch.node.Node.<init>(Node.java:267) ~[elasticsearch-5.5.2.jar:5.5.2]
	at org.elasticsearch.node.Node.<init>(Node.java:244) ~[elasticsearch-5.5.2.jar:5.5.2]
	at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:232) ~[elasticsearch-5.5.2.jar:5.5.2]
	at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:232) ~[elasticsearch-5.5.2.jar:5.5.2]
	at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:351) [elasticsearch-5.5.2.jar:5.5.2]
	at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:123) [elasticsearch-5.5.2.jar:5.5.2]
	at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:114) [elasticsearch-5.5.2.jar:5.5.2]
	at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:67) [elasticsearch-5.5.2.jar:5.5.2]
	at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:122) [elasticsearch-5.5.2.jar:5.5.2]
	at org.elasticsearch.cli.Command.main(Command.java:88) [elasticsearch-5.5.2.jar:5.5.2]
	at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:91) [elasticsearch-5.5.2.jar:5.5.2]
	at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:84) [elasticsearch-5.5.2.jar:5.5.2]
Caused by: java.io.IOException: failed to write in data directory [E:\Elasticsearch\data\nodes\0\indices\hhRngq1_QE-91vOmuIEYvw\0\_state] write permission is required
	at org.elasticsearch.env.NodeEnvironment.tryWriteTempFile(NodeEnvironment.java:1076) ~[elasticsearch-5.5.2.jar:5.5.2]
	at org.elasticsearch.env.NodeEnvironment.assertCanWrite(NodeEnvironment.java:1059) ~[elasticsearch-5.5.2.jar:5.5.2]
	at org.elasticsearch.env.NodeEnvironment.<init>(NodeEnvironment.java:278) ~[elasticsearch-5.5.2.jar:5.5.2]
	at org.elasticsearch.node.Node.<init>(Node.java:264) ~[elasticsearch-5.5.2.jar:5.5.2]
	... 11 more
Caused by: java.nio.file.FileAlreadyExistsException: E:\Elasticsearch\data\nodes\0\indices\hhRngq1_QE-91vOmuIEYvw\0\_state\.es_temp_file
	at sun.nio.fs.WindowsException.translateToIOException(WindowsException.java:81) ~[?:?]
	at sun.nio.fs.WindowsException.rethrowAsIOException(WindowsException.java:97) ~[?:?]
	at sun.nio.fs.WindowsException.rethrowAsIOException(WindowsException.java:102) ~[?:?]
	at sun.nio.fs.WindowsFileSystemProvider.newByteChannel(WindowsFileSystemProvider.java:230) ~[?:?]
	at java.nio.file.Files.newByteChannel(Files.java:361) ~[?:1.8.0_161]
	at java.nio.file.Files.createFile(Files.java:632) ~[?:1.8.0_161]
	at org.elasticsearch.env.NodeEnvironment.tryWriteTempFile(NodeEnvironment.java:1073) ~[elasticsearch-5.5.2.jar:5.5.2]
	at org.elasticsearch.env.NodeEnvironment.assertCanWrite(NodeEnvironment.java:1059) ~[elasticsearch-5.5.2.jar:5.5.2]
	at org.elasticsearch.env.NodeEnvironment.<init>(NodeEnvironment.java:278) ~[elasticsearch-5.5.2.jar:5.5.2]
	at org.elasticsearch.node.Node.<init>(Node.java:264) ~[elasticsearch-5.5.2.jar:5.5.2]
	... 11 more
[2018-08-28T09:11:36,230][WARN ][o.e.b.ElasticsearchUncaughtExceptionHandler] [AADCWEB609D] uncaught exception in thread [main]
org.elasticsearch.bootstrap.StartupException: java.lang.IllegalStateException: Failed to create node environment
	at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:127) ~[elasticsearch-5.5.2.jar:5.5.2]
	at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:114) ~[elasticsearch-5.5.2.jar:5.5.2]
	at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:67) ~[elasticsearch-5.5.2.jar:5.5.2]
	at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:122) ~[elasticsearch-5.5.2.jar:5.5.2]
	at org.elasticsearch.cli.Command.main(Command.java:88) ~[elasticsearch-5.5.2.jar:5.5.2]
	at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:91) ~[elasticsearch-5.5.2.jar:5.5.2]
	at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:84) ~[elasticsearch-5.5.2.jar:5.5.2]
Caused by: java.lang.IllegalStateException: Failed to create node environment
	at org.elasticsearch.node.Node.<init>(Node.java:267) ~[elasticsearch-5.5.2.jar:5.5.2]
	at org.elasticsearch.node.Node.<init>(Node.java:244) ~[elasticsearch-5.5.2.jar:5.5.2]
	at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:232) ~[elasticsearch-5.5.2.jar:5.5.2]
	at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:232) ~[elasticsearch-5.5.2.jar:5.5.2]
	at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:351) ~[elasticsearch-5.5.2.jar:5.5.2]
	at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:123) ~[elasticsearch-5.5.2.jar:5.5.2]
	... 6 more
Caused by: java.io.IOException: failed to write in data directory [E:\Elasticsearch\data\nodes\0\indices\hhRngq1_QE-91vOmuIEYvw\0\_state] write permission is required
	at org.elasticsearch.env.NodeEnvironment.tryWriteTempFile(NodeEnvironment.java:1076) ~[elasticsearch-5.5.2.jar:5.5.2]
	at org.elasticsearch.env.NodeEnvironment.assertCanWrite(NodeEnvironment.java:1059) ~[elasticsearch-5.5.2.jar:5.5.2]
	at org.elasticsearch.env.NodeEnvironment.<init>(NodeEnvironment.java:278) ~[elasticsearch-5.5.2.jar:5.5.2]
	at org.elasticsearch.node.Node.<init>(Node.java:264) ~[elasticsearch-5.5.2.jar:5.5.2]
	at org.elasticsearch.node.Node.<init>(Node.java:244) ~[elasticsearch-5.5.2.jar:5.5.2]
	at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:232) ~[elasticsearch-5.5.2.jar:5.5.2]
	at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:232) ~[elasticsearch-5.5.2.jar:5.5.2]
	at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:351) ~[elasticsearch-5.5.2.jar:5.5.2]
	at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:123) ~[elasticsearch-5.5.2.jar:5.5.2]
	... 6 more

Any help or suggestions is greatly appreciated. Thank you,

Tyler

2

The service is set to log on as the local system account, which has full permissions to E:\Elasticsearch.

3

bump

4

I figured it out!

Take a look at this line:
Caused by: java.nio.file.FileAlreadyExistsException: E:\Elasticsearch\data\nodes\0\indices\hhRngq1_QE-91vOmuIEYvw\0\_state\.es_temp_file

I'm not sure what generates this file or causes it to be persistent, but after deleting .es_temp_file, everything began working normally. Maybe it wasn't destroyed automatically like it's supposed to?

In any event, I am no longer experiencing issues and the file is not staying persistent.

5

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.