# What does this error mean, and would it cause a data node to crash

**URL:** <https://discuss.elastic.co/t/what-does-this-error-mean-and-would-it-cause-a-data-node-to-crash/263173>\
**Category:** Elasticsearch\
**Created:** [February 3, 2021, 10:17pm UTC](https://discuss.elastic.co/t/what-does-this-error-mean-and-would-it-cause-a-data-node-to-crash/263173 "2021-02-03T22:17:41Z")\
**Posts on this page:** 9\
**Page:** 1

<div class="post-metadata">

**Author:** ![cis4life](https://avatars.discourse-cdn.com/v4/letter/c/82dd89/32.png) [@cis4life](https://discuss.elastic.co/u/cis4life)\
**Post date:** [February 3, 2021, 10:17pm UTC](https://discuss.elastic.co/t/what-does-this-error-mean-and-would-it-cause-a-data-node-to-crash/263173/1 "2021-02-03T22:17:41Z")

</div>

I have a cluster on ES 5.x and suddenly some of the data nodes simply crash randomly. I see this error and want to know what it is and is this something I'm overlooking to fix it??? Any insight would be GREATLY appreciated.

elasticsearch.service - Elasticsearch  
Loaded: loaded (/usr/lib/systemd/system/elasticsearch.service; enabled; vendor preset: enabled)  
Active: failed (Result: exit-code) since Tue 2021-02-02 17:41:29 EST; 15h ago  
Docs: [http://www.elastic.co](http://www.elastic.co)  
Process: 1108 ExecStart=/usr/share/elasticsearch/bin/elasticsearch -p {PID\_DIR}/elasticsearch.pid --quiet -Edefault.path.logs={LOG\_D  
Process: 1069 ExecStartPre=/usr/share/elasticsearch/bin/elasticsearch-systemd-pre-exec (code=exited, status=0/SUCCESS)  
Main PID: 1108 (code=exited, status=127)

Feb 02 11:26:57 ITSSD5ESDN04 elasticsearch[1108]: 2021-02-02 11:26:57,863 main ERROR Null object returned for RollingFile in Appenders.  
Feb 02 11:26:57 ITSSD5ESDN04 elasticsearch[1108]: 2021-02-02 11:26:57,863 main ERROR Null object returned for RollingFile in Appenders.  
Feb 02 11:26:57 ITSSD5ESDN04 elasticsearch[1108]: 2021-02-02 11:26:57,864 main ERROR Null object returned for RollingFile in Appenders.  
Feb 02 11:26:57 ITSSD5ESDN04 elasticsearch[1108]: 2021-02-02 11:26:57,864 main ERROR Unable to locate appender "rolling" for logger conf  
Feb 02 11:26:57 ITSSD5ESDN04 elasticsearch[1108]: 2021-02-02 11:26:57,864 main ERROR Unable to locate appender "index\_indexing\_slowlog\_r  
Feb 02 11:26:57 ITSSD5ESDN04 elasticsearch[1108]: 2021-02-02 11:26:57,864 main ERROR Unable to locate appender "index\_search\_slowlog\_rol  
Feb 02 11:26:57 ITSSD5ESDN04 elasticsearch[1108]: 2021-02-02 11:26:57,864 main ERROR Unable to locate appender "deprecation\_rolling" for  
Feb 02 17:41:29 ITSSD5ESDN04 systemd[1]: elasticsearch.service: Main process exited, code=exited, status=127/n/a  
Feb 02 17:41:29 ITSSD5ESDN04 systemd[1]: elasticsearch.service: Unit entered failed state.  
Feb 02 17:41:29 ITSSD5ESDN04 systemd[1]: elasticsearch.service: Failed with result 'exit-code'.

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [February 4, 2021, 4:18am UTC](https://discuss.elastic.co/t/what-does-this-error-mean-and-would-it-cause-a-data-node-to-crash/263173/2 "2021-02-04T04:18:54Z")

</div>

> [@cis4life](#):
>
> I have a cluster on ES 5.x

That's [EOL](https://www.elastic.co/support/eol), you should upgrade as a matter of urgency. Latest versions are 6.8 and 7.10.

Is there more in your Elasticsearch log file?

---

<div class="post-metadata">

**Author:** ![cis4life](https://avatars.discourse-cdn.com/v4/letter/c/82dd89/32.png) [@cis4life](https://discuss.elastic.co/u/cis4life)\
**Post date:** [February 4, 2021, 4:23pm UTC](https://discuss.elastic.co/t/what-does-this-error-mean-and-would-it-cause-a-data-node-to-crash/263173/3 "2021-02-04T16:23:08Z")

</div>

Yeah, we plan to, but i need to fix this now. Just trying to figure out whats causing the Datanode crashing now so i can upgrade.

---

<div class="post-metadata">

**Author:** ![cis4life](https://avatars.discourse-cdn.com/v4/letter/c/82dd89/32.png) [@cis4life](https://discuss.elastic.co/u/cis4life)\
**Post date:** [February 4, 2021, 5:14pm UTC](https://discuss.elastic.co/t/what-does-this-error-mean-and-would-it-cause-a-data-node-to-crash/263173/4 "2021-02-04T17:14:08Z")

</div>

Also,  
Where exactly would that log file reside?  
Thanks

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [February 5, 2021, 12:01am UTC](https://discuss.elastic.co/t/what-does-this-error-mean-and-would-it-cause-a-data-node-to-crash/263173/5 "2021-02-05T00:01:37Z")

</div>

Depends how you installed it, but usually `/var/log/elasticsearch`.

---

<div class="post-metadata">

**Author:** ![cis4life](https://avatars.discourse-cdn.com/v4/letter/c/82dd89/32.png) [@cis4life](https://discuss.elastic.co/u/cis4life)\
**Post date:** [February 5, 2021, 3:32pm UTC](https://discuss.elastic.co/t/what-does-this-error-mean-and-would-it-cause-a-data-node-to-crash/263173/6 "2021-02-05T15:32:26Z")

</div>

Good Day,

I check that directory and I'm not seeing any files / log files at all there, is there a place I can check to make sure logging is running and to where?

---

<div class="post-metadata">

**Author:** ![cis4life](https://avatars.discourse-cdn.com/v4/letter/c/82dd89/32.png) [@cis4life](https://discuss.elastic.co/u/cis4life)\
**Post date:** [February 5, 2021, 3:57pm UTC](https://discuss.elastic.co/t/what-does-this-error-mean-and-would-it-cause-a-data-node-to-crash/263173/7 "2021-02-05T15:57:13Z")

</div>

I think i found the directory i have my log files in the elastic yml file. But im not seeing any log files there either. So do i need to do something to set the permissions to the custom directory?

also,  
I have my data nodes with 64gb of ram and i have the jvm memory set for a little than less than half of that... 29g.  
Im experiencing data node crashes, should set / uncomment the config line... bootstrap.memory\_lock: true

thanks,

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [February 8, 2021, 4:45am UTC](https://discuss.elastic.co/t/what-does-this-error-mean-and-would-it-cause-a-data-node-to-crash/263173/8 "2021-02-08T04:45:21Z")

</div>

If Elasticsearch cannot log then it won't start. There's nothing in that specified log path?

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [March 8, 2021, 4:45am UTC](https://discuss.elastic.co/t/what-does-this-error-mean-and-would-it-cause-a-data-node-to-crash/263173/9 "2021-03-08T04:45:29Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
