# Elasticsearch Crash on Start up

**URL:** https://discuss.elastic.co/t/elasticsearch-crash-on-start-up/79614
**Category:** Elasticsearch
**Created:** [March 22, 2017, 3:57pm UTC](https://discuss.elastic.co/t/elasticsearch-crash-on-start-up/79614 "2017-03-22T15:57:08Z")
**Posts on this page:** 4
**Page:** 1

<div class="post-metadata">

### Author: ![jaliph](https://avatars.discourse-cdn.com/v4/letter/j/7cd45c/32.png) [@jaliph](https://discuss.elastic.co/u/jaliph)
#### Post date: [March 22, 2017, 3:57pm UTC](https://discuss.elastic.co/t/elasticsearch-crash-on-start-up/79614/1 "2017-03-22T15:57:08Z")

</div>

Hi,

This is Production system with around 2.5 TB of Data.

Elasticsearch version is 5.0.2.

The Server has rebooted somehow and we are still doing an RCA on that.  
Elasticsearch is not coming up.

Please suggest the needful.

[2017-03-22T21:14:15,666][INFO][o.e.n.Node] [node-rpt1] initializing ...  
[2017-03-22T21:14:15,793][INFO][o.e.e.NodeEnvironment] [node-rpt1] using [2] data paths, mounts [[/newdata1 (/dev/mapper/newdata1), /data1 (/dev/mapper/data2)]], net usable\_space [4.9tb], net total\_space [9.3tb], spins? [possibly], types [ext4, ext3]  
[2017-03-22T21:14:15,794][INFO][o.e.e.NodeEnvironment] [node-rpt1] heap size [30.8gb], compressed ordinary object pointers [true]  
[2017-03-22T21:14:16,643][INFO][o.e.n.Node] [node-rpt1] version[5.0.0], pid[28829], build[253032b/2016-10-26T04:37:51.531Z], OS[Linux/2.6.32-220.el6.x86\_64/amd64], JVM[Oracle Corporation/Java HotSpot(TM) 64-Bit Server VM/1.8.0\_101/25.101-b13]  
[2017-03-22T21:14:17,538][INFO][o.e.p.PluginsService] [node-rpt1] loaded module [aggs-matrix-stats]  
[2017-03-22T21:14:17,539][INFO][o.e.p.PluginsService] [node-rpt1] loaded module [ingest-common]  
[2017-03-22T21:14:17,539][INFO][o.e.p.PluginsService] [node-rpt1] loaded module [lang-expression]  
[2017-03-22T21:14:17,539][INFO][o.e.p.PluginsService] [node-rpt1] loaded module [lang-groovy]  
[2017-03-22T21:14:17,539][INFO][o.e.p.PluginsService] [node-rpt1] loaded module [lang-mustache]  
[2017-03-22T21:14:17,539][INFO][o.e.p.PluginsService] [node-rpt1] loaded module [lang-painless]  
[2017-03-22T21:14:17,539][INFO][o.e.p.PluginsService] [node-rpt1] loaded module [percolator]  
[2017-03-22T21:14:17,539][INFO][o.e.p.PluginsService] [node-rpt1] loaded module [reindex]  
[2017-03-22T21:14:17,539][INFO][o.e.p.PluginsService] [node-rpt1] loaded module [transport-netty3]  
[2017-03-22T21:14:17,539][INFO][o.e.p.PluginsService] [node-rpt1] loaded module [transport-netty4]  
[2017-03-22T21:14:17,540][INFO][o.e.p.PluginsService] [node-rpt1] no plugins loaded  
[2017-03-22T21:14:19,976][WARN][o.e.c.u.IndexFolderUpgrader] [/data1/esdata/nodes/0/indices/ctVB6IYsSAKjCTAhY28p4A] no index state found - ignoring  
[2017-03-22T21:14:19,988][ERROR][o.e.g.GatewayMetaState] [node-rpt1] failed to read local state, exiting...  
org.elasticsearch.ElasticsearchException: java.io.IOException: failed to read [id:11, legacy:false, file:/data1/esdata/nodes/0/indices/Gy6M6ijSSwqyZO15jl7RmQ/\_state/state-11.st]  
at org.elasticsearch.ExceptionsHelper.maybeThrowRuntimeAndSuppress(ExceptionsHelper.java:150) ~[elasticsearch-5.0.0.jar:5.0.0]  
at org.elasticsearch.gateway.MetaDataStateFormat.loadLatestState(MetaDataStateFormat.java:333) ~[elasticsearch-5.0.0.jar:5.0.0]  
at org.elasticsearch.common.util.IndexFolderUpgrader.upgrade(IndexFolderUpgrader.java:89) ~[elasticsearch-5.0.0.jar:5.0.0]  
at org.elasticsearch.common.util.IndexFolderUpgrader.upgradeIndicesIfNeeded(IndexFolderUpgrader.java:127) ~[elasticsearch-5.0.0.jar:5.0.0]  
at org.elasticsearch.gateway.GatewayMetaState.(GatewayMetaState.java:89) [elasticsearch-5.0.0.jar:5.0.0]  
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) ~[?:?]  
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) [?:1.8.0\_101]  
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) [?:1.8.0\_101]  
at java.lang.reflect.Constructor.newInstance(Constructor.java:423) [?:1.8.0\_101]  
at org.elasticsearch.common.inject.DefaultConstructionProxyFactory$1.newInstance(DefaultConstructionProxyFactory.java:49) [elasticsearch-5.0.0.jar:5.0.0]  
at org.elasticsearch.common.inject.ConstructorInjector.construct(ConstructorInjector.java:86) [elasticsearch-5.0.0.jar:5.0.0]  
at org.elasticsearch.common.inject.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:116) [elasticsearch-5.0.0.jar:5.0.0]  
at org.elasticsearch.common.inject.ProviderToInternalFactoryAdapter$1.call(ProviderToInternalFactoryAdapter.java:47) [elasticsearch-5.0.0.jar:5.0.0]  
at org.elasticsearch.common.inject.InjectorImpl.callInContext(InjectorImpl.java:825) [elasticsearch-5.0.0.jar:5.0.0]  
at org.elasticsearch.common.inject.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:43) [elasticsearch-5.0.0.jar:5.0.0]  
at org.elasticsearch.common.inject.Scopes$1$1.get(Scopes.java:59) [elasticsearch-5.0.0.jar:5.0.0]  
at org.elasticsearch.common.inject.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:50) [elasticsearch-5.0.0.jar:5.0.0]  
at org.elasticsearch.common.inject.SingleParameterInjector.inject(SingleParameterInjector.java:42) [elasticsearch-5.0.0.jar:5.0.0]  
at org.elasticsearch.common.inject.SingleParameterInjector.getAll(SingleParameterInjector.java:66) [elasticsearch-5.0.0.jar:5.0.0]  
at org.elasticsearch.common.inject.ConstructorInjector.construct(ConstructorInjector.java:85) [elasticsearch-5.0.0.jar:5.0.0]  
at org.elasticsearch.common.inject.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:116) [elasticsearch-5.0.0.jar:5.0.0]  
at org.elasticsearch.common.inject.ProviderToInternalFactoryAdapter$1.call(ProviderToInternalFactoryAdapter.java:47) [elasticsearch-5.0.0.jar:5.0.0]  
at org.elasticsearch.common.inject.InjectorImpl.callInContext(InjectorImpl.java:825) [elasticsearch-5.0.0.jar:5.0.0]  
at org.elasticsearch.common.inject.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:43) [elasticsearch-5.0.0.jar:5.0.0]  
at org.elasticsearch.common.inject.Scopes$1$1.get(Scopes.java:59) [elasticsearch-5.0.0.jar:5.0.0]  
at org.elasticsearch.common.inject.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:50) [elasticsearch-5.0.0.jar:5.0.0]  
at org.elasticsearch.common.inject.InjectorBuilder$1.call(InjectorBuilder.java:191) [elasticsearch-5.0.0.jar:5.0.0]  
at org.elasticsearch.common.inject.InjectorBuilder$1.call(InjectorBuilder.java:183) [elasticsearch-5.0.0.jar:5.0.0]

---

<div class="post-metadata">

### Author: ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)
#### Post date: [March 23, 2017, 2:40am UTC](https://discuss.elastic.co/t/elasticsearch-crash-on-start-up/79614/2 "2017-03-23T02:40:33Z")

</div>

> [@jaliph](#):
>
> /data1/esdata/nodes/0/indices/Gy6M6ijSSwqyZO15jl7RmQ/\_state/state-11.st

Does that path exist?

---

<div class="post-metadata">

### Author: ![jaliph](https://avatars.discourse-cdn.com/v4/letter/j/7cd45c/32.png) [@jaliph](https://discuss.elastic.co/u/jaliph)
#### Post date: [March 23, 2017, 7:55am UTC](https://discuss.elastic.co/t/elasticsearch-crash-on-start-up/79614/3 "2017-03-23T07:55:10Z")

</div>

Yes.. This file exists and it is empty file. We have checked the partition. Seems fine.

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [April 20, 2017, 7:55am UTC](https://discuss.elastic.co/t/elasticsearch-crash-on-start-up/79614/4 "2017-04-20T07:55:14Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
