# My first corrupted index

**URL:** <https://discuss.elastic.co/t/my-first-corrupted-index/22936>\
**Category:** Elasticsearch\
**Created:** [March 27, 2015, 3:10am UTC](https://discuss.elastic.co/t/my-first-corrupted-index/22936 "2015-03-27T03:10:59Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![Michael\_Dillon](https://avatars.discourse-cdn.com/v4/letter/m/ee7513/32.png) [@Michael\_Dillon](https://discuss.elastic.co/u/Michael_Dillon)\
**Post date:** [March 27, 2015, 3:10am UTC](https://discuss.elastic.co/t/my-first-corrupted-index/22936/1 "2015-03-27T03:10:59Z")

</div>

I had a disk problem on my development laptop and my ES index is only  
barely working. Before restoring a [old] snapshot and just moving forward,  
I'd like to learn if this can be recovered.

My first sign of trouble were query errors like this:

{  
"error": "NoShardAvailableActionException[[twitter\_profiles][0] null]",  
"status": 503  
}

The disk checks out OK now, but the logs below show what happens when the  
node starts up.

What's best way to proceed?

Thanks in advance!

* * *

The details are here [http://pastebin.com/BCXe87Ri](http://pastebin.com/BCXe87Ri), but the high points  
are:

[2015-03-26 20:36:55,065][INFO][node] [Glob] version[  
_1.4.2_], pid[10652], build[927caff/2014-12-16T14:11:12Z]

[2015-03-26 20:37:03,101][WARN][indices.cluster] [Glob]  
[twitter\_profiles][0] _failed to start shard_  
org.elasticsearch.index.gateway.IndexShardGatewayRecoveryException:  
[twitter\_profiles][0] failed to fetch index version after copying it over

Caused by: org.apache.lucene.index.CorruptIndexException:  
[twitter\_profiles][0] _Preexisting corrupted index_  
[corrupted\_dd6VM9dCQOeajI\_AV9COnA] caused by: CorruptIndexException[Invalid  
fieldsStream maxPointer (file truncated?): maxPointer=86078308,  
length=4294967295]  
org.apache.lucene.index.CorruptIndexException: Invalid fieldsStream  
maxPointer (file truncated?): maxPointer=86078308, length=4294967295

[2015-03-26 20:37:03,261][WARN][cluster.action.shard] [Glob]  
[twitter\_profiles][0] _sending failed shard_ for [twitter\_profiles][0],  
node[msa32a5JQHW5aojBitwEqQ], [P], s[INITIALIZING], indexUUID  
[1tNwpxI0Rl6M2yldd\_l5lw], reason [Failed to start shard, message  
[IndexShardGatewayRecoveryException[[twitter\_profiles][0] failed to fetch  
index version after copying it over]; nested:  
CorruptIndexException[[twitter\_profiles][0] Preexisting corrupted index  
[corrupted\_dd6VM9dCQOeajI\_AV9COnA] caused by: CorruptIndexException[Invalid  
fieldsStream maxPointer (file truncated?): maxPointer=86078308,  
length=4294967295]  
org.apache.lucene.index.CorruptIndexException: Invalid fieldsStream  
maxPointer (file truncated?): maxPointer=86078308, length=4294967295

[2015-03-26 20:37:03,262][WARN][cluster.action.shard] [Glob]  
[twitter\_profiles][0] _received shard failed_ for [twitter\_profiles][0],  
node[msa32a5JQHW5aojBitwEqQ], [P], s[INITIALIZING], indexUUID  
[1tNwpxI0Rl6M2yldd\_l5lw], reason [Failed to start shard, message  
[IndexShardGatewayRecoveryException[[twitter\_profiles][0] failed to fetch  
index version after copying it over]; nested:  
CorruptIndexException[[twitter\_profiles][0] Preexisting corrupted index  
[corrupted\_dd6VM9dCQOeajI\_AV9COnA] caused by: CorruptIndexException[Invalid  
fieldsStream maxPointer (file truncated?): maxPointer=86078308,  
length=4294967295]  
org.apache.lucene.index.CorruptIndexException: Invalid fieldsStream  
maxPointer (file truncated?): maxPointer=86078308, length=4294967295

[2015-03-26 20:37:03,262][INFO][gateway] [Glob] _recovered  
[2] indices into cluster\_state_  
[2015-03-26 20:37:17,612][WARN][indices.cluster] [Glob]  
[twitter\_profiles][0] _failed to start shard_  
org.elasticsearch.index.gateway.IndexShardGatewayRecoveryException:  
[twitter\_profiles][0] _failed to fetch index version after copying it over_

Caused by: org.apache.lucene.index.CorruptIndexException:  
[twitter\_profiles][0] _Preexisting corrupted index_  
[corrupted\_dd6VM9dCQOeajI\_AV9COnA] caused by: CorruptIndexException[Invalid  
fieldsStream maxPointer (file truncated?): maxPointer=86078308,  
length=4294967295]  
org.apache.lucene.index.CorruptIndexException: Invalid fieldsStream  
maxPointer (file truncated?): maxPointer=86078308, length=4294967295

[2015-03-26 20:37:17,613][WARN][cluster.action.shard] [Glob]  
[twitter\_profiles][0] _sending failed shard for_ [twitter\_profiles][0],  
node[msa32a5JQHW5aojBitwEqQ], [P], s[INITIALIZING], indexUUID  
[1tNwpxI0Rl6M2yldd\_l5lw], reason [Failed to start shard, message  
[IndexShardGatewayRecoveryException[[twitter\_profiles][0] failed to fetch  
index version after copying it over]; nested:  
CorruptIndexException[[twitter\_profiles][0] Preexisting corrupted index  
[corrupted\_dd6VM9dCQOeajI\_AV9COnA] caused by: CorruptIndexException[Invalid  
fieldsStream maxPointer (file truncated?): maxPointer=86078308,  
length=4294967295]  
org.apache.lucene.index.CorruptIndexException: Invalid fieldsStream  
maxPointer (file truncated?): maxPointer=86078308, length=4294967295

[2015-03-26 20:37:17,613][WARN][cluster.action.shard] [Glob]  
[twitter\_profiles][0] _received shard failed_ for [twitter\_profiles][0],  
node[msa32a5JQHW5aojBitwEqQ], [P], s[INITIALIZING], indexUUID  
[1tNwpxI0Rl6M2yldd\_l5lw], reason [Failed to start shard, message  
[IndexShardGatewayRecoveryException[[twitter\_profiles][0] failed to fetch  
index version after copying it over]; nested:  
CorruptIndexException[[twitter\_profiles][0] Preexisting corrupted index  
[corrupted\_dd6VM9dCQOeajI\_AV9COnA] caused by: CorruptIndexException[Invalid  
fieldsStream maxPointer (file truncated?): maxPointer=86078308,  
length=4294967295]  
org.apache.lucene.index.CorruptIndexException: Invalid fieldsStream  
maxPointer (file truncated?): maxPointer=86078308, length=4294967295

[2015-03-26 20:37:17,719][WARN][cluster.action.shard] [Glob]  
[twitter\_profiles][0] _received shard failed_ for [twitter\_profiles][0],  
node[msa32a5JQHW5aojBitwEqQ], [P], s[INITIALIZING], indexUUID  
[1tNwpxI0Rl6M2yldd\_l5lw], reason [master  
[Glob][msa32a5JQHW5aojBitwEqQ][mymachine][inet[/192.168.10.101:9300]]  
marked shard as initializing, but shard is marked as failed, resend shard  
failure]  
[2015-03-26 20:37:18,702][WARN][indices.cluster] [Glob]  
[twitter\_profiles][0] failed to start shard  
org.elasticsearch.index.gateway.IndexShardGatewayRecoveryException:  
[twitter\_profiles][0] failed to fetch index version after copying it over

Caused by: org.apache.lucene.index.CorruptIndexException:  
[twitter\_profiles][0] _Preexisting corrupted index_  
[corrupted\_dd6VM9dCQOeajI\_AV9COnA] caused by: CorruptIndexException[Invalid  
fieldsStream maxPointer (file truncated?): maxPointer=86078308,  
length=4294967295]  
org.apache.lucene.index.CorruptIndexException: Invalid fieldsStream  
maxPointer (file truncated?): maxPointer=86078308, length=4294967295

[2015-03-26 20:37:18,703][WARN][cluster.action.shard] [Glob]  
[twitter\_profiles][0] _sending failed shard_ for [twitter\_profiles][0],  
node[msa32a5JQHW5aojBitwEqQ], [P], s[INITIALIZING], indexUUID  
[1tNwpxI0Rl6M2yldd\_l5lw], reason [Failed to start shard, message  
[IndexShardGatewayRecoveryException[[twitter\_profiles][0] failed to fetch  
index version after copying it over]; nested:  
CorruptIndexException[[twitter\_profiles][0] Preexisting corrupted index  
[corrupted\_dd6VM9dCQOeajI\_AV9COnA] caused by: CorruptIndexException[Invalid  
fieldsStream maxPointer (file truncated?): maxPointer=86078308,  
length=4294967295]  
org.apache.lucene.index.CorruptIndexException: Invalid fieldsStream  
maxPointer (file truncated?): maxPointer=86078308, length=4294967295

[2015-03-26 20:37:18,703][WARN][cluster.action.shard] [Glob]  
[twitter\_profiles][0] _received shard failed_ for [twitter\_profiles][0],  
node[msa32a5JQHW5aojBitwEqQ], [P], s[INITIALIZING], indexUUID  
[1tNwpxI0Rl6M2yldd\_l5lw], reason [Failed to start shard, message  
[IndexShardGatewayRecoveryException[[twitter\_profiles][0] failed to fetch  
index version after copying it over]; nested:  
CorruptIndexException[[twitter\_profiles][0] Preexisting corrupted index  
[corrupted\_dd6VM9dCQOeajI\_AV9COnA] caused by: CorruptIndexException[Invalid  
fieldsStream maxPointer (file truncated?): maxPointer=86078308,  
length=4294967295]  
org.apache.lucene.index.CorruptIndexException: Invalid fieldsStream  
maxPointer (file truncated?): maxPointer=86078308, length=4294967295

[2015-03-26 20:37:18,947][WARN][indices.cluster] [Glob]  
[twitter\_profiles][0] _failed to start shard_  
org.elasticsearch.index.gateway.IndexShardGatewayRecoveryException:  
[twitter\_profiles][0] failed to fetch index version after copying it over

Caused by: org.apache.lucene.index.CorruptIndexException:  
[twitter\_profiles][0] _Preexisting corrupted index_  
[corrupted\_dd6VM9dCQOeajI\_AV9COnA] caused by: CorruptIndexException[Invalid  
fieldsStream maxPointer (file truncated?): maxPointer=86078308,  
length=4294967295]  
org.apache.lucene.index.CorruptIndexException: Invalid fieldsStream  
maxPointer (file truncated?): maxPointer=86078308, length=4294967295

[2015-03-26 20:37:18,948][WARN][cluster.action.shard] [Glob]  
[twitter\_profiles][0] _sending failed shard_ for [twitter\_profiles][0],  
node[msa32a5JQHW5aojBitwEqQ], [P], s[INITIALIZING], indexUUID  
[1tNwpxI0Rl6M2yldd\_l5lw], reason [Failed to start shard, message  
[IndexShardGatewayRecoveryException[[twitter\_profiles][0] failed to fetch  
index version after copying it over]; nested:  
CorruptIndexException[[twitter\_profiles][0] Preexisting corrupted index  
[corrupted\_dd6VM9dCQOeajI\_AV9COnA] caused by: CorruptIndexException[Invalid  
fieldsStream maxPointer (file truncated?): maxPointer=86078308,  
length=4294967295]  
org.apache.lucene.index.CorruptIndexException: Invalid fieldsStream  
maxPointer (file truncated?): maxPointer=86078308, length=4294967295

[2015-03-26 20:37:18,948][WARN][cluster.action.shard] [Glob]  
[twitter\_profiles][0] _received shard failed_ for [twitter\_profiles][0],  
node[msa32a5JQHW5aojBitwEqQ], [P], s[INITIALIZING], indexUUID  
[1tNwpxI0Rl6M2yldd\_l5lw], reason [Failed to start shard, message  
[IndexShardGatewayRecoveryException[[twitter\_profiles][0] failed to fetch  
index version after copying it over]; nested:  
CorruptIndexException[[twitter\_profiles][0] Preexisting corrupted index  
[corrupted\_dd6VM9dCQOeajI\_AV9COnA] caused by: CorruptIndexException[Invalid  
fieldsStream maxPointer (file truncated?): maxPointer=86078308,  
length=4294967295]  
org.apache.lucene.index.CorruptIndexException: Invalid fieldsStream  
maxPointer (file truncated?): maxPointer=86078308, length=4294967295

Thoughts?

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/755c0650-9612-4924-9b9c-d52316d99cca%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/755c0650-9612-4924-9b9c-d52316d99cca%40googlegroups.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 12:23am UTC](https://discuss.elastic.co/t/my-first-corrupted-index/22936/2 "2017-07-06T00:23:33Z")

</div>


