# Shard repeat to be UNASSIGNED **URL:** \ **Category:** Elasticsearch\ **Created:** [April 28, 2017, 7:37am UTC](https://discuss.elastic.co/t/shard-repeat-to-be-unassigned/83975 "2017-04-28T07:37:09Z")\ **Posts on this page:** 6\ **Page:** 1
**Author:** ![Yong\_Zhang](https://avatars.discourse-cdn.com/v4/letter/y/a183cd/32.png) [@Yong\_Zhang](https://discuss.elastic.co/u/Yong_Zhang)\ **Post date:** [April 28, 2017, 7:37am UTC](https://discuss.elastic.co/t/shard-repeat-to-be-unassigned/83975/1 "2017-04-28T07:37:09Z")
I have the latest index devops-2017.04.28, but cluster health will turn into red status no more than 30 minutes since there're UNASSIGNED shards in this index, then I XDELETE index devops-2017.04.28, cluster state turns into green, but after a while it will be red again because of the same issue. ES version: 5.3.0 number of client node: 3 number of master/data node: 3 here's the info I can find: GET \_cat/shards: devops-2017.04.28 1 p STARTED 856594 373.1mb 10.42.191.21 devops-esdata-1 devops-2017.04.28 1 r STARTED 856594 347.2mb 10.42.177.244 devops-esdata-0 devops-2017.04.28 2 p UNASSIGNED devops-2017.04.28 2 r UNASSIGNED devops-2017.04.28 0 p STARTED 859183 413mb 10.42.177.244 devops-esdata-0 devops-2017.04.28 0 r STARTED 859193 394mb 10.42.53.138 devops-esdata-2 GET \_cat/shards?h=index,shard,prirep,state,unassigned.reason: devops-2017.04.28 2 p UNASSIGNED ALLOCATION\_FAILED devops-2017.04.28 2 r UNASSIGNED PRIMARY\_FAILED devops-2017.04.28 1 p STARTED devops-2017.04.28 1 r STARTED devops-2017.04.28 0 p STARTED devops-2017.04.28 0 r STARTED Logs: ```auto [2017-04-28T04:33:53,695][ERROR][o.e.i.e.InternalEngine$EngineMergeScheduler] [devops-esdata-2] [devops-2017.04.28][0] failed to merge org.apache.lucene.index.CorruptIndexException: codec footer mismatch (file truncated?): actual footer=16777217 vs expected footer=-1071082520 (resource=BufferedChecksumIndexInput(MMapIndexInput(path="/data/data/nodes/0/indices/BRiSyoI1SYiR74D8xaB11g/0/index/_u3_Lucene50_0.pos"))) at org.apache.lucene.codecs.CodecUtil.validateFooter(CodecUtil.java:499) ~[lucene-core-6.4.1.jar:6.4.1 72f75b2503fa0aa4f0aff76d439874feb923bb0e - jpountz - 2017-02-01 14:43:32] at org.apache.lucene.codecs.CodecUtil.checkFooter(CodecUtil.java:411) ~[lucene-core-6.4.1.jar:6.4.1 72f75b2503fa0aa4f0aff76d439874feb923bb0e - jpountz - 2017-02-01 14:43:32] at org.apache.lucene.codecs.lucene50.Lucene50CompoundFormat.write(Lucene50CompoundFormat.java:103) ~[lucene-core-6.4.1.jar:6.4.1 72f75b2503fa0aa4f0aff76d439874feb923bb0e - jpountz - 2017-02-01 14:43:32] at org.apache.lucene.index.IndexWriter.createCompoundFile(IndexWriter.java:4924) ~[lucene-core-6.4.1.jar:6.4.1 72f75b2503fa0aa4f0aff76d439874feb923bb0e - jpountz - 2017-02-01 14:43:32] at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4400) ~[lucene-core-6.4.1.jar:6.4.1 72f75b2503fa0aa4f0aff76d439874feb923bb0e - jpountz - 2017-02-01 14:43:32] at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3920) ~[lucene-core-6.4.1.jar:6.4.1 72f75b2503fa0aa4f0aff76d439874feb923bb0e - jpountz - 2017-02-01 14:43:32] at org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:588) ~[lucene-core-6.4.1.jar:6.4.1 72f75b2503fa0aa4f0aff76d439874feb923bb0e - jpountz - 2017-02-01 14:43:32] at org.elasticsearch.index.engine.ElasticsearchConcurrentMergeScheduler.doMerge(ElasticsearchConcurrentMergeScheduler.java:99) ~[elasticsearch-5.3.0.jar:5.3.0] at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:626) [lucene-core-6.4.1.jar:6.4.1 72f75b2503fa0aa4f0aff76d439874feb923bb0e - jpountz - 2017-02-01 14:43:32] [2017-04-28T04:33:53,764][WARN][o.e.i.c.IndicesClusterStateService] [devops-esdata-2] [[devops-2017.04.28][0]] marking and sending shard failed due to [shard failure, reason [merge failed]] org.apache.lucene.index.MergePolicy$MergeException: org.apache.lucene.index.CorruptIndexException: codec footer mismatch (file truncated?): actual footer=16777217 vs expected footer=-1071082520 (resource=BufferedChecksumIndexInput(MMapIndexInput(path="/data/data/nodes/0/indices/BRiSyoI1SYiR74D8xaB11g/0/index/_u3_Lucene50_0.pos"))) at org.elasticsearch.index.engine.InternalEngine$EngineMergeScheduler$2.doRun(InternalEngine.java:1340) ~[elasticsearch-5.3.0.jar:5.3.0] at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:613) ~[elasticsearch-5.3.0.jar:5.3.0] at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-5.3.0.jar:5.3.0] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_121] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_121] at java.lang.Thread.run(Thread.java:745) [?:1.8.0_121] Caused by: org.apache.lucene.index.CorruptIndexException: codec footer mismatch (file truncated?): actual footer=16777217 vs expected footer=-1071082520 (resource=BufferedChecksumIndexInput(MMapIndexInput(path="/data/data/nodes/0/indices/BRiSyoI1SYiR74D8xaB11g/0/index/_u3_Lucene50_0.pos"))) at org.apache.lucene.codecs.CodecUtil.validateFooter(CodecUtil.java:499) ~[lucene-core-6.4.1.jar:6.4.1 72f75b2503fa0aa4f0aff76d439874feb923bb0e - jpountz - 2017-02-01 14:43:32] at org.apache.lucene.codecs.CodecUtil.checkFooter(CodecUtil.java:411) ~[lucene-core-6.4.1.jar:6.4.1 72f75b2503fa0aa4f0aff76d439874feb923bb0e - jpountz - 2017-02-01 14:43:32] at org.apache.lucene.codecs.lucene50.Lucene50CompoundFormat.write(Lucene50CompoundFormat.java:103) ~[lucene-core-6.4.1.jar:6.4.1 72f75b2503fa0aa4f0aff76d439874feb923bb0e - jpountz - 2017-02-01 14:43:32] at org.apache.lucene.index.IndexWriter.createCompoundFile(IndexWriter.java:4924) ~[lucene-core-6.4.1.jar:6.4.1 72f75b2503fa0aa4f0aff76d439874feb923bb0e - jpountz - 2017-02-01 14:43:32] at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4400) ~[lucene-core-6.4.1.jar:6.4.1 72f75b2503fa0aa4f0aff76d439874feb923bb0e - jpountz - 2017-02-01 14:43:32] at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3920) ~[lucene-core-6.4.1.jar:6.4.1 72f75b2503fa0aa4f0aff76d439874feb923bb0e - jpountz - 2017-02-01 14:43:32] at org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:588) ~[lucene-core-6.4.1.jar:6.4.1 72f75b2503fa0aa4f0aff76d439874feb923bb0e - jpountz - 2017-02-01 14:43:32] at org.elasticsearch.index.engine.ElasticsearchConcurrentMergeScheduler.doMerge(ElasticsearchConcurrentMergeScheduler.java:99) ~[elasticsearch-5.3.0.jar:5.3.0] at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:626) ~[lucene-core-6.4.1.jar:6.4.1 72f75b2503fa0aa4f0aff76d439874feb923bb0e - jpountz - 2017-02-01 14:43:32] ``` Thanks for the help. ---
**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Post date:** [April 28, 2017, 7:50am UTC](https://discuss.elastic.co/t/shard-repeat-to-be-unassigned/83975/2 "2017-04-28T07:50:43Z")
What version are you on? ---
**Author:** ![Yong\_Zhang](https://avatars.discourse-cdn.com/v4/letter/y/a183cd/32.png) [@Yong\_Zhang](https://discuss.elastic.co/u/Yong_Zhang)\ **Post date:** [April 28, 2017, 7:52am UTC](https://discuss.elastic.co/t/shard-repeat-to-be-unassigned/83975/3 "2017-04-28T07:52:49Z")
elasticsearch 5.3.0 ---
**Author:** ![Yong\_Zhang](https://avatars.discourse-cdn.com/v4/letter/y/a183cd/32.png) [@Yong\_Zhang](https://discuss.elastic.co/u/Yong_Zhang)\ **Post date:** [May 2, 2017, 1:55am UTC](https://discuss.elastic.co/t/shard-repeat-to-be-unassigned/83975/4 "2017-05-02T01:55:59Z")
POST \_cluster/reroute ··· "details": """shard failure, reason [refresh failed], failure CorruptIndexException[codec footer mismatch (file truncated?): actual footer=50536199 vs expected footer=-1071082520 (resource=BufferedChecksumIndexInput(MMapIndexInput(path="/data/data/nodes/0/indices/bxCxWKeeTJmEVq55Kam7lQ/1/index/\_lh6\_Lucene50\_0.doc")))]""", ··· ---
**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\ **Post date:** [May 2, 2017, 4:45am UTC](https://discuss.elastic.co/t/shard-repeat-to-be-unassigned/83975/5 "2017-05-02T04:45:21Z")
Is this on the cluster you mentioned is running glusterFS in [this other post](https://discuss.elastic.co/t/elasticsearch-index-health-turned-red/83805/9)? ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [May 30, 2017, 4:52am UTC](https://discuss.elastic.co/t/shard-repeat-to-be-unassigned/83975/6 "2017-05-30T04:52:05Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.