# Shards getting closed on Indexing Data **URL:** \ **Category:** Elasticsearch\ **Created:** [August 9, 2013, 5:26am UTC](https://discuss.elastic.co/t/shards-getting-closed-on-indexing-data/13141 "2013-08-09T05:26:01Z")\ **Posts on this page:** 7\ **Page:** 1
**Author:** ![narinder\_izap](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/narinder_izap/32/803_2.png) [@narinder\_izap](https://discuss.elastic.co/u/narinder_izap)\ **Post date:** [August 9, 2013, 5:26am UTC](https://discuss.elastic.co/t/shards-getting-closed-on-indexing-data/13141/1 "2013-08-09T05:26:01Z")
Hi, ``` I am using version 0.90.3 of elasticsearch. I am trying to index the ``` data. This index is not via bulk api. I am pushing one by one documents into the index. And then it closes one of my index's shard. I found the following Log _[2013-08-09 09:07:55,395][INFO][node] [Goldbug] version[0.90.3], pid[4299], build[5c38d60/2013-08-06T13:18:31Z]_ _[2013-08-09 09:07:55,396][INFO][node] [Goldbug] initializing ..._ _[2013-08-09 09:07:55,415][INFO][plugins] [Goldbug] loaded [], sites []_ _[2013-08-09 09:08:07,234][INFO][node] [Goldbug] initialized_ _[2013-08-09 09:08:07,234][INFO][node] [Goldbug] starting ..._ _[2013-08-09 09:08:07,656][INFO][transport] [Goldbug] bound\_address {inet[/0:0:0:0:0:0:0:0:9300]}, publish\_address {inet[/192.168.1.105:9300]}_ _[2013-08-09 09:08:11,122][INFO][cluster.service] [Goldbug] new\_master [Goldbug][MQ3oITPKRPWPM4pIeRzHpQ][inet[/192.168.1.105:9300]], reason: zen-disco-join (elected\_as\_master)_ _[2013-08-09 09:08:11,178][INFO][discovery] [Goldbug] elasticsearch/MQ3oITPKRPWPM4pIeRzHpQ_ _[2013-08-09 09:08:11,278][INFO][http] [Goldbug] bound\_address {inet[/0:0:0:0:0:0:0:0:9200]}, publish\_address {inet[/192.168.1.105:9200]}_ _[2013-08-09 09:08:11,278][INFO][node] [Goldbug] started_ _[2013-08-09 09:08:16,320][INFO][gateway] [Goldbug] recovered [4] indices into cluster\_state_ _[2013-08-09 10:45:28,746][WARN][index.merge.scheduler] [Goldbug] [es\_requests\_2][0] failed to merge_ _java.lang.ArrayIndexOutOfBoundsException: 612_ - at org.apache.lucene.codecs.lucene40.BitVector.get(BitVector.java:146)\* - at org.apache.lucene.index.MergeState$DocMap$1.get(MergeState.java:86)\* - at org.apache.lucene.codecs.MappingMultiDocsAndPositionsEnum.nextDoc(MappingMultiDocsAndPositionsEnum.java:107) - - at org.apache.lucene.codecs.PostingsConsumer.merge(PostingsConsumer.java:109)\* - at org.apache.lucene.codecs.TermsConsumer.merge(TermsConsumer.java:164)\* - at org.apache.lucene.codecs.FieldsConsumer.merge(FieldsConsumer.java:72)\* - at org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:365)\* - at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:98)\* - at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:3772)\* - at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3376)\* - at org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:405) - - at org.apache.lucene.index.TrackingConcurrentMergeScheduler.doMerge(TrackingConcurrentMergeScheduler.java:91) - - at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:482) - _[2013-08-09 10:45:28,807][WARN][index.engine.robin] [Goldbug] [es\_requests\_2][0] failed engine_ _org.apache.lucene.index.MergePolicy$MergeException: java.lang.ArrayIndexOutOfBoundsException: 612_ - at org.elasticsearch.index.merge.scheduler.ConcurrentMergeSchedulerProvider$CustomConcurrentMergeScheduler.handleMergeException(ConcurrentMergeSchedulerProvider.java:99) - - at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:518) - _Caused by: java.lang.ArrayIndexOutOfBoundsException: 612_ - at org.apache.lucene.codecs.lucene40.BitVector.get(BitVector.java:146)\* - at org.apache.lucene.index.MergeState$DocMap$1.get(MergeState.java:86)\* - at org.apache.lucene.codecs.MappingMultiDocsAndPositionsEnum.nextDoc(MappingMultiDocsAndPositionsEnum.java:107) - - at org.apache.lucene.codecs.PostingsConsumer.merge(PostingsConsumer.java:109)\* - at org.apache.lucene.codecs.TermsConsumer.merge(TermsConsumer.java:164)\* - at org.apache.lucene.codecs.FieldsConsumer.merge(FieldsConsumer.java:72)\* - at org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:365)\* - at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:98)\* - at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:3772)\* - at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3376)\* - at org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:405) - - at org.apache.lucene.index.TrackingConcurrentMergeScheduler.doMerge(TrackingConcurrentMergeScheduler.java:91) - - at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:482) - _[2013-08-09 10:45:28,918][WARN][cluster.action.shard] [Goldbug] sending failed shard for [es\_requests\_2][0], node[MQ3oITPKRPWPM4pIeRzHpQ], [P], s[STARTED], reason [engine failure, message [MergeException[java.lang.ArrayIndexOutOfBoundsException: 612]; nested: ArrayIndexOutOfBoundsException[612]; ]]_ _[2013-08-09 10:45:28,918][WARN][cluster.action.shard] [Goldbug] received shard failed for [es\_requests\_2][0], node[MQ3oITPKRPWPM4pIeRzHpQ], [P], s[STARTED], reason [engine failure, message [MergeException[java.lang.ArrayIndexOutOfBoundsException: 612]; nested: ArrayIndexOutOfBoundsException[612]; ]]_ \* \* I am facing such situation since I moved to version 0.9 . and I used to push data in the similar way. but never faced shard close till I was with version 0.20.\* . This creating a lot of problem, I am trying to find, if I am making some data in wrong format. but not able to find. Is it Elasticsearch's bug or My bug. Please help me to understand it. Thanks Narinder Kaur -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![Ivan](https://avatars.discourse-cdn.com/v4/letter/i/df788c/32.png) [@Ivan](https://discuss.elastic.co/u/Ivan)\ **Post date:** [August 9, 2013, 11:36pm UTC](https://discuss.elastic.co/t/shards-getting-closed-on-indexing-data/13141/2 "2013-08-09T23:36:17Z")
How are you indexing data? Via REST or the Java API? If you are using the Java API, have you updated the client as well? What are your refresh settings? If you provide more information besides the error itself, perhaps someone on the list can help you. -- Ivan On Thu, Aug 8, 2013 at 10:26 PM, Narinder Kaur [narinder.kaur@izap.in](mailto:narinder.kaur@izap.in)wrote: > Hi, > > ``` > I am using version 0.90.3 of elasticsearch. I am trying to index the > > ``` > > data. This index is not via bulk api. I am pushing one by one documents > into the index. And then it closes one of my index's shard. I found the > following Log > > _[2013-08-09 09:07:55,395][INFO][node] [Goldbug] > version[0.90.3], pid[4299], build[5c38d60/2013-08-06T13:18:31Z]_ > _[2013-08-09 09:07:55,396][INFO][node] [Goldbug] > initializing ..._ > _[2013-08-09 09:07:55,415][INFO][plugins] [Goldbug] > loaded [], sites []_ > _[2013-08-09 09:08:07,234][INFO][node] [Goldbug] > initialized_ > _[2013-08-09 09:08:07,234][INFO][node] [Goldbug] > starting ..._ > _[2013-08-09 09:08:07,656][INFO][transport] [Goldbug] > bound\_address {inet[/0:0:0:0:0:0:0:0:9300]}, publish\_address {inet[/ > 192.168.1.105:9300]}_ > _[2013-08-09 09:08:11,122][INFO][cluster.service] [Goldbug] > new\_master [Goldbug][MQ3oITPKRPWPM4pIeRzHpQ][inet[/192.168.1.105:9300]], > reason: zen-disco-join (elected\_as\_master)_ > _[2013-08-09 09:08:11,178][INFO][discovery] [Goldbug] > elasticsearch/MQ3oITPKRPWPM4pIeRzHpQ_ > _[2013-08-09 09:08:11,278][INFO][http] [Goldbug] > bound\_address {inet[/0:0:0:0:0:0:0:0:9200]}, publish\_address {inet[/ > 192.168.1.105:9200]}_ > _[2013-08-09 09:08:11,278][INFO][node] [Goldbug] > started_ > _[2013-08-09 09:08:16,320][INFO][gateway] [Goldbug] > recovered [4] indices into cluster\_state_ > _[2013-08-09 10:45:28,746][WARN][index.merge.scheduler] [Goldbug] > [es\_requests\_2][0] failed to merge_ > _java.lang.ArrayIndexOutOfBoundsException: 612_ > > - at org.apache.lucene.codecs.lucene40.BitVector.get(BitVector.java:146)\* > - at org.apache.lucene.index.MergeState$DocMap$1.get(MergeState.java:86)\* > - at > org.apache.lucene.codecs.MappingMultiDocsAndPositionsEnum.nextDoc(MappingMultiDocsAndPositionsEnum.java:107) > - > - at > org.apache.lucene.codecs.PostingsConsumer.merge(PostingsConsumer.java:109) > - > - at org.apache.lucene.codecs.TermsConsumer.merge(TermsConsumer.java:164)\* > - at org.apache.lucene.codecs.FieldsConsumer.merge(FieldsConsumer.java:72) > - > - at > org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:365)\* > - at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:98)\* > - at > org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:3772)\* > - at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3376)\* > - at > org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:405) > - > - at > org.apache.lucene.index.TrackingConcurrentMergeScheduler.doMerge(TrackingConcurrentMergeScheduler.java:91) > - > - at > org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:482) > - > > _[2013-08-09 10:45:28,807][WARN][index.engine.robin] [Goldbug] > [es\_requests\_2][0] failed engine_ > _org.apache.lucene.index.MergePolicy$MergeException: > java.lang.ArrayIndexOutOfBoundsException: 612_ > > - at > org.elasticsearch.index.merge.scheduler.ConcurrentMergeSchedulerProvider$CustomConcurrentMergeScheduler.handleMergeException(ConcurrentMergeSchedulerProvider.java:99) > - > - at > org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:518) > - > > _Caused by: java.lang.ArrayIndexOutOfBoundsException: 612_ > > - at org.apache.lucene.codecs.lucene40.BitVector.get(BitVector.java:146)\* > - at org.apache.lucene.index.MergeState$DocMap$1.get(MergeState.java:86)\* > - at > org.apache.lucene.codecs.MappingMultiDocsAndPositionsEnum.nextDoc(MappingMultiDocsAndPositionsEnum.java:107) > - > - at > org.apache.lucene.codecs.PostingsConsumer.merge(PostingsConsumer.java:109) > - > - at org.apache.lucene.codecs.TermsConsumer.merge(TermsConsumer.java:164)\* > - at org.apache.lucene.codecs.FieldsConsumer.merge(FieldsConsumer.java:72) > - > - at > org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:365)\* > - at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:98)\* > - at > org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:3772)\* > - at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3376)\* > - at > org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:405) > - > - at > org.apache.lucene.index.TrackingConcurrentMergeScheduler.doMerge(TrackingConcurrentMergeScheduler.java:91) > - > - at > org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:482) > - > > _[2013-08-09 10:45:28,918][WARN][cluster.action.shard] [Goldbug] > sending failed shard for [es\_requests\_2][0], node[MQ3oITPKRPWPM4pIeRzHpQ], > [P], s[STARTED], reason [engine failure, message > [MergeException[java.lang.ArrayIndexOutOfBoundsException: 612]; nested: > ArrayIndexOutOfBoundsException[612]; ]]_ > _[2013-08-09 10:45:28,918][WARN][cluster.action.shard] [Goldbug] > received shard failed for [es\_requests\_2][0], node[MQ3oITPKRPWPM4pIeRzHpQ], > [P], s[STARTED], reason [engine failure, message > [MergeException[java.lang.ArrayIndexOutOfBoundsException: 612]; nested: > ArrayIndexOutOfBoundsException[612]; ]]_ > \* > \* > I am facing such situation since I moved to version 0.9 . and I used to > push data in the similar way. but never faced shard close till I was with > version 0.20.\* . This creating a lot of problem, I am trying to find, if I > am making some data in wrong format. but not able to find. Is it > Elasticsearch's bug or My bug. Please help me to understand it. > > Thanks > Narinder Kaur > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![narinder\_izap](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/narinder_izap/32/803_2.png) [@narinder\_izap](https://discuss.elastic.co/u/narinder_izap)\ **Post date:** [August 10, 2013, 8:19am UTC](https://discuss.elastic.co/t/shards-getting-closed-on-indexing-data/13141/3 "2013-08-10T08:19:40Z")
I am using REST Api, and refresh settings are defaults. But I am calling refresh api after every new document index. On Saturday, 10 August 2013 05:06:17 UTC+5:30, Ivan Brusic wrote: > How are you indexing data? Via REST or the Java API? If you are using the > Java API, have you updated the client as well? What are your refresh > settings? If you provide more information besides the error itself, perhaps > someone on the list can help you. > > -- > Ivan > > On Thu, Aug 8, 2013 at 10:26 PM, Narinder Kaur \ > > > wrote: > > > Hi, > > > > ``` > > I am using version 0.90.3 of elasticsearch. I am trying to index the > > > > ``` > > > > data. This index is not via bulk api. I am pushing one by one documents > > into the index. And then it closes one of my index's shard. I found the > > following Log > > > > _[2013-08-09 09:07:55,395][INFO][node] [Goldbug] > > version[0.90.3], pid[4299], build[5c38d60/2013-08-06T13:18:31Z]_ > > _[2013-08-09 09:07:55,396][INFO][node] [Goldbug] > > initializing ..._ > > _[2013-08-09 09:07:55,415][INFO][plugins] [Goldbug] > > loaded [], sites []_ > > _[2013-08-09 09:08:07,234][INFO][node] [Goldbug] > > initialized_ > > _[2013-08-09 09:08:07,234][INFO][node] [Goldbug] > > starting ..._ > > _[2013-08-09 09:08:07,656][INFO][transport] [Goldbug] > > bound\_address {inet[/0:0:0:0:0:0:0:0:9300]}, publish\_address {inet[/ > > 192.168.1.105:9300]}_ > > _[2013-08-09 09:08:11,122][INFO][cluster.service] [Goldbug] > > new\_master [Goldbug][MQ3oITPKRPWPM4pIeRzHpQ][inet[/192.168.1.105:9300]], > > reason: zen-disco-join (elected\_as\_master)_ > > _[2013-08-09 09:08:11,178][INFO][discovery] [Goldbug] > > elasticsearch/MQ3oITPKRPWPM4pIeRzHpQ_ > > _[2013-08-09 09:08:11,278][INFO][http] [Goldbug] > > bound\_address {inet[/0:0:0:0:0:0:0:0:9200]}, publish\_address {inet[/ > > 192.168.1.105:9200]}_ > > _[2013-08-09 09:08:11,278][INFO][node] [Goldbug] > > started_ > > _[2013-08-09 09:08:16,320][INFO][gateway] [Goldbug] > > recovered [4] indices into cluster\_state_ > > _[2013-08-09 10:45:28,746][WARN][index.merge.scheduler] [Goldbug] > > [es\_requests\_2][0] failed to merge_ > > _java.lang.ArrayIndexOutOfBoundsException: 612_ > > > > - at org.apache.lucene.codecs.lucene40.BitVector.get(BitVector.java:146)\* > > - at org.apache.lucene.index.MergeState$DocMap$1.get(MergeState.java:86)\* > > - at > > org.apache.lucene.codecs.MappingMultiDocsAndPositionsEnum.nextDoc(MappingMultiDocsAndPositionsEnum.java:107) > > - > > - at > > org.apache.lucene.codecs.PostingsConsumer.merge(PostingsConsumer.java:109) > > - > > - at org.apache.lucene.codecs.TermsConsumer.merge(TermsConsumer.java:164) > > - > > - at > > org.apache.lucene.codecs.FieldsConsumer.merge(FieldsConsumer.java:72)\* > > - at > > org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:365)\* > > - at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:98)\* > > - at > > org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:3772)\* > > - at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3376)\* > > - at > > org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:405) > > - > > - at > > org.apache.lucene.index.TrackingConcurrentMergeScheduler.doMerge(TrackingConcurrentMergeScheduler.java:91) > > - > > - at > > org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:482) > > - > > > > _[2013-08-09 10:45:28,807][WARN][index.engine.robin] [Goldbug] > > [es\_requests\_2][0] failed engine_ > > _org.apache.lucene.index.MergePolicy$MergeException: > > java.lang.ArrayIndexOutOfBoundsException: 612_ > > > > - at > > org.elasticsearch.index.merge.scheduler.ConcurrentMergeSchedulerProvider$CustomConcurrentMergeScheduler.handleMergeException(ConcurrentMergeSchedulerProvider.java:99) > > - > > - at > > org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:518) > > - > > > > _Caused by: java.lang.ArrayIndexOutOfBoundsException: 612_ > > > > - at org.apache.lucene.codecs.lucene40.BitVector.get(BitVector.java:146)\* > > - at org.apache.lucene.index.MergeState$DocMap$1.get(MergeState.java:86)\* > > - at > > org.apache.lucene.codecs.MappingMultiDocsAndPositionsEnum.nextDoc(MappingMultiDocsAndPositionsEnum.java:107) > > - > > - at > > org.apache.lucene.codecs.PostingsConsumer.merge(PostingsConsumer.java:109) > > - > > - at org.apache.lucene.codecs.TermsConsumer.merge(TermsConsumer.java:164) > > - > > - at > > org.apache.lucene.codecs.FieldsConsumer.merge(FieldsConsumer.java:72)\* > > - at > > org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:365)\* > > - at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:98)\* > > - at > > org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:3772)\* > > - at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3376)\* > > - at > > org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:405) > > - > > - at > > org.apache.lucene.index.TrackingConcurrentMergeScheduler.doMerge(TrackingConcurrentMergeScheduler.java:91) > > - > > - at > > org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:482) > > - > > > > _[2013-08-09 10:45:28,918][WARN][cluster.action.shard] [Goldbug] > > sending failed shard for [es\_requests\_2][0], node[MQ3oITPKRPWPM4pIeRzHpQ], > > [P], s[STARTED], reason [engine failure, message > > [MergeException[java.lang.ArrayIndexOutOfBoundsException: 612]; nested: > > ArrayIndexOutOfBoundsException[612]; ]]_ > > _[2013-08-09 10:45:28,918][WARN][cluster.action.shard] [Goldbug] > > received shard failed for [es\_requests\_2][0], node[MQ3oITPKRPWPM4pIeRzHpQ], > > [P], s[STARTED], reason [engine failure, message > > [MergeException[java.lang.ArrayIndexOutOfBoundsException: 612]; nested: > > ArrayIndexOutOfBoundsException[612]; ]]_ > > \* > > \* > > I am facing such situation since I moved to version 0.9 . and I used to > > push data in the similar way. but never faced shard close till I was with > > version 0.20.\* . This creating a lot of problem, I am trying to find, if I > > am making some data in wrong format. but not able to find. Is it > > Elasticsearch's bug or My bug. Please help me to understand it. > > > > Thanks > > Narinder Kaur > > > > -- > > You received this message because you are subscribed to the Google Groups > > "elasticsearch" group. > > To unsubscribe from this group and stop receiving emails from it, send an > > email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com) \. > > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![simonw\_2](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/simonw_2/32/1130_2.png) [@simonw\_2](https://discuss.elastic.co/u/simonw_2)\ **Post date:** [August 13, 2013, 7:30am UTC](https://discuss.elastic.co/t/shards-getting-closed-on-indexing-data/13141/4 "2013-08-13T07:30:12Z")
Hey Narinder, this exception seems pretty serious. It's a problem in Lucene I suppose. I have never been able to reproduce this so I'd be very very happy to get a hold on your index and mappings etc. if possible the entire ES data you have sitting on the machine. I wonder if that is possible or if not if you have a way to reproduce the issue? You can contact me directly via [simon.willnauer@elasticsearch.com](mailto:simon.willnauer@elasticsearch.com) if you don't want to pass any related infos via the mailing list. simon On Saturday, August 10, 2013 10:19:40 AM UTC+2, Narinder Kaur wrote: > I am using REST Api, and refresh settings are defaults. But I am calling > refresh api after every new document index. > > On Saturday, 10 August 2013 05:06:17 UTC+5:30, Ivan Brusic wrote: > > > How are you indexing data? Via REST or the Java API? If you are using the > > Java API, have you updated the client as well? What are your refresh > > settings? If you provide more information besides the error itself, perhaps > > someone on the list can help you. > > > > -- > > Ivan > > > > On Thu, Aug 8, 2013 at 10:26 PM, Narinder Kaur [narind...@izap.in](mailto:narind...@izap.in) wrote: > > > > > Hi, > > > > > > ``` > > > I am using version 0.90.3 of elasticsearch. I am trying to index the > > > > > > ``` > > > > > > data. This index is not via bulk api. I am pushing one by one documents > > > into the index. And then it closes one of my index's shard. I found the > > > following Log > > > > > > _[2013-08-09 09:07:55,395][INFO][node] [Goldbug] > > > version[0.90.3], pid[4299], build[5c38d60/2013-08-06T13:18:31Z]_ > > > _[2013-08-09 09:07:55,396][INFO][node] [Goldbug] > > > initializing ..._ > > > _[2013-08-09 09:07:55,415][INFO][plugins] [Goldbug] > > > loaded [], sites []_ > > > _[2013-08-09 09:08:07,234][INFO][node] [Goldbug] > > > initialized_ > > > _[2013-08-09 09:08:07,234][INFO][node] [Goldbug] > > > starting ..._ > > > _[2013-08-09 09:08:07,656][INFO][transport] [Goldbug] > > > bound\_address {inet[/0:0:0:0:0:0:0:0:9300]}, publish\_address {inet[/ > > > 192.168.1.105:9300]}_ > > > _[2013-08-09 09:08:11,122][INFO][cluster.service] [Goldbug] > > > new\_master [Goldbug][MQ3oITPKRPWPM4pIeRzHpQ][inet[/192.168.1.105:9300]], > > > reason: zen-disco-join (elected\_as\_master)_ > > > _[2013-08-09 09:08:11,178][INFO][discovery] [Goldbug] > > > elasticsearch/MQ3oITPKRPWPM4pIeRzHpQ_ > > > _[2013-08-09 09:08:11,278][INFO][http] [Goldbug] > > > bound\_address {inet[/0:0:0:0:0:0:0:0:9200]}, publish\_address {inet[/ > > > 192.168.1.105:9200]}_ > > > _[2013-08-09 09:08:11,278][INFO][node] [Goldbug] > > > started_ > > > _[2013-08-09 09:08:16,320][INFO][gateway] [Goldbug] > > > recovered [4] indices into cluster\_state_ > > > _[2013-08-09 10:45:28,746][WARN][index.merge.scheduler] [Goldbug] > > > [es\_requests\_2][0] failed to merge_ > > > _java.lang.ArrayIndexOutOfBoundsException: 612_ > > > > > > - at org.apache.lucene.codecs.lucene40.BitVector.get(BitVector.java:146) > > > - > > > - at org.apache.lucene.index.MergeState$DocMap$1.get(MergeState.java:86) > > > - > > > - at > > > org.apache.lucene.codecs.MappingMultiDocsAndPositionsEnum.nextDoc(MappingMultiDocsAndPositionsEnum.java:107) > > > - > > > - at > > > org.apache.lucene.codecs.PostingsConsumer.merge(PostingsConsumer.java:109) > > > - > > > - at > > > org.apache.lucene.codecs.TermsConsumer.merge(TermsConsumer.java:164)\* > > > - at > > > org.apache.lucene.codecs.FieldsConsumer.merge(FieldsConsumer.java:72)\* > > > - at > > > org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:365) > > > - > > > - at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:98)\* > > > - at > > > org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:3772)\* > > > - at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3376)\* > > > - at > > > org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:405) > > > - > > > - at > > > org.apache.lucene.index.TrackingConcurrentMergeScheduler.doMerge(TrackingConcurrentMergeScheduler.java:91) > > > - > > > - at > > > org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:482) > > > - > > > > > > _[2013-08-09 10:45:28,807][WARN][index.engine.robin] [Goldbug] > > > [es\_requests\_2][0] failed engine_ > > > _org.apache.lucene.index.MergePolicy$MergeException: > > > java.lang.ArrayIndexOutOfBoundsException: 612_ > > > > > > - at > > > org.elasticsearch.index.merge.scheduler.ConcurrentMergeSchedulerProvider$CustomConcurrentMergeScheduler.handleMergeException(ConcurrentMergeSchedulerProvider.java:99) > > > - > > > - at > > > org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:518) > > > - > > > > > > _Caused by: java.lang.ArrayIndexOutOfBoundsException: 612_ > > > > > > - at org.apache.lucene.codecs.lucene40.BitVector.get(BitVector.java:146) > > > - > > > - at org.apache.lucene.index.MergeState$DocMap$1.get(MergeState.java:86) > > > - > > > - at > > > org.apache.lucene.codecs.MappingMultiDocsAndPositionsEnum.nextDoc(MappingMultiDocsAndPositionsEnum.java:107) > > > - > > > - at > > > org.apache.lucene.codecs.PostingsConsumer.merge(PostingsConsumer.java:109) > > > - > > > - at > > > org.apache.lucene.codecs.TermsConsumer.merge(TermsConsumer.java:164)\* > > > - at > > > org.apache.lucene.codecs.FieldsConsumer.merge(FieldsConsumer.java:72)\* > > > - at > > > org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:365) > > > - > > > - at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:98)\* > > > - at > > > org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:3772)\* > > > - at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3376)\* > > > - at > > > org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:405) > > > - > > > - at > > > org.apache.lucene.index.TrackingConcurrentMergeScheduler.doMerge(TrackingConcurrentMergeScheduler.java:91) > > > - > > > - at > > > org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:482) > > > - > > > > > > _[2013-08-09 10:45:28,918][WARN][cluster.action.shard] [Goldbug] > > > sending failed shard for [es\_requests\_2][0], node[MQ3oITPKRPWPM4pIeRzHpQ], > > > [P], s[STARTED], reason [engine failure, message > > > [MergeException[java.lang.ArrayIndexOutOfBoundsException: 612]; nested: > > > ArrayIndexOutOfBoundsException[612]; ]]_ > > > _[2013-08-09 10:45:28,918][WARN][cluster.action.shard] [Goldbug] > > > received shard failed for [es\_requests\_2][0], node[MQ3oITPKRPWPM4pIeRzHpQ], > > > [P], s[STARTED], reason [engine failure, message > > > [MergeException[java.lang.ArrayIndexOutOfBoundsException: 612]; nested: > > > ArrayIndexOutOfBoundsException[612]; ]]_ > > > \* > > > \* > > > I am facing such situation since I moved to version 0.9 . and I used to > > > push data in the similar way. but never faced shard close till I was with > > > version 0.20.\* . This creating a lot of problem, I am trying to find, if I > > > am making some data in wrong format. but not able to find. Is it > > > Elasticsearch's bug or My bug. Please help me to understand it. > > > > > > Thanks > > > Narinder Kaur > > > > > > -- > > > You received this message because you are subscribed to the Google > > > Groups "elasticsearch" group. > > > To unsubscribe from this group and stop receiving emails from it, send > > > an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![jprante](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jprante/32/44941_2.png) [@jprante](https://discuss.elastic.co/u/jprante)\ **Post date:** [August 13, 2013, 8:31am UTC](https://discuss.elastic.co/t/shards-getting-closed-on-indexing-data/13141/5 "2013-08-13T08:31:44Z")
I guess the index got corrupted, probably after running out of file descriptors. Jörg -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![simonw\_2](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/simonw_2/32/1130_2.png) [@simonw\_2](https://discuss.elastic.co/u/simonw_2)\ **Post date:** [August 13, 2013, 10:39am UTC](https://discuss.elastic.co/t/shards-getting-closed-on-indexing-data/13141/6 "2013-08-13T10:39:25Z")
On Tuesday, August 13, 2013 10:31:44 AM UTC+2, Jörg Prante wrote: > I guess the index got corrupted, probably after running out of file > descriptors. very unlikely here we'd see something like read past EOF or similar errors but this is really odd since it's basically opening a healthy index but the num of docs is jagged. This rather seems like a bug to me but I wanna make sure though. simon > Jörg -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 2:21am UTC](https://discuss.elastic.co/t/shards-getting-closed-on-indexing-data/13141/7 "2017-07-06T02:21:22Z")