Hi,
we have tried to upgrade our cluster to 0.90RC2 and everything worked fine
(1.3 Billion Documents, 3.4TByte), the cluster was restarting fine and got
into green status, flushing and refreshing did not returned any errors.
But then we reactivated the RabbitMQ river (latest version 1.4.0) and
suddenly shard where going offline and online all the time, leaving this
messages in the errorlog:
[2013-04-27 11:16:59,801][WARN ][cluster.action.shard ]
[es-cluster-raid-5] sending failed shard for [egoarchive][6],
node[jGrpxhH0Tj63U_AuEw0hlQ], [P], s[STARTED], reason [engine failure,
message
[MergeException[org.elasticsearch.ElasticSearchIllegalStateException: no
index mapper found for field: [data]]; nested:
ElasticSearchIllegalStateException[no index mapper found for field:
[data]]; ]]
[2013-04-27 11:16:59,803][WARN ][index.merge.scheduler ]
[es-cluster-raid-5] [egoarchive][6] failed to merge
org.elasticsearch.ElasticSearchIllegalStateException: no index mapper found
for field: [data]
at
org.elasticsearch.index.codec.PerFieldMappingPostingFormatCodec.getPostingsFormatForField(PerFieldMappingPostingFormatCodec.java:52)
at
org.apache.lucene.codecs.lucene42.Lucene42Codec$1.getPostingsFormatForField(Lucene42Codec.java:59)
at
org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsWriter.addField(PerFieldPostingsFormat.java:102)
at
org.apache.lucene.codecs.FieldsConsumer.merge(FieldsConsumer.java:71)
at
org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:383)
at
org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:116)
at
org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:3693)
at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3296)
at
org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:401)
at
org.apache.lucene.index.TrackingConcurrentMergeScheduler.doMerge(TrackingConcurrentMergeScheduler.java:91)
at
org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:478)
[2013-04-27 11:17:02,521][WARN ][indices.cluster ]
[es-cluster-raid-5] [egoarchive][6] master
[[es-cluster-raid-3][rJ2_qq3NRhaTmVFhm2ZMWg][inet[/10.55.65.214:9300]]]
marked shard as started, but shard have not been created, mark shard as
failed
[2013-04-27 11:17:02,522][WARN ][cluster.action.shard ]
[es-cluster-raid-5] sending failed shard for [egoarchive][6],
node[jGrpxhH0Tj63U_AuEw0hlQ], [P], s[STARTED], reason [master
[es-cluster-raid-3][rJ2_qq3NRhaTmVFhm2ZMWg][inet[/10.55.65.214:9300]]
marked shard as started, but shard have not been created, mark shard as
failed]
[2013-04-27 11:17:04,246][WARN ][indices.cluster ]
[es-cluster-raid-5] [egoarchive][6] master
[[es-cluster-raid-3][rJ2_qq3NRhaTmVFhm2ZMWg][inet[/10.55.65.214:9300]]]
marked shard as started, but shard have not been created, mark shard as
failed
[2013-04-27 11:17:04,247][WARN ][cluster.action.shard ]
[es-cluster-raid-5] sending failed shard for [egoarchive][6],
node[jGrpxhH0Tj63U_AuEw0hlQ], [P], s[STARTED], reason [master
[es-cluster-raid-3][rJ2_qq3NRhaTmVFhm2ZMWg][inet[/10.55.65.214:9300]]
marked shard as started, but shard have not been created, mark shard as
failed]
[2013-04-27 11:17:45,654][WARN ][index.merge.scheduler ]
[es-cluster-raid-5] [egoarchive][6] failed to merge
org.elasticsearch.ElasticSearchIllegalStateException: no index mapper found
for field: [data]
at
org.elasticsearch.index.codec.PerFieldMappingPostingFormatCodec.getPostingsFormatForField(PerFieldMappingPostingFormatCodec.java:52)
at
org.apache.lucene.codecs.lucene42.Lucene42Codec$1.getPostingsFormatForField(Lucene42Codec.java:59)
at
org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsWriter.addField(PerFieldPostingsFormat.java:102)
at
org.apache.lucene.codecs.FieldsConsumer.merge(FieldsConsumer.java:71)
at
org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:383)
at
org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:116)
at
org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:3693)
at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3296)
at
org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:401)
at
org.apache.lucene.index.TrackingConcurrentMergeScheduler.doMerge(TrackingConcurrentMergeScheduler.java:91)
at
org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:478)
So we where unable to use the river with 0.90RC2, the cluster was never
stable running with the river connected, as soon as we disabled the river
the cluster was stable again, any ideas why?
Thank you,
Max
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.