Good Day
I hope someone can possible help me. I have a 5 node ES cluster. The app writes data to our index. When there are no replicas on the index all is fine. As soon as i add replicas I get the following:
Not sure where the issue is. Mappings maybe? (We only use long type on current_time and that is less than 32 chars.)
[WARN ][cluster.action.shard ] [node3] [pandora][1] received shard failed for [pandora][1],
node[b5d8phsxQUCoScLSiM194A], [R], s[STARTED], indexUUID [f5DW-cX0QuO3VsoF8cAPWQ], reason [Failed to perform [indices:data/write/index]
on replica, message [RemoteTransportException[[Live-Elasticsearch-Node03][inet[/10.100.19.176:9300]][indices:data/write/index[r]]];
nested: CreateFailedEngineException[[pandora][1]
Create failed for [data#AU2J9E_LacmaoOIy8gAI]]; nested: IOException[Cannot read numeric data larger than 32 chars]; ]]
[2015-05-25 07:23:16,507][WARN ][indices.cluster ] [Live-Elasticsearch-Node03] [[pandora][1]] marking and sending shard failed due to [engine failure, reason [indices:data/write/index failed on replica]]
org.elasticsearch.index.engine.CreateFailedEngineException: [pandora][1] Create failed for [data#AU2J9E_LacmaoOIy8gAI]
at org.elasticsearch.index.engine.InternalEngine.create(InternalEngine.java:262)
at org.elasticsearch.index.shard.IndexShard.create(IndexShard.java:470)
at org.elasticsearch.action.index.TransportIndexAction.shardOperationOnReplica(TransportIndexAction.java:249)
at org.elasticsearch.action.support.replication.TransportShardReplicationOperationAction$ReplicaOperationTransportHandler.messageReceived(TransportShardReplicationOperationAction.java:249)
at org.elasticsearch.action.support.replication.TransportShardReplicationOperationAction$ReplicaOperationTransportHandler.messageReceived(TransportShardReplicationOperationAction.java:228)
at org.elasticsearch.transport.netty.MessageChannelHandler$RequestHandler.doRun(MessageChannelHandler.java:277)
at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:36)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: Cannot read numeric data larger than 32 chars
at org.elasticsearch.index.analysis.NumericTokenizer.incrementToken(NumericTokenizer.java:78)
at org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:618)
at org.apache.lucene.index.DefaultIndexingChain.processField(DefaultIndexingChain.java:359)
at org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:318)
at org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:241)
at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:465)
at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1526)
at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1252)
at org.elasticsearch.index.engine.InternalEngine.innerCreateNoLock(InternalEngine.java:343)
at org.elasticsearch.index.engine.InternalEngine.innerCreate(InternalEngine.java:285)
at org.elasticsearch.index.engine.InternalEngine.create(InternalEngine.java:256)
... 9 more