Hey all, I have two elastic search nodes running. The replica shards are
frequently becoming unassigned. I have the same version of elasticsearch
and java running on both nodes. The stack of the error I get (from the
perspective of the node which is "master") is below (note this is using the
mapper attachments plugin). The replication fails due to an error in
parsing the document (which for some reason only occurred on the replica
and not the primary). Thereafter the node becomes unassigned.
Note I also round robin requests between the nodes in my cluster.
[2013-08-29 01:11:37,011][WARN ][action.index ] [Sif] Failed
to perform index on replica [v3][12]
org.elasticsearch.transport.RemoteTransportException:
[Scorpio][inet[/10.149.11.248:9300]][index/replica]
Caused by: org.elasticsearch.index.mapper.MapperParsingException: Failed to
extract [100000] characters of text for [null]
at
org.elasticsearch.index.mapper.attachment.AttachmentMapper.parse(AttachmentMapper.java:316)
at
org.elasticsearch.index.mapper.object.ObjectMapper.serializeValue(ObjectMapper.java:587)
at
org.elasticsearch.index.mapper.object.ObjectMapper.parse(ObjectMapper.java:459)
at
org.elasticsearch.index.mapper.DocumentMapper.parse(DocumentMapper.java:486)
at
org.elasticsearch.index.mapper.DocumentMapper.parse(DocumentMapper.java:430)
at
org.elasticsearch.index.shard.service.InternalIndexShard.prepareIndex(InternalIndexShard.java:318)
at
org.elasticsearch.action.index.TransportIndexAction.shardOperationOnReplica(TransportIndexAction.java:258)
at
org.elasticsearch.action.support.replication.TransportShardReplicationOperationAction$ReplicaOperationTransportHandler.messageReceived(TransportShardReplicationOperationAction.java:254)
at
org.elasticsearch.action.support.replication.TransportShardReplicationOperationAction$ReplicaOperationTransportHandler.messageReceived(TransportShardReplicationOperationAction.java:240)
at
org.elasticsearch.transport.netty.MessageChannelHandler$RequestHandler.run(MessageChannelHandler.java:268)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
Caused by: org.apache.tika.exception.TikaException: Unexpected
RuntimeException from org.apache.tika.parser.pdf.PDFParser@4f042cc7
at
org.apache.tika.parser.CompositeParser.parse(CompositeParser.java:244)
at
org.apache.tika.parser.CompositeParser.parse(CompositeParser.java:242)
at
org.apache.tika.parser.AutoDetectParser.parse(AutoDetectParser.java:120)
at org.apache.tika.Tika.parseToString(Tika.java:421)
at
org.elasticsearch.index.mapper.attachment.AttachmentMapper.parse(AttachmentMapper.java:314)
... 12 more
Caused by: java.security.ProviderException: doFinal() failed
at sun.security.pkcs11.P11Cipher.implDoFinal(P11Cipher.java:814)
at sun.security.pkcs11.P11Cipher.engineDoFinal(P11Cipher.java:542)
at sun.security.pkcs11.P11Cipher.engineDoFinal(P11Cipher.java:525)
at javax.crypto.Cipher.doFinal(Cipher.java:1805)
at javax.crypto.CipherInputStream.close(CipherInputStream.java:299)
at
org.apache.pdfbox.pdmodel.encryption.SecurityHandler.encryptData(SecurityHandler.java:320)
at
org.apache.pdfbox.pdmodel.encryption.SecurityHandler.decryptStream(SecurityHandler.java:412)
at
org.apache.pdfbox.pdmodel.encryption.SecurityHandler.decrypt(SecurityHandler.java:384)
at
org.apache.pdfbox.pdmodel.encryption.SecurityHandler.decryptObject(SecurityHandler.java:358)
at
org.apache.pdfbox.pdmodel.encryption.SecurityHandler.proceedDecryption(SecurityHandler.java:195)
at
org.apache.pdfbox.pdmodel.encryption.StandardSecurityHandler.decryptDocument(StandardSecurityHandler.java:156)
at
org.apache.pdfbox.pdmodel.PDDocument.openProtection(PDDocument.java:1366)
at org.apache.pdfbox.pdmodel.PDDocument.decrypt(PDDocument.java:798)
at
org.apache.pdfbox.util.PDFTextStripper.writeText(PDFTextStripper.java:316)
at org.apache.tika.parser.pdf.PDF2XHTML.process(PDF2XHTML.java:66)
at org.apache.tika.parser.pdf.PDFParser.parse(PDFParser.java:153)
at
org.apache.tika.parser.CompositeParser.parse(CompositeParser.java:242)
... 16 more
Caused by: sun.security.pkcs11.wrapper.PKCS11Exception: CKR_OPERATION_ACTIVE
at sun.security.pkcs11.wrapper.PKCS11.C_DecryptInit(Native Method)
at sun.security.pkcs11.P11Cipher.initialize(P11Cipher.java:440)
at
sun.security.pkcs11.P11Cipher.ensureInitialized(P11Cipher.java:424)
at sun.security.pkcs11.P11Cipher.implDoFinal(P11Cipher.java:770)
... 32 more
[2013-08-29 01:11:37,012][WARN ][cluster.action.shard ] [Sif] sending
failed shard for [v3][12], node[rLChFYTMSvaWR4aJRy39ig], [R], s[STARTED],
reason [Failed to perform [index] on replica, message
[RemoteTransportException[[Scorpio][inet[/10.149.11.248:9300]][index/replica]];
nested: MapperParsingException[Failed to extract [100000] characters of
text for [null]]; nested: TikaException[Unexpected RuntimeException from
org.apache.tika.parser.pdf.PDFParser@4f042cc7]; nested:
ProviderException[doFinal() failed]; nested:
PKCS11Exception[CKR_OPERATION_ACTIVE]; ]]
[2013-08-29 01:11:37,012][WARN ][cluster.action.shard ] [Sif] received
shard failed for [v3][12], node[rLChFYTMSvaWR4aJRy39ig], [R], s[STARTED],
reason [Failed to perform [index] on replica, message
[RemoteTransportException[[Scorpio][inet[/10.149.11.248:9300]][index/replica]];
nested: MapperParsingException[Failed to extract [100000] characters of
text for [null]]; nested: TikaException[Unexpected RuntimeException from
org.apache.tika.parser.pdf.PDFParser@4f042cc7]; nested:
ProviderException[doFinal() failed]; nested:
PKCS11Exception[CKR_OPERATION_ACTIVE]; ]]
[2013-08-29 01:11:37,026][TRACE][gateway.local.state.shards] [Sif] [v3][12]
writing shard state, reason [version changed from [96] to [97]]
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.