I am running elasticsearch 0.19.9 with 36 instances. I saw the following
exceptions. Is it safe to be ignored? Otherwise, how can I tune the
parameter?
[2012-09-25 17:40:26,436][WARN ][index.translog ] [Archimage]
[request_trace20120925][0] failed to flush shard on translog threshold
org.elasticsearch.index.engine.FlushFailedEngineException:
[request_trace20120925][0] Flush failed
at
org.elasticsearch.index.engine.robin.RobinEngine.flush(RobinEngine.java:903)
at
org.elasticsearch.index.shard.service.InternalIndexShard.flush(InternalIndexShard.java:467)
at
org.elasticsearch.index.translog.TranslogService$TranslogBasedFlush$1.run(TranslogService.java:191)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
Caused by: java.lang.NullPointerException
at
org.elasticsearch.common.compress.BufferRecycler.releaseEncodeBuffer(BufferRecycler.java:68)
at
org.elasticsearch.common.compress.lzf.ChunkEncoder.close(ChunkEncoder.java:113)
at
org.elasticsearch.common.compress.lzf.LZFCompressedIndexOutput.doClose(LZFCompressedIndexOutput.java:63)
at
org.elasticsearch.common.compress.CompressedIndexOutput.close(CompressedIndexOutput.java:184)
at
org.elasticsearch.index.store.Store$StoreIndexOutput.close(Store.java:645)
at org.apache.lucene.util.IOUtils.close(IOUtils.java:141)
at org.apache.lucene.index.FieldsWriter.close(FieldsWriter.java:139)
at
org.apache.lucene.index.StoredFieldsWriter.flush(StoredFieldsWriter.java:55)
at
org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:59)
at
org.apache.lucene.index.DocumentsWriter.flush(DocumentsWriter.java:581)
at
org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:3587)
at org.apache.lucene.index.IndexWriter.prepareCommit(IndexWriter.java:3376)
at
org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:3485)
at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:3467)
at
org.elasticsearch.index.engine.robin.RobinEngine.flush(RobinEngine.java:871)
... 5 more
I get the same exception fairly regularly with 0.20.6:
[2013-08-27 13:26:05,337][WARN ][action.deletebyquery ] [elasticsearch-node] Failed to perform deleteByQuery/shard on replica [index][0]
org.elasticsearch.transport.RemoteTransportException: [elasticsearch-node][inet[/10.10.10.10:9300]][deleteByQuery/shard/replica]
Caused by: org.elasticsearch.index.engine.RefreshFailedEngineException: [search-enca][0] Refresh failed
at org.elasticsearch.index.engine.robin.RobinEngine.refresh(RobinEngine.java:787)
at org.elasticsearch.index.engine.robin.RobinEngine.refreshVersioningTable(RobinEngine.java:966)
at org.elasticsearch.index.engine.robin.RobinEngine.delete(RobinEngine.java:728)
at org.elasticsearch.index.shard.service.InternalIndexShard.deleteByQuery(InternalIndexShard.java:385)
at org.elasticsearch.action.deletebyquery.TransportShardDeleteByQueryAction.shardOperationOnReplica(TransportShardDeleteByQueryAction.java:106)
at org.elasticsearch.action.support.replication.TransportShardReplicationOperationAction$ReplicaOperationTransportHandler.messageReceived(TransportShardReplicationOperationAction.java:254)
at org.elasticsearch.action.support.replication.TransportShardReplicationOperationAction$ReplicaOperationTransportHandler.messageReceived(TransportShardReplicationOperationAction.java:240)
at org.elasticsearch.transport.netty.MessageChannelHandler$RequestHandler.run(MessageChannelHandler.java:268)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:662)
Caused by: java.lang.NullPointerException
at org.elasticsearch.common.compress.BufferRecycler.releaseEncodeBuffer(BufferRecycler.java:68)
at org.elasticsearch.common.compress.lzf.ChunkEncoder.close(ChunkEncoder.java:113)
at org.elasticsearch.common.compress.lzf.LZFCompressedIndexOutput.doClose(LZFCompressedIndexOutput.java:63)
at org.elasticsearch.common.compress.CompressedIndexOutput.close(CompressedIndexOutput.java:184)
at org.elasticsearch.index.store.Store$StoreIndexOutput.close(Store.java:640)
at org.apache.lucene.util.IOUtils.close(IOUtils.java:141)
at org.apache.lucene.index.FieldsWriter.close(FieldsWriter.java:139)
at org.apache.lucene.index.StoredFieldsWriter.flush(StoredFieldsWriter.java:55)
at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:59)
at org.apache.lucene.index.DocumentsWriter.flush(DocumentsWriter.java:581)
at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:3587)
at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:3552)
at org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:450)
at org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:399)
at org.apache.lucene.index.DirectoryReader.doOpenFromWriter(DirectoryReader.java:413)
at org.apache.lucene.index.DirectoryReader.doOpenIfChanged(DirectoryReader.java:432)
at org.apache.lucene.index.DirectoryReader.doOpenIfChanged(DirectoryReader.java:375)
at org.apache.lucene.index.IndexReader.openIfChanged(IndexReader.java:508)
at org.apache.lucene.search.SearcherManager.refreshIfNeeded(SearcherManager.java:109)
at org.apache.lucene.search.SearcherManager.refreshIfNeeded(SearcherManager.java:57)
at org.apache.lucene.search.ReferenceManager.maybeRefresh(ReferenceManager.java:137)
at org.elasticsearch.index.engine.robin.RobinEngine.refresh(RobinEngine.java:768)
... 10 more
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.