Hi,
we encounter a lot of exceptions of two types (see below) in our log
files, together with huge performance degradation for index operations
of our 6-node cluster.
The status remains "green", the system continues to function.
Any suggestions will be appreciated.
Please let me know if you need more information.
Regards,
Vadim
org.apache.lucene.index.MergePolicy$MergeException:
java.io.IOException: Illegal seek
at
org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:
347)
at org.apache.lucene.index.ConcurrentMergeScheduler
$MergeThread.run(ConcurrentMergeScheduler.java:312)
Caused by: java.io.IOException: Illegal seek
at sun.nio.ch.FileDispatcher.pread0(Native Method)
at sun.nio.ch.FileDispatcher.pread(FileDispatcher.java:31)
at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:234)
at sun.nio.ch.IOUtil.read(IOUtil.java:210)
at sun.nio.ch.FileChannelImpl.read(FileChannelImpl.java:622)
at org.apache.lucene.store.NIOFSDirectory
$NIOFSIndexInput.readInternal(NIOFSDirectory.java:168)
at
org.apache.lucene.store.BufferedIndexInput.refill(BufferedIndexInput.java:
160)
at
org.apache.lucene.store.BufferedIndexInput.readBytes(BufferedIndexInput.java:
119)
at
org.apache.lucene.store.BufferedIndexInput.readBytes(BufferedIndexInput.java:
94)
at
org.apache.lucene.store.IndexOutput.copyBytes(IndexOutput.java:174)
at
org.apache.lucene.index.FieldsWriter.addRawDocuments(FieldsWriter.java:
216)
at
org.apache.lucene.index.SegmentMerger.copyFieldsNoDeletions(SegmentMerger.java:
430)
at
org.apache.lucene.index.SegmentMerger.mergeFields(SegmentMerger.java:
342)
at
org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:155)
at
org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4443)
at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:
4000)
at
org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:
231)
at org.apache.lucene.index.ConcurrentMergeScheduler
$MergeThread.run(ConcurrentMergeScheduler.java:288)
org.apache.lucene.index.MergePolicy$MergeException:
java.lang.AssertionError: Terms are out of order: field=obj.key
(number 54) lastField=obj.key (number 54)
text=lba0000020031229dzct001V1 lastText=lba0000020031229dzct001pm
at
org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:
347)
at org.apache.lucene.index.ConcurrentMergeScheduler
$MergeThread.run(ConcurrentMergeScheduler.java:312)
Caused by: java.lang.AssertionError: Terms are out of order:
field=obj.key (number 54) lastField=obj.key (number 54)
text=lba0000020031229dzct001V1 lastText=lba0000020031229dzct001pm
at
org.apache.lucene.index.TermInfosWriter.add(TermInfosWriter.java:163)
at
org.apache.lucene.index.FormatPostingsDocsWriter.finish(FormatPostingsDocsWriter.java:
115)
at
org.apache.lucene.index.SegmentMerger.appendPostings(SegmentMerger.java:
707)
at
org.apache.lucene.index.SegmentMerger.mergeTermInfos(SegmentMerger.java:
635)
at
org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:
573)
at
org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:156)
at
org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4443)
at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:
4000)
at
org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:
231)
at org.apache.lucene.index.ConcurrentMergeScheduler
$MergeThread.run(ConcurrentMergeScheduler.java:288)