# Logstash crash on start due to PQ

**URL:** https://discuss.elastic.co/t/logstash-crash-on-start-due-to-pq/196155
**Category:** Logstash
**Created:** [August 21, 2019, 4:07pm UTC](https://discuss.elastic.co/t/logstash-crash-on-start-due-to-pq/196155 "2019-08-21T16:07:49Z")
**Posts on this page:** 3
**Page:** 1

<div class="post-metadata">

### Author: ![matteoclc](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/matteoclc/32/52720_2.png) [@matteoclc](https://discuss.elastic.co/u/matteoclc)
#### Post date: [August 21, 2019, 4:07pm UTC](https://discuss.elastic.co/t/logstash-crash-on-start-due-to-pq/196155/1 "2019-08-21T16:07:49Z")

</div>

Hi all,  
my logstash (6.5.0) crash on start with the following error

org.logstash.ackedqueue.io.MmapPageIOV2$PageIOInvalidElementException: Element seqNum 0 is expected to be 3920351

[2019-08-21T17:15:31,045][ERROR][logstash.agent] Failed to execute action {:action=\>LogStash::PipelineAction::Create/pipeline\_id:main, :exception=\>"Java::JavaLang::IllegalStateException", :message=\>"org.logstash.ackedqueue.io.MmapPageIOV2$PageIOInvalidElementException: Element seqNum 0 is expected to be 3920351", :backtrace=\>["org.logstash.execution.AbstractPipelineExt.openQueue(AbstractPipelineExt.java:170)", "org.logstash.execution.AbstractPipelineExt$INVOKER$i$0$0$openQueue.call(AbstractPipelineExt$INVOKER$i$0$0$openQueue.gen)", "org.jruby.internal.runtime.methods.JavaMethod$JavaMethodN.call(JavaMethod.java:737)", "org.jruby.ir.targets.InvokeSite.invoke(InvokeSite.java:145)", "usr.share.logstash.logstash\_minus\_core.lib.logstash.pipeline.RUBY$method$initialize$0(/usr/share/logstash/logstash-core/lib/logstash/pipeline.rb:91)", "org.jruby.internal.runtime.methods.CompiledIRMethod.call(CompiledIRMethod.java:77)", "org.jruby.internal.runtime.methods.MixedModeIRMethod.call(MixedModeIRMethod.java:93)", "org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:298)", "org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:79)", "org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:83)", "org.jruby.RubyClass.newInstance(RubyClass.java:1022)", "org.jruby.RubyClass$INVOKER$i$newInstance.call(RubyClass$INVOKER$i$newInstance.gen)", "org.jruby.ir.targets.InvokeSite.invoke(InvokeSite.java:145)", "usr.share.logstash.logstash\_minus\_core.lib.logstash.pipeline\_action.create.RUBY$block$execute$1(/usr/share/logstash/logstash-core/lib/logstash/pipeline\_action/create.rb:42)", "org.jruby.runtime.CompiledIRBlockBody.callDirect(CompiledIRBlockBody.java:145)", "org.jruby.runtime.IRBlockBody.call(IRBlockBody.java:71)", "org.jruby.runtime.Block.call(Block.java:124)", "org.jruby.RubyProc.call(RubyProc.java:289)", "org.jruby.RubyProc.call19(RubyProc.java:273)", "org.jruby.RubyProc$INVOKER$i$0$0$call19.call(RubyProc$INVOKER$i$0$0$call19.gen)", "org.jruby.ir.targets.InvokeSite.invoke(InvokeSite.java:145)", "usr.share.logstash.logstash\_minus\_core.lib.logstash.agent.RUBY$block$exclusive$1(/usr/share/logstash/logstash-core/lib/logstash/agent.rb:92)", "org.jruby.runtime.CompiledIRBlockBody.yieldDirect(CompiledIRBlockBody.java:156)", "org.jruby.runtime.IRBlockBody.yieldSpecific(IRBlockBody.java:80)", "org.jruby.runtime.Block.yieldSpecific(Block.java:134)", "org.jruby.ext.thread.Mutex.synchronize(Mutex.java:148)", "org.jruby.ext.thread.Mutex$INVOKER$i$0$0$synchronize.call(Mutex$INVOKER$i$0$0$synchronize.gen)", "org.jruby.internal.runtime.methods.JavaMethod$JavaMethodZeroBlock.call(JavaMethod.java:498)", "org.jruby.ir.targets.InvokeSite.invoke(InvokeSite.java:145)", "usr.share.logstash.logstash\_minus\_core.lib.logstash.agent.RUBY$method$exclusive$0(/usr/share/logstash/logstash-core/lib/logstash/agent.rb:92)", "usr.share.logstash.logstash\_minus\_core.lib.logstash.agent.RUBY$method$exclusive$0$ **VARARGS** (/usr/share/logstash/logstash-core/lib/logstash/agent.rb)", "org.jruby.internal.runtime.methods.CompiledIRMethod.call(CompiledIRMethod.java:77)", "org.jruby.internal.runtime.methods.MixedModeIRMethod.call(MixedModeIRMethod.java:93)", "org.jruby.ir.targets.InvokeSite.invoke(InvokeSite.java:145)", "usr.share.logstash.logstash\_minus\_core.lib.logstash.pipeline\_action.create.RUBY$method$execute$0(/usr/share/logstash/logstash-core/lib/logstash/pipeline\_action/create.rb:38)", "usr.share.logstash.logstash\_minus\_core.lib.logstash.pipeline\_action.create.RUBY$method$execute$0$ **VARARGS** (/usr/share/logstash/logstash-core/lib/logstash/pipeline\_action/create.rb)", "org.jruby.internal.runtime.methods.CompiledIRMethod.call(CompiledIRMethod.java:77)", "org.jruby.internal.runtime.methods.MixedModeIRMethod.call(MixedModeIRMethod.java:93)", "org.jruby.ir.targets.InvokeSite.invoke(InvokeSite.java:145)", "usr.share.logstash.logstash\_minus\_core.lib.logstash.agent.RUBY$block$converge\_state$2(/usr/share/logstash/logstash-core/lib/logstash/agent.rb:317)", "org.jruby.runtime.CompiledIRBlockBody.callDirect(CompiledIRBlockBody.java:145)", "org.jruby.runtime.IRBlockBody.call(IRBlockBody.java:71)", "org.jruby.runtime.Block.call(Block.java:124)", "org.jruby.RubyProc.call(RubyProc.java:289)", "org.jruby.RubyProc.call(RubyProc.java:246)", "org.jruby.internal.runtime.RubyRunnable.run(RubyRunnable.java:104)", "java.lang.Thread.run(Thread.java:748)"]}  
--------- | [2019-08-21T17:15:31,124][FATAL][logstash.runner] An unexpected error occurred! {:error=\>#\<LogStash::Error: Don't know how to handle `Java::JavaLang::IllegalStateException` for `PipelineAction::Create<main>`\>, :backtrace=\>["org/logstash/execution/ConvergeResultExt.java:103:in `create'", "org/logstash/execution/ConvergeResultExt.java:34:in`add'", "/usr/share/logstash/logstash-core/lib/logstash/agent.rb:329:in `block in converge\_state'"]}

i have 1.8GB of events in 27 page file that i need to recover, is there any way to workaround or fix the problem?

i found that the element that should have seqNum 3920351 is in the first page file (100)

pageNum=100, firstUnackedPageNum=0, firstUnackedSeqNum=3920369, minSeqNum=3891507, elementCount=52452, isFullyAcked=n

thank you

---

<div class="post-metadata">

### Author: ![matteoclc](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/matteoclc/32/52720_2.png) [@matteoclc](https://discuss.elastic.co/u/matteoclc)
#### Post date: [August 22, 2019, 12:57pm UTC](https://discuss.elastic.co/t/logstash-crash-on-start-due-to-pq/196155/2 "2019-08-22T12:57:03Z")

</div>

up!!

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [September 19, 2019, 12:57pm UTC](https://discuss.elastic.co/t/logstash-crash-on-start-due-to-pq/196155/3 "2019-09-19T12:57:11Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
