Unable to create dead letter queue writer

Logstash Version - 7.9.1

Currently we are unable to start Logstash properly without receiving error below:

[2023-04-10T20:18:52,978][ERROR][org.logstash.common.DeadLetterQueueFactory] unable to create dead letter queue writer
java.nio.file.NoSuchFileException: /usr/share/logstash/data/dead_letter_queue/beats/.lock
        at sun.nio.fs.UnixException.translateToIOException(UnixException.java:92) ~[?:?]
        at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:111) ~[?:?]
        at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:116) ~[?:?]
        at sun.nio.fs.UnixPath.toRealPath(UnixPath.java:860) ~[?:?]
        at org.logstash.FileLockFactory.obtainLock(FileLockFactory.java:83) ~[logstash-core.jar:?]
        at org.logstash.common.io.DeadLetterQueueWriter.<init>(DeadLetterQueueWriter.java:81) ~[logstash-core.jar:?]
        at org.logstash.common.DeadLetterQueueFactory.newWriter(DeadLetterQueueFactory.java:88) ~[logstash-core.jar:?]
        at org.logstash.common.DeadLetterQueueFactory.lambda$getWriter$0(DeadLetterQueueFactory.java:79) ~[logstash-core.jar:?]
        at java.util.concurrent.ConcurrentHashMap.computeIfAbsent(ConcurrentHashMap.java:1705) [?:?]
        at org.logstash.common.DeadLetterQueueFactory.getWriter(DeadLetterQueueFactory.java:79) [logstash-core.jar:?]
        at org.logstash.execution.AbstractPipelineExt.dlqWriter(AbstractPipelineExt.java:277) [logstash-core.jar:?]
        at org.logstash.execution.JavaBasePipelineExt.initialize(JavaBasePipelineExt.java:79) [logstash-core.jar:?]
        at org.logstash.execution.JavaBasePipelineExt$INVOKER$i$1$0$initialize.call(JavaBasePipelineExt$INVOKER$i$1$0$initialize.gen) [jruby-complete-9.2.13.0.jar:?]
        at org.jruby.internal.runtime.methods.JavaMethod$JavaMethodN.call(JavaMethod.java:837) [jruby-complete-9.2.13.0.jar:?]
        at org.jruby.ir.runtime.IRRuntimeHelpers.instanceSuper(IRRuntimeHelpers.java:1169) [jruby-complete-9.2.13.0.jar:?]
        at org.jruby.ir.runtime.IRRuntimeHelpers.instanceSuperSplatArgs(IRRuntimeHelpers.java:1156) [jruby-complete-9.2.13.0.jar:?]
        at org.jruby.ir.targets.InstanceSuperInvokeSite.invoke(InstanceSuperInvokeSite.java:39) [jruby-complete-9.2.13.0.jar:?]
        at usr.share.logstash.logstash_minus_core.lib.logstash.java_pipeline.RUBY$method$initialize$0(/usr/share/logstash/logstash-core/lib/logstash/java_pipeline.rb:44) [jruby-complete-9.2.13.0.jar:?]
        at org.jruby.internal.runtime.methods.CompiledIRMethod.call(CompiledIRMethod.java:80) [jruby-complete-9.2.13.0.jar:?]
        at org.jruby.internal.runtime.methods.MixedModeIRMethod.call(MixedModeIRMethod.java:70) [jruby-complete-9.2.13.0.jar:?]
        at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:332) [jruby-complete-9.2.13.0.jar:?]
        at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:86) [jruby-complete-9.2.13.0.jar:?]
        at org.jruby.RubyClass.newInstance(RubyClass.java:939) [jruby-complete-9.2.13.0.jar:?]
        at org.jruby.RubyClass$INVOKER$i$newInstance.call(RubyClass$INVOKER$i$newInstance.gen) [jruby-complete-9.2.13.0.jar:?]
        at org.jruby.ir.targets.InvokeSite.invoke(InvokeSite.java:207) [jruby-complete-9.2.13.0.jar:?]
        at usr.share.logstash.logstash_minus_core.lib.logstash.pipeline_action.create.RUBY$method$execute$0(/usr/share/logstash/logstash-core/lib/logstash/pipeline_action/create.rb:52) [jruby-complete-9.2.13.0.jar:?]
        at usr.share.logstash.logstash_minus_core.lib.logstash.pipeline_action.create.RUBY$method$execute$0$__VARARGS__(/usr/share/logstash/logstash-core/lib/logstash/pipeline_action/create.rb) [jruby-complete-9.2.13.0.jar:?]
        at org.jruby.internal.runtime.methods.CompiledIRMethod.call(CompiledIRMethod.java:80) [jruby-complete-9.2.13.0.jar:?]
        at org.jruby.internal.runtime.methods.MixedModeIRMethod.call(MixedModeIRMethod.java:70) [jruby-complete-9.2.13.0.jar:?]
        at org.jruby.ir.targets.InvokeSite.invoke(InvokeSite.java:207) [jruby-complete-9.2.13.0.jar:?]
        at usr.share.logstash.logstash_minus_core.lib.logstash.agent.RUBY$block$converge_state$2(/usr/share/logstash/logstash-core/lib/logstash/agent.rb:357) [jruby-complete-9.2.13.0.jar:?]
        at org.jruby.runtime.CompiledIRBlockBody.callDirect(CompiledIRBlockBody.java:138) [jruby-complete-9.2.13.0.jar:?]
        at org.jruby.runtime.IRBlockBody.call(IRBlockBody.java:58) [jruby-complete-9.2.13.0.jar:?]
        at org.jruby.runtime.IRBlockBody.call(IRBlockBody.java:52) [jruby-complete-9.2.13.0.jar:?]
        at org.jruby.runtime.Block.call(Block.java:139) [jruby-complete-9.2.13.0.jar:?]
        at org.jruby.RubyProc.call(RubyProc.java:318) [jruby-complete-9.2.13.0.jar:?]
        at org.jruby.internal.runtime.RubyRunnable.run(RubyRunnable.java:105) [jruby-complete-9.2.13.0.jar:?]
        at java.lang.Thread.run(Thread.java:834) [?:?]

I have tried restarting Logstash but that doesn't seem to fix the error. Any idea on how to fix this?

Figured it out had to run chown command on our beats directory to fix.

1 Like

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.