How configure pipeline to process DLQ

I have default-pipeline configured and I would like to have pipeline to process events from DLQ.
I have configured two pipelines:

- pipeline.id: default-pipeline
  path.config: "/etc/logstash/conf.d/default-pipeline.conf"

- pipeline.id: dlq-test
  path.config: "/etc/logstash/conf.d/dlq-pipeline.conf"

This is my input configuration of dlq-test pipeline:

input {
    dead_letter_queue {
        path => "/var/lib/logstash/dead_letter_queue"
        pipeline_id => "default-pipeline"
    }
}

And I receiving errors like this:

[2018-08-27T11:10:58,028][ERROR][logstash.pipeline ] Error registering plugin {:pipeline_id=>"dlq-test", :plugin=>"<LogStash::Inputs::DeadLetterQueue path=>\"/var/lib/logstash/dead_letter_queue\", id=>\"813df15404507532c4a60b451cdd58575ef19ddc07cd76c1c9df63ea7cabd073\", enable_metric=>true, codec=><LogStash::Codecs::Plain id=>\"plain_61c11650-72f2-49bc-a08a-81497b197003\", enable_metric=>true, charset=>\"UTF-8\">, pipeline_id=>\"main\", commit_offsets=>true>", :error=>"User limit of inotify instances reached or too many open files", :thread=>"#<Thread:0x92b8b5c@/usr/share/logstash/vendor/bundle/jruby/2.3.0/gems/stud-0.0.23/lib/stud/interval.rb:18 run>"}

[2018-08-27T11:10:59,028][ERROR][logstash.pipeline ] Pipeline aborted due to error {:pipeline_id=>"dlq-test", :exception=>java.io.IOException: User limit of inotify instances reached or too many open files, :backtrace=>["sun.nio.fs.LinuxWatchService.<init>(sun/nio/fs/LinuxWatchService.java:64)", "sun.nio.fs.LinuxFileSystem.newWatchService(sun/nio/fs/LinuxFileSystem.java:47)", "org.logstash.common.io.DeadLetterQueueReader.<init>(org/logstash/common/io/DeadLetterQueueReader.java:54)", "org.logstash.input.DeadLetterQueueInputPlugin.<init>(org/logstash/input/DeadLetterQueueInputPlugin.java:48)", "java.lang.reflect.Constructor.newInstance(java/lang/reflect/Constructor.java:423)", "org.jruby.javasupport.JavaConstructor.newInstanceDirect(org/jruby/javasupport/JavaConstructor.java:246)", "org.jruby.RubyClass.newInstance(org/jruby/RubyClass.java:1022)", "org.jruby.RubyClass$INVOKER$i$newInstance.call(org/jruby/RubyClass$INVOKER$i$newInstance.gen)", "usr.share.logstash.vendor.bundle.jruby.$2_dot_3_dot_0.gems.logstash_minus_input_minus_dead_letter_queue_minus_1_dot_1_dot_4.lib.logstash.inputs.dead_letter_queue.invokeOther50:new(usr/share/logstash/vendor/bundle/jruby/$2_dot_3_dot_0/gems/logstash_minus_input_minus_dead_letter_queue_minus_1_dot_1_dot_4/lib/logstash/inputs//usr/share/logstash/vendor/bundle/jruby/2.3.0/gems/logstash-input-dead_letter_queue-1.1.4/lib/logstash/inputs/dead_letter_queue.rb:54)", "usr.share.logstash.vendor.bundle.jruby.$2_dot_3_dot_0.gems.logstash_minus_input_minus_dead_letter_queue_minus_1_dot_1_dot_4.lib.logstash.inputs.dead_letter_queue.register(/usr/share/logstash/vendor/bundle/jruby/2.3.0/gems/logstash-input-dead_letter_queue-1.1.4/lib/logstash/inputs/dead_letter_queue.rb:54)", "usr.share.logstash.logstash_minus_core.lib.logstash.pipeline.invokeOther0:register(usr/share/logstash/logstash_minus_core/lib/logstash//usr/share/logstash/logstash-core/lib/logstash/pipeline.rb:342)", "usr.share.logstash.logstash_minus_core.lib.logstash.pipeline.register_plugin(/usr/share/logstash/logstash-core/lib/logstash/pipeline.rb:342)", "usr.share.logstash.logstash_minus_core.lib.logstash.pipeline.invokeOther0:register_plugin(usr/share/logstash/logstash_minus_core/lib/logstash//usr/share/logstash/logstash-core/lib/logstash/pipeline.rb:353)", "usr.share.logstash.logstash_minus_core.lib.logstash.pipeline.block in register_plugins(/usr/share/logstash/logstash-core/lib/logstash/pipeline.rb:353)", "org.jruby.RubyArray.each(org/jruby/RubyArray.java:1734)", "org.jruby.RubyArray$INVOKER$i$0$0$each.call(org/jruby/RubyArray$INVOKER$i$0$0$each.gen)", "usr.share.logstash.logstash_minus_core.lib.logstash.pipeline.invokeOther3:each(usr/share/logstash/logstash_minus_core/lib/logstash//usr/share/logstash/logstash-core/lib/logstash/pipeline.rb:353)", "usr.share.logstash.logstash_minus_core.lib.logstash.pipeline.register_plugins(/usr/share/logstash/logstash-core/lib/logstash/pipeline.rb:353)", "usr.share.logstash.logstash_minus_core.lib.logstash.pipeline.invokeOther17:register_plugins(usr/share/logstash/logstash_minus_core/lib/logstash//usr/share/logstash/logstash-core/lib/logstash/pipeline.rb:500)", "usr.share.logstash.logstash_minus_core.lib.logstash.pipeline.start_inputs(/usr/share/logstash/logstash-core/lib/logstash/pipeline.rb:500)", "usr.share.logstash.logstash_minus_core.lib.logstash.pipeline.invokeOther80:start_inputs(usr/share/logstash/logstash_minus_core/lib/logstash//usr/share/logstash/logstash-core/lib/logstash/pipeline.rb:394)", "usr.share.logstash.logstash_minus_core.lib.logstash.pipeline.start_workers(/usr/share/logstash/logstash-core/lib/logstash/pipeline.rb:394)", "usr.share.logstash.logstash_minus_core.lib.logstash.pipeline.invokeOther9:start_workers(usr/share/logstash/logstash_minus_core/lib/logstash//usr/share/logstash/logstash-core/lib/logstash/pipeline.rb:290)", "usr.share.logstash.logstash_minus_core.lib.logstash.pipeline.run(/usr/share/logstash/logstash-core/lib/logstash/pipeline.rb:290)", "usr.share.logstash.logstash_minus_core.lib.logstash.pipeline.invokeOther4:run(usr/share/logstash/logstash_minus_core/lib/logstash//usr/share/logstash/logstash-core/lib/logstash/pipeline.rb:250)", "usr.share.logstash.logstash_minus_core.lib.logstash.pipeline.block in start(/usr/share/logstash/logstash-core/lib/logstash/pipeline.rb:250)", "org.jruby.RubyProc.call(org/jruby/RubyProc.java:289)", "org.jruby.RubyProc.call(org/jruby/RubyProc.java:246)", "java.lang.Thread.run(java/lang/Thread.java:748)"], :thread=>"#<Thread:0x92b8b5c@/usr/share/logstash/vendor/bundle/jruby/2.3.0/gems/stud-0.0.23/lib/stud/interval.rb:18 run>"}

[2018-08-27T11:10:59,029][ERROR][logstash.agent ] Failed to execute action {:id=>:"dlq-test", :action_type=>LogStash::ConvergeResult::FailedAction, :message=>"Could not execute action: LogStash::PipelineAction::Create/pipeline_id:dlq-test, action_result: false", :backtrace=>nil}

Could explain me how to create pipeline for DLQ ?

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.