I receive this error when trying to send index to elastic output

Elastic Stack Logstash
1 
[INFO ][logstash.agent           ] Pipelines running {:count=>1, :running_pipelines=>[:exec_result], :non_running_pipelines=>[]}
[2023-10-05T13:36:37,359][ERROR][logstash.javapipeline    ][exec_result] Pipeline worker error, the pipeline will be stopped {:pipeline_id=>"exec_result", :error=>"(NoMethodError) undefined method `shutdown_requested?' for #<LogStash::JavaPipeline:0x71cfd3e1>", :exception=>Java::OrgJrubyExceptions::NoMethodError, :backtrace=>["usr.share.logstash.vendor.bundle.jruby.$2_dot_5_dot_0.gems.logstash_minus_output_minus_elasticsearch_minus_11_dot_16_dot_0_minus_java.lib.logstash.plugin_mixins.elasticsearch.common.pipeline_shutdown_requested?(/usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-output-elasticsearch-11.16.0-java/lib/logstash/plugin_mixins/elasticsearch/common.rb:384)", "usr.share.logstash.vendor.bundle.jruby.$2_dot_5_dot_0.gems.logstash_minus_output_minus_elasticsearch_minus_11_dot_16_dot_0_minus_java.lib.logstash.outputs.elasticsearch.wait_for_successful_connection(/usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-output-elasticsearch-11.16.0-java/lib/logstash/outputs/elasticsearch.rb:426)", "usr.share.logstash.vendor.bundle.jruby.$2_dot_5_dot_0.gems.logstash_minus_output_minus_elasticsearch_minus_11_dot_16_dot_0_minus_java.lib.logstash.outputs.elasticsearch.multi_receive(/usr/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-output-elasticsearch-11.16.0-java/lib/logstash/outputs/elasticsearch.rb:376)", "org.logstash.config.ir.compiler.OutputStrategyExt$AbstractOutputStrategyExt.multi_receive(org/logstash/config/ir/compiler/OutputStrategyExt.java:143)", "org.logstash.config.ir.compiler.AbstractOutputDelegatorExt.multi_receive(org/logstash/config/ir/compiler/AbstractOutputDelegatorExt.java:121)", "usr.share.logstash.logstash_minus_core.lib.logstash.java_pipeline.start_workers(/usr/share/logstash/logstash-core/lib/logstash/java_pipeline.rb:295)"], :thread=>"#<Thread:0x3729bf45 sleep>"}

This is my pipeline config test, this error is only when I used plugin elasticsearch output

input {
    mongodb {
        uri => 'mongodb://test_user:test_mongo_user@mongo_db:27017/mongo-test-results'
        placeholder_db_dir => '/opt/logstash-mongodb/'
        placeholder_db_name => 'logstash_sqlite.db'
        collection => 'test_result'
        batch_size => 10000
        generateId => 'true'
        parse_method => 'flatten'
    }
}

filter {
  mutate {
    gsub => [ "log_entry", "=>", ": " ]
    gsub => [ "log_entry", "(\d{4}-\d{2}-\d{2} \d{2}:\d{2}:\d{2} \w+,)", '"\1"' ]
    gsub => [ "log_entry", "BSON::ObjectId\('([0-9a-f]+)'\)", '"\1"' ]
    rename => { "_id" => "mongo_id" }
    remove_field => [ "log_entry","host","date_expiration","date_created" ]
    }
  json { 
    source => "json_log"
  }
 }  


output {        
        elasticsearch {
                action => "index"
                index => "mongo_exec_result"
                hosts => ["elasticservice:9200"]
                user => "test_user"
                password => "test_password"
        }
        stdout {
                codec => rubydebug
        }
}
2

I do not understand how that error could occur. A JavaPipeline definitely has a shutdown_requested? method. The original (11.15.0) implementation of this call had a typo, but that was fixed in 11.15.5. 11.16.0 should have the fix, and the error message indicates it does.

3

I think that was overload service.

4

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.