Failed to start Logstash - S3 output plugin is not working

Elastic Stack Logstash
1

Hi. I'm using Logstash.

I recently upgraded Logstash to version 8.7.0, but it's not working. I'm getting an error message.

Failed to execute action {:action=>LogStash::PipelineAction::Create/pipeline_id:OSQUERY, :exception=>"Java::JavaLang::IllegalStateException", :message=>"Unable to configure plugins: (RuntimeError) \n\n\tyou might need to reinstall the gem which depends on the missing jar or in case there is Jars.lock then resolve the jars with `lock_jars` command\n\nno such file to load -- org/logstash/plugins/integration/aws/logstash-integration-aws/7.1.0/logstash-integration-aws-7.1.0.jar (LoadError)", :backtrace=>["org.logstash.config.ir.CompiledPipeline.<init>(CompiledPipeline.java:120)", "org.logstash.execution.AbstractPipelineExt.initialize(AbstractPipelineExt.java:186)", "org.logstash.execution.AbstractPipelineExt$INVOKER$i$initialize.call(AbstractPipelineExt$INVOKER$i$initialize.gen)", "org.jruby.internal.runtime.methods.JavaMethod$JavaMethodN.call(JavaMethod.java:846)", "org.jruby.ir.runtime.IRRuntimeHelpers.instanceSuper(IRRuntimeHelpers.java:1229)", "org.jruby.ir.runtime.IRRuntimeHelpers.instanceSuperSplatArgs(IRRuntimeHelpers.java:1202)", "org.jruby.ir.targets.indy.InstanceSuperInvokeSite.invoke(InstanceSuperInvokeSite.java:29)", "usr.share.logstash.logstash_minus_core.lib.logstash.java_pipeline.RUBY$method$initialize$0(/usr/share/logstash/logstash-core/lib/logstash/java_pipeline.rb:48)", "usr.share.logstash.logstash_minus_core.lib.logstash.pipeline_action.create.RUBY$method$execute$0(/usr/share/logstash/logstash-core/lib/logstash/pipeline_action/create.rb:50)", "usr.share.logstash.logstash_minus_core.lib.logstash.agent.RUBY$block$converge_state$2(/usr/share/logstash/logstash-core/lib/logstash/agent.rb:386)", "org.jruby.runtime.CompiledIRBlockBody.callDirect(CompiledIRBlockBody.java:141)", "org.jruby.runtime.IRBlockBody.call(IRBlockBody.java:64)", "org.jruby.runtime.IRBlockBody.call(IRBlockBody.java:58)", "org.jruby.runtime.Block.call(Block.java:143)", "org.jruby.RubyProc.call(RubyProc.java:309)", "org.jruby.internal.runtime.RubyRunnable.run(RubyRunnable.java:107)", "java.base/java.lang.Thread.run(Thread.java:833)"]}

Only pipelines that use the s3 output plugin are not working.

Previous Version: 8.5.3

What I tried to do to solve the problem:

  • Reinstall Java
  • Reinstall Gem
  • Reinstall Ruby
  • Reinstall Logstash

I did all of these but the problem still persisted.

My S3 Output Plugin Conf.


output {
    s3 {
        region                  => "My Region"
        bucket                  => "My Bucket"

        validate_credentials_on_root_bucket => true 
        temporary_directory     => "./_temp/s3/" 
        rotation_strategy       => "size_and_time"
        time_file               => 10 
        prefix                  => "ysp/"
        encoding                => "gzip"
        retry_count             => 3 
        retry_delay             => 3
        codec                   => json_lines
        enable_metric           => false
    }
}

What should I do?

2

Same story here. Version 8.5.3 worked. But the lastest release 8.7.0 is giving me same error.

I think they will do a bug fix release soon.

3

Thank you for your response.

Since there are no other responses, I guess I have to wait.

If anyone has solved this problem, please provide an answer.

4

@WonhyeongCho Have you raised a bug report for this?

5

Did you open a bug report? Without it Elastic probably doesn't even know about this issue.

You need to open a bug report on the plugin repository

6

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.