Hi all,
I'm having an issue with any logstash plugin deployment. I tried logstash-plugin install logstash-output-google_cloud_storage several times and I was met with several different error messages that seemed to be pointing to a proxy misconfiguration in my windows server, but I was able to download other packages or at least run other commands that showed that wasn't the issue. I than followed the off-line plugin option from below github repo:
I was able to install the logstash plugin successfully and have the ability to view the plugin when I run "logstash-plugin list".
logstash-output-file
logstash-output-google_cloud_storage
logstash-output-graphite
logstash-output-http
logstash-output-lumberjack
I than tried to start logstash with the following command and config file:
.\logstash.bat --debug -f .\config\logstash-sample.conf
input {
beats {
port => "5044"
}
}
filter {
kv {
field_split => ";"
}
mutate { convert => { "HttpStatus" => "integer" } }
mutate { convert => { "RequestSize" => "integer" } }
mutate { convert => { "ResponseSize" => "integer" } }
mutate { convert => { "RoutingTime" => "integer" } }
mutate { convert => { "TotalTime" => "integer" } }
if [RoutingTime] and [RoutingTime] > 0 {
ruby { code => "event['***Time'] = event['TotalTime'] - event['RoutingTime']" }
} else {
mutate { add_field => [ "**Time", "%{TotalTime}" ] }
}
}
output {
google_cloud_storage {
bucket => "**-ilogbucket"
}
}
I get the following error every time:
][ERROR][logstash.agent ] Failed to execute action {:action=>LogStash::PipelineAction::Create/pipeline_id:main, :exception=>"Java::JavaLang::IllegalStateException", :message=>"Unable to configure plugins: (PluginLoadingError) Couldn't find any output plugin named 'google_cloud_storage'. Are you sure this is correct? Trying to load the google_cloud_storage output plugin resulted in this error: Unable to load the requested plugin named google_cloud_storage of type output. The plugin is not installed.", :backtrace=>["org.logstash.config.ir.CompiledPipeline.(CompiledPipeline.java:120)", "org.logstash.execution.AbstractPipelineExt.initialize(AbstractPipelineExt.java:186)", "org.logstash.execution.AbstractPipelineExt$INVOKER$i$initialize.call(AbstractPipelineExt$INVOKER$i$initialize.gen)", "org.jruby.internal.runtime.methods.JavaMethod$JavaMethodN.call(JavaMethod.java:847)", "org.jruby.ir.runtime.IRRuntimeHelpers.instanceSuper(IRRuntimeHelpers.java:1319)", "org.jruby.ir.instructions.InstanceSuperInstr.interpret(InstanceSuperInstr.java:139)", "org.jruby.ir.interpreter.InterpreterEngine.processCall(InterpreterEngine.java:367)", "org.jruby.ir.interpreter.StartupInterpreterEngine.interpret(StartupInterpreterEngine.java:66)", "org.jruby.internal.runtime.methods.MixedModeIRMethod.INTERPRET_METHOD(MixedModeIRMethod.java:128)", "org.jruby.internal.runtime.methods.MixedModeIRMethod.call(MixedModeIRMethod.java:115)", "org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:446)", "org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:92)", "org.jruby.RubyClass.newInstance(RubyClass.java:931)", "org.jruby.RubyClass$INVOKER$i$newInstance.call(RubyClass$INVOKER$i$newInstance.gen)", "org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:446)", "org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:92)", "org.jruby.ir.instructions.CallBase.interpret(CallBase.java:548)", "org.jruby.ir.interpreter.InterpreterEngine.processCall(InterpreterEngine.java:367)", "org.jruby.ir.interpreter.StartupInterpreterEngine.interpret(StartupInterpreterEngine.java:66)", "org.jruby.ir.interpreter.InterpreterEngine.interpret(InterpreterEngine.java:88)", "org.jruby.internal.runtime.methods.MixedModeIRMethod.INTERPRET_METHOD(MixedModeIRMethod.java:238)", "org.jruby.internal.runtime.methods.MixedModeIRMethod.call(MixedModeIRMethod.java:225)", "org.jruby.internal.runtime.methods.DynamicMethod.call(DynamicMethod.java:228)", "org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:476)", "org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:293)", "org.jruby.ir.interpreter.InterpreterEngine.processCall(InterpreterEngine.java:328)", "org.jruby.ir.interpreter.StartupInterpreterEngine.interpret(StartupInterpreterEngine.java:66)", "org.jruby.ir.interpreter.Interpreter.INTERPRET_BLOCK(Interpreter.java:116)", "org.jruby.runtime.MixedModeIRBlockBody.commonYieldPath(MixedModeIRBlockBody.java:136)", "org.jruby.runtime.IRBlockBody.call(IRBlockBody.java:66)", "org.jruby.runtime.IRBlockBody.call(IRBlockBody.java:58)", "org.jruby.runtime.Block.call(Block.java:144)", "org.jruby.RubyProc.call(RubyProc.java:352)", "org.jruby.internal.runtime.RubyRunnable.run(RubyRunnable.java:111)", "java.base/java.lang.Thread.run(Thread.java:834)"]}
Any help on where to look would be greatly appreciated:
Server specs:
Windows 2019 server
Logstash 8.2.1
Elasticsearch 8.2