Hi,
I've setup elastic-7.1.1 and enabled http.ssl and transport.ssl and this seems to be working fine (I've also installed Kibana).
I next lifted an old conf file from a previous version of Logstash that I'm running on another machine (v 5.5.2) but when running this from the command line using logstash -f .\ncv.conf, I received errors and therefore disabled both http.ssl and transport.ssl in elastic (even though the errors don't seem to have anything to do with security).
My conf file is as per below:
input {
jdbc {
jdbc_driver_library => "E:\Oracle\client64\product\12.1.0\client_1\jdbc\lib\ojdbc6.jar"
jdbc_driver_class => "Java::oracle.jdbc.driver.OracleDriver"
jdbc_connection_string => "jdbc:oracle:thin:@5oracle.mydomain.net:1521/prod.WORLD"
jdbc_user => "USERNAME"
jdbc_password => "PASSWORD"
jdbc_validate_connection => true
jdbc_paging_enabled => "true"
jdbc_page_size => "100000"
statement => "select o.order_id as id, o.status as status, to_char(o.updt_dt_tm, 'dd/mm/yyyy hh24:mi') as UPDT_DT_TM from orders o where o.order_id = 105994115.000000;"
}
}
output {
elasticsearch {
hosts => "http://mypc5874:9200"
index => "logstash-ncv"
user => "elastic"
password => "elasticpassword"
document_id => "%{id}"
}
stdout { codec => rubydebug }
}
The below is the error message I receive:
E:\logstash-7.1.1\bin>logstash -f e:\logstash-7.1.1\bin\ncv.conf
Sending Logstash logs to E:/logstash-7.1.1/logs which is now configured via log4j2.properties
[2020-02-03T13:18:27,053][WARN ][logstash.config.source.multilocal] Ignoring the 'pipelines.yml' file because modules or command line options are specified
[2020-02-03T13:18:27,075][INFO ][logstash.runner ] Starting Logstash {"logstash.version"=>"7.1.1"}
[2020-02-03T13:18:28,573][ERROR][logstash.agent ] Failed to execute action {:action=>LogStash::PipelineAction::Create/pipeline_id:main, :exception=>"Java::JavaLang::NoSuchMethodError", :message=>"com.google.common.collect.Sets$SetView.iterator()Lcom/google/common/collect/UnmodifiableIterator;", :backtrace=>["org.logstash.plugins.discovery.Reflections.expandSuperTypes(Reflections.java:114)", "org.logstash.plugins.discovery.Reflections.<init>(Reflections.java:36)", "org.logstash.plugins.discovery.Reflections.<init>(Reflections.java:46)", "org.logstash.plugins.discovery.Reflections.<init>(Reflections.java:42)", "org.logstash.plugins.discovery.PluginRegistry.discoverPluginsPluginRegistry.java:36)", "org.logstash.plugins.discovery.PluginRegistry.<clinit>(PluginRegistry.java:29)", "org.logstash.plugins.PluginLookup.lookup(PluginLookup.java:27)", "org.logstash.plugins.PluginFactoryExt$Plugins.plugin(PluginFactoryExt.java:200)", "org.logstash.plugins.PluginFactoryExt$Plugins.buildInput(PluginFactoryExt.java:117)", "org.logstash.config.ir.CompiledPipeline.lambda$setupInputs$1(CompiledPipeline.java:150)", "java.util.ArrayList.forEach(ArrayList.java:1249)", "org.logstash.config.ir.CompiledPipeline.setupInputs(CompiledPipeline.java:147)", "org.logstash.config.ir.CompiledPipeline.<init>(CompiledPipeline.java:80)", "org.logstash.execution.JavaBasePipelineExt.initialize(JavaBasePipelineExt.java:50)", "org.logstash.execution.JavaBasePipelineExt$INVOKER$i$1$0$initialize.call(JavaBasePipelineExt$INVOKER$i$1$0$initialize.gen)", "org.jruby.internal.runtime.methods.JavaMethod$JavaMethodN.call(JavaMethod.java:837)", "org.jruby.ir.runtime.IRRuntimeHelpers.instanceSuper(IRRuntimeHelpers.java:1154)", "org.jruby.ir.runtime.IRRuntimeHelpers.instanceSuperSplatArgs(IRRuntimeHelpers.java:1141)", "org.jruby.ir.targets.InstanceSu
perInvokeSite.invoke(InstanceSuperInvokeSite.java:39)", "E_3a_.logstash_minus_7_dot_1_dot_1.logstash_minus_core.lib.logstash.java_pipeline.RUBY$method$initialize$0(E:/logstash-7.1.1/logstash-core/lib/logstash/java_pipeline.rb:23)", "org.jruby.internal.runtime.methods.CompiledIRMethod.call(CompiledIRMethod.java:91)", "org.jruby.internal.runtime.methods.MixedModeIRMethod.call(MixedModeIRMethod.java:90)", "org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:296)", "org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:82)", "org.jruby.RubyClass.newInstance(RubyClass.java:915)", "org.jruby.RubyClass$INVOKER$i$newInstance.call(RubyClass$INVOKER$i$newInstance.gen)", "org.jruby.ir.targets.InvokeSite.invoke(InvokeSite.java:183)", "E_3a_.logstash_minus_7_dot_1_dot_1.logstash_minus_core.lib.logstash.pipeline_action.create.RUBY$method$execute$0(E:/logstash-7.1.1/logstash-core/lib/logstash/pipeline_action/create.rb:36)", "E_3a_.logstash_minus_7_dot_1_dot_1.logstash_minus_core.lib.logstash.pipeline
_action.create.RUBY$method$execute$0$__VARARGS__(E:/logstash-7.1.1/logstash-core/lib/logstash/pipeline_action/create.rb)", "org.jruby.internal.runtime.methods.CompiledIRMethod.call(CompiledIRMethod.java:91)", "org.jruby.internal.runtime.methods.MixedModeIRMethod.call(MixedModeIRMethod.java:90)", "org.jruby.ir.targets.InvokeSite.invoke(InvokeSite.java:183)", "E_3a_.logstash_minus_7_dot_1_dot_1.logstash_minus_core.lib.logstash.agent.RUBY$block$converge_state$2(E:/logstash-7.1.1/logstash-core/lib/logstash/agent.rb:325)", "org.jruby.runtime.CompiledIRBlockBody.callDirect(CompiledIRBlockBody.java:136)", "org.jruby.runtime.IRBlockBody.call(IRBlockBody.java:77)", "org.jruby.runtime.Block.call(Block.java:124)", "org.jruby.RubyProc.call(RubyProc.java:295)", "org.jruby.RubyProc.call(RubyProc.java:274)", "org.jruby.RubyProc.call(RubyProc.java:270)", "org.jruby.internal.runtime.RubyRunnable.run(RubyRunnable.java:105)", "java.lang.Thread.run(Thread.java:745)"]}
warning: thread "Converge PipelineAction::Create<main>" terminated with exception (report_on_exception is true):
LogStash::Error: Don't know how to handle `Java::JavaLang::NoSuchMethodError` for `PipelineAction::Create<main>`
create at org/logstash/execution/ConvergeResultExt.java:109
add at org/logstash/execution/ConvergeResultExt.java:37
converge_state at E:/logstash-7.1.1/logstash-core/lib/logstash/agent.rb:338
[2020-02-03T13:18:28,589][ERROR][logstash.agent ] An exception happened when converging configuration {:exception=>LogStash::Error, :message=>"Don't know how to handle `Java::JavaLang::NoSuchMethodError` for `PipelineAction::Create<main>`", :backtrace=>["org/logstash/execution/ConvergeResultExt.java:109:in `create'", "org/logstash/execution/ConvergeResultExt.java:37:in `add'", "E:/logstash-7.1.1/logstash-core/lib/logstash/agent.rb:338:in `block in converge_state'"]}
[2020-02-03T13:18:28,636][FATAL][logstash.runner ] An unexpected erroroccurred! {:error=>#<LogStash::Error: Don't know how to handle `Java::JavaLang::NoSuchMethodError` for `PipelineAction::Create<main>`>, :backtrace=>["org/logstash/execution/ConvergeResultExt.java:109:in `create'", "org/logstash/execution/ConvergeResultExt.java:37:in `add'", "E:/logstash-7.1.1/logstash-core/lib/logstash/agent.rb:338:in `block in converge_state'"]}
[2020-02-03T13:18:28,713][ERROR][org.logstash.Logstash ] java.lang.IllegalStateException: Logstash stopped processing because of an error: (SystemExit) exit
I've stripped down the conf file as much as I can and have no idea how to interpret this error. Any help explaining what this means and how to resolve it would be very much appreciated.