# Logstash 7.2 exception when enabling TLS and X-pack (error with elastic output) **URL:** \ **Category:** Logstash\ **Created:** [July 21, 2019, 5:57pm UTC](https://discuss.elastic.co/t/logstash-7-2-exception-when-enabling-tls-and-x-pack-error-with-elastic-output/191532 "2019-07-21T17:57:18Z")\ **Posts on this page:** 8\ **Page:** 1
**Author:** ![LogBabel](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/logbabel/32/45107_2.png) [@LogBabel](https://discuss.elastic.co/u/LogBabel)\ **Post date:** [July 21, 2019, 5:57pm UTC](https://discuss.elastic.co/t/logstash-7-2-exception-when-enabling-tls-and-x-pack-error-with-elastic-output/191532/1 "2019-07-21T17:57:18Z")
Hello. After an upgrade to Logstash 7.2 my config using Ruby code fails to start. The Ruby code is basic inline using "ruby { code =\> '`' } "` Error message below. Thank you for the help. Here is the giant error, it is too big for a single post so I will break it up into two. [2019-07-21T10:52:06,171][WARN][logstash.config.source.multilocal] Ignoring the 'pipelines.yml' file because modules or command line options are specified [2019-07-21T10:52:06,185][INFO][logstash.runner] Starting Logstash {"logstash.version"=\>"7.2.0"} [2019-07-21T10:52:11,234][ERROR][logstash.javapipeline] java.lib.manticore.client.pool\_builder(/opt/share/logstash/vendor/bundle/jruby/2.5.0/gems/manticore-0.6.4-java/lib/manticore/client.rb:397)", "opt.share.logstash.vendor.bundle.jruby.$2\_dot\_5\_dot\_0.gems.manticore\_minus\_0\_dot\_6\_dot\_4\_minus\_java.lib.manticore.client.RUBY$method$pool\_builder$0$ **VARARGS** (opt/share/logstash/vendor/bundle/jruby/$2\_dot\_5\_dot\_0/gems/manticore\_minus\_0\_dot\_6\_dot\_4\_minus\_java/lib/manticore//opt/share/logstash/vendor/bundle/jruby/2.5.0/gems/manticore-0.6.4-java/lib/manticore/client.rb)", "opt.share.logstash.vendor.bundle.jruby.$2\_dot\_5\_dot\_0.gems.manticore\_minus\_0\_dot\_6\_dot\_4\_minus\_java.lib.manticore.client.pool(/opt/share/logstash/vendor/bundle/jruby/2.5.0/gems/manticore-0.6.4-java/lib/manticore/client.rb:405)", "opt.share.logstash.vendor.bundle.jruby.$2\_dot\_5\_dot\_0.gems.manticore\_minus\_0\_dot\_6\_dot\_4\_minus\_java.lib.manticore.client.initialize(/opt/share/logstash/vendor/bundle/jruby/2.5.0/gems/manticore-0.6.4-java/lib/manticore/client.rb:209)", "org.jruby.RubyClass.newInstance(org/jruby/RubyClass.java:915)", "org.jruby.RubyClass$INVOKER$i$newInstance.call(org/jruby/RubyClass$INVOKER$i$newInstance.gen)", "opt.share.logstash.vendor.bundle.jruby.$2\_dot\_5\_dot\_0.gems.logstash\_minus\_output\_minus\_elasticsearch\_minus\_10\_dot\_1\_dot\_0\_minus\_java.lib.logstash.outputs.elasticsearch.http\_client.manticore\_adapter.initialize(/opt/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-output-elasticsearch-10.1.0-java/lib/logstash/outputs/elasticsearch/http\_client/manticore\_adapter.rb:26)", "org.jruby.RubyClass.newInstance(org/jruby/RubyClass.java:915)", "org.jruby.RubyClass$INVOKER$i$newInstance.call(org/jruby/RubyClass$INVOKER$i$newInstance.gen)", "opt.share.logstash.vendor.bundle.jruby.$2\_dot\_5\_dot\_0.gems.logstash\_minus\_output\_minus\_elasticsearch\_minus\_10\_dot\_1\_dot\_0\_minus\_java.lib.logstash.outputs.elasticsearch.http\_client.build\_adapter(/opt/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-output-elasticsearch-10.1.0-java/lib/logstash/outputs/elasticsearch/http\_client.rb:282)", "opt.share.logstash.vendor.bundle.jruby.$2\_dot\_5\_dot\_0.gems.logstash\_minus\_output\_minus\_elasticsearch\_minus\_10\_dot\_1\_dot\_0\_minus\_java.lib.logstash.outputs.elasticsearch.http\_client.RUBY$method$build\_adapter$0$ **VARARGS** (opt/share/logstash/vendor/bundle/jruby/$2\_dot\_5\_dot\_0/gems/logstash\_minus\_output\_minus\_elasticsearch\_minus\_10\_dot\_1\_dot\_0\_minus\_java/lib/logstash/outputs/elasticsearch//opt/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-output-elasticsearch-10.1.0-java/lib/logstash/outputs/elasticsearch/http\_client.rb)", "opt.share.logstash.vendor.bundle.jruby.$2\_dot\_5\_dot\_0.gems.logstash\_minus\_output\_minus\_elasticsearch\_minus\_10\_dot\_1\_dot\_0\_minus\_java.lib.logstash.outputs.elasticsearch.http\_client.build\_pool(/opt/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-output-elasticsearch-10.1.0-java/lib/logstash/outputs/elasticsearch/http\_client.rb:286)", "opt.share.logstash.vendor.bundle.jruby.$2\_dot\_5\_dot\_0.gems.logstash\_minus\_output\_minus\_elasticsearch\_minus\_10\_dot\_1\_dot\_0\_minus\_java.lib.logstash.outputs.elasticsearch.http\_client.RUBY$method$build\_pool$0$ **VARARGS** (opt/share/logstash/vendor/bundle/jruby/$2\_dot\_5\_dot\_0/gems/logstash\_minus\_output\_minus\_elasticsearch\_minus\_10\_dot\_1\_dot\_0\_minus\_java/lib/logstash/outputs/elasticsearch//opt/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-output-elasticsearch-10.1.0-java/lib/logstash/outputs/elasticsearch/http\_client.rb)", "opt.share.logstash.vendor.bundle.jruby.$2\_dot\_5\_dot\_0.gems.logstash\_minus\_output\_minus\_elasticsearch\_minus\_10\_dot\_1\_dot\_0\_minus\_java.lib.logstash.outputs.elasticsearch.http\_client.initialize(/opt/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-output-elasticsearch-10.1.0-java/lib/logstash/outputs/elasticsearch/http\_client.rb:64)", "org.jruby.RubyClass.newInstance(org/jruby/RubyClass.java:915)", "org.jruby.RubyClass$INVOKER$i$newInstance.call(org/jruby/RubyClass$INVOKER$i$newInstance.gen)", "opt.share.logstash.vendor.bundle.jruby.$2\_dot\_5\_dot\_0.gems.logstash\_minus\_output\_minus\_elasticsearch\_minus\_10\_dot\_1\_dot\_0\_minus\_java.lib.logstash.outputs.elasticsearch.http\_client\_builder.create\_http\_client(/opt/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-output-elasticsearch-10.1.0-java/lib/logstash/outputs/elasticsearch/http\_client\_builder.rb:103)", ---
**Author:** ![LogBabel](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/logbabel/32/45107_2.png) [@LogBabel](https://discuss.elastic.co/u/LogBabel)\ **Post date:** [July 21, 2019, 5:57pm UTC](https://discuss.elastic.co/t/logstash-7-2-exception-when-enabling-tls-and-x-pack-error-with-elastic-output/191532/2 "2019-07-21T17:57:46Z")
Continuation of error message from initial post: "opt.share.logstash.vendor.bundle.jruby.$2\_dot\_5\_dot\_0.gems.logstash\_minus\_output\_minus\_elasticsearch\_minus\_10\_dot\_1\_dot\_0\_minus\_java.lib.logstash.outputs.elasticsearch.http\_client\_builder.RUBY$method$create\_http\_client$0$ **VARARGS** (opt/share/logstash/vendor/bundle/jruby/$2\_dot\_5\_dot\_0/gems/logstash\_minus\_output\_minus\_elasticsearch\_minus\_10\_dot\_1\_dot\_0\_minus\_java/lib/logstash/outputs/elasticsearch//opt/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-output-elasticsearch-10.1.0-java/lib/logstash/outputs/elasticsearch/http\_client\_builder.rb)", "opt.share.logstash.vendor.bundle.jruby.$2\_dot\_5\_dot\_0.gems.logstash\_minus\_output\_minus\_elasticsearch\_minus\_10\_dot\_1\_dot\_0\_minus\_java.lib.logstash.outputs.elasticsearch.http\_client\_builder.build(/opt/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-output-elasticsearch-10.1.0-java/lib/logstash/outputs/elasticsearch/http\_client\_builder.rb:99)", "opt.share.logstash.vendor.bundle.jruby.$2\_dot\_5\_dot\_0.gems.logstash\_minus\_output\_minus\_elasticsearch\_minus\_10\_dot\_1\_dot\_0\_minus\_java.lib.logstash.outputs.elasticsearch.http\_client\_builder.RUBY$method$build$0$ **VARARGS** (opt/share/logstash/vendor/bundle/jruby/$2\_dot\_5\_dot\_0/gems/logstash\_minus\_output\_minus\_elasticsearch\_minus\_10\_dot\_1\_dot\_0\_minus\_java/lib/logstash/outputs/elasticsearch//opt/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-output-elasticsearch-10.1.0-java/lib/logstash/outputs/elasticsearch/http\_client\_builder.rb)", "opt.share.logstash.vendor.bundle.jruby.$2\_dot\_5\_dot\_0.gems.logstash\_minus\_output\_minus\_elasticsearch\_minus\_10\_dot\_1\_dot\_0\_minus\_java.lib.logstash.outputs.elasticsearch.build\_client(/opt/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-output-elasticsearch-10.1.0-java/lib/logstash/outputs/elasticsearch.rb:238)", "opt.share.logstash.vendor.bundle.jruby.$2\_dot\_5\_dot\_0.gems.logstash\_minus\_output\_minus\_elasticsearch\_minus\_10\_dot\_1\_dot\_0\_minus\_java.lib.logstash.outputs.elasticsearch.RUBY$method$build\_client$0$ **VARARGS** (opt/share/logstash/vendor/bundle/jruby/$2\_dot\_5\_dot\_0/gems/logstash\_minus\_output\_minus\_elasticsearch\_minus\_10\_dot\_1\_dot\_0\_minus\_java/lib/logstash/outputs//opt/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-output-elasticsearch-10.1.0-java/lib/logstash/outputs/elasticsearch.rb)", "opt.share.logstash.vendor.bundle.jruby.$2\_dot\_5\_dot\_0.gems.logstash\_minus\_output\_minus\_elasticsearch\_minus\_10\_dot\_1\_dot\_0\_minus\_java.lib.logstash.outputs.elasticsearch.common.register(/opt/share/logstash/vendor/bundle/jruby/2.5.0/gems/logstash-output-elasticsearch-10.1.0-java/lib/logstash/outputs/elasticsearch/common.rb:25)", "org.jruby.RubyClass.finvoke(org/jruby/RubyClass.java:548)", "org.jruby.RubyBasicObject.callMethod(org/jruby/RubyBasicObject.java:354)", "org.logstash.config.ir.compiler.OutputStrategyExt$SimpleAbstractOutputStrategyExt.reg(org/logstash/config/ir/compiler/OutputStrategyExt.java:246)", "org.logstash.config.ir.compiler.OutputStrategyExt$AbstractOutputStrategyExt.register(org/logstash/config/ir/compiler/OutputStrategyExt.java:106)", "org.logstash.config.ir.compiler.OutputDelegatorExt.doRegister(org/logstash/config/ir/compiler/OutputDelegatorExt.java:91)", "org.logstash.config.ir.compiler.AbstractOutputDelegatorExt.register(org/logstash/config/ir/compiler/AbstractOutputDelegatorExt.java:48)", "org.logstash.config.ir.compiler.AbstractOutputDelegatorExt$INVOKER$i$0$0$register.call(org/logstash/config/ir/compiler/AbstractOutputDelegatorExt$INVOKER$i$0$0$register.gen)", "opt.share.logstash.logstash\_minus\_core.lib.logstash.java\_pipeline.register\_plugins(/opt/share/logstash/logstash-core/lib/logstash/java\_pipeline.rb:192)", "org.jruby.RubyArray.each(org/jruby/RubyArray.java:1792)", "org.jruby.RubyArray$INVOKER$i$0$0$each.call(org/jruby/RubyArray$INVOKER$i$0$0$each.gen)", "opt.share.logstash.logstash\_minus\_core.lib.logstash.java\_pipeline.register\_plugins(/opt/share/logstash/logstash-core/lib/logstash/java\_pipeline.rb:191)", "opt.share.logstash.logstash\_minus\_core.lib.logstash.java\_pipeline.RUBY$method$register\_plugins$0$ **VARARGS** (opt/share/logstash/logstash\_minus\_core/lib/logstash//opt/share/logstash/logstash-core/lib/logstash/java\_pipeline.rb)", "opt.share.logstash.logstash\_minus\_core.lib.logstash.java\_pipeline.maybe\_setup\_out\_plugins(/opt/share/logstash/logstash-core/lib/logstash/java\_pipeline.rb:462)", "opt.share.logstash.logstash\_minus\_core.lib.logstash.java\_pipeline.RUBY$method$maybe\_setup\_out\_plugins$0$ **VARARGS** (opt/share/logstash/logstash\_minus\_core/lib/logstash//opt/share/logstash/logstash-core/lib/logstash/java\_pipeline.rb)", "opt.share.logstash.logstash\_minus\_core.lib.logstash.java\_pipeline.start\_workers(/opt/share/logstash/logstash-core/lib/logstash/java\_pipeline.rb:204)", "opt.share.logstash.logstash\_minus\_core.lib.logstash.java\_pipeline.RUBY$method$start\_workers$0$ **VARARGS** (opt/share/logstash/logstash\_minus\_core/lib/logstash//opt/share/logstash/logstash-core/lib/logstash/java\_pipeline.rb)", "opt.share.logstash.logstash\_minus\_core.lib.logstash.java\_pipeline.run(/opt/share/logstash/logstash-core/lib/logstash/java\_pipeline.rb:146)", "opt.share.logstash.logstash\_minus\_core.lib.logstash.java\_pipeline.RUBY$method$run$0$ **VARARGS** (opt/share/logstash/logstash\_minus\_core/lib/logstash//opt/share/logstash/logstash-core/lib/logstash/java\_pipeline.rb)", "opt.share.logstash.logstash\_minus\_core.lib.logstash.java\_pipeline.start(/opt/share/logstash/logstash-core/lib/logstash/java\_pipeline.rb:105)", "org.jruby.RubyProc.call(org/jruby/RubyProc.java:295)", "org.jruby.RubyProc.call(org/jruby/RubyProc.java:274)", "org.jruby.RubyProc.call(org/jruby/RubyProc.java:270)", "java.lang.Thread.run(java/lang/Thread.java:834)"], :thread=\>"#\"} [2019-07-21T10:52:11,258][ERROR][logstash.agent] Failed to execute action {:id=\>:main, :action\_type=\>LogStash::ConvergeResult::FailedAction, :message=\>"Could not execute action: PipelineAction::Create, action\_result: false", :backtrace=\>nil} [2019-07-21T10:52:11,543][INFO][logstash.agent] Successfully started Logstash API endpoint {:port=\>9600} [2019-07-21T10:52:16,633][INFO][logstash.runner] Logstash shut down. ---
**Author:** ![Badger](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/badger/32/25190_2.png) [@Badger](https://discuss.elastic.co/u/Badger)\ **Post date:** [July 21, 2019, 10:44pm UTC](https://discuss.elastic.co/t/logstash-7-2-exception-when-enabling-tls-and-x-pack-error-with-elastic-output/191532/3 "2019-07-21T22:44:11Z")
The error appears to be in an elasticsearch output, not in a ruby filter. Can you show us your configuration? Did you upgrade elasticsearch to 7.2 along with logstash? ---
**Author:** ![LogBabel](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/logbabel/32/45107_2.png) [@LogBabel](https://discuss.elastic.co/u/LogBabel)\ **Post date:** [July 22, 2019, 3:49pm UTC](https://discuss.elastic.co/t/logstash-7-2-exception-when-enabling-tls-and-x-pack-error-with-elastic-output/191532/4 "2019-07-22T15:49:17Z")
Thanks, that helps, it's probably the TLS and auth setup. Yes, Elasticsearch was upgraded to 7.2 prior to the Logstash upgrade. Logstash remained at 6.8 and continued to operate. The major change was enabling x-pack and TLS on the ES cluster. Logstash was then upgraded to 7.2 and modified to use TLS and authentication. I've followed the guides for creating users. The logstash user has all relevant privileges. The logstash TLS config is somewhat unclear compared to the config for enabling cluster TLS. Maybe this is where the problem is. The ES output config is: elasticsearch { hosts =\> ["[https://10.1.1.1:9200](https://10.1.1.1:9200)"] codec =\> "plain" sniffing =\> false index =\> "logfiles-%{+YYYY.MM.dd}" manage\_template =\> false template\_name =\> "logfiles\_template" template\_overwrite =\> false ssl =\> true ssl\_certificate\_verification =\> false cacert =\> "/etc/logstash/certs/elastic-ca.pem" user =\> "user" password =\> "password" } ---
**Author:** ![Badger](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/badger/32/25190_2.png) [@Badger](https://discuss.elastic.co/u/Badger)\ **Post date:** [July 22, 2019, 4:22pm UTC](https://discuss.elastic.co/t/logstash-7-2-exception-when-enabling-tls-and-x-pack-error-with-elastic-output/191532/5 "2019-07-22T16:22:41Z")
The [place](https://github.com/cheald/manticore/blob/5a2fb766cb6f96ff7b1082381d65f15f6235dbb5/lib/manticore/client.rb#L397) where the exception occurs is certainly TLS related. You might want to fix the title of the thread to be 'Logstash 7.2 exception when enabling TLS and X-pack'. I do not run elasticsearch so I cannot help further. ---
**Author:** ![LogBabel](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/logbabel/32/45107_2.png) [@LogBabel](https://discuss.elastic.co/u/LogBabel)\ **Post date:** [July 22, 2019, 4:33pm UTC](https://discuss.elastic.co/t/logstash-7-2-exception-when-enabling-tls-and-x-pack-error-with-elastic-output/191532/6 "2019-07-22T16:33:01Z")
Thanks, I will change the subject. You helped me see the problem differently where I could solve it after slight config modifications. The CA cert wasn't in the correct format (.pem vs .p12) Now there's a different error about "ressurrect connection to dead ES instance" relating to 'response code 403' which I think may be related to ES user permissions. ---
**Author:** ![LogBabel](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/logbabel/32/45107_2.png) [@LogBabel](https://discuss.elastic.co/u/LogBabel)\ **Post date:** [July 22, 2019, 5:17pm UTC](https://discuss.elastic.co/t/logstash-7-2-exception-when-enabling-tls-and-x-pack-error-with-elastic-output/191532/7 "2019-07-22T17:17:11Z")
This issue is resolved. The user\_role was lacking specifics from the Elastic documentation. ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [August 19, 2019, 5:29pm UTC](https://discuss.elastic.co/t/logstash-7-2-exception-when-enabling-tls-and-x-pack-error-with-elastic-output/191532/8 "2019-08-19T17:29:52Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.