Ok so I followed the documentation the best I could, in both cases I am still getting error.
Case1: using centralized management. I have created following logstash pipeline using Kibana UI
input {
beats {
port => 5044
type => "log"
host => "0.0.0.0"
}
}
output {
elasticsearch {
hosts => "https://xxxxxx:9243"
user => "elastic"
password => "xxxxxxr"
index => "%{[@metadata][beat]}-%{+yyyy.ww}"
#document_type => "%{[@metadata][type]}"
}
}
I am getting following error
[2021-05-28T14:05:57,449][ERROR][logstash.javapipeline ][main] Pipeline error {:pipeline_id=>"main", :exception=>#<L
gStash::Json::ParserError: Unexpected character ('<' (code 60)): expected a valid value (number, String, array, object,
'true', 'false' or 'null')
at [Source: (byte[])"<!DOCTYPE html><html lang="en"><head><meta charSet="utf-8"/><meta http-equiv="X-UA-Compatible" co
tent="IE=edge,chrome=1"/><meta name="viewport" content="width=device-width"/><title>Elastic</title><style>
@font-face {
font-family: 'Inter UI';
font-style: normal;
font-weight: 100;
src: url('/ui/fonts/inter_ui/Inter-UI-Thin-BETA.woff2') format('woff2'), url('/ui/fonts/inter_ui/Inter-UI-Thi
-BETA.woff') format('woff');
}
@fon"[truncated 133696 bytes]; line: 1, column: 2]>, :backtrace=>["C:/logstash-7.12.1/logstash-core/lib/logstas
/json.rb:32:in `jruby_load'", "C:/logstash-7.12.1/vendor/bundle/jruby/2.5.0/gems/logstash-output-elasticsearch-10.8.6-j
va/lib/logstash/outputs/elasticsearch/http_client/pool.rb:470:in `get_es_version'", "C:/logstash-7.12.1/vendor/bundle/j
uby/2.5.0/gems/logstash-output-elasticsearch-10.8.6-java/lib/logstash/outputs/elasticsearch/http_client/pool.rb:273:in
block in healthcheck!'", "org/jruby/RubyHash.java:1415:in `each'", "C:/logstash-7.12.1/vendor/bundle/jruby/2.5.0/gems/l
gstash-output-elasticsearch-10.8.6-java/lib/logstash/outputs/elasticsearch/http_client/pool.rb:265:in `healthcheck!'",
C:/logstash-7.12.1/vendor/bundle/jruby/2.5.0/gems/logstash-output-elasticsearch-10.8.6-java/lib/logstash/outputs/elasti
search/http_client/pool.rb:367:in `update_urls'", "C:/logstash-7.12.1/vendor/bundle/jruby/2.5.0/gems/logstash-output-el
sticsearch-10.8.6-java/lib/logstash/outputs/elasticsearch/http_client/pool.rb:83:in `update_initial_urls'", "C:/logstas
-7.12.1/vendor/bundle/jruby/2.5.0/gems/logstash-output-elasticsearch-10.8.6-java/lib/logstash/outputs/elasticsearch/htt
_client/pool.rb:77:in `start'", "C:/logstash-7.12.1/vendor/bundle/jruby/2.5.0/gems/logstash-output-elasticsearch-10.8.6
java/lib/logstash/outputs/elasticsearch/http_client.rb:338:in `build_pool'", "C:/logstash-7.12.1/vendor/bundle/jruby/2.
.0/gems/logstash-output-elasticsearch-10.8.6-java/lib/logstash/outputs/elasticsearch/http_client.rb:64:in `initialize'"
"C:/logstash-7.12.1/vendor/bundle/jruby/2.5.0/gems/logstash-output-elasticsearch-10.8.6-java/lib/logstash/outputs/elas
icsearch/http_client_builder.rb:106:in `create_http_client'", "C:/logstash-7.12.1/vendor/bundle/jruby/2.5.0/gems/logsta
h-output-elasticsearch-10.8.6-java/lib/logstash/outputs/elasticsearch/http_client_builder.rb:102:in `build'", "C:/logst
sh-7.12.1/vendor/bundle/jruby/2.5.0/gems/logstash-output-elasticsearch-10.8.6-java/lib/logstash/plugin_mixins/elasticse
rch/common.rb:34:in `build_client'", "C:/logstash-7.12.1/vendor/bundle/jruby/2.5.0/gems/logstash-output-elasticsearch-1
.8.6-java/lib/logstash/outputs/elasticsearch.rb:270:in `register'", "org/logstash/config/ir/compiler/OutputStrategyExt.
ava:131:in `register'", "org/logstash/config/ir/compiler/AbstractOutputDelegatorExt.java:68:in `register'", "C:/logstas
-7.12.1/logstash-core/lib/logstash/java_pipeline.rb:228:in `block in register_plugins'", "org/jruby/RubyArray.java:1809
in `each'", "C:/logstash-7.12.1/logstash-core/lib/logstash/java_pipeline.rb:227:in `register_plugins'", "C:/logstash-7.
2.1/logstash-core/lib/logstash/java_pipeline.rb:585:in `maybe_setup_out_plugins'", "C:/logstash-7.12.1/logstash-core/li
/logstash/java_pipeline.rb:240:in `start_workers'", "C:/logstash-7.12.1/logstash-core/lib/logstash/java_pipeline.rb:185
in `run'", "C:/logstash-7.12.1/logstash-core/lib/logstash/java_pipeline.rb:137:in `block in start'"], "pipeline.sources
=>["central pipeline management"], :thread=>"#<Thread:0x373d74dd run>"}
[2021-05-28T14:05:57,456][INFO ][logstash.javapipeline ][main] Pipeline terminated {"pipeline.id"=>"main"}
[2021-05-28T14:05:57,465][ERROR][logstash.agent ] Failed to execute action {:id=>:main, :action_type=>LogStas
::ConvergeResult::FailedAction, :message=>"Could not execute action: PipelineAction::Create<main>, action_result: false
, :backtrace=>nil}
Case 2: management enabled setup true, path specified for a local *.conf file