I have installed X-pack on logstash but in step it is mentioned to add user and pwd in logstash.yml .
but i am using pipelines which have configuration files under conf.d ,
so where shall i add x-pack related settings .
Update Logstash to use the new password for the built-in logstash_system user, which you set up along with the other built-in users when you installed X-Pack on Elasticsearch. You must configure the xpack.monitoring.elasticsearch.password setting in the logstash.yml configuration file with the new password for the logstash_system user.
but i am seeing below exception while starting logstash ,
[2018-01-05T00:00:04,329][WARN ][logstash.outputs.elasticsearch] You are using a deprecated config setting "document_type" set in
elasticsearch. Deprecated settings will continue to work, but are scheduled for removal from logstash in the future. Document type
s are being deprecated in Elasticsearch 6.0, and removed entirely in 7.0. You should avoid this feature If you have any questions
about this, please visit the logstash channel on freenode irc. {:name=>"document_type", :plugin=><LogStash::Outputs::ElasticSearc
h hosts=>[http://vielk01dsy.dsone.3ds.com:9200, http://vielk02dsy.dsone.3ds.com:9200, http://vpkiba1dsy.dsone.3ds.com:9200], bulk_
path=>"/_xpack/monitoring/_bulk?system_id=logstash&system_api_version=2&interval=1s", manage_template=>false, document_type=>"%{[@
metadata][document_type]}", sniffing=>false, user=>"logstash_system", password=>, id=>"e2ff6781ffaafd4b5fe25b53c84ba2f89
d28fd61c871ada00b153a1f3a3fbe7d", enable_metric=>true, codec=><LogStash::Codecs::Plain id=>"plain_582aa62d-0178-4f91-b184-1e70cb03
f84a", enable_metric=>true, charset=>"UTF-8">, workers=>1, template_name=>"logstash", template_overwrite=>false, doc_as_upsert=>fa
lse, script_type=>"inline", script_lang=>"painless", script_var_name=>"event", scripted_upsert=>false, retry_initial_interval=>2,
retry_max_interval=>64, retry_on_conflict=>1, action=>"index", ssl_certificate_verification=>true, sniffing_delay=>5, timeout=>60,
pool_max=>1000, pool_max_per_route=>100, resurrect_delay=>5, validate_after_inactivity=>10000, http_compression=>false>}
[2018-01-05T00:00:04,577][INFO ][logstash.outputs.elasticsearch] Elasticsearch pool URLs updated {:changes=>{:removed=>, :added=
[2018-01-05T00:00:04,729][WARN ][logstash.outputs.elasticsearch] Detected a 6.x and above cluster: the type event field won't be
used to determine the document _type {:es_version=>6}
[2018-01-05T00:00:06,371][WARN ][logstash.outputs.elasticsearch] Attempted to resurrect connection to dead ES instance, but got an error.
{:url=>"http://vielk01dsy.dsone.3ds.com:9200/", :error_type=>LogStash::Outputs::Elasticsearch::HttpClient::Pool::BadResponseCodeError,
:error=>"Got response code '401' contacting Elasticsearch at URL 'http://vielk01dsy.dsone.3ds.com:9200/'"}
[2018-01-05T00:00:06,379][WARN ][logstash.outputs.elasticsearch] Attempted to resurrect connection to dead ES instance, but got an error.
{:url=>"http://vielk02dsy.dsone.3ds.com:9200/", :error_type=>LogStash::Outputs::Elasticsearch::HttpClient::Pool::BadResponseCodeError,
:error=>"Got response code '401' contacting Elasticsearch at URL 'http://vielk02dsy.dsone.3ds.com:9200/'"}
[2018-01-05T00:00:06,392][WARN ][logstash.outputs.elasticsearch] Attempted to resurrect connection to dead ES instance, but got an error.
{:url=>"http://vpkiba1dsy.dsone.3ds.com:9200/", :error_type=>LogStash::Outputs::Elasticsearch::HttpClient::Pool::BadResponseCodeError,
:error=>"Got response code '401' contacting Elasticsearch at URL 'http://vpkiba1dsy.dsone.3ds.com:9200/'"}
[2018-01-05T00:00:06,392][INFO ][logstash.outputs.elasticsearch] Using mapping template from {:path=>nil}
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.