How to log _bulk request payload sent by Logstash to Elasticsearch via output plugin?

Elastic Stack Logstash
1

I am getting this error on using logstash-elasticsearch output plugin:

[2018-06-11T17:46:29,075][ERROR][logstash.outputs.elasticsearch] Encountered a retryable error. Will Retry with exponential backoff {:code=>400, :url=>"https://myurl.com:443/_bulk"}

How to get insight why am i getting a 400 request? How can one enable logs for logstash-elasticsearch output plugin?

I am using ES version 6.2.2 and logstash 6.2.4. Also I am using kafka input plugin and ruby filter plugin.

On running logstash with log.level=debug and searching logs I only get this for my output plugin -

[2018-06-11T18:01:46,297][DEBUG][logstash.outputs.elasticsearch] Closing {:plugin=>"LogStash::Outputs::ElasticSearch"}
[2018-06-11T18:01:46,317][DEBUG][logstash.outputs.elasticsearch] Stopping sniffer
[2018-06-11T18:01:46,324][DEBUG][logstash.outputs.elasticsearch] Stopping resurrectionist
[2018-06-11T18:01:46,389][DEBUG][logstash.outputs.elasticsearch] Waiting for in use manticore connections
[2018-06-11T18:01:46,408][DEBUG][logstash.outputs.elasticsearch] Closing adapter #LogStash::Outputs::ElasticSearch::HttpClient::ManticoreAdapter:0x402c54c3

But getting complete logs for input and filter plugins. Please help to generate es-output logs

2

Using log.level=trace getting detailed error log but not logs for success cases.

3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.