Actually I'm using a cluster of Amazon ElasticSearch and I'm trying to load some documents from S3 (input) using logstash.
I've one pipeline (file.conf) with 25 inputs , one for each different folder in S3.
The ouput is AmazonElasticSearch.
When logstash run I can see in my index that logstash yes index the documents but sometimes I Can see that not all documents.
I try to enable dead_letter_queue to know what queues anda data I'm lossing , but never see anything.
I change this parameters in my logstash.yml:
I'm not sure if I need change another configuration or something.. ?
Thanks for advanced.