I am using logstash 6.2.3 and running two pipelines as given below:
- pipeline.id: main
path.config: "/etc/logstash/conf.d/logstash_es.conf"
dead_letter_queue.enable: true
dead_letter_queue.max_bytes: 30g
path.dead_letter_queue: "/var/lib/logstash/dead_letter_queue"
#queue.type: persisted
- pipeline.id: dlq
path.config: "/etc/logstash/conf.d/logstash_es_dlq.conf"
I noticed sometimes single byte files are being generated in /var/lib/logstash/dead_letter_queue/mian directory which causes "timestamp field is misisng " in the dlq pipeline. may I know the circumstances in which the single byte file is produced by DeadLetterQueue Reader? is there any workarounds for this issue? thanks