I'm working on a system that uses Filebeat (v7.8) with Logstash output (v2.2.4).
Filebeat reads files from a specific folder and publishes the data to Logstash which in turn sends the output to RabbitMQ.
I need to upgrade Logstash to the latest version (or at least a newer version) to be able to use forked pipelines for a single input multiple config scenario.
What are the steps I should follow to prevent data loss? Is there a way I can persist the checkpoint of the last read event in fileabeat so that the newer Logstash can resume from there?