Logstash durability and scalibility

Hello folks! Please help with these quesitons.
I am running a load test which is generating 8-10 gb of real time logs in an hour, what settings will be the best to make sure that no data is lost?

  1. What's the diff bw "stat_interval and pipeline.batch.delay" ?
  2. what number will be optimal for the setting "pipeline.batch.size" in case of the data that i have?
  3. I have read about persistent queues? can i use it in my case and what settings would be optimal?

This seems to be a duplicate of this thread. Please do not open multiple threads about the same problem or question. This forum is manned by volunteers so you will need to be patient.

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.