Logstash durability and scalibility

Elastic Stack Logstash
1

Hello folks! Please help with these quesitons.
I am running a load test which is generating 8-10 gb of real time logs in an hour, what settings will be the best to make sure that no data is lost?

  1. What's the diff bw "stat_interval and pipeline.batch.delay" ?
  2. what number will be optimal for the setting "pipeline.batch.size" in case of the data that i have?
  3. I have read about persistent queues? can i use it in my case and what settings would be optimal?
2

This seems to be a duplicate of this thread. Please do not open multiple threads about the same problem or question. This forum is manned by volunteers so you will need to be patient.

3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.