Simultaneous Filebeats to handle high load

Elastic Stack Beats
1

I'd like to leverage Filebeat so it'd fetch our o365\azure\aws logs using the various modules .
How would it handle very high volumes? Is there any benchmark for example events\MBs per second?

Is there any way to maintain a cluster of Filebeat clusters?
Did anyone encounter situation where one Filebeat per data type (o365\gsuite\azure audit log) wasn't enough?

Seems like in S3 sqs specifically horizontal scaling is feasible, but what about the others?

2

What sort of volumes are you thinking here?

3

This is simply an attempt to estimate the options we will have if we choose to use this form of ingestion... understanding what would be the upper limits.
Thousands of events per second if I'm thinking of O365\Gsuite for example?

4

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.