Do we have any benchmark , in term of how may log lines can logstash ingest and egress ? I know this depends to a config but is there any ways to measure the rate before hand so that we can tweak things before going to production?
Currently, our logging rate is about 2MM/5min ~=6666lines/second -- we are pushing logs from a logfile to sqs and we notice that the logstash "pushers" are having issue in keeping up with that rate (we have N number of logstash pushers on origin server).
Is there a better alternative in pushing logs to sqs rather than using logstash?