Hi team,
I am looking at what is maximum log rate logstash can ingest logs at i have got scenario where log rate will be
10k to 20k /sec has anyone got documented maximum log rate supported ?
Vik
Hi team,
I am looking at what is maximum log rate logstash can ingest logs at i have got scenario where log rate will be
10k to 20k /sec has anyone got documented maximum log rate supported ?
Vik
We've seen about 10K EPS without filters, ie straight in and straight out.
You should really check based on your own data though.
10 k without filter with multiple filter this should drop drastically. Any way this can be scaled up ?
In this case looks like logstash would be bottleneck .
More LS instances with a broker.
Thought so as i was posting , got broker splitting LS for different log type can do might have to spin multiple LS to get job done.
© 2020. All Rights Reserved - Elasticsearch
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant logo are trademarks of the Apache Software Foundation in the United States and/or other countries.