In a situation where I have 2 or more output e.g. an elasticsearch and a kafka. If kafka is very slow and elasticsearch is very fast. What will happen to the reading speed of logstash? Will logstash wait for kafka before parsing new lines of logs? If yes. Will this slow the number of parse events going into elasticsearch as logstash waits for kafka?
Yes, the speed of the entire pipeline will be determined by the slowest output, assuming each batch holds event that need to go to both outputs.
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.