Logstash Exceptionhandling / Catching exceptions from output plugin

Elastic Stack Logstash
1

Hi there!

We are currently evaluating ELK and so far it looks very promising, but we found one big issu we couldn't find satisfying information so far:

We want to log all our events in Elasticsearch, so when something fails here, we want to implement some kind of failover mechanism and save the according data somewhere else, so the basic question is:

How can we catch Exceptions from an output plugin and handle them?

Thanks in advance for all suggestions...

Regards,

Wolfgang

2

I don't think there's a good way of dealing with this.

3

Couldn't you fork the output plugins you are using and then build the exception handling in ruby?

4

Well, we have no experience with Ruby here and what we want is a general solution. You can probably run into this problem with every output plugin...

5

Usually you only need 1/2 output plugins though, in our setup all we use is an elastic and graphite output... should not be to hard to hack 2 outputs really for extra logging / etc.