Logstash Exceptionhandling / Catching exceptions from output plugin

(Wolfgang Grossinger) #1

Hi there!

We are currently evaluating ELK and so far it looks very promising, but we found one big issu we couldn't find satisfying information so far:

We want to log all our events in Elasticsearch, so when something fails here, we want to implement some kind of failover mechanism and save the according data somewhere else, so the basic question is:

How can we catch Exceptions from an output plugin and handle them?

Thanks in advance for all suggestions...



Catching exceptions from output plugins
(Magnus B├Ąck) #2

I don't think there's a good way of dealing with this.

(Sam Saffron) #3

Couldn't you fork the output plugins you are using and then build the exception handling in ruby?

(Wolfgang Grossinger) #4

Well, we have no experience with Ruby here and what we want is a general solution. You can probably run into this problem with every output plugin...

(Sam Saffron) #5

Usually you only need 1/2 output plugins though, in our setup all we use is an elastic and graphite output... should not be to hard to hack 2 outputs really for extra logging / etc.

(system) #6