High Availity Logstash Pipeline

[ksremo]

I have 2 Logstash Instances. Both are active. In case of beat-based Logshipper there is a built-in way to load balance the traffic to both Logstash. In case one Logstash is offline because of maintenance or failure traffic is indexed anyways.

How to archive this by using an Logstash pipeline input like JDCB, IMAP and so on.
What happens if a define a pipeline in both instances. In case of JDBC an database is queried 2 times and this data is double-indexed? What is beast pratice for this use case.

[Badger]

@ksremo

In case of JDBC an database is queried 2 times and this data is double-indexed?

Yes, it is.

[ksremo]

ok thanks for the answer but how to make an jdbc input high available?

[Badger]

I do not know.