I have a 2 node logstash setup populating the elastic cluster. There are few configs that use the jdbc plugin in the input. Is there a way to setup high availability among the logstash nodes when one of them fails? My query is the same as the one in the below link, however, I am raising it again since there were no responses to that.
No, logstash does not support clustering where one of a group of nodes performs an operation.
It seems only option is to generate id's using fingerprint plugin and in elasticsearch output use document_id => "%{[@metadata][fingerprint]}". But you have to accept the fact, that you make more queries to your db and cost of updating elasticsearch index and using generated id's.