Multiple Output Reliability


(Jonar B) #1

How can I check if the data were successfully transferred to elasticsearch?

For example I got this output.

output {
 elasticsearch1 {
  hosts => ["xxx.xxx.xxx.250:9200"]
  index => "logstash1-%{+YYYY.MM.dd}"
 }
 elasticsearch2 {
  hosts => ["xxx.xxx.xxx.251:9200"]
  index => "logstash2-%{+YYYY.MM.dd}"
 }
}
  1. If the server for elasticsearch 2 is down, does the data will still be transfered to elasticsearch1?

  2. If the server for elasticsearch 2 is already up, will the logstash can get the previous data that was already stored in elasticsearch 1 during downtime if possible?

Thank you.


(Christian Dahlqvist) #2

If any of the outputs is not available, Logstash will stop processing and retry sending the current data until it becomes available.


(Jonar B) #3

Oh nice! :slight_smile:
So it will be synchronize on sending the data, right?
There's no chance that the other output is ahead in storing data.

Thank you for your reply @Christian_Dahlqvist


(Jonar B) #4

Another thing @Christian_Dahlqvist, Can I run multiple logstash so that if the 1 output is not available, output number 2 can still retrieve the data.


(Jonar B) #5

hmmm. up


(system) #6

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.