I have a pretty simple ELK stack here with 4 ES nodes (3 data nodes and 1 client node).
I lost one of the data nodes and all of a sudden my Logstash servers couldn't send anything to the ES cluster. I found this error on the LS nodes and on the surviving ES nodes:
"reason":"blocked by: [SERVICE_UNAVAILABLE/2/no master];"}],
"reason":"blocked by: [SERVICE_UNAVAILABLE/2/no master];"},"status":503}",
I am assuming that this is because the ES cluster could no longer elect a master...but I thought that 2 nodes in a 3 node cluster were enough. Did I miss something along the way?
(Sorry if this is basic ES knowledge. I found a posting about someone else running into this problem as well during a rolling upgrade, but there was not a response.)
I am running ES version 2.2.0.
Thanks in advance.