Delayed-allocation not working as I thought it should

We are seeing an issue with our AWS cluster. If we lose a node, the entire cluster becomes unresponsive. I set this - index.unassigned.node_left.delayed_timeout": "0" - but still doesn't help.

Is there something else that I need to set? If we lose a node, our cluster should not go unresponsive for several seconds (Or at least I wouldn't think it should. This was not the behavior in 1.5 :frowning:

Thank you!
Jenn

What version are you on?

We tested with 2.4.1 and 5.0.1. Both has similar results.