If you have 3 masters then min masters is 2, so you can still lose a master and maintain availability.
If you don't set it then you risk data loss and corruption.
It's a balance for sure, but I'd prefer consistency over availability myself, cause what's the point of having access to the data if it's wrong?