ES 2.1.0
When you say it removed and re-adds, does it mean it drops the node and re-adds the node, making many shards go unassigned and have to be assigned again?
This is exactly what is happening. I see cluster goes into yellow every hour and many shards become unassigned.