Cluster rebalancing when client nodes connect to cluster

ES 2.3.3
We use embedded client nodes to connect from our application to the cluster (master = false/data = false). When we restart the client nodes in 2.3.3, we're seeing the cluster rebalance. This didn't seem to happen in 1.7. Was there any change, or configuration changes we should make to avoid this?