I think there are a couple of things at play here. We made some changes to improve the accuracy of highlighting in 5.3 which may be contributing to the slowdown. But as you noted, a query like <field>:* will be faster than *. This is because of the new all fields mode. I suspect it's the combination of the two that's really hurting us. Both of these issues are on our roadmap to fix.