I can confirm this looks like a bug (or minimally missing functionality) to me. I was able to reproduce and I can't think of a good reason this shouldn't work. I took a brief look at the set of known issues around this feature as well and didn't see anything right off.
Do you mind creating an issue and linking it here. I'm happy to help make sure it's routed appropriately. Can't promise when we'll get to it, but really appreciate you calling it out.