I'm stupid, it was another issue, this works just fine.
For some reason i still don't understand Logstash was not overwriting the template despite template_overwrite => true was set.
When I increment the version of the template, Logstash seems to overwrite it, so maybe it's just that.
Guess I should have checked the stored template earlier.