I guess I will have to. I just disabled ipv6 on my machine by adding a custom config file under /etc/sysctl.d with the following contents:
net.ipv6.conf.all.disable_ipv6 = 1
net.ipv6.conf.default.disable_ipv6 = 1
net.ipv6.conf.lo.disable_ipv6 = 1
I rebooted, and it is still opening an ipv6 UDP port.
I took the nuclear option and just disabled ipv6 in my grub configuration. Now it is using ipv4 ports as it should.