Is my delete phase correctly configured in ILM?

What version are you running, there was a bug in previous 7.X that caused this when applying the policy via Kibana. If you upgrade it'll fix it, or use the API directly.