This sounds similar to what occurs when an ILM policy with Rollover is used, but the index template either doesn't exist or doesn't have index.lifecycle.name set.
Could you post the index template that's being used for your indices? Do you have any of template, manage_template, or template_overwrite set in your Logstash output config? Have you manually changed the index template that Logstash installs?