Restoring 7.x snapshot to fresh 8.14.3 ECK: System data streams missing after migration

I created the snapshot of my old version 7.x elk stack , and I now I am trying to restore the old snapshot on the new eck-elasticsearch version 8.14.3.

Context:

  • Upgraded from Elasticsearch v7.17.22 to v8.14.3 using ECK (Elastic Cloud on Kubernetes)
  • Configured S3 for storing snapshots
  • Initiated restore process from a v7.17.22 snapshot to the v8.14.3 ECK-Elasticsearch cluster

Steps Taken:

  1. Successfully restored data indices
  • All data indices are visible and accessible in the v8.14.3 ECK-Elasticsearch cluster
  1. Attempted to restore system indices:
  • .ds-.slm-history-*
  • .ds-ilm-history-*

Current Situation:

  • The system indices (.ds-.slm-history-* and .ds-ilm-history-*) were successfully restored
  • However, the associated data streams (.slm-history-5 and ilm-history-5) are not present in the v8.14.3 cluster

Expected Behavior:

After restoring the .ds-.slm-history-* and .ds-ilm-history-* indices, we expected to see the corresponding data streams (.slm-history-5 and ilm-history-5) automatically recreated in the v8.14.3 cluster.

Question:

Is this behavior expected when restoring from a 7.x snapshot to an 8.x cluster? If so, what are the recommended steps to properly recreate these system data streams while maintaining the historical data contained in the restored indices?

Added snapshot-and-restore and removed #elastic-cloud

Removed #elastic-cloud, snapshot-and-restore

Added ilm-index-lifecycle-management, slm-snapshot-lifecycle-management and removed #elastic-cloud

Added snapshot-and-restore and removed #elastic-cloud