# Failed indices in snapshot since upgrade to 8.5.3 **URL:** \ **Category:** Elasticsearch\ **Tags:** snapshot-and-restore\ **Created:** [January 10, 2023, 8:28am UTC](https://discuss.elastic.co/t/failed-indices-in-snapshot-since-upgrade-to-8-5-3/322802 "2023-01-10T08:28:01Z")\ **Posts on this page:** 9\ **Page:** 1
**Author:** ![QuLh44](https://avatars.discourse-cdn.com/v4/letter/q/8dc957/32.png) [@QuLh44](https://discuss.elastic.co/u/QuLh44)\ **Post date:** [January 10, 2023, 8:28am UTC](https://discuss.elastic.co/t/failed-indices-in-snapshot-since-upgrade-to-8-5-3/322802/1 "2023-01-10T08:28:01Z")
Hello, Since we upgraded Elasticsearch/Logstash/Kibana to 8.5.3 version yesterday, we have lot of failed indices in snapshots (559 indices are OK, but 168 failed). Here is the error for each of them : **INTERNAL\_SERVER\_ERROR: UnsupportedOperationException[Old formats can't be used for writing]** Please could you help me to solve this problem ? Thanks! ---
**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Post date:** [January 10, 2023, 10:47pm UTC](https://discuss.elastic.co/t/failed-indices-in-snapshot-since-upgrade-to-8-5-3/322802/2 "2023-01-10T22:47:03Z")
Welcome to our community! 😃 Please share the full requests you are making as well as the full responses from Elasticsearch. You might also want to check the Elasticsearch logs and post them. ---
**Author:** ![QuLh44](https://avatars.discourse-cdn.com/v4/letter/q/8dc957/32.png) [@QuLh44](https://discuss.elastic.co/u/QuLh44)\ **Post date:** [January 11, 2023, 11:15am UTC](https://discuss.elastic.co/t/failed-indices-in-snapshot-since-upgrade-to-8-5-3/322802/3 "2023-01-11T11:15:36Z")
Hello, Thank you! I just run new snapshot from the GUI, and I can see a lot of Failed shared : ![Capture](https://us1.discourse-cdn.com/elastic/original/3X/6/f/6f8f35117335a513c0208a2d865d9901a36d610f.png) ![Capture](https://us1.discourse-cdn.com/elastic/original/3X/1/d/1d59a852a338398886250fb6d791ec22cb285b56.png) I also check /var/log/elasticsearch/elasticsearch.log but I can see nothing relevant... Maybe I checked in the wrong log file ? ---
**Author:** ![Ayush\_Mathur](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ayush_mathur/32/77134_2.png) [@Ayush\_Mathur](https://discuss.elastic.co/u/Ayush_Mathur)\ **Post date:** [January 11, 2023, 11:22am UTC](https://discuss.elastic.co/t/failed-indices-in-snapshot-since-upgrade-to-8-5-3/322802/4 "2023-01-11T11:22:16Z")
What was the earlier stack version ? May be there was reindexing required for your indices which hasn't been performed. Can you dump your ES logs when you start snapshotting and share it across ? ---
**Author:** ![QuLh44](https://avatars.discourse-cdn.com/v4/letter/q/8dc957/32.png) [@QuLh44](https://discuss.elastic.co/u/QuLh44)\ **Post date:** [January 11, 2023, 2:19pm UTC](https://discuss.elastic.co/t/failed-indices-in-snapshot-since-upgrade-to-8-5-3/322802/5 "2023-01-11T14:19:46Z")
We upgraded from 7.17.7 version of ELK. I think we have no logs in elasticsearch.log file because we have 3 servers in cluster. So if I check in the elk-cluster.log files on each node, I don't see any errors regarding snapshot. I can see these errors : ```auto [2023-01-11T15:16:56,505][WARN][o.e.x.s.a.ApiKeyAuthenticator] [es-node-1] Authentication using apikey failed - api key [72XfDYMBMecjRi8RMj1Z] has been invalidated [2023-01-11T15:17:23,557][WARN][o.e.x.s.a.ApiKeyAuthenticator] [es-node-1] Authentication using apikey failed - api key [72XfDYMBMecjRi8RMj1Z] has been invalidated [2023-01-11T15:17:32,210][WARN][o.e.x.s.a.ApiKeyAuthenticator] [es-node-1] Authentication using apikey failed - api key [72XfDYMBMecjRi8RMj1Z] has been invalidated [2023-01-11T15:17:48,754][WARN][o.e.x.s.a.ApiKeyAuthenticator] [es-node-1] Authentication using apikey failed - api key [72XfDYMBMecjRi8RMj1Z] has been invalidated ``` ```auto [2023-01-11T15:04:25,229][INFO][o.e.m.j.JvmGcMonitorService] [es-node-2] [gc][85957] overhead, spent [267ms] collecting in the last [1s] [2023-01-11T15:10:27,665][INFO][o.e.m.j.JvmGcMonitorService] [es-node-2] [gc][86319] overhead, spent [287ms] collecting in the last [1s] [2023-01-11T15:17:19,028][INFO][o.e.m.j.JvmGcMonitorService] [es-node-2] [gc][86730] overhead, spent [256ms] collecting in the last [1s] ``` ```auto [2023-01-11T14:21:33,421][INFO][o.e.m.j.JvmGcMonitorService] [es-node-3] [gc][191528] overhead, spent [267ms] collecting in the last [1s] [2023-01-11T15:00:29,311][INFO][o.e.c.m.MetadataMappingService] [es-node-3] [logstash-adds-000230/j-cl7qdCSm-0mvowafkOqg] update_mapping [_doc] [2023-01-11T15:05:20,286][INFO][o.e.m.j.JvmGcMonitorService] [es-node-3] [gc][194150] overhead, spent [260ms] collecting in the last [1s] ``` ---
**Author:** ![Ayush\_Mathur](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ayush_mathur/32/77134_2.png) [@Ayush\_Mathur](https://discuss.elastic.co/u/Ayush_Mathur)\ **Post date:** [January 11, 2023, 3:09pm UTC](https://discuss.elastic.co/t/failed-indices-in-snapshot-since-upgrade-to-8-5-3/322802/6 "2023-01-11T15:09:46Z")
May be you are hitting something similar to [UnsupportedOperationException causes snapshots to fail - Elastic Stack / Elasticsearch - Discuss the Elastic Stack](https://discuss.elastic.co/t/unsupportedoperationexception-causes-snapshots-to-fail/249181/2) ---
**Author:** ![QuLh44](https://avatars.discourse-cdn.com/v4/letter/q/8dc957/32.png) [@QuLh44](https://discuss.elastic.co/u/QuLh44)\ **Post date:** [January 11, 2023, 3:21pm UTC](https://discuss.elastic.co/t/failed-indices-in-snapshot-since-upgrade-to-8-5-3/322802/7 "2023-01-11T15:21:47Z")
I saw this thread, bu it seems there is no solution... I don't understand why for exemple **logstash-adds-000009** is failed and **logstash-adds-000008** is not failed, while the two indexes were created a long time ago at a day's interval in the same index version. ---
**Author:** ![QuLh44](https://avatars.discourse-cdn.com/v4/letter/q/8dc957/32.png) [@QuLh44](https://discuss.elastic.co/u/QuLh44)\ **Post date:** [January 11, 2023, 3:55pm UTC](https://discuss.elastic.co/t/failed-indices-in-snapshot-since-upgrade-to-8-5-3/322802/8 "2023-01-11T15:55:22Z")
I recreated the repository not in "source-only" mode, and it seems to be good now. Snapshot is in progress without failed shards. ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [February 8, 2023, 3:56pm UTC](https://discuss.elastic.co/t/failed-indices-in-snapshot-since-upgrade-to-8-5-3/322802/9 "2023-02-08T15:56:19Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.