Elasticsearch S3 Backup Failing

[akshaymaniyar]

Hi,

We run a backup of our data every 3 hours. We have recently started getting the below message because of which the backup fails sometimes. When we retry sometimes it succeeds, sometimes it fails with the same error.

\reason\\:\\[1363871--elasticsearch--2019-06-24--14-20-00--full:snapshot_1571664901787/S2KnlgBKQWWmkOOO5ZB0nw] failed to create snapshot\\,\\caused_by\\:\\type\\:\\i_o_exception\\,\\reason\\:\\Unable to upload object [indices/G2g4EI-WS4SGcQuaEMVwCA/meta-S2KnlgBKQWWmkOOO5ZB0nw.dat] using a single upload\\,\\caused_by\\:\\type\\:\\sdk_client_exception\\,\\reason\\:\\sdk_client_exception: Unable to execute HTTP request: Read timed out\\,\\caused_by\\:\\type\\:\\i_o_exception\\,\\reason\\:\\Read timed out\\,\\status\\:500[\18485.63 MB\, \15.29 pct\, \/usr/share/elasticsearch/jdk/bin/java -Xms16g -Xmx16g -XX:+U\, \8.90 MB\, \0.01 pct\

[Armin_Braun]

Hi @akshaymaniyar

This is a known issue with S3 snapshots that we recently fixed in https://github.com/elastic/elasticsearch/pull/46589. Upcoming ES v7.5.0 should fix your issue.

[akshaymaniyar]

Thanks for the quick revert. We'll upgrade as soon as it releases.