Elasticsearch S3 Backup Failing


We run a backup of our data every 3 hours. We have recently started getting the below message because of which the backup fails sometimes. When we retry sometimes it succeeds, sometimes it fails with the same error.

\reason\\:\\[1363871--elasticsearch--2019-06-24--14-20-00--full:snapshot_1571664901787/S2KnlgBKQWWmkOOO5ZB0nw] failed to create snapshot\\,\\caused_by\\:\\type\\:\\i_o_exception\\,\\reason\\:\\Unable to upload object [indices/G2g4EI-WS4SGcQuaEMVwCA/meta-S2KnlgBKQWWmkOOO5ZB0nw.dat] using a single upload\\,\\caused_by\\:\\type\\:\\sdk_client_exception\\,\\reason\\:\\sdk_client_exception: Unable to execute HTTP request: Read timed out\\,\\caused_by\\:\\type\\:\\i_o_exception\\,\\reason\\:\\Read timed out\\,\\status\\:500[\18485.63 MB\, \15.29 pct\, \/usr/share/elasticsearch/jdk/bin/java -Xms16g -Xmx16g -XX:+U\, \8.90 MB\, \0.01 pct\

Hi @akshaymaniyar

This is a known issue with S3 snapshots that we recently fixed in https://github.com/elastic/elasticsearch/pull/46589. Upcoming ES v7.5.0 should fix your issue.

Thanks for the quick revert. We'll upgrade as soon as it releases.

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.