# Elastic search S3 backup speed **URL:** \ **Category:** Elasticsearch\ **Created:** [March 16, 2015, 1:44pm UTC](https://discuss.elastic.co/t/elastic-search-s3-backup-speed/22686 "2015-03-16T13:44:31Z")\ **Posts on this page:** 4\ **Page:** 1
**Author:** ![Alejandro\_Calderon](https://avatars.discourse-cdn.com/v4/letter/a/77aa72/32.png) [@Alejandro\_Calderon](https://discuss.elastic.co/u/Alejandro_Calderon)\ **Post date:** [March 16, 2015, 1:44pm UTC](https://discuss.elastic.co/t/elastic-search-s3-backup-speed/22686/1 "2015-03-16T13:44:31Z")
Hello, I am using "elasticsearch-cloud-aws" to create backups for my cluster in S3, but the backups are taking too long to finish, by using cloud watch i am seeing an average of of 760 MB/minute of network out in the machines, i used to have similar numbers while the index was balancing itself but by changing "indices.recovery.max\_bytes\_per\_sec: 1000mb" i got much better speeds, topping at 5GB/minute. I would like to know if its there another property that maybe will make the backup faster or its there a way to make this backups faster. Thanks in advance. -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/6b89b7ca-48a5-4820-840e-7ba5c7522087%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/6b89b7ca-48a5-4820-840e-7ba5c7522087%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Post date:** [March 18, 2015, 9:05pm UTC](https://discuss.elastic.co/t/elastic-search-s3-backup-speed/22686/2 "2015-03-18T21:05:25Z")
You can set max\_snapshot\_bytes\_per\_sec - > **[Snapshot module | Elasticsearch Guide \[8.11\] | Elastic](https://www.elastic.co/guide/en/elasticsearch/reference/current/modules-snapshots.html#_common_repository_settings)** There is also a snapshot threadpool you can experiment with, but it's not recommended, I'm just making you aware of it - > **[Thread pools | Elasticsearch Guide \[8.11\] | Elastic](https://www.elastic.co/guide/en/elasticsearch/reference/current/modules-threadpool.html#modules-threadpool)** But you are ultimately limited to your network speed. On 16 March 2015 at 06:44, Alejandro Calderon \< [alejandrocalderonvelez@gmail.com](mailto:alejandrocalderonvelez@gmail.com)\> wrote: > Hello, > > I am using "elasticsearch-cloud-aws" to create backups for my cluster in > S3, but the backups are taking too long to finish, by using cloud watch i > am seeing an average of of 760 MB/minute of network out in the machines, i > used to have similar numbers while the index was balancing itself but by > changing "indices.recovery.max\_bytes\_per\_sec: 1000mb" i got much better > speeds, topping at 5GB/minute. > I would like to know if its there another property that maybe will make > the backup faster or its there a way to make this backups faster. > > Thanks in advance. > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/6b89b7ca-48a5-4820-840e-7ba5c7522087%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/6b89b7ca-48a5-4820-840e-7ba5c7522087%40googlegroups.com) > [https://groups.google.com/d/msgid/elasticsearch/6b89b7ca-48a5-4820-840e-7ba5c7522087%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/6b89b7ca-48a5-4820-840e-7ba5c7522087%40googlegroups.com?utm_medium=email&utm_source=footer) > . > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAEYi1X\_z\_EfzLTiG%2BPmPJHz9w%3DKRSUdoGhwpGa\_MUcQXx5u3RQ%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAEYi1X_z_EfzLTiG%2BPmPJHz9w%3DKRSUdoGhwpGa_MUcQXx5u3RQ%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![Alejandro\_Calderon](https://avatars.discourse-cdn.com/v4/letter/a/77aa72/32.png) [@Alejandro\_Calderon](https://discuss.elastic.co/u/Alejandro_Calderon)\ **Post date:** [March 19, 2015, 3:15pm UTC](https://discuss.elastic.co/t/elastic-search-s3-backup-speed/22686/3 "2015-03-19T15:15:48Z")
Thanks i tested the settings and the speed get better, I also found out ES 1.4.0 has a bug about the snapshot/restore, after upgrading to 1.4.4 my speed triplicated. On Monday, March 16, 2015 at 8:44:32 AM UTC-5, Alejandro Calderon wrote: > Hello, > > I am using "elasticsearch-cloud-aws" to create backups for my cluster in > S3, but the backups are taking too long to finish, by using cloud watch i > am seeing an average of of 760 MB/minute of network out in the machines, i > used to have similar numbers while the index was balancing itself but by > changing "indices.recovery.max\_bytes\_per\_sec: 1000mb" i got much better > speeds, topping at 5GB/minute. > I would like to know if its there another property that maybe will make > the backup faster or its there a way to make this backups faster. > > Thanks in advance. -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/c9e7772b-2980-48f3-934c-cb02c9a105ae%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/c9e7772b-2980-48f3-934c-cb02c9a105ae%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 12:25am UTC](https://discuss.elastic.co/t/elastic-search-s3-backup-speed/22686/4 "2017-07-06T00:25:36Z")