Procedure tu backup/restore

Elastic Stack Elasticsearch
1

Hi, im need to be sure if using this script
--> https://gist.github.com/radu-gheorghe/3180985#file-log_backup-bash to
backup and restore doesnt impact any creation of index (outage of ES) where
script is running.

WHat do exactly those features?
curl -XPOST 'http://localhost:9200/twitter/_optimize'
index.blocks.write
index.translog.disable_flush

I need to be sure that when script isrunning doing zip with those active
--> ( "blocks.write": true , "translog.disable_flush": true, curl -XPOST "$ADDRESS/$INDEX_NAME/_optimize)
I do not lost any indices ..

Regards

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/230b23b1-79e7-43ee-bfd9-6fab5f52dc1a%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

2

You can find the answers to what those HTTP calls are doing here -

Basically the script stops writes to an index, then backs it up and
re-enables writes to continue normal functionality.

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: markw@campaignmonitor.com
web: www.campaignmonitor.com

On 12 December 2013 08:08, Rino Rondan villadalmine@gmail.com wrote:

Hi, im need to be sure if using this script -->
Optimize&Backup Elasticsearch index. And restore. · GitHub to
backup and restore doesnt impact any creation of index (outage of ES) where
script is running.

WHat do exactly those features?
curl -XPOST 'http://localhost:9200/twitter/_optimize'
index.blocks.write
index.translog.disable_flush

I need to be sure that when script isrunning doing zip with those active
--> ( "blocks.write": true , "translog.disable_flush": true, curl -XPOST "$ADDRESS/$INDEX_NAME/_optimize)
I do not lost any indices ..

Regards

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/230b23b1-79e7-43ee-bfd9-6fab5f52dc1a%40googlegroups.com
.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAEM624aW8U243bw926So7gaz403XxqJUSENVYV-uuzsS02h3sg%40mail.gmail.com.
For more options, visit https://groups.google.com/groups/opt_out.

3

Ok, thank you, but just a little more information to what happen when index
stop write to disk in order to manage all info that are on memory.

Regards

On Wed, Dec 11, 2013 at 6:42 PM, Mark Walkom markw@campaignmonitor.comwrote:

You can find the answers to what those HTTP calls are doing here -
Elasticsearch Platform — Find real-time answers at scale | Elastic

Basically the script stops writes to an index, then backs it up and
re-enables writes to continue normal functionality.

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: markw@campaignmonitor.com
web: www.campaignmonitor.com

On 12 December 2013 08:08, Rino Rondan villadalmine@gmail.com wrote:

Hi, im need to be sure if using this script -->
Optimize&Backup Elasticsearch index. And restore. · GitHub to
backup and restore doesnt impact any creation of index (outage of ES) where
script is running.

WHat do exactly those features?
curl -XPOST 'http://localhost:9200/twitter/_optimize'
index.blocks.write
index.translog.disable_flush

I need to be sure that when script isrunning doing zip with those active
--> ( "blocks.write": true , "translog.disable_flush": true, curl -XPOST "$ADDRESS/$INDEX_NAME/_optimize)
I do not lost any indices ..

Regards

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.

To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/230b23b1-79e7-43ee-bfd9-6fab5f52dc1a%40googlegroups.com
.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/AoLR8dLNpC4/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAEM624aW8U243bw926So7gaz403XxqJUSENVYV-uuzsS02h3sg%40mail.gmail.com
.

For more options, visit https://groups.google.com/groups/opt_out.

--

Rondan Rino
Certificado en LPIC-2 https://cs.lpi.org/caf/Xamman/certification
LPI ID:LPI000209832
Verification Code:gbblvwyfxu
Red Hat Certified Engineer -- RHCE --
RHCVAhttps://www.redhat.com/wapps/training/certification/verify.html?certNumber=120-175-658&verify=Verify

Blog:http://www.itrestauracion.com.ar
Cv: http://cv.rinorondan.com.ar http://www.rinorondan.com.ar/
http://counter.li.org Linux User -> #517918
Viva La Santa Federacion!!
Mueran Los Salvages Unitarios!!
^^^Transcripcion de la epoca ^^^

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAASrp44ZomN5JpjQDAL7FvPxXyZZcGiLKkVtckyw_Xs9S2rODQ%40mail.gmail.com.
For more options, visit https://groups.google.com/groups/opt_out.

4

It stops writing to the index and just store things in the transaction log.

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: markw@campaignmonitor.com
web: www.campaignmonitor.com

On 12 December 2013 08:55, rino villadalmine@gmail.com wrote:

Ok, thank you, but just a little more information to what happen when
index stop write to disk in order to manage all info that are on memory.

Regards

On Wed, Dec 11, 2013 at 6:42 PM, Mark Walkom markw@campaignmonitor.comwrote:

You can find the answers to what those HTTP calls are doing here -
Elasticsearch Platform — Find real-time answers at scale | Elastic

Basically the script stops writes to an index, then backs it up and
re-enables writes to continue normal functionality.

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: markw@campaignmonitor.com
web: www.campaignmonitor.com

On 12 December 2013 08:08, Rino Rondan villadalmine@gmail.com wrote:

Hi, im need to be sure if using this script -->
Optimize&Backup Elasticsearch index. And restore. · GitHub to
backup and restore doesnt impact any creation of index (outage of ES) where
script is running.

WHat do exactly those features?
curl -XPOST 'http://localhost:9200/twitter/_optimize'
index.blocks.write
index.translog.disable_flush

I need to be sure that when script isrunning doing zip with those
active --> ( "blocks.write": true , "translog.disable_flush": true, curl
-XPOST "$ADDRESS/$INDEX_NAME/_optimize) I do not lost any indices ..

Regards

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearch+unsubscribe@googlegroups.com.

To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/230b23b1-79e7-43ee-bfd9-6fab5f52dc1a%40googlegroups.com
.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/AoLR8dLNpC4/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAEM624aW8U243bw926So7gaz403XxqJUSENVYV-uuzsS02h3sg%40mail.gmail.com
.

For more options, visit https://groups.google.com/groups/opt_out.

--

Rondan Rino
Certificado en LPIC-2 https://cs.lpi.org/caf/Xamman/certification
LPI ID:LPI000209832
Verification Code:gbblvwyfxu
Red Hat Certified Engineer -- RHCE -- RHCVAhttps://www.redhat.com/wapps/training/certification/verify.html?certNumber=120-175-658&verify=Verify

Blog:http://www.itrestauracion.com.ar
Cv: http://cv.rinorondan.com.ar http://www.rinorondan.com.ar/
http://counter.li.org Linux User -> #517918
Viva La Santa Federacion!!
Mueran Los Salvages Unitarios!!
^^^Transcripcion de la epoca ^^^

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAASrp44ZomN5JpjQDAL7FvPxXyZZcGiLKkVtckyw_Xs9S2rODQ%40mail.gmail.com
.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAEM624a0tORj6MMEKNyNvzqc88XbFV5%2B-4SH%2BQBykJr0vJKHeQ%40mail.gmail.com.
For more options, visit https://groups.google.com/groups/opt_out.

5

ok , so all indices created when is not writting at disk, are on
transaction logs and after enabled write and then flush it will be updated
without any impact on the application that use those indices. ??

Regards

On Wed, Dec 11, 2013 at 6:58 PM, Mark Walkom markw@campaignmonitor.comwrote:

It stops writing to the index and just store things in the transaction log.

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: markw@campaignmonitor.com
web: www.campaignmonitor.com

On 12 December 2013 08:55, rino villadalmine@gmail.com wrote:

Ok, thank you, but just a little more information to what happen when
index stop write to disk in order to manage all info that are on memory.

Regards

On Wed, Dec 11, 2013 at 6:42 PM, Mark Walkom markw@campaignmonitor.comwrote:

You can find the answers to what those HTTP calls are doing here -
Elasticsearch Platform — Find real-time answers at scale | Elastic

Basically the script stops writes to an index, then backs it up and
re-enables writes to continue normal functionality.

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: markw@campaignmonitor.com
web: www.campaignmonitor.com

On 12 December 2013 08:08, Rino Rondan villadalmine@gmail.com wrote:

Hi, im need to be sure if using this script -->
Optimize&Backup Elasticsearch index. And restore. · GitHub to
backup and restore doesnt impact any creation of index (outage of ES) where
script is running.

WHat do exactly those features?
curl -XPOST 'http://localhost:9200/twitter/_optimize'
index.blocks.write
index.translog.disable_flush

I need to be sure that when script isrunning doing zip with those
active --> ( "blocks.write": true , "translog.disable_flush": true, curl
-XPOST "$ADDRESS/$INDEX_NAME/_optimize) I do not lost any indices ..

Regards

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearch+unsubscribe@googlegroups.com.

To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/230b23b1-79e7-43ee-bfd9-6fab5f52dc1a%40googlegroups.com
.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/AoLR8dLNpC4/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAEM624aW8U243bw926So7gaz403XxqJUSENVYV-uuzsS02h3sg%40mail.gmail.com
.

For more options, visit https://groups.google.com/groups/opt_out.

--

Rondan Rino
Certificado en LPIC-2 https://cs.lpi.org/caf/Xamman/certification
LPI ID:LPI000209832
Verification Code:gbblvwyfxu
Red Hat Certified Engineer -- RHCE -- RHCVAhttps://www.redhat.com/wapps/training/certification/verify.html?certNumber=120-175-658&verify=Verify

Blog:http://www.itrestauracion.com.ar
Cv: http://cv.rinorondan.com.ar http://www.rinorondan.com.ar/
http://counter.li.org Linux User -> #517918
Viva La Santa Federacion!!
Mueran Los Salvages Unitarios!!
^^^Transcripcion de la epoca ^^^

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAASrp44ZomN5JpjQDAL7FvPxXyZZcGiLKkVtckyw_Xs9S2rODQ%40mail.gmail.com
.

For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/AoLR8dLNpC4/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAEM624a0tORj6MMEKNyNvzqc88XbFV5%2B-4SH%2BQBykJr0vJKHeQ%40mail.gmail.com
.

For more options, visit https://groups.google.com/groups/opt_out.

--

Rondan Rino
Certificado en LPIC-2 https://cs.lpi.org/caf/Xamman/certification
LPI ID:LPI000209832
Verification Code:gbblvwyfxu
Red Hat Certified Engineer -- RHCE --
RHCVAhttps://www.redhat.com/wapps/training/certification/verify.html?certNumber=120-175-658&verify=Verify

Blog:http://www.itrestauracion.com.ar
Cv: http://cv.rinorondan.com.ar http://www.rinorondan.com.ar/
http://counter.li.org Linux User -> #517918
Viva La Santa Federacion!!
Mueran Los Salvages Unitarios!!
^^^Transcripcion de la epoca ^^^

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAASrp47HC_1bBh09ROrvs6s3f69m9wyMjA7h8-g%3DVjYByZ940g%40mail.gmail.com.
For more options, visit https://groups.google.com/groups/opt_out.

6

There will obviously be a delay with new data being inserted into your
indexes, but if your app isn't expecting a constant flow it should be fine
as it will still be able to read.

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: markw@campaignmonitor.com
web: www.campaignmonitor.com

On 12 December 2013 09:00, rino villadalmine@gmail.com wrote:

ok , so all indices created when is not writting at disk, are on
transaction logs and after enabled write and then flush it will be updated
without any impact on the application that use those indices. ??

Regards

On Wed, Dec 11, 2013 at 6:58 PM, Mark Walkom markw@campaignmonitor.comwrote:

It stops writing to the index and just store things in the transaction
log.

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: markw@campaignmonitor.com
web: www.campaignmonitor.com

On 12 December 2013 08:55, rino villadalmine@gmail.com wrote:

Ok, thank you, but just a little more information to what happen when
index stop write to disk in order to manage all info that are on memory.

Regards

On Wed, Dec 11, 2013 at 6:42 PM, Mark Walkom markw@campaignmonitor.comwrote:

You can find the answers to what those HTTP calls are doing here -
Elasticsearch Platform — Find real-time answers at scale | Elastic

Basically the script stops writes to an index, then backs it up and
re-enables writes to continue normal functionality.

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: markw@campaignmonitor.com
web: www.campaignmonitor.com

On 12 December 2013 08:08, Rino Rondan villadalmine@gmail.com wrote:

Hi, im need to be sure if using this script -->
Optimize&Backup Elasticsearch index. And restore. · GitHub to
backup and restore doesnt impact any creation of index (outage of ES) where
script is running.

WHat do exactly those features?
curl -XPOST 'http://localhost:9200/twitter/_optimize'
index.blocks.write
index.translog.disable_flush

I need to be sure that when script isrunning doing zip with those
active --> ( "blocks.write": true , "translog.disable_flush": true, curl
-XPOST "$ADDRESS/$INDEX_NAME/_optimize) I do not lost any indices ..

Regards

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearch+unsubscribe@googlegroups.com.

To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/230b23b1-79e7-43ee-bfd9-6fab5f52dc1a%40googlegroups.com
.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/AoLR8dLNpC4/unsubscribe
.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAEM624aW8U243bw926So7gaz403XxqJUSENVYV-uuzsS02h3sg%40mail.gmail.com
.

For more options, visit https://groups.google.com/groups/opt_out.

--

Rondan Rino
Certificado en LPIC-2 https://cs.lpi.org/caf/Xamman/certification
LPI ID:LPI000209832
Verification Code:gbblvwyfxu
Red Hat Certified Engineer -- RHCE -- RHCVAhttps://www.redhat.com/wapps/training/certification/verify.html?certNumber=120-175-658&verify=Verify

Blog:http://www.itrestauracion.com.ar
Cv: http://cv.rinorondan.com.ar http://www.rinorondan.com.ar/
http://counter.li.org Linux User -> #517918
Viva La Santa Federacion!!
Mueran Los Salvages Unitarios!!
^^^Transcripcion de la epoca ^^^

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAASrp44ZomN5JpjQDAL7FvPxXyZZcGiLKkVtckyw_Xs9S2rODQ%40mail.gmail.com
.

For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/AoLR8dLNpC4/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAEM624a0tORj6MMEKNyNvzqc88XbFV5%2B-4SH%2BQBykJr0vJKHeQ%40mail.gmail.com
.

For more options, visit https://groups.google.com/groups/opt_out.

--

Rondan Rino
Certificado en LPIC-2 https://cs.lpi.org/caf/Xamman/certification
LPI ID:LPI000209832
Verification Code:gbblvwyfxu
Red Hat Certified Engineer -- RHCE -- RHCVAhttps://www.redhat.com/wapps/training/certification/verify.html?certNumber=120-175-658&verify=Verify

Blog:http://www.itrestauracion.com.ar
Cv: http://cv.rinorondan.com.ar http://www.rinorondan.com.ar/
http://counter.li.org Linux User -> #517918
Viva La Santa Federacion!!
Mueran Los Salvages Unitarios!!
^^^Transcripcion de la epoca ^^^

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAASrp47HC_1bBh09ROrvs6s3f69m9wyMjA7h8-g%3DVjYByZ940g%40mail.gmail.com
.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAEM624Yt2A42tb64AFh%2BT7uOYQ4P%3Du3RWw0ovRR%2BnwZ035etyA%40mail.gmail.com.
For more options, visit https://groups.google.com/groups/opt_out.

7

Ok, so to be more close to general idea, when process of backup are running
, new indices created only will be ready to use after backup.... is this
the unique way to do a backup?
El dic 11, 2013 7:11 p.m., "Mark Walkom" markw@campaignmonitor.com
escribió:

There will obviously be a delay with new data being inserted into your
indexes, but if your app isn't expecting a constant flow it should be fine
as it will still be able to read.

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: markw@campaignmonitor.com
web: www.campaignmonitor.com

On 12 December 2013 09:00, rino villadalmine@gmail.com wrote:

ok , so all indices created when is not writting at disk, are on
transaction logs and after enabled write and then flush it will be updated
without any impact on the application that use those indices. ??

Regards

On Wed, Dec 11, 2013 at 6:58 PM, Mark Walkom markw@campaignmonitor.comwrote:

It stops writing to the index and just store things in the transaction
log.

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: markw@campaignmonitor.com
web: www.campaignmonitor.com

On 12 December 2013 08:55, rino villadalmine@gmail.com wrote:

Ok, thank you, but just a little more information to what happen when
index stop write to disk in order to manage all info that are on memory.

Regards

On Wed, Dec 11, 2013 at 6:42 PM, Mark Walkom <markw@campaignmonitor.com

wrote:

You can find the answers to what those HTTP calls are doing here -
Elasticsearch Platform — Find real-time answers at scale | Elastic

Basically the script stops writes to an index, then backs it up and
re-enables writes to continue normal functionality.

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: markw@campaignmonitor.com
web: www.campaignmonitor.com

On 12 December 2013 08:08, Rino Rondan villadalmine@gmail.com wrote:

Hi, im need to be sure if using this script -->
Optimize&Backup Elasticsearch index. And restore. · GitHub backup and restore doesnt impact any creation of index (outage of ES)
where script is running.

WHat do exactly those features?
curl -XPOST 'http://localhost:9200/twitter/_optimize'
index.blocks.write
index.translog.disable_flush

I need to be sure that when script isrunning doing zip with those
active --> ( "blocks.write": true , "translog.disable_flush": true, curl
-XPOST "$ADDRESS/$INDEX_NAME/_optimize) I do not lost any indices ..

Regards

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it,
send an email to elasticsearch+unsubscribe@googlegroups.com.

To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/230b23b1-79e7-43ee-bfd9-6fab5f52dc1a%40googlegroups.com
.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/AoLR8dLNpC4/unsubscribe
.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAEM624aW8U243bw926So7gaz403XxqJUSENVYV-uuzsS02h3sg%40mail.gmail.com
.

For more options, visit https://groups.google.com/groups/opt_out.

--

Rondan Rino
Certificado en LPIC-2 https://cs.lpi.org/caf/Xamman/certification
LPI ID:LPI000209832
Verification Code:gbblvwyfxu
Red Hat Certified Engineer -- RHCE -- RHCVAhttps://www.redhat.com/wapps/training/certification/verify.html?certNumber=120-175-658&verify=Verify

Blog:http://www.itrestauracion.com.ar
Cv: http://cv.rinorondan.com.ar http://www.rinorondan.com.ar/
http://counter.li.org Linux User -> #517918
Viva La Santa Federacion!!
Mueran Los Salvages Unitarios!!
^^^Transcripcion de la epoca ^^^

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAASrp44ZomN5JpjQDAL7FvPxXyZZcGiLKkVtckyw_Xs9S2rODQ%40mail.gmail.com
.

For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/AoLR8dLNpC4/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAEM624a0tORj6MMEKNyNvzqc88XbFV5%2B-4SH%2BQBykJr0vJKHeQ%40mail.gmail.com
.

For more options, visit https://groups.google.com/groups/opt_out.

--

Rondan Rino
Certificado en LPIC-2 https://cs.lpi.org/caf/Xamman/certification
LPI ID:LPI000209832
Verification Code:gbblvwyfxu
Red Hat Certified Engineer -- RHCE -- RHCVAhttps://www.redhat.com/wapps/training/certification/verify.html?certNumber=120-175-658&verify=Verify

Blog:http://www.itrestauracion.com.ar
Cv: http://cv.rinorondan.com.ar http://www.rinorondan.com.ar/
http://counter.li.org Linux User -> #517918
Viva La Santa Federacion!!
Mueran Los Salvages Unitarios!!
^^^Transcripcion de la epoca ^^^

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAASrp47HC_1bBh09ROrvs6s3f69m9wyMjA7h8-g%3DVjYByZ940g%40mail.gmail.com
.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/AoLR8dLNpC4/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAEM624Yt2A42tb64AFh%2BT7uOYQ4P%3Du3RWw0ovRR%2BnwZ035etyA%40mail.gmail.com
.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAASrp47D5Bp6%3DLCsrCS2_41Mjkz63-zCw3w0FAGAcYju8SNCLw%40mail.gmail.com.
For more options, visit https://groups.google.com/groups/opt_out.

8

This script it will only run on one index.
There is new features coming in V1 that will allow complete snapshots and
backups and I'd imagine that the process that it will use will be similar,
though that's just a guess.

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: markw@campaignmonitor.com
web: www.campaignmonitor.com

On 12 December 2013 09:39, rino villadalmine@gmail.com wrote:

Ok, so to be more close to general idea, when process of backup are
running , new indices created only will be ready to use after backup.... is
this the unique way to do a backup?
El dic 11, 2013 7:11 p.m., "Mark Walkom" markw@campaignmonitor.com
escribió:

There will obviously be a delay with new data being inserted into your
indexes, but if your app isn't expecting a constant flow it should be fine
as it will still be able to read.

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: markw@campaignmonitor.com
web: www.campaignmonitor.com

On 12 December 2013 09:00, rino villadalmine@gmail.com wrote:

ok , so all indices created when is not writting at disk, are on
transaction logs and after enabled write and then flush it will be updated
without any impact on the application that use those indices. ??

Regards

On Wed, Dec 11, 2013 at 6:58 PM, Mark Walkom markw@campaignmonitor.comwrote:

It stops writing to the index and just store things in the transaction
log.

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: markw@campaignmonitor.com
web: www.campaignmonitor.com

On 12 December 2013 08:55, rino villadalmine@gmail.com wrote:

Ok, thank you, but just a little more information to what happen when
index stop write to disk in order to manage all info that are on memory.

Regards

On Wed, Dec 11, 2013 at 6:42 PM, Mark Walkom <
markw@campaignmonitor.com> wrote:

You can find the answers to what those HTTP calls are doing here -
Elasticsearch Platform — Find real-time answers at scale | Elastic

Basically the script stops writes to an index, then backs it up and
re-enables writes to continue normal functionality.

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: markw@campaignmonitor.com
web: www.campaignmonitor.com

On 12 December 2013 08:08, Rino Rondan villadalmine@gmail.comwrote:

Hi, im need to be sure if using this script -->
Optimize&Backup Elasticsearch index. And restore. · GitHub backup and restore doesnt impact any creation of index (outage of ES)
where script is running.

WHat do exactly those features?
curl -XPOST 'http://localhost:9200/twitter/_optimize'
index.blocks.write
index.translog.disable_flush

I need to be sure that when script isrunning doing zip with those
active --> ( "blocks.write": true , "translog.disable_flush": true, curl
-XPOST "$ADDRESS/$INDEX_NAME/_optimize) I do not lost any indices ..

Regards

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it,
send an email to elasticsearch+unsubscribe@googlegroups.com.

To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/230b23b1-79e7-43ee-bfd9-6fab5f52dc1a%40googlegroups.com
.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to a topic in
the Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/AoLR8dLNpC4/unsubscribe
.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAEM624aW8U243bw926So7gaz403XxqJUSENVYV-uuzsS02h3sg%40mail.gmail.com
.

For more options, visit https://groups.google.com/groups/opt_out.

--

Rondan Rino
Certificado en LPIC-2 https://cs.lpi.org/caf/Xamman/certification
LPI ID:LPI000209832
Verification Code:gbblvwyfxu
Red Hat Certified Engineer -- RHCE -- RHCVAhttps://www.redhat.com/wapps/training/certification/verify.html?certNumber=120-175-658&verify=Verify

Blog:http://www.itrestauracion.com.ar
Cv: http://cv.rinorondan.com.ar http://www.rinorondan.com.ar/
http://counter.li.org Linux User -> #517918
Viva La Santa Federacion!!
Mueran Los Salvages Unitarios!!
^^^Transcripcion de la epoca ^^^

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAASrp44ZomN5JpjQDAL7FvPxXyZZcGiLKkVtckyw_Xs9S2rODQ%40mail.gmail.com
.

For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/AoLR8dLNpC4/unsubscribe
.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAEM624a0tORj6MMEKNyNvzqc88XbFV5%2B-4SH%2BQBykJr0vJKHeQ%40mail.gmail.com
.

For more options, visit https://groups.google.com/groups/opt_out.

--

Rondan Rino
Certificado en LPIC-2 https://cs.lpi.org/caf/Xamman/certification
LPI ID:LPI000209832
Verification Code:gbblvwyfxu
Red Hat Certified Engineer -- RHCE -- RHCVAhttps://www.redhat.com/wapps/training/certification/verify.html?certNumber=120-175-658&verify=Verify

Blog:http://www.itrestauracion.com.ar
Cv: http://cv.rinorondan.com.ar http://www.rinorondan.com.ar/
http://counter.li.org Linux User -> #517918
Viva La Santa Federacion!!
Mueran Los Salvages Unitarios!!
^^^Transcripcion de la epoca ^^^

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAASrp47HC_1bBh09ROrvs6s3f69m9wyMjA7h8-g%3DVjYByZ940g%40mail.gmail.com
.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/AoLR8dLNpC4/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAEM624Yt2A42tb64AFh%2BT7uOYQ4P%3Du3RWw0ovRR%2BnwZ035etyA%40mail.gmail.com
.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAASrp47D5Bp6%3DLCsrCS2_41Mjkz63-zCw3w0FAGAcYju8SNCLw%40mail.gmail.com
.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAEM624b80QP5aK66oRX5NKOi72c0QAK0Xr2Mfyes1estffVSbw%40mail.gmail.com.
For more options, visit https://groups.google.com/groups/opt_out.

9

That will be great :).. my problem is that somes index are about 10gb, so
it take a while do the zip on the script.. any better idea?
El dic 11, 2013 7:49 p.m., "Mark Walkom" markw@campaignmonitor.com
escribió:

This script it will only run on one index.
There is new features coming in V1 that will allow complete snapshots and
backups and I'd imagine that the process that it will use will be similar,
though that's just a guess.

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: markw@campaignmonitor.com
web: www.campaignmonitor.com

On 12 December 2013 09:39, rino villadalmine@gmail.com wrote:

Ok, so to be more close to general idea, when process of backup are
running , new indices created only will be ready to use after backup.... is
this the unique way to do a backup?
El dic 11, 2013 7:11 p.m., "Mark Walkom" markw@campaignmonitor.com
escribió:

There will obviously be a delay with new data being inserted into your
indexes, but if your app isn't expecting a constant flow it should be fine
as it will still be able to read.

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: markw@campaignmonitor.com
web: www.campaignmonitor.com

On 12 December 2013 09:00, rino villadalmine@gmail.com wrote:

ok , so all indices created when is not writting at disk, are on
transaction logs and after enabled write and then flush it will be updated
without any impact on the application that use those indices. ??

Regards

On Wed, Dec 11, 2013 at 6:58 PM, Mark Walkom <markw@campaignmonitor.com

wrote:

It stops writing to the index and just store things in the transaction
log.

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: markw@campaignmonitor.com
web: www.campaignmonitor.com

On 12 December 2013 08:55, rino villadalmine@gmail.com wrote:

Ok, thank you, but just a little more information to what happen when
index stop write to disk in order to manage all info that are on memory.

Regards

On Wed, Dec 11, 2013 at 6:42 PM, Mark Walkom <
markw@campaignmonitor.com> wrote:

You can find the answers to what those HTTP calls are doing here -
Elasticsearch Platform — Find real-time answers at scale | Elastic

Basically the script stops writes to an index, then backs it up and
re-enables writes to continue normal functionality.

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: markw@campaignmonitor.com
web: www.campaignmonitor.com

On 12 December 2013 08:08, Rino Rondan villadalmine@gmail.comwrote:

Hi, im need to be sure if using this script -->
Optimize&Backup Elasticsearch index. And restore. · GitHub backup and restore doesnt impact any creation of index (outage of ES)
where script is running.

WHat do exactly those features?
curl -XPOST 'http://localhost:9200/twitter/_optimize'
index.blocks.write
index.translog.disable_flush

I need to be sure that when script isrunning doing zip with those
active --> ( "blocks.write": true , "translog.disable_flush":
true, curl -XPOST "$ADDRESS/$INDEX_NAME/_optimize) I do not lost
any indices ..

Regards

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it,
send an email to elasticsearch+unsubscribe@googlegroups.com.

To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/230b23b1-79e7-43ee-bfd9-6fab5f52dc1a%40googlegroups.com
.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to a topic in
the Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/AoLR8dLNpC4/unsubscribe
.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAEM624aW8U243bw926So7gaz403XxqJUSENVYV-uuzsS02h3sg%40mail.gmail.com
.

For more options, visit https://groups.google.com/groups/opt_out.

--

Rondan Rino
Certificado en LPIC-2 https://cs.lpi.org/caf/Xamman/certification
LPI ID:LPI000209832
Verification Code:gbblvwyfxu
Red Hat Certified Engineer -- RHCE -- RHCVAhttps://www.redhat.com/wapps/training/certification/verify.html?certNumber=120-175-658&verify=Verify

Blog:http://www.itrestauracion.com.ar
Cv: http://cv.rinorondan.com.ar http://www.rinorondan.com.ar/
http://counter.li.org Linux User -> #517918
Viva La Santa Federacion!!
Mueran Los Salvages Unitarios!!
^^^Transcripcion de la epoca ^^^

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it,
send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAASrp44ZomN5JpjQDAL7FvPxXyZZcGiLKkVtckyw_Xs9S2rODQ%40mail.gmail.com
.

For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/AoLR8dLNpC4/unsubscribe
.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAEM624a0tORj6MMEKNyNvzqc88XbFV5%2B-4SH%2BQBykJr0vJKHeQ%40mail.gmail.com
.

For more options, visit https://groups.google.com/groups/opt_out.

--

Rondan Rino
Certificado en LPIC-2 https://cs.lpi.org/caf/Xamman/certification
LPI ID:LPI000209832
Verification Code:gbblvwyfxu
Red Hat Certified Engineer -- RHCE -- RHCVAhttps://www.redhat.com/wapps/training/certification/verify.html?certNumber=120-175-658&verify=Verify

Blog:http://www.itrestauracion.com.ar
Cv: http://cv.rinorondan.com.ar http://www.rinorondan.com.ar/
http://counter.li.org Linux User -> #517918
Viva La Santa Federacion!!
Mueran Los Salvages Unitarios!!
^^^Transcripcion de la epoca ^^^

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAASrp47HC_1bBh09ROrvs6s3f69m9wyMjA7h8-g%3DVjYByZ940g%40mail.gmail.com
.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/AoLR8dLNpC4/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAEM624Yt2A42tb64AFh%2BT7uOYQ4P%3Du3RWw0ovRR%2BnwZ035etyA%40mail.gmail.com
.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAASrp47D5Bp6%3DLCsrCS2_41Mjkz63-zCw3w0FAGAcYju8SNCLw%40mail.gmail.com
.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/AoLR8dLNpC4/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAEM624b80QP5aK66oRX5NKOi72c0QAK0Xr2Mfyes1estffVSbw%40mail.gmail.com
.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAASrp46kMUqP9qDah3pw%2B69qvUBP7716XguEP7jE3sqAoG9TTA%40mail.gmail.com.
For more options, visit https://groups.google.com/groups/opt_out.

10

I was testing the script and i detect that after doing the backup (
Optimize&Backup Elasticsearch index. And restore. · GitHub)
the function cleanup doesnt move to false flush and block_write so i need
to do it manually

On Wed, Dec 11, 2013 at 7:56 PM, rino villadalmine@gmail.com wrote:

That will be great :).. my problem is that somes index are about 10gb, so
it take a while do the zip on the script.. any better idea?
El dic 11, 2013 7:49 p.m., "Mark Walkom" markw@campaignmonitor.com
escribió:

This script it will only run on one index.

There is new features coming in V1 that will allow complete snapshots and
backups and I'd imagine that the process that it will use will be similar,
though that's just a guess.

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: markw@campaignmonitor.com
web: www.campaignmonitor.com

On 12 December 2013 09:39, rino villadalmine@gmail.com wrote:

Ok, so to be more close to general idea, when process of backup are
running , new indices created only will be ready to use after backup.... is
this the unique way to do a backup?
El dic 11, 2013 7:11 p.m., "Mark Walkom" markw@campaignmonitor.com
escribió:

There will obviously be a delay with new data being inserted into your
indexes, but if your app isn't expecting a constant flow it should be fine
as it will still be able to read.

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: markw@campaignmonitor.com
web: www.campaignmonitor.com

On 12 December 2013 09:00, rino villadalmine@gmail.com wrote:

ok , so all indices created when is not writting at disk, are on
transaction logs and after enabled write and then flush it will be updated
without any impact on the application that use those indices. ??

Regards

On Wed, Dec 11, 2013 at 6:58 PM, Mark Walkom <
markw@campaignmonitor.com> wrote:

It stops writing to the index and just store things in the
transaction log.

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: markw@campaignmonitor.com
web: www.campaignmonitor.com

On 12 December 2013 08:55, rino villadalmine@gmail.com wrote:

Ok, thank you, but just a little more information to what happen
when index stop write to disk in order to manage all info that are on
memory.

Regards

On Wed, Dec 11, 2013 at 6:42 PM, Mark Walkom <
markw@campaignmonitor.com> wrote:

You can find the answers to what those HTTP calls are doing here -
Elasticsearch Platform — Find real-time answers at scale | Elastic

Basically the script stops writes to an index, then backs it up and
re-enables writes to continue normal functionality.

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: markw@campaignmonitor.com
web: www.campaignmonitor.com

On 12 December 2013 08:08, Rino Rondan villadalmine@gmail.comwrote:

Hi, im need to be sure if using this script -->
Optimize&Backup Elasticsearch index. And restore. · GitHub backup and restore doesnt impact any creation of index (outage of ES)
where script is running.

WHat do exactly those features?
curl -XPOST 'http://localhost:9200/twitter/_optimize'
index.blocks.write
index.translog.disable_flush

I need to be sure that when script isrunning doing zip with those
active --> ( "blocks.write": true , "translog.disable_flush":
true, curl -XPOST "$ADDRESS/$INDEX_NAME/_optimize) I do not lost
any indices ..

Regards

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it,
send an email to elasticsearch+unsubscribe@googlegroups.com.

To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/230b23b1-79e7-43ee-bfd9-6fab5f52dc1a%40googlegroups.com
.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to a topic in
the Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/AoLR8dLNpC4/unsubscribe
.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAEM624aW8U243bw926So7gaz403XxqJUSENVYV-uuzsS02h3sg%40mail.gmail.com
.

For more options, visit https://groups.google.com/groups/opt_out.

--

Rondan Rino
Certificado en LPIC-2 https://cs.lpi.org/caf/Xamman/certification
LPI ID:LPI000209832
Verification Code:gbblvwyfxu
Red Hat Certified Engineer -- RHCE -- RHCVAhttps://www.redhat.com/wapps/training/certification/verify.html?certNumber=120-175-658&verify=Verify

Blog:http://www.itrestauracion.com.ar
Cv: http://cv.rinorondan.com.ar http://www.rinorondan.com.ar/
http://counter.li.org Linux User -> #517918
Viva La Santa Federacion!!
Mueran Los Salvages Unitarios!!
^^^Transcripcion de la epoca ^^^

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it,
send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAASrp44ZomN5JpjQDAL7FvPxXyZZcGiLKkVtckyw_Xs9S2rODQ%40mail.gmail.com
.

For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to a topic in
the Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/AoLR8dLNpC4/unsubscribe
.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAEM624a0tORj6MMEKNyNvzqc88XbFV5%2B-4SH%2BQBykJr0vJKHeQ%40mail.gmail.com
.

For more options, visit https://groups.google.com/groups/opt_out.

--

Rondan Rino
Certificado en LPIC-2 https://cs.lpi.org/caf/Xamman/certification
LPI ID:LPI000209832
Verification Code:gbblvwyfxu
Red Hat Certified Engineer -- RHCE -- RHCVAhttps://www.redhat.com/wapps/training/certification/verify.html?certNumber=120-175-658&verify=Verify

Blog:http://www.itrestauracion.com.ar
Cv: http://cv.rinorondan.com.ar http://www.rinorondan.com.ar/
http://counter.li.org Linux User -> #517918
Viva La Santa Federacion!!
Mueran Los Salvages Unitarios!!
^^^Transcripcion de la epoca ^^^

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAASrp47HC_1bBh09ROrvs6s3f69m9wyMjA7h8-g%3DVjYByZ940g%40mail.gmail.com
.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/AoLR8dLNpC4/unsubscribe
.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAEM624Yt2A42tb64AFh%2BT7uOYQ4P%3Du3RWw0ovRR%2BnwZ035etyA%40mail.gmail.com
.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAASrp47D5Bp6%3DLCsrCS2_41Mjkz63-zCw3w0FAGAcYju8SNCLw%40mail.gmail.com
.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/AoLR8dLNpC4/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAEM624b80QP5aK66oRX5NKOi72c0QAK0Xr2Mfyes1estffVSbw%40mail.gmail.com
.
For more options, visit https://groups.google.com/groups/opt_out.

--

Rondan Rino
Certificado en LPIC-2 https://cs.lpi.org/caf/Xamman/certification
LPI ID:LPI000209832
Verification Code:gbblvwyfxu
Red Hat Certified Engineer -- RHCE --
RHCVAhttps://www.redhat.com/wapps/training/certification/verify.html?certNumber=120-175-658&verify=Verify

Blog:http://www.itrestauracion.com.ar
Cv: http://cv.rinorondan.com.ar http://www.rinorondan.com.ar/
http://counter.li.org Linux User -> #517918
Viva La Santa Federacion!!
Mueran Los Salvages Unitarios!!
^^^Transcripcion de la epoca ^^^

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAASrp44JNPM72pjPTCkpkNKWyzXQ_UiZUqM7wupaPu8Ab8sMOg%40mail.gmail.com.
For more options, visit https://groups.google.com/groups/opt_out.

11

was sent by error :S

i did
curl -XPUT "http://app-es2-dr.55social.com:9200/posts/_settings" -d '{
"index": {
"translog.disable_flush": false
}
}'

curl -XPUT "http://localhost:9200/posts/_settings" -d '{
"index": {
"blocks.write": false
}
}'

but i think that i need to have it again in false , is that an errror of
the script or im doing a wrong steps..

Regards

On Thu, Dec 12, 2013 at 4:19 PM, rino villadalmine@gmail.com wrote:

I was testing the script and i detect that after doing the backup (
Optimize&Backup Elasticsearch index. And restore. · GitHub)
the function cleanup doesnt move to false flush and block_write so i need
to do it manually

On Wed, Dec 11, 2013 at 7:56 PM, rino villadalmine@gmail.com wrote:

That will be great :).. my problem is that somes index are about 10gb,
so it take a while do the zip on the script.. any better idea?
El dic 11, 2013 7:49 p.m., "Mark Walkom" markw@campaignmonitor.com
escribió:

This script it will only run on one index.

There is new features coming in V1 that will allow complete snapshots
and backups and I'd imagine that the process that it will use will be
similar, though that's just a guess.

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: markw@campaignmonitor.com
web: www.campaignmonitor.com

On 12 December 2013 09:39, rino villadalmine@gmail.com wrote:

Ok, so to be more close to general idea, when process of backup are
running , new indices created only will be ready to use after backup.... is
this the unique way to do a backup?
El dic 11, 2013 7:11 p.m., "Mark Walkom" markw@campaignmonitor.com
escribió:

There will obviously be a delay with new data being inserted into your
indexes, but if your app isn't expecting a constant flow it should be fine
as it will still be able to read.

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: markw@campaignmonitor.com
web: www.campaignmonitor.com

On 12 December 2013 09:00, rino villadalmine@gmail.com wrote:

ok , so all indices created when is not writting at disk, are on
transaction logs and after enabled write and then flush it will be updated
without any impact on the application that use those indices. ??

Regards

On Wed, Dec 11, 2013 at 6:58 PM, Mark Walkom <
markw@campaignmonitor.com> wrote:

It stops writing to the index and just store things in the
transaction log.

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: markw@campaignmonitor.com
web: www.campaignmonitor.com

On 12 December 2013 08:55, rino villadalmine@gmail.com wrote:

Ok, thank you, but just a little more information to what happen
when index stop write to disk in order to manage all info that are on
memory.

Regards

On Wed, Dec 11, 2013 at 6:42 PM, Mark Walkom <
markw@campaignmonitor.com> wrote:

You can find the answers to what those HTTP calls are doing here -
Elasticsearch Platform — Find real-time answers at scale | Elastic

Basically the script stops writes to an index, then backs it up
and re-enables writes to continue normal functionality.

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: markw@campaignmonitor.com
web: www.campaignmonitor.com

On 12 December 2013 08:08, Rino Rondan villadalmine@gmail.comwrote:

Hi, im need to be sure if using this script -->
Optimize&Backup Elasticsearch index. And restore. · GitHub backup and restore doesnt impact any creation of index (outage of ES)
where script is running.

WHat do exactly those features?
curl -XPOST 'http://localhost:9200/twitter/_optimize'
index.blocks.write
index.translog.disable_flush

I need to be sure that when script isrunning doing zip with
those active --> ( "blocks.write": true , "translog.disable_flush":
true, curl -XPOST "$ADDRESS/$INDEX_NAME/_optimize) I do not lost
any indices ..

Regards

--
You received this message because you are subscribed to the
Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it,
send an email to elasticsearch+unsubscribe@googlegroups.com.

To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/230b23b1-79e7-43ee-bfd9-6fab5f52dc1a%40googlegroups.com
.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to a topic in
the Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/AoLR8dLNpC4/unsubscribe
.
To unsubscribe from this group and all its topics, send an email
to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAEM624aW8U243bw926So7gaz403XxqJUSENVYV-uuzsS02h3sg%40mail.gmail.com
.

For more options, visit https://groups.google.com/groups/opt_out.

--

Rondan Rino
Certificado en LPIC-2 https://cs.lpi.org/caf/Xamman/certification
LPI ID:LPI000209832
Verification Code:gbblvwyfxu
Red Hat Certified Engineer -- RHCE -- RHCVAhttps://www.redhat.com/wapps/training/certification/verify.html?certNumber=120-175-658&verify=Verify

Blog:http://www.itrestauracion.com.ar
Cv: http://cv.rinorondan.com.ar http://www.rinorondan.com.ar/
http://counter.li.org Linux User -> #517918
Viva La Santa Federacion!!
Mueran Los Salvages Unitarios!!
^^^Transcripcion de la epoca ^^^

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it,
send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAASrp44ZomN5JpjQDAL7FvPxXyZZcGiLKkVtckyw_Xs9S2rODQ%40mail.gmail.com
.

For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to a topic in
the Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/AoLR8dLNpC4/unsubscribe
.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAEM624a0tORj6MMEKNyNvzqc88XbFV5%2B-4SH%2BQBykJr0vJKHeQ%40mail.gmail.com
.

For more options, visit https://groups.google.com/groups/opt_out.

--

Rondan Rino
Certificado en LPIC-2 https://cs.lpi.org/caf/Xamman/certification
LPI ID:LPI000209832
Verification Code:gbblvwyfxu
Red Hat Certified Engineer -- RHCE -- RHCVAhttps://www.redhat.com/wapps/training/certification/verify.html?certNumber=120-175-658&verify=Verify

Blog:http://www.itrestauracion.com.ar
Cv: http://cv.rinorondan.com.ar http://www.rinorondan.com.ar/
http://counter.li.org Linux User -> #517918
Viva La Santa Federacion!!
Mueran Los Salvages Unitarios!!
^^^Transcripcion de la epoca ^^^

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it,
send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAASrp47HC_1bBh09ROrvs6s3f69m9wyMjA7h8-g%3DVjYByZ940g%40mail.gmail.com
.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/AoLR8dLNpC4/unsubscribe
.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAEM624Yt2A42tb64AFh%2BT7uOYQ4P%3Du3RWw0ovRR%2BnwZ035etyA%40mail.gmail.com
.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAASrp47D5Bp6%3DLCsrCS2_41Mjkz63-zCw3w0FAGAcYju8SNCLw%40mail.gmail.com
.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/AoLR8dLNpC4/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAEM624b80QP5aK66oRX5NKOi72c0QAK0Xr2Mfyes1estffVSbw%40mail.gmail.com
.
For more options, visit https://groups.google.com/groups/opt_out.

--

Rondan Rino
Certificado en LPIC-2 https://cs.lpi.org/caf/Xamman/certification
LPI ID:LPI000209832
Verification Code:gbblvwyfxu
Red Hat Certified Engineer -- RHCE -- RHCVAhttps://www.redhat.com/wapps/training/certification/verify.html?certNumber=120-175-658&verify=Verify

Blog:http://www.itrestauracion.com.ar
Cv: http://cv.rinorondan.com.ar http://www.rinorondan.com.ar/
http://counter.li.org Linux User -> #517918
Viva La Santa Federacion!!
Mueran Los Salvages Unitarios!!
^^^Transcripcion de la epoca ^^^

--

Rondan Rino
Certificado en LPIC-2 https://cs.lpi.org/caf/Xamman/certification
LPI ID:LPI000209832
Verification Code:gbblvwyfxu
Red Hat Certified Engineer -- RHCE --
RHCVAhttps://www.redhat.com/wapps/training/certification/verify.html?certNumber=120-175-658&verify=Verify

Blog:http://www.itrestauracion.com.ar
Cv: http://cv.rinorondan.com.ar http://www.rinorondan.com.ar/
http://counter.li.org Linux User -> #517918
Viva La Santa Federacion!!
Mueran Los Salvages Unitarios!!
^^^Transcripcion de la epoca ^^^

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAASrp47Q%2BOfyYSND2%3DX9e%3DcrHt%2BRb_Cx-5HCzaYTZfbLuPAhpw%40mail.gmail.com.
For more options, visit https://groups.google.com/groups/opt_out.