Best way to reindex in production

Elastic Stack Elasticsearch
1

Hello,

I'm running Elastic 0.26, 2 nodes. I need to make a change to the
mapping. The cluster is in heavy use 24/7. What is the best way to do
this?

-Matt

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

2

By now, have a look at:



http://euphonious-intuition.com/2012/08/reindexing-your-elasticsearch-data-with-scanscroll/

The last one is using scan&scroll API: http://www.elasticsearch.org/guide/reference/api/search/scroll/

HTH

David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 3 mai 2013 à 06:46, Matt Chambers yougotrooted@gmail.com a écrit :

Hello,

I'm running Elastic 0.26, 2 nodes. I need to make a change to the mapping. The cluster is in heavy use 24/7. What is the best way to do this?

-Matt

You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

3

Thanks David, I checked those out, although I'm not certain of something.
What happens to the updates that happen to the index during the export?
Are those just lost?

On Friday, May 3, 2013 5:50:41 PM UTC+12, David Pilato wrote:

By now, have a look at:
GitHub - karussell/elasticsearch-reindex: Simple re-indexing. To backup, apply index settings changes and more ElasticMagic
GitHub - crate/elasticsearch-inout-plugin: An Elasticsearch plugin which provides the ability to export data by query on server side.

http://euphonious-intuition.com/2012/08/reindexing-your-elasticsearch-data-with-scanscroll/

The last one is using scan&scroll API:
Elasticsearch Platform — Find real-time answers at scale | Elastic

HTH

David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 3 mai 2013 à 06:46, Matt Chambers <yougot...@gmail.com <javascript:>>
a écrit :

Hello,

I'm running Elastic 0.26, 2 nodes. I need to make a change to the
mapping. The cluster is in heavy use 24/7. What is the best way to do
this?

-Matt

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com <javascript:>.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

4

hi matt

we are currently working to implement a direct re-index in
GitHub - crate/elasticsearch-inout-plugin: An Elasticsearch plugin which provides the ability to export data by query on server side., this should be
available in a week or so.

However - note that the inout plugin is only compatible with elasticsearch
0.90.

br, bernd

The feature will allow you to reindex directly on a given index.

On Saturday, May 4, 2013 3:17:33 AM UTC+2, Matt Chambers wrote:

Thanks David, I checked those out, although I'm not certain of something.
What happens to the updates that happen to the index during the export?
Are those just lost?

For the inout plugin _export command, yes. You can compare the export with
a large query, which does not take new or updated documents into account,
since its start.

On Friday, May 3, 2013 5:50:41 PM UTC+12, David Pilato wrote:

By now, have a look at:
GitHub - karussell/elasticsearch-reindex: Simple re-indexing. To backup, apply index settings changes and more ElasticMagic
GitHub - crate/elasticsearch-inout-plugin: An Elasticsearch plugin which provides the ability to export data by query on server side.

http://euphonious-intuition.com/2012/08/reindexing-your-elasticsearch-data-with-scanscroll/

The last one is using scan&scroll API:
Elasticsearch Platform — Find real-time answers at scale | Elastic

HTH

David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 3 mai 2013 à 06:46, Matt Chambers yougot...@gmail.com a écrit :

Hello,

I'm running Elastic 0.26, 2 nodes. I need to make a change to the
mapping. The cluster is in heavy use 24/7. What is the best way to do
this?

-Matt

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

5

Hey i am having same issue that how the updates will happen during export. Have you resolved that.