Best way to reindex in production


(Matt Chambers) #1

Hello,

I'm running Elastic 0.26, 2 nodes. I need to make a change to the
mapping. The cluster is in heavy use 24/7. What is the best way to do
this?

-Matt

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.


(David Pilato) #2

By now, have a look at:



http://euphonious-intuition.com/2012/08/reindexing-your-elasticsearch-data-with-scanscroll/

The last one is using scan&scroll API: http://www.elasticsearch.org/guide/reference/api/search/scroll/

HTH

David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 3 mai 2013 à 06:46, Matt Chambers yougotrooted@gmail.com a écrit :

Hello,

I'm running Elastic 0.26, 2 nodes. I need to make a change to the mapping. The cluster is in heavy use 24/7. What is the best way to do this?

-Matt

You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.


(Matt Chambers) #3

Thanks David, I checked those out, although I'm not certain of something.
What happens to the updates that happen to the index during the export?
Are those just lost?

On Friday, May 3, 2013 5:50:41 PM UTC+12, David Pilato wrote:

By now, have a look at:
https://github.com/karussell/elasticsearch-reindex
https://github.com/crate/elasticsearch-inout-plugin

http://euphonious-intuition.com/2012/08/reindexing-your-elasticsearch-data-with-scanscroll/

The last one is using scan&scroll API:
http://www.elasticsearch.org/guide/reference/api/search/scroll/

HTH

David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 3 mai 2013 à 06:46, Matt Chambers <yougot...@gmail.com <javascript:>>
a écrit :

Hello,

I'm running Elastic 0.26, 2 nodes. I need to make a change to the
mapping. The cluster is in heavy use 24/7. What is the best way to do
this?

-Matt

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com <javascript:>.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.


(dobe) #4

hi matt

we are currently working to implement a direct re-index in
https://github.com/crate/elasticsearch-inout-plugin, this should be
available in a week or so.

However - note that the inout plugin is only compatible with elasticsearch
0.90.

br, bernd

The feature will allow you to reindex directly on a given index.

On Saturday, May 4, 2013 3:17:33 AM UTC+2, Matt Chambers wrote:

Thanks David, I checked those out, although I'm not certain of something.
What happens to the updates that happen to the index during the export?
Are those just lost?

For the inout plugin _export command, yes. You can compare the export with
a large query, which does not take new or updated documents into account,
since its start.

On Friday, May 3, 2013 5:50:41 PM UTC+12, David Pilato wrote:

By now, have a look at:
https://github.com/karussell/elasticsearch-reindex
https://github.com/crate/elasticsearch-inout-plugin

http://euphonious-intuition.com/2012/08/reindexing-your-elasticsearch-data-with-scanscroll/

The last one is using scan&scroll API:
http://www.elasticsearch.org/guide/reference/api/search/scroll/

HTH

David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 3 mai 2013 à 06:46, Matt Chambers yougot...@gmail.com a écrit :

Hello,

I'm running Elastic 0.26, 2 nodes. I need to make a change to the
mapping. The cluster is in heavy use 24/7. What is the best way to do
this?

-Matt

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.


(Monika Maheshwari) #5

Hey i am having same issue that how the updates will happen during export. Have you resolved that.