Syncing two elasticsearch clusters

Elastic Stack Elasticsearch
1

Hello, my problem is that I need to suport second cluster of ES which has
different version, different document structure, but the same data from the
first ES.
The data is coming to the first cluster, and I need to take that data,
restructure it, and push it to the second ES.
What would be the best approach?
Any suggestion or help is greatly appreciated.
Thank you,
Eugene

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

2

Hey,

check out the scan search type, which would allow you do to that using a
small script in whatever scripting language you prefer. See

--Alex

On Mon, Nov 4, 2013 at 2:57 PM, Eugene Strokin eugene@strokin.info wrote:

Hello, my problem is that I need to suport second cluster of ES which has
different version, different document structure, but the same data from the
first ES.
The data is coming to the first cluster, and I need to take that data,
restructure it, and push it to the second ES.
What would be the best approach?
Any suggestion or help is greatly appreciated.
Thank you,
Eugene

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

3

Alex, thank you for your help. But what about updates and deletes? I have hundred millions documents, I'm sure it will take time to import and during that time will be deletes and updates of the documents which will be already imported, and the changes will be lost. Do you have any idea about that?
Thanks,
Eugene

On Nov 14, 2013, at 3:50 AM, Alexander Reelsen alr@spinscale.de wrote:

Hey,

check out the scan search type, which would allow you do to that using a small script in whatever scripting language you prefer. See

Elasticsearch Platform — Find real-time answers at scale | Elastic

--Alex

On Mon, Nov 4, 2013 at 2:57 PM, Eugene Strokin eugene@strokin.info wrote:
Hello, my problem is that I need to suport second cluster of ES which has different version, different document structure, but the same data from the first ES.
The data is coming to the first cluster, and I need to take that data, restructure it, and push it to the second ES.
What would be the best approach?
Any suggestion or help is greatly appreciated.
Thank you,
Eugene

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to a topic in the Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/elasticsearch/T435WEMFkms/unsubscribe.
To unsubscribe from this group and all its topics, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.