The best way to migrate data from 3 indices to new index


(tao hiko) #1

I have similar 3 indices in same cluster and I will create new index for
support new change.

Anyone please suggest me, How to migrate data from those to the new one
easily?

Hiko.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/89a519e3-0beb-4cc4-ae0b-0742aedc2274%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


(Mark Walkom) #2

Use one of the official clients to do it - http://www.elastic.co/guide/

On 27 April 2015 at 20:02, tao hiko taohiko@gmail.com wrote:

I have similar 3 indices in same cluster and I will create new index for
support new change.

Anyone please suggest me, How to migrate data from those to the new one
easily?

Hiko.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/89a519e3-0beb-4cc4-ae0b-0742aedc2274%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/89a519e3-0beb-4cc4-ae0b-0742aedc2274%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAEYi1X9bpuxdi6kESRtARGhiNfMxkLKRh63oP64D40bWnoMdJA%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.


(tao hiko) #3

Hi Mark,

I'm trying to use javascript to do that by bulk operation but I found some
issue when source data contain "\" that cannot insert to target index that
show below error

MapperParsingException[failed to parse [summary]]; nested:
JsonParseException[Unrecognized character escape 's' (code 115)

The source data contains path on Windows (eg. C:\path) so ES ejects that
document.

Hiko

On Tuesday, April 28, 2015 at 4:24:40 AM UTC+7, Mark Walkom wrote:

Use one of the official clients to do it - http://www.elastic.co/guide/

On 27 April 2015 at 20:02, tao hiko <tao...@gmail.com <javascript:>>
wrote:

I have similar 3 indices in same cluster and I will create new index for
support new change.

Anyone please suggest me, How to migrate data from those to the new one
easily?

Hiko.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com <javascript:>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/89a519e3-0beb-4cc4-ae0b-0742aedc2274%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/89a519e3-0beb-4cc4-ae0b-0742aedc2274%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/61d15631-a6a5-47e3-9759-25c052a0443a%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


(tao hiko) #4

This problem is fixed, I replace "\" with "\\" and load again.

Finally, I create js script and run by node command that is work for me.

On Thursday, April 30, 2015 at 6:09:05 PM UTC+7, tao hiko wrote:

Hi Mark,

I'm trying to use javascript to do that by bulk operation but I found some
issue when source data contain "\" that cannot insert to target index that
show below error

MapperParsingException[failed to parse [summary]]; nested:
JsonParseException[Unrecognized character escape 's' (code 115)

The source data contains path on Windows (eg. C:\path) so ES ejects that
document.

Hiko

On Tuesday, April 28, 2015 at 4:24:40 AM UTC+7, Mark Walkom wrote:

Use one of the official clients to do it - http://www.elastic.co/guide/

On 27 April 2015 at 20:02, tao hiko tao...@gmail.com wrote:

I have similar 3 indices in same cluster and I will create new index for
support new change.

Anyone please suggest me, How to migrate data from those to the new one
easily?

Hiko.

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearc...@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/89a519e3-0beb-4cc4-ae0b-0742aedc2274%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/89a519e3-0beb-4cc4-ae0b-0742aedc2274%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
Please update your bookmarks! We moved to https://discuss.elastic.co/

You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/90d4c0ec-11a3-445e-8f07-4a38d34bc688%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


(system) #5