Copy Indices to new Server


(Andrew Lakes) #1

Hey guys,

we have set up a new physical ES-server in order to get more ressources for
our ELK-Stack.

On our old server we got about 1.8 TB/ 127 Indices which have to be
available on the new server.

So we copied the the indices to the new server, which have the same
configuration as the old server and set the permissions so that
elasticsearch can read/write on the indices.

We restarted elasticsearch so that ES can initialise the indices properly,
but unfortunate it didnt load them into the cluster.

Is there anything you have to configure that we dont have already done, in
order to copy the indices?

Thanks for response

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/2e55eedd-c051-4aec-be05-1db57c7e5f5a%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


(vineeth mohan-2) #2

Hello Andrew ,

Did you copy the data folder or do a snapshot/restore -
http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/modules-snapshots.html#_snapshot

Thanks
Vineeth

On Tue, Sep 2, 2014 at 7:05 PM, Andrew Lakes alakes501@gmail.com wrote:

Hey guys,

we have set up a new physical ES-server in order to get more ressources
for our ELK-Stack.

On our old server we got about 1.8 TB/ 127 Indices which have to be
available on the new server.

So we copied the the indices to the new server, which have the same
configuration as the old server and set the permissions so that
elasticsearch can read/write on the indices.

We restarted elasticsearch so that ES can initialise the indices properly,
but unfortunate it didnt load them into the cluster.

Is there anything you have to configure that we dont have already done, in
order to copy the indices?

Thanks for response

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/2e55eedd-c051-4aec-be05-1db57c7e5f5a%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/2e55eedd-c051-4aec-be05-1db57c7e5f5a%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAGdPd5%3DShDPBz0fzjG0L_foVU2Sg4Bf%3DvoL4bRLt%3D3UB3x6ejg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.


(Andrew Lakes) #3

Hi Vineeth,

i copied the the data folder to the new server.

Thanks

Am Dienstag, 2. September 2014 16:31:12 UTC+2 schrieb vineeth mohan:

Hello Andrew ,

Did you copy the data folder or do a snapshot/restore -
http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/modules-snapshots.html#_snapshot

Thanks
Vineeth

On Tue, Sep 2, 2014 at 7:05 PM, Andrew Lakes <alak...@gmail.com
<javascript:>> wrote:

Hey guys,

we have set up a new physical ES-server in order to get more ressources
for our ELK-Stack.

On our old server we got about 1.8 TB/ 127 Indices which have to be
available on the new server.

So we copied the the indices to the new server, which have the same
configuration as the old server and set the permissions so that
elasticsearch can read/write on the indices.

We restarted elasticsearch so that ES can initialise the indices
properly, but unfortunate it didnt load them into the cluster.

Is there anything you have to configure that we dont have already done,
in order to copy the indices?

Thanks for response

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com <javascript:>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/2e55eedd-c051-4aec-be05-1db57c7e5f5a%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/2e55eedd-c051-4aec-be05-1db57c7e5f5a%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/f4f9c602-9f01-4bc8-a491-40aa5e13914e%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


(Mark Walkom) #4

Can you elaborate which directory you copied from and to, ie the full path?
Did you make any changes at all in the config on the new server?

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: markw@campaignmonitor.com
web: www.campaignmonitor.com

On 3 September 2014 17:17, Andrew Lakes alakes501@gmail.com wrote:

Hi Vineeth,

i copied the the data folder to the new server.

Thanks

Am Dienstag, 2. September 2014 16:31:12 UTC+2 schrieb vineeth mohan:

Hello Andrew ,

Did you copy the data folder or do a snapshot/restore -
http://www.elasticsearch.org/guide/en/elasticsearch/
reference/current/modules-snapshots.html#_snapshot

Thanks
Vineeth

On Tue, Sep 2, 2014 at 7:05 PM, Andrew Lakes alak...@gmail.com wrote:

Hey guys,

we have set up a new physical ES-server in order to get more ressources
for our ELK-Stack.

On our old server we got about 1.8 TB/ 127 Indices which have to be
available on the new server.

So we copied the the indices to the new server, which have the same
configuration as the old server and set the permissions so that
elasticsearch can read/write on the indices.

We restarted elasticsearch so that ES can initialise the indices
properly, but unfortunate it didnt load them into the cluster.

Is there anything you have to configure that we dont have already done,
in order to copy the indices?

Thanks for response

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearc...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/
msgid/elasticsearch/2e55eedd-c051-4aec-be05-1db57c7e5f5a%
40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/2e55eedd-c051-4aec-be05-1db57c7e5f5a%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/f4f9c602-9f01-4bc8-a491-40aa5e13914e%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/f4f9c602-9f01-4bc8-a491-40aa5e13914e%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAEM624YcW6QkqK36bDr-9MokF6Ap53pyqrQiiddM1R3di88m5Q%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.


(Andrew Lakes) #5

Hi,

i copied from /data/es_index/elasticsearch/nodes/0/indices to
/data/es/t2//nodes/0/indices/

So indeed i change the clustername and have version 1.3.2 instead of 1.3.1
on the new server.

Beside that i havent changed anything.

Cheers

Am Mittwoch, 3. September 2014 09:46:37 UTC+2 schrieb Mark Walkom:

Can you elaborate which directory you copied from and to, ie the full path?
Did you make any changes at all in the config on the new server?

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com <javascript:>
web: www.campaignmonitor.com

On 3 September 2014 17:17, Andrew Lakes <alak...@gmail.com <javascript:>>
wrote:

Hi Vineeth,

i copied the the data folder to the new server.

Thanks

Am Dienstag, 2. September 2014 16:31:12 UTC+2 schrieb vineeth mohan:

Hello Andrew ,

Did you copy the data folder or do a snapshot/restore -
http://www.elasticsearch.org/guide/en/elasticsearch/
reference/current/modules-snapshots.html#_snapshot

Thanks
Vineeth

On Tue, Sep 2, 2014 at 7:05 PM, Andrew Lakes alak...@gmail.com wrote:

Hey guys,

we have set up a new physical ES-server in order to get more ressources
for our ELK-Stack.

On our old server we got about 1.8 TB/ 127 Indices which have to be
available on the new server.

So we copied the the indices to the new server, which have the same
configuration as the old server and set the permissions so that
elasticsearch can read/write on the indices.

We restarted elasticsearch so that ES can initialise the indices
properly, but unfortunate it didnt load them into the cluster.

Is there anything you have to configure that we dont have already done,
in order to copy the indices?

Thanks for response

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearc...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/
msgid/elasticsearch/2e55eedd-c051-4aec-be05-1db57c7e5f5a%
40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/2e55eedd-c051-4aec-be05-1db57c7e5f5a%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com <javascript:>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/f4f9c602-9f01-4bc8-a491-40aa5e13914e%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/f4f9c602-9f01-4bc8-a491-40aa5e13914e%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/ecf72421-a2a7-45d7-89ba-8e5b796f242b%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


(Mark Walkom) #6

Did you change path.data as well in elasticsearch.yml?

If not, what are the two values you have on each node.

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: markw@campaignmonitor.com
web: www.campaignmonitor.com

On 3 September 2014 20:46, Andrew Lakes alakes501@gmail.com wrote:

Hi,

i copied from /data/es_index/elasticsearch/nodes/0/indices to
/data/es/t2//nodes/0/indices/

So indeed i change the clustername and have version 1.3.2 instead of 1.3.1
on the new server.

Beside that i havent changed anything.

Cheers

Am Mittwoch, 3. September 2014 09:46:37 UTC+2 schrieb Mark Walkom:

Can you elaborate which directory you copied from and to, ie the full
path?
Did you make any changes at all in the config on the new server?

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com

On 3 September 2014 17:17, Andrew Lakes alak...@gmail.com wrote:

Hi Vineeth,

i copied the the data folder to the new server.

Thanks

Am Dienstag, 2. September 2014 16:31:12 UTC+2 schrieb vineeth mohan:

Hello Andrew ,

Did you copy the data folder or do a snapshot/restore -
http://www.elasticsearch.org/guide/en/elasticsearch/refere
nce/current/modules-snapshots.html#_snapshot

Thanks
Vineeth

On Tue, Sep 2, 2014 at 7:05 PM, Andrew Lakes alak...@gmail.com wrote:

Hey guys,

we have set up a new physical ES-server in order to get more
ressources for our ELK-Stack.

On our old server we got about 1.8 TB/ 127 Indices which have to be
available on the new server.

So we copied the the indices to the new server, which have the same
configuration as the old server and set the permissions so that
elasticsearch can read/write on the indices.

We restarted elasticsearch so that ES can initialise the indices
properly, but unfortunate it didnt load them into the cluster.

Is there anything you have to configure that we dont have already
done, in order to copy the indices?

Thanks for response

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearc...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/
msgid/elasticsearch/2e55eedd-c051-4aec-be05-1db57c7e5f5a%40goo
glegroups.com
https://groups.google.com/d/msgid/elasticsearch/2e55eedd-c051-4aec-be05-1db57c7e5f5a%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearc...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/
msgid/elasticsearch/f4f9c602-9f01-4bc8-a491-40aa5e13914e%
40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/f4f9c602-9f01-4bc8-a491-40aa5e13914e%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/ecf72421-a2a7-45d7-89ba-8e5b796f242b%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/ecf72421-a2a7-45d7-89ba-8e5b796f242b%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAEM624ZsDfCrkepfMXys2eAYK0GB_bY%2B5zj0cHP0VgCryM-NDQ%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.


(Andrew Lakes) #7

Hi,

on the new server i´ve set up an internal elasticsearch cluster in order to
move the indices to a slower storage.

On the slower storage node the setting is:
path.data: /data/es/t2

On the fast one
path.data: /data/es/t1

On the old server the setting was:

path.data: /data/es_index

Could it be that there went sth. wrong on the copy-process? Like some
"metadata" weren´t copied right?

Am Mittwoch, 3. September 2014 12:49:30 UTC+2 schrieb Mark Walkom:

Did you change path.data as well in elasticsearch.yml?

If not, what are the two values you have on each node.

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com <javascript:>
web: www.campaignmonitor.com

On 3 September 2014 20:46, Andrew Lakes <alak...@gmail.com <javascript:>>
wrote:

Hi,

i copied from /data/es_index/elasticsearch/nodes/0/indices to
/data/es/t2//nodes/0/indices/

So indeed i change the clustername and have version 1.3.2 instead of
1.3.1 on the new server.

Beside that i havent changed anything.

Cheers

Am Mittwoch, 3. September 2014 09:46:37 UTC+2 schrieb Mark Walkom:

Can you elaborate which directory you copied from and to, ie the full
path?
Did you make any changes at all in the config on the new server?

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com

On 3 September 2014 17:17, Andrew Lakes alak...@gmail.com wrote:

Hi Vineeth,

i copied the the data folder to the new server.

Thanks

Am Dienstag, 2. September 2014 16:31:12 UTC+2 schrieb vineeth mohan:

Hello Andrew ,

Did you copy the data folder or do a snapshot/restore -
http://www.elasticsearch.org/guide/en/elasticsearch/refere
nce/current/modules-snapshots.html#_snapshot

Thanks
Vineeth

On Tue, Sep 2, 2014 at 7:05 PM, Andrew Lakes alak...@gmail.com
wrote:

Hey guys,

we have set up a new physical ES-server in order to get more
ressources for our ELK-Stack.

On our old server we got about 1.8 TB/ 127 Indices which have to be
available on the new server.

So we copied the the indices to the new server, which have the same
configuration as the old server and set the permissions so that
elasticsearch can read/write on the indices.

We restarted elasticsearch so that ES can initialise the indices
properly, but unfortunate it didnt load them into the cluster.

Is there anything you have to configure that we dont have already
done, in order to copy the indices?

Thanks for response

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it,
send an email to elasticsearc...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/
msgid/elasticsearch/2e55eedd-c051-4aec-be05-1db57c7e5f5a%40goo
glegroups.com
https://groups.google.com/d/msgid/elasticsearch/2e55eedd-c051-4aec-be05-1db57c7e5f5a%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearc...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/
msgid/elasticsearch/f4f9c602-9f01-4bc8-a491-40aa5e13914e%
40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/f4f9c602-9f01-4bc8-a491-40aa5e13914e%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com <javascript:>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/ecf72421-a2a7-45d7-89ba-8e5b796f242b%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/ecf72421-a2a7-45d7-89ba-8e5b796f242b%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/ef70addb-3fa8-4c2b-86b3-4b404ceec7b3%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


(system) #8