Copy Indices to new Server

Andrew_Lakes · September 2, 2014, 1:35pm

Hey guys,

we have set up a new physical ES-server in order to get more ressources for
our ELK-Stack.

On our old server we got about 1.8 TB/ 127 Indices which have to be
available on the new server.

So we copied the the indices to the new server, which have the same
configuration as the old server and set the permissions so that
elasticsearch can read/write on the indices.

We restarted elasticsearch so that ES can initialise the indices properly,
but unfortunate it didnt load them into the cluster.

Is there anything you have to configure that we dont have already done, in
order to copy the indices?

Thanks for response

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/2e55eedd-c051-4aec-be05-1db57c7e5f5a%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

vineeth_mohan_2 · September 2, 2014, 2:31pm

Hello Andrew ,

Did you copy the data folder or do a snapshot/restore -

Thanks
Vineeth

On Tue, Sep 2, 2014 at 7:05 PM, Andrew Lakes alakes501@gmail.com wrote:

Hey guys,

we have set up a new physical ES-server in order to get more ressources
for our ELK-Stack.

On our old server we got about 1.8 TB/ 127 Indices which have to be
available on the new server.

So we copied the the indices to the new server, which have the same
configuration as the old server and set the permissions so that
elasticsearch can read/write on the indices.

We restarted elasticsearch so that ES can initialise the indices properly,
but unfortunate it didnt load them into the cluster.

Is there anything you have to configure that we dont have already done, in
order to copy the indices?

Thanks for response

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/2e55eedd-c051-4aec-be05-1db57c7e5f5a%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/2e55eedd-c051-4aec-be05-1db57c7e5f5a%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAGdPd5%3DShDPBz0fzjG0L_foVU2Sg4Bf%3DvoL4bRLt%3D3UB3x6ejg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

Andrew_Lakes · September 3, 2014, 7:17am

Hi Vineeth,

i copied the the data folder to the new server.

Thanks

Am Dienstag, 2. September 2014 16:31:12 UTC+2 schrieb vineeth mohan:

Hello Andrew ,

Did you copy the data folder or do a snapshot/restore -
Elasticsearch Platform — Find real-time answers at scale | Elastic

Thanks
Vineeth

On Tue, Sep 2, 2014 at 7:05 PM, Andrew Lakes <alak...@gmail.com
<javascript:>> wrote:

Hey guys,

we have set up a new physical ES-server in order to get more ressources
for our ELK-Stack.

On our old server we got about 1.8 TB/ 127 Indices which have to be
available on the new server.

So we copied the the indices to the new server, which have the same
configuration as the old server and set the permissions so that
elasticsearch can read/write on the indices.

We restarted elasticsearch so that ES can initialise the indices
properly, but unfortunate it didnt load them into the cluster.

Is there anything you have to configure that we dont have already done,
in order to copy the indices?

Thanks for response

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com <javascript:>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/2e55eedd-c051-4aec-be05-1db57c7e5f5a%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/2e55eedd-c051-4aec-be05-1db57c7e5f5a%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/f4f9c602-9f01-4bc8-a491-40aa5e13914e%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

warkolm · September 3, 2014, 7:45am

Can you elaborate which directory you copied from and to, ie the full path?
Did you make any changes at all in the config on the new server?

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: markw@campaignmonitor.com
web: www.campaignmonitor.com

On 3 September 2014 17:17, Andrew Lakes alakes501@gmail.com wrote:

Hi Vineeth,

i copied the the data folder to the new server.

Thanks

Am Dienstag, 2. September 2014 16:31:12 UTC+2 schrieb vineeth mohan:

Hello Andrew ,

Did you copy the data folder or do a snapshot/restore -
Elasticsearch Platform — Find real-time answers at scale | Elastic
reference/current/modules-snapshots.html#_snapshot

Thanks
Vineeth

On Tue, Sep 2, 2014 at 7:05 PM, Andrew Lakes alak...@gmail.com wrote:

Hey guys,

we have set up a new physical ES-server in order to get more ressources
for our ELK-Stack.

On our old server we got about 1.8 TB/ 127 Indices which have to be
available on the new server.

So we copied the the indices to the new server, which have the same
configuration as the old server and set the permissions so that
elasticsearch can read/write on the indices.

We restarted elasticsearch so that ES can initialise the indices
properly, but unfortunate it didnt load them into the cluster.

Is there anything you have to configure that we dont have already done,
in order to copy the indices?

Thanks for response

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearc...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/
msgid/elasticsearch/2e55eedd-c051-4aec-be05-1db57c7e5f5a%
40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/2e55eedd-c051-4aec-be05-1db57c7e5f5a%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/f4f9c602-9f01-4bc8-a491-40aa5e13914e%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/f4f9c602-9f01-4bc8-a491-40aa5e13914e%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAEM624YcW6QkqK36bDr-9MokF6Ap53pyqrQiiddM1R3di88m5Q%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

Andrew_Lakes · September 3, 2014, 10:46am

Hi,

i copied from /data/es_index/elasticsearch/nodes/0/indices to
/data/es/t2//nodes/0/indices/

So indeed i change the clustername and have version 1.3.2 instead of 1.3.1
on the new server.

Beside that i havent changed anything.

Cheers

Am Mittwoch, 3. September 2014 09:46:37 UTC+2 schrieb Mark Walkom:

Can you elaborate which directory you copied from and to, ie the full path?
Did you make any changes at all in the config on the new server?

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com <javascript:>
web: www.campaignmonitor.com

On 3 September 2014 17:17, Andrew Lakes <alak...@gmail.com <javascript:>>
wrote:

Hi Vineeth,

i copied the the data folder to the new server.

Thanks

Am Dienstag, 2. September 2014 16:31:12 UTC+2 schrieb vineeth mohan:

Hello Andrew ,

Did you copy the data folder or do a snapshot/restore -
Elasticsearch Platform — Find real-time answers at scale | Elastic
reference/current/modules-snapshots.html#_snapshot

Thanks
Vineeth

On Tue, Sep 2, 2014 at 7:05 PM, Andrew Lakes alak...@gmail.com wrote:

Hey guys,

we have set up a new physical ES-server in order to get more ressources
for our ELK-Stack.

On our old server we got about 1.8 TB/ 127 Indices which have to be
available on the new server.

So we copied the the indices to the new server, which have the same
configuration as the old server and set the permissions so that
elasticsearch can read/write on the indices.

We restarted elasticsearch so that ES can initialise the indices
properly, but unfortunate it didnt load them into the cluster.

Is there anything you have to configure that we dont have already done,
in order to copy the indices?

Thanks for response

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearc...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/
msgid/elasticsearch/2e55eedd-c051-4aec-be05-1db57c7e5f5a%
40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/2e55eedd-c051-4aec-be05-1db57c7e5f5a%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com <javascript:>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/f4f9c602-9f01-4bc8-a491-40aa5e13914e%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/f4f9c602-9f01-4bc8-a491-40aa5e13914e%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/ecf72421-a2a7-45d7-89ba-8e5b796f242b%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

warkolm · September 3, 2014, 10:48am

Did you change path.data as well in elasticsearch.yml?

If not, what are the two values you have on each node.

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: markw@campaignmonitor.com
web: www.campaignmonitor.com

On 3 September 2014 20:46, Andrew Lakes alakes501@gmail.com wrote:

Hi,

i copied from /data/es_index/elasticsearch/nodes/0/indices to
/data/es/t2//nodes/0/indices/

So indeed i change the clustername and have version 1.3.2 instead of 1.3.1
on the new server.

Beside that i havent changed anything.

Cheers

Am Mittwoch, 3. September 2014 09:46:37 UTC+2 schrieb Mark Walkom:

Can you elaborate which directory you copied from and to, ie the full
path?
Did you make any changes at all in the config on the new server?

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com

On 3 September 2014 17:17, Andrew Lakes alak...@gmail.com wrote:

Hi Vineeth,

i copied the the data folder to the new server.

Thanks

Am Dienstag, 2. September 2014 16:31:12 UTC+2 schrieb vineeth mohan:

Hello Andrew ,

Did you copy the data folder or do a snapshot/restore -
Elasticsearch Platform — Find real-time answers at scale | Elastic
nce/current/modules-snapshots.html#_snapshot

Thanks
Vineeth

On Tue, Sep 2, 2014 at 7:05 PM, Andrew Lakes alak...@gmail.com wrote:

Hey guys,

we have set up a new physical ES-server in order to get more
ressources for our ELK-Stack.

On our old server we got about 1.8 TB/ 127 Indices which have to be
available on the new server.

So we copied the the indices to the new server, which have the same
configuration as the old server and set the permissions so that
elasticsearch can read/write on the indices.

We restarted elasticsearch so that ES can initialise the indices
properly, but unfortunate it didnt load them into the cluster.

Is there anything you have to configure that we dont have already
done, in order to copy the indices?

Thanks for response

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearc...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/
msgid/elasticsearch/2e55eedd-c051-4aec-be05-1db57c7e5f5a%40goo
glegroups.com
https://groups.google.com/d/msgid/elasticsearch/2e55eedd-c051-4aec-be05-1db57c7e5f5a%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearc...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/
msgid/elasticsearch/f4f9c602-9f01-4bc8-a491-40aa5e13914e%
40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/f4f9c602-9f01-4bc8-a491-40aa5e13914e%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/ecf72421-a2a7-45d7-89ba-8e5b796f242b%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/ecf72421-a2a7-45d7-89ba-8e5b796f242b%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAEM624ZsDfCrkepfMXys2eAYK0GB_bY%2B5zj0cHP0VgCryM-NDQ%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

Andrew_Lakes · September 3, 2014, 11:06am

Hi,

on the new server i´ve set up an internal elasticsearch cluster in order to
move the indices to a slower storage.

On the slower storage node the setting is:
path.data: /data/es/t2

On the fast one
path.data: /data/es/t1

On the old server the setting was:

path.data: /data/es_index

Could it be that there went sth. wrong on the copy-process? Like some
"metadata" weren´t copied right?

Am Mittwoch, 3. September 2014 12:49:30 UTC+2 schrieb Mark Walkom:

Did you change path.data as well in elasticsearch.yml?

If not, what are the two values you have on each node.

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com <javascript:>
web: www.campaignmonitor.com

On 3 September 2014 20:46, Andrew Lakes <alak...@gmail.com <javascript:>>
wrote:

Hi,

i copied from /data/es_index/elasticsearch/nodes/0/indices to
/data/es/t2//nodes/0/indices/

So indeed i change the clustername and have version 1.3.2 instead of
1.3.1 on the new server.

Beside that i havent changed anything.

Cheers

Am Mittwoch, 3. September 2014 09:46:37 UTC+2 schrieb Mark Walkom:

Can you elaborate which directory you copied from and to, ie the full
path?
Did you make any changes at all in the config on the new server?

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com
web: www.campaignmonitor.com

On 3 September 2014 17:17, Andrew Lakes alak...@gmail.com wrote:

Hi Vineeth,

i copied the the data folder to the new server.

Thanks

Am Dienstag, 2. September 2014 16:31:12 UTC+2 schrieb vineeth mohan:

Hello Andrew ,

Did you copy the data folder or do a snapshot/restore -
Elasticsearch Platform — Find real-time answers at scale | Elastic
nce/current/modules-snapshots.html#_snapshot

Thanks
Vineeth

On Tue, Sep 2, 2014 at 7:05 PM, Andrew Lakes alak...@gmail.com
wrote:

Hey guys,

we have set up a new physical ES-server in order to get more
ressources for our ELK-Stack.

On our old server we got about 1.8 TB/ 127 Indices which have to be
available on the new server.

So we copied the the indices to the new server, which have the same
configuration as the old server and set the permissions so that
elasticsearch can read/write on the indices.

We restarted elasticsearch so that ES can initialise the indices
properly, but unfortunate it didnt load them into the cluster.

Is there anything you have to configure that we dont have already
done, in order to copy the indices?

Thanks for response

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it,
send an email to elasticsearc...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/
msgid/elasticsearch/2e55eedd-c051-4aec-be05-1db57c7e5f5a%40goo
glegroups.com
https://groups.google.com/d/msgid/elasticsearch/2e55eedd-c051-4aec-be05-1db57c7e5f5a%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearc...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/
msgid/elasticsearch/f4f9c602-9f01-4bc8-a491-40aa5e13914e%
40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/f4f9c602-9f01-4bc8-a491-40aa5e13914e%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com <javascript:>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/ecf72421-a2a7-45d7-89ba-8e5b796f242b%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/ecf72421-a2a7-45d7-89ba-8e5b796f242b%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/ef70addb-3fa8-4c2b-86b3-4b404ceec7b3%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.