Help a newb understand node distribution

Elastic Stack Elasticsearch
1

Hi all,
I'm just getting started with ES, but I have been a lucene user for a few
years. One question that I can't find a straight answer to is how (or if) I
can take and existing ES index with 10 shards, and bring up one or more
additional physical nodes, and have the shards be distributed to the new
node. Does ES do that for you or do you have to manually copy the shards
and configure ES to know how to search them? Does ES support the sort of
dynamic addition of new nodes? Any help or pointers to documentation would
be great. My existing index stats are here:

"ok" : true,
"_shards" : {
"total" : 10,
"successful" : 10,
"failed" : 0
},
"indices" : {
"gdata" : {
"index" : {
"primary_size" : "772.4mb",
"primary_size_in_bytes" : 810012290,
"size" : "772.4mb",
"size_in_bytes" : 810012290
},
"docs" : {
"num_docs" : 138718,
"max_doc" : 138718,
"deleted_docs" : 0
},

I am just running with mostly the default ES config though I did create the index with my own analysis settings.

Thanks!

--

2

Yes ES will do it for you! Just bring up nodes.

You can look at some of my slides here: http://www.slideshare.net/dadoonet/elasticsearch-devoxx-france-2012-english-version

HTH

David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 6 janv. 2013 à 17:55, James Rhodes jrrhodes@gmail.com a écrit :

Hi all,
I'm just getting started with ES, but I have been a lucene user for a few years. One question that I can't find a straight answer to is how (or if) I can take and existing ES index with 10 shards, and bring up one or more additional physical nodes, and have the shards be distributed to the new node. Does ES do that for you or do you have to manually copy the shards and configure ES to know how to search them? Does ES support the sort of dynamic addition of new nodes? Any help or pointers to documentation would be great. My existing index stats are here:

"ok" : true,
"_shards" : {
"total" : 10,
"successful" : 10,
"failed" : 0
},
"indices" : {
"gdata" : {
"index" : {
"primary_size" : "772.4mb",
"primary_size_in_bytes" : 810012290,
"size" : "772.4mb",
"size_in_bytes" : 810012290
},
"docs" : {
"num_docs" : 138718,
"max_doc" : 138718,
"deleted_docs" : 0
},

I am just running with mostly the default ES config though I did create the index with my own analysis settings.

Thanks!

--

3

Thanks David I will check out your slides tonight. Cheers!

On Sunday, January 6, 2013 11:55:48 AM UTC-5, James Rhodes wrote:

Hi all,
I'm just getting started with ES, but I have been a lucene user for a few
years. One question that I can't find a straight answer to is how (or if) I
can take and existing ES index with 10 shards, and bring up one or more
additional physical nodes, and have the shards be distributed to the new
node. Does ES do that for you or do you have to manually copy the shards
and configure ES to know how to search them? Does ES support the sort of
dynamic addition of new nodes? Any help or pointers to documentation would
be great. My existing index stats are here:

"ok" : true,
"_shards" : {
"total" : 10,
"successful" : 10,
"failed" : 0
},
"indices" : {
"gdata" : {
"index" : {
"primary_size" : "772.4mb",
"primary_size_in_bytes" : 810012290,
"size" : "772.4mb",
"size_in_bytes" : 810012290
},
"docs" : {
"num_docs" : 138718,
"max_doc" : 138718,
"deleted_docs" : 0
},

I am just running with mostly the default ES config though I did create the index with my own analysis settings.

Thanks!

--