Scale Out Best Practices / How to

Is there a How to guide along with best practices for Scale Out?

I have a single instance server of Elastic Search and I would like to scale
out.

From other posts in this group I have tried with no success to add an
additional server into the group.

This additional server is not on the same domain
it's hostname.DIT.mydomain.com vs. hostname2.SIT.mydomain.com

Other than it just not working for me at this point, I'm concerned because
if I have to edit the elasticsearch.yml file that means I must bring down
that instance.

If I end up with 1,2,3,4,10,20,30,40 nodes. How do I not bring them all
down for any changes. I'm sure there are different practices like a Master
that in the 40 case you would keep up all the time and only upgrade each
one individually.

How do you handle this with upgrades etc.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/7617be7a-1590-4651-9c46-83470ee448be%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

(I couldn't find your other posts on scaling?)

As long as your nodes can talk to each other then you should be ok. However
if you are thinking about running cross DC clusters (reading between the
lines based on your hostname convention), then that is not recommended.

The rest of your question is based on how you expect to grow, but until you
get to more than 1 node you are probably going to have to restart your
current one.

On 14 February 2015 at 09:44, GWired garrettcjohnson@gmail.com wrote:

Is there a How to guide along with best practices for Scale Out?

I have a single instance server of Elastic Search and I would like to
scale out.

From other posts in this group I have tried with no success to add an
additional server into the group.

This additional server is not on the same domain it's
hostname.DIT.mydomain.com vs. hostname2.SIT.mydomain.com

Other than it just not working for me at this point, I'm concerned because
if I have to edit the elasticsearch.yml file that means I must bring down
that instance.

If I end up with 1,2,3,4,10,20,30,40 nodes. How do I not bring them all
down for any changes. I'm sure there are different practices like a Master
that in the 40 case you would keep up all the time and only upgrade each
one individually.

How do you handle this with upgrades etc.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/7617be7a-1590-4651-9c46-83470ee448be%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/7617be7a-1590-4651-9c46-83470ee448be%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAEYi1X_jgGLBehF5znKfe3PfqqcuTpZbMzNLEFZ-tT_rudQr%2Bw%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

Are you saying it is not recommended to host across Data Centers?

How do you provide High Availability if one Data Center goes down?

And reading between the lines on more than 1 node issue. I'm guessing you
are saying that once I have multiple nodes I can bring them up and down as
needed. Really having a hard time understanding plugins in this scenario.
I don't want every server in the cluster to be executing say the jdbc river
do I? I only want one to be running it and then in the event that one
goes down another would pick it up. As far as I know there isn't any
altering system.

On Monday, February 16, 2015 at 4:03:11 AM UTC-5, Mark Walkom wrote:

(I couldn't find your other posts on scaling?)

As long as your nodes can talk to each other then you should be ok.
However if you are thinking about running cross DC clusters (reading
between the lines based on your hostname convention), then that is not
recommended.

The rest of your question is based on how you expect to grow, but until
you get to more than 1 node you are probably going to have to restart your
current one.

On 14 February 2015 at 09:44, GWired <garrett...@gmail.com <javascript:>>
wrote:

Is there a How to guide along with best practices for Scale Out?

I have a single instance server of Elastic Search and I would like to
scale out.

From other posts in this group I have tried with no success to add an
additional server into the group.

This additional server is not on the same domain it's
hostname.DIT.mydomain.com vs. hostname2.SIT.mydomain.com

Other than it just not working for me at this point, I'm concerned
because if I have to edit the elasticsearch.yml file that means I must
bring down that instance.

If I end up with 1,2,3,4,10,20,30,40 nodes. How do I not bring them all
down for any changes. I'm sure there are different practices like a Master
that in the 40 case you would keep up all the time and only upgrade each
one individually.

How do you handle this with upgrades etc.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com <javascript:>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/7617be7a-1590-4651-9c46-83470ee448be%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/7617be7a-1590-4651-9c46-83470ee448be%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/1bcb86b3-7833-4afa-a5b5-66408b325b9a%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Yes, that is what I am saying. ES is latency sensitive and betting against
that can potentially cause problem.
You are better off using snapshot+restore or using your indexing method to
send to both clusters.

As for plugins, some require all nodes to run them, some don't. Ultimately
this comes down to what the plugin does and you have to work around/with it.

On 17 February 2015 at 01:02, GWired garrettcjohnson@gmail.com wrote:

Are you saying it is not recommended to host across Data Centers?

How do you provide High Availability if one Data Center goes down?

And reading between the lines on more than 1 node issue. I'm guessing you
are saying that once I have multiple nodes I can bring them up and down as
needed. Really having a hard time understanding plugins in this scenario.
I don't want every server in the cluster to be executing say the jdbc river
do I? I only want one to be running it and then in the event that one
goes down another would pick it up. As far as I know there isn't any
altering system.

On Monday, February 16, 2015 at 4:03:11 AM UTC-5, Mark Walkom wrote:

(I couldn't find your other posts on scaling?)

As long as your nodes can talk to each other then you should be ok.
However if you are thinking about running cross DC clusters (reading
between the lines based on your hostname convention), then that is not
recommended.

The rest of your question is based on how you expect to grow, but until
you get to more than 1 node you are probably going to have to restart your
current one.

On 14 February 2015 at 09:44, GWired garrett...@gmail.com wrote:

Is there a How to guide along with best practices for Scale Out?

I have a single instance server of Elastic Search and I would like to
scale out.

From other posts in this group I have tried with no success to add an
additional server into the group.

This additional server is not on the same domain it's
hostname.DIT.mydomain.com vs. hostname2.SIT.mydomain.com

Other than it just not working for me at this point, I'm concerned
because if I have to edit the elasticsearch.yml file that means I must
bring down that instance.

If I end up with 1,2,3,4,10,20,30,40 nodes. How do I not bring them all
down for any changes. I'm sure there are different practices like a Master
that in the 40 case you would keep up all the time and only upgrade each
one individually.

How do you handle this with upgrades etc.

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearc...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/
msgid/elasticsearch/7617be7a-1590-4651-9c46-83470ee448be%
40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/7617be7a-1590-4651-9c46-83470ee448be%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/1bcb86b3-7833-4afa-a5b5-66408b325b9a%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/1bcb86b3-7833-4afa-a5b5-66408b325b9a%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAEYi1X_D5qn3bRjHp74Ms9zrNa2JOn19pOaT5OJfjaRZgu-%3D1A%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.