AutoScale elasticsearch


(John S) #1

Hi,

Currently am having a cluster with 4 nodes provisioned in Aws
Ec2. Occasionally there were some issue happened like disk
space utilization and cpu utilization, which impacted the cluster, then
manually add new disk or create additional nodes for handling load.

I was investigating if there is an automated option, something like
elasticsearch cluster if there is an high disk utilization, or other
option like horizontal scaling for high cpu issue(like changing the
instance type to a higher instance capacity with cpu/memory).

There is an Autoscale option from Aws services for high cpu utilization,
but just thinking if there is any other options available from cluster
level.

Am trying to build a solution to avoid any downtime. Let me know if anyone
have any approach to handle these and possible impacts doing so.
Note: understand adding one more data nodes will re-balance the shards in
the cluster.

Regards
John

--
Please update your bookmarks! We have moved to https://discuss.elastic.co/

You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/9b8708d0-e1f0-4c7b-bba1-b663c68a4741%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


(Mark Walkom) #2

You can certainly use AWS autoscaling groups to accomplish things, but
there is nothing native in ES to do it.

On 11 May 2015 at 12:07, John S bunix1@gmail.com wrote:

Hi,

Currently am having a cluster with 4 nodes provisioned in Aws
Ec2. Occasionally there were some issue happened like disk
space utilization and cpu utilization, which impacted the cluster, then
manually add new disk or create additional nodes for handling load.

I was investigating if there is an automated option, something like
elasticsearch cluster if there is an high disk utilization, or other
option like horizontal scaling for high cpu issue(like changing the
instance type to a higher instance capacity with cpu/memory).

There is an Autoscale option from Aws services for high cpu utilization,
but just thinking if there is any other options available from cluster
level.

Am trying to build a solution to avoid any downtime. Let me know if
anyone have any approach to handle these and possible impacts doing so.
Note: understand adding one more data nodes will re-balance the shards in
the cluster.

Regards
John

--
Please update your bookmarks! We have moved to https://discuss.elastic.co/

You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/9b8708d0-e1f0-4c7b-bba1-b663c68a4741%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/9b8708d0-e1f0-4c7b-bba1-b663c68a4741%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
Please update your bookmarks! We have moved to https://discuss.elastic.co/

You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAEYi1X88CH0KUCs81qn2boR9conPZa61F5Pv50EhVOFaLAdcMQ%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.


(system) #3