I have a cluster in ECE with two nodes/two zones setup. The ECE has several spare runners are available. It works normally as expected. But I noticed that two nodes were assigned to one runner in a given zone.
Is it right that ECE may deploy multiple nodes of one cluster to one single runner? This is a concern that the cluster may loose more than one node due to runner issue which seems to be risky.
Hi Jin,
you're right that in this particular topology you will lose two instances if allocator (runner) goes down. However, ECE sets up the cluster the way that shard replicas cannot be allocated to an instance that is running on the same allocator (runner). This topology is primarily used if you need more than 64Gb (32Gb heap + 32Gb kernel) of memory per availability zone. 64Gb is the maximum memory that makes sense to use per instance (see why). Therefore, if you need, for example, 256Gb per AZ and 3 AZ, you should provision 4 64Gb nodes in every AZ.
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.