# ANN: new elasticsearch discovery plugin - eskka **URL:** \ **Category:** Elasticsearch\ **Created:** [May 5, 2014, 5:19am UTC](https://discuss.elastic.co/t/ann-new-elasticsearch-discovery-plugin-eskka/17342 "2014-05-05T05:19:36Z")\ **Posts on this page:** 8\ **Page:** 1
**Author:** ![shikhar](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/shikhar/32/1152_2.png) [@shikhar](https://discuss.elastic.co/u/shikhar)\ **Post date:** [May 5, 2014, 5:19am UTC](https://discuss.elastic.co/t/ann-new-elasticsearch-discovery-plugin-eskka/17342/1 "2014-05-05T05:19:36Z")
See README [https://github.com/shikhar/eskka/blob/release-0.1/README.md](https://github.com/shikhar/eskka/blob/release-0.1/README.md) I'd love to have feedback on this first release! -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAHWG4DMdPDCSpm0QJOznZuMDgi%2BTdFGx8dBTXvsACLuTvFmgxg%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAHWG4DMdPDCSpm0QJOznZuMDgi%2BTdFGx8dBTXvsACLuTvFmgxg%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![shikhar](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/shikhar/32/1152_2.png) [@shikhar](https://discuss.elastic.co/u/shikhar)\ **Post date:** [May 7, 2014, 3:42am UTC](https://discuss.elastic.co/t/ann-new-elasticsearch-discovery-plugin-eskka/17342/2 "2014-05-07T03:42:58Z")
Just released 0.1.1 [https://github.com/shikhar/eskka/releases/tag/v0.1.1](https://github.com/shikhar/eskka/releases/tag/v0.1.1) This version is working well in my manual testing. Automated testing is on the roadmap... On Mon, May 5, 2014 at 10:49 AM, shikhar [shikhar@schmizz.net](mailto:shikhar@schmizz.net) wrote: > See README [https://github.com/shikhar/eskka/blob/release-0.1/README.md](https://github.com/shikhar/eskka/blob/release-0.1/README.md) > > I'd love to have feedback on this first release! -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAHWG4DNiwCxbZakzogFfqFxYxabcQ\_ysG2\_OMd06%3D%2BfDqFEQdA%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAHWG4DNiwCxbZakzogFfqFxYxabcQ_ysG2_OMd06%3D%2BfDqFEQdA%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![Ivan](https://avatars.discourse-cdn.com/v4/letter/i/df788c/32.png) [@Ivan](https://discuss.elastic.co/u/Ivan)\ **Post date:** [May 7, 2014, 4:01pm UTC](https://discuss.elastic.co/t/ann-new-elasticsearch-discovery-plugin-eskka/17342/3 "2014-05-07T16:01:55Z")
Extremely interesting! What is the recommended size of the Akka cluster compared to the Elasticsearch cluster? -- Ivan On Tue, May 6, 2014 at 8:42 PM, shikhar [shikhar@schmizz.net](mailto:shikhar@schmizz.net) wrote: > Just released 0.1.1 [https://github.com/shikhar/eskka/releases/tag/v0.1.1](https://github.com/shikhar/eskka/releases/tag/v0.1.1) > > This version is working well in my manual testing. Automated testing is on > the roadmap... > > On Mon, May 5, 2014 at 10:49 AM, shikhar [shikhar@schmizz.net](mailto:shikhar@schmizz.net) wrote: > > > See README [https://github.com/shikhar/eskka/blob/release-0.1/README.md](https://github.com/shikhar/eskka/blob/release-0.1/README.md) > > > > I'd love to have feedback on this first release! > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/CAHWG4DNiwCxbZakzogFfqFxYxabcQ\_ysG2\_OMd06%3D%2BfDqFEQdA%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAHWG4DNiwCxbZakzogFfqFxYxabcQ_ysG2_OMd06%3D%2BfDqFEQdA%40mail.gmail.com)[https://groups.google.com/d/msgid/elasticsearch/CAHWG4DNiwCxbZakzogFfqFxYxabcQ\_ysG2\_OMd06%3D%2BfDqFEQdA%40mail.gmail.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/CAHWG4DNiwCxbZakzogFfqFxYxabcQ_ysG2_OMd06%3D%2BfDqFEQdA%40mail.gmail.com?utm_medium=email&utm_source=footer) > . > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CALY%3DcQDjg7Uaw4tTVr2-8cGM7w2sutH6F2XzCVj3JjKK-RCt5g%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CALY%3DcQDjg7Uaw4tTVr2-8cGM7w2sutH6F2XzCVj3JjKK-RCt5g%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![shikhar](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/shikhar/32/1152_2.png) [@shikhar](https://discuss.elastic.co/u/shikhar)\ **Post date:** [May 8, 2014, 7:32am UTC](https://discuss.elastic.co/t/ann-new-elasticsearch-discovery-plugin-eskka/17342/4 "2014-05-08T07:32:24Z")
All Elasticsearch nodes will end up being part of the Akka cluster ๐Ÿ™‚ I think you're really asking how many seed nodes you should specify. The seed node list is probably going to be similar to what you might use for zen.unicast.hosts. Worth noting that besides being initial contact points for when the cluster is starting up, with eskka they are also used for resolving partitions. Given this requirement, you would ideally have 3 or more specified. It is perfectly ok to have all of your nodes listed, if you know their addresses before startup. > **[GitHub - shikhar/eskka: elasticsearch discovery plugin using akka cluster...](https://github.com/shikhar/eskka#configuration)** > > elasticsearch discovery plugin using akka cluster (unmaintained) - GitHub - shikhar/eskka: elasticsearch discovery plugin using akka cluster (unmaintained) On Wed, May 7, 2014 at 9:31 PM, Ivan Brusic [ivan@brusic.com](mailto:ivan@brusic.com) wrote: > Extremely interesting! What is the recommended size of the Akka cluster > compared to the Elasticsearch cluster? > > -- > Ivan > > On Tue, May 6, 2014 at 8:42 PM, shikhar [shikhar@schmizz.net](mailto:shikhar@schmizz.net) wrote: > > > Just released 0.1.1[https://github.com/shikhar/eskka/releases/tag/v0.1.1](https://github.com/shikhar/eskka/releases/tag/v0.1.1) > > > > This version is working well in my manual testing. Automated testing is > > on the roadmap... > > > > On Mon, May 5, 2014 at 10:49 AM, shikhar [shikhar@schmizz.net](mailto:shikhar@schmizz.net) wrote: > > > > > See README [https://github.com/shikhar/eskka/blob/release-0.1/README.md](https://github.com/shikhar/eskka/blob/release-0.1/README.md) > > > > > > I'd love to have feedback on this first release! > > > > -- > > You received this message because you are subscribed to the Google Groups > > "elasticsearch" group. > > To unsubscribe from this group and stop receiving emails from it, send an > > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > > To view this discussion on the web visit > > [https://groups.google.com/d/msgid/elasticsearch/CAHWG4DNiwCxbZakzogFfqFxYxabcQ\_ysG2\_OMd06%3D%2BfDqFEQdA%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAHWG4DNiwCxbZakzogFfqFxYxabcQ_ysG2_OMd06%3D%2BfDqFEQdA%40mail.gmail.com)[https://groups.google.com/d/msgid/elasticsearch/CAHWG4DNiwCxbZakzogFfqFxYxabcQ\_ysG2\_OMd06%3D%2BfDqFEQdA%40mail.gmail.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/CAHWG4DNiwCxbZakzogFfqFxYxabcQ_ysG2_OMd06%3D%2BfDqFEQdA%40mail.gmail.com?utm_medium=email&utm_source=footer) > > . > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/CALY%3DcQDjg7Uaw4tTVr2-8cGM7w2sutH6F2XzCVj3JjKK-RCt5g%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CALY%3DcQDjg7Uaw4tTVr2-8cGM7w2sutH6F2XzCVj3JjKK-RCt5g%40mail.gmail.com)[https://groups.google.com/d/msgid/elasticsearch/CALY%3DcQDjg7Uaw4tTVr2-8cGM7w2sutH6F2XzCVj3JjKK-RCt5g%40mail.gmail.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/CALY%3DcQDjg7Uaw4tTVr2-8cGM7w2sutH6F2XzCVj3JjKK-RCt5g%40mail.gmail.com?utm_medium=email&utm_source=footer) > . > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAHWG4DO-nGqKuv9i\_wFpR0nomTY4mk%3DmkVxvgai3bjO8sSyRxw%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAHWG4DO-nGqKuv9i_wFpR0nomTY4mk%3DmkVxvgai3bjO8sSyRxw%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![shikhar](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/shikhar/32/1152_2.png) [@shikhar](https://discuss.elastic.co/u/shikhar)\ **Post date:** [May 8, 2014, 7:33am UTC](https://discuss.elastic.co/t/ann-new-elasticsearch-discovery-plugin-eskka/17342/5 "2014-05-08T07:33:41Z")
On Thu, May 8, 2014 at 1:02 PM, shikhar [shikhar@schmizz.net](mailto:shikhar@schmizz.net) wrote: > Worth noting that besides being initial contact points for when the > cluster is starting up, with eskka they are also used for resolving > partitions. Given this requirement, you would ideally have 3 or more > specified. It is perfectly ok to have all of your nodes listed, if you know > their addresses before startup. Another idea for what nodes to use as seed: if you are using master-only nodes, make them seed nodes. -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAHWG4DPFje-U8LriQgDMefhUzxOr8CuH1jqKghqMDO3bLYgpvg%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAHWG4DPFje-U8LriQgDMefhUzxOr8CuH1jqKghqMDO3bLYgpvg%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![otisg](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/otisg/32/492_2.png) [@otisg](https://discuss.elastic.co/u/otisg)\ **Post date:** [May 8, 2014, 7:03pm UTC](https://discuss.elastic.co/t/ann-new-elasticsearch-discovery-plugin-eskka/17342/6 "2014-05-08T19:03:24Z")
Cool, Shikhar, At Sematext we use both ES and Akka (in SPM [http://sematext.com/spm/](http://sematext.com/spm/)), so this is interesting for me to see... Would it make sense to add a bit more to the README..... things like: - why? is something wrong with Zen? - pros and cons of this vs. Zen vs. ZK ## Thanks, Otis Performance Monitoring \* Log Analytics \* Search Analytics Solr & Elasticsearch Support \* [http://sematext.com/](http://sematext.com/) On Thursday, May 8, 2014 3:32:24 AM UTC-4, Shikhar Bhushan wrote: > All Elasticsearch nodes will end up being part of the Akka cluster ๐Ÿ™‚ I > think you're really asking how many seed nodes you should specify. The seed > node list is probably going to be similar to what you might use for > zen.unicast.hosts. > > Worth noting that besides being initial contact points for when the > cluster is starting up, with eskka they are also used for resolving > partitions. Given this requirement, you would ideally have 3 or more > specified. It is perfectly ok to have all of your nodes listed, if you know > their addresses before startup. > > [GitHub - shikhar/eskka: elasticsearch discovery plugin using akka cluster](https://github.com/shikhar/eskka#configuration) > > On Wed, May 7, 2014 at 9:31 PM, Ivan Brusic \<[iv...@brusic.com](mailto:iv...@brusic.com)\ > > > wrote: > > > Extremely interesting! What is the recommended size of the Akka cluster > > compared to the Elasticsearch cluster? > > > > -- > > Ivan > > > > On Tue, May 6, 2014 at 8:42 PM, shikhar \<[shi...@schmizz.net](mailto:shi...@schmizz.net) \ > > > > > wrote: > > > > > Just released 0.1.1[https://github.com/shikhar/eskka/releases/tag/v0.1.1](https://github.com/shikhar/eskka/releases/tag/v0.1.1) > > > > > > This version is working well in my manual testing. Automated testing is > > > on the roadmap... > > > > > > On Mon, May 5, 2014 at 10:49 AM, shikhar \<[shi...@schmizz.net](mailto:shi...@schmizz.net)\ > > > > > > > wrote: > > > > > > > See README[https://github.com/shikhar/eskka/blob/release-0.1/README.md](https://github.com/shikhar/eskka/blob/release-0.1/README.md) > > > > > > > > I'd love to have feedback on this first release! > > > > > > -- > > > You received this message because you are subscribed to the Google > > > Groups "elasticsearch" group. > > > To unsubscribe from this group and stop receiving emails from it, send > > > an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com) \. > > > To view this discussion on the web visit > > > [https://groups.google.com/d/msgid/elasticsearch/CAHWG4DNiwCxbZakzogFfqFxYxabcQ\_ysG2\_OMd06%3D%2BfDqFEQdA%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAHWG4DNiwCxbZakzogFfqFxYxabcQ_ysG2_OMd06%3D%2BfDqFEQdA%40mail.gmail.com)[https://groups.google.com/d/msgid/elasticsearch/CAHWG4DNiwCxbZakzogFfqFxYxabcQ\_ysG2\_OMd06%3D%2BfDqFEQdA%40mail.gmail.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/CAHWG4DNiwCxbZakzogFfqFxYxabcQ_ysG2_OMd06%3D%2BfDqFEQdA%40mail.gmail.com?utm_medium=email&utm_source=footer) > > > . > > > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > > > -- > > You received this message because you are subscribed to the Google Groups > > "elasticsearch" group. > > To unsubscribe from this group and stop receiving emails from it, send an > > email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com) \. > > To view this discussion on the web visit > > [https://groups.google.com/d/msgid/elasticsearch/CALY%3DcQDjg7Uaw4tTVr2-8cGM7w2sutH6F2XzCVj3JjKK-RCt5g%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CALY%3DcQDjg7Uaw4tTVr2-8cGM7w2sutH6F2XzCVj3JjKK-RCt5g%40mail.gmail.com)[https://groups.google.com/d/msgid/elasticsearch/CALY%3DcQDjg7Uaw4tTVr2-8cGM7w2sutH6F2XzCVj3JjKK-RCt5g%40mail.gmail.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/CALY%3DcQDjg7Uaw4tTVr2-8cGM7w2sutH6F2XzCVj3JjKK-RCt5g%40mail.gmail.com?utm_medium=email&utm_source=footer) > > . > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/9b73c46d-66dd-4c29-9e76-feba3f033133%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/9b73c46d-66dd-4c29-9e76-feba3f033133%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![shikhar](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/shikhar/32/1152_2.png) [@shikhar](https://discuss.elastic.co/u/shikhar)\ **Post date:** [May 9, 2014, 10:23am UTC](https://discuss.elastic.co/t/ann-new-elasticsearch-discovery-plugin-eskka/17342/7 "2014-05-09T10:23:41Z")
Thanks for the feedback Otis! On Fri, May 9, 2014 at 12:33 AM, Otis Gospodnetic \< [otis.gospodnetic@gmail.com](mailto:otis.gospodnetic@gmail.com)\> wrote: > At Sematext we use both ES and Akka (in SPM [http://sematext.com/spm/](http://sematext.com/spm/)), > so this is interesting for me to see... Would it make sense to add a bit > more to the README..... things like: > > - why? is something wrong with Zen? > - pros and cons of this vs. Zen vs. ZK Makes sense to add this context, I'll add to the docs soon. The major con for eskka is of course that it is new and unproven. _vs zookeeper_ You don't need to setup or admin ZooKeeper. In Shay's resiliency blog post \<[http://resiliency](http://resiliency) and elasticsearch\> he writes "By having the discovery module in Elasticsearch using its own infrastructure, specifically the communication layer, it means that we can use the โ€œlivenessโ€ of the cluster to assess its health." This is an interesting point which partly holds for eskka as well, since it also lives in the same JVM. However it doesn't use the same communication layer (the ES internal transport), the akka cluster runs on a different port. _vs zen_ Essentially: eskka is built to be split-brain resistant. But then so is Zen in theory ๐Ÿ˜‰ So I'd like to maybe do some testing with Jepsen before making that tall claim. Both Zen and Akka Cluster are implementing a gossip protocol for discovery & fault-detection, however to me the latter feels better specified and tested. eskka itself does not have any tests at the application-level which I intend to fix. ## I'd like to think the use of actors -- the main ones being Master[https://github.com/shikhar/eskka/blob/master/src/main/scala/eskka/Master.scala](https://github.com/shikhar/eskka/blob/master/src/main/scala/eskka/Master.scala) , Follower[https://github.com/shikhar/eskka/blob/master/src/main/scala/eskka/Follower.scala](https://github.com/shikhar/eskka/blob/master/src/main/scala/eskka/Follower.scala) and QuorumBasedPartitionMonitor[https://github.com/shikhar/eskka/blob/master/src/main/scala/eskka/QuorumBasedPartitionMonitor.scala](https://github.com/shikhar/eskka/blob/master/src/main/scala/eskka/QuorumBasedPartitionMonitor.scala) makes it easier to reason about state in a distributed system and maintain invariants. -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAHWG4DMMPZMhmi7w74vsUqJJria%2BtVj5p7sn-v%3DVeXNUqaXziw%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAHWG4DMMPZMhmi7w74vsUqJJria%2BtVj5p7sn-v%3DVeXNUqaXziw%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 1:30am UTC](https://discuss.elastic.co/t/ann-new-elasticsearch-discovery-plugin-eskka/17342/8 "2017-07-06T01:30:34Z")