I am about to go for running multiple Elasticsearch clusters managed by an eck operator on k8 in production. eIasticsearch, kibana, curator and all other deployments are working as expected. I am wondering if there's any best practices/guide for managing eck operator. Sometimes I've noticed that eck operator does ack'ed for new configs changes deploy via k8-cli but eck doesn't do anything until that Elasticsearch cluster is in green state. for example: if k8 nodes goes down and there's no where the new pod can spin up, in this case I might want to reduce Elasticsearch pod count. but the new new es cluster config is deployed eck operator will do nothing until first that es cluster becomes green.
IMHO, the fundamental issue with operators is the fact that they are generally built with optimal faultless operation in mind and usually can't do anything if an unexpected event happens. Stateful applications, like the Elasticsearch, are especially hard to manage automatically. I suggest you to keep testing the setup with error and edge cases, like you describe. If you feel so you can still make the operator work, then go for it. If it feels awkward that now you have to fight with one more entity to actually do what you expect it to do, then I would urge you to reconsider the utlility of such a solution, or figure out ways how you can override it when necessary.
great points! I agree and I like eck operator compared to deploying es with just sts, and is working fine.its managing couple of Elasticsearch clusters actually. like you said I'll look for ways to override options to get it going. --Thanks for your comments.
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.