I'm trying to setup my own ES service in AWS because the native AWS service isn't any where near enough suitable for what we need. It was nice and simple for us to get up and running, but we've now outgrown it..
At the moment, I have (for our devel/test/pre-release cluster):
2x Coordinating nodes (with a AWS ALB in front of them for user/client access)
3x Master eligible nodes
1x Ingest node (don't need it, but ES complained when I didn't have one)
3x Data nodes (only needed/wanted two, but because of the "note.attr" and "awareness.force" etc, I needed at least one in each AZ).
I've installed X-Pack (the free one at the moment) on all of them and managed to get it setup (roughly) the way I want it. I'm assuming that was right?
My ES cluster is ONLY accessible via the ALB (everything else is blocked via the security groups, and only the ALB allow HTTP access, with HTTPS offloading to the coordinating nodes) and only the Coordinating nodes have HTTP enabled (and allows access only from the ALB)...
So the question is, where do I install Kibana? On all of them (sounds like overkill) or only on the Coordinating nodes? Or do/should I have a separate Kibana host(s)?
I've planned a two-instance monitoring cluster next to this one, but I haven't started that up yet.. Maybe I should have Kibana on that one (with an(other) ALB infront of those instances)?