We currently have a single Elasticsearch box running 0.17.6 - it's using
the fs gateway type.
We're really liking the tool and it's working great for our uses - now I am
stepping in to deploy a cluster of boxes using 0.18.4. My goal is to:
- Have a cluster of nodes running for speed and availability.
- Use the S3/Cloudfiles gateway to keep gateway persistent and more
durable with VPS failures.
I have been reading the mailing list/guides/tutorials/etc and have come up
with this plan but have a couple questions.
First the proposed plan:
- Flush and shutdown the currently running 0.17.6.
- Update the binaries to 0.18.4.
- Start the new binaries and make sure they work.
- Add another node to the cluster.
Here are my questions:
Because it's currently using the fs gateway, unless they all have access
to that directory of files then the others will not be able to recover from
failure properly. We should have used local gateway for that single box
If I add the new nodes with the S3/Cloudfiles gateway, will they
replicate all of the indexes properly to S3/Cloudfiles? Or do they only add
the items when they're indexed? I have read a ton about people trying to do
that, looks like they need to re-index so that the offsite gateways get
populated - is that correct?
The clustering seems to be pretty magical as far as discovery goes - this
is the config that worked great with Rackspace Cloud
- Do the boxes have to be on the same subnet to find each other?
I couldn't find any details about that and it all worked flawlessly, but
wondering how I'll add boxes in the future when they run out of IP
addresses that are "nearby". Or if that even matters.
Sorry if I've missed something, I have read everything I can find and I'm
just trying to make sure on my last few questions. I found a lot of
information that appeared to apply to old releases and just wanted to
We're really loving the product and I spent much of this weekend adding and
removing nodes to my cluster, dropping and adding all sorts of indexes and
watching it rebalance - very nice work so far.