Elasticsearch cluster

Elastic Stack Elasticsearch
1

To create multiple nodes in elasticsearh cluster, do we need to start the
multiple elasticsearch instance?
I have a one elasticsearch storage on one server. How can I create cluster
with muliple nodes which reads the same storage?

-Jimi.

--

2

Each node uses its own storage.
But you can use SharedFS: http://www.elasticsearch.org/guide/reference/modules/gateway/fs.html

But, why do you want to do that?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 24 janv. 2013 à 21:14, Jimi Parekh jimiparekh@gmail.com a écrit :

To create multiple nodes in elasticsearh cluster, do we need to start the multiple elasticsearch instance?
I have a one elasticsearch storage on one server. How can I create cluster with muliple nodes which reads the same storage?

-Jimi.

--

3

Jimi Parekh wrote:

To create multiple nodes in elasticsearh cluster, do we need to
start the multiple elasticsearch instance? I have a one
elasticsearch storage on one server. How can I create cluster with
muliple nodes which reads the same storage?

Start each node with the path.data parameter. A simple example would
be:

bin/elasticsearch -Des.path.data=/data/es -f

You can also set it in elasticsearch.yml config file.

path.data: /data/es

-Drew

--

4

I have one elasticsearch index stored on server-1. Now I want to make sure
if server-1 is down, still users can query the index and get the result.
I am not sure whats the best possible way to accomplish it. I thought by
adding new nodes i can do it.

On Thursday, January 24, 2013 3:37:52 PM UTC-5, David Pilato wrote:

Each node uses its own storage.
But you can use SharedFS:
Elasticsearch Platform — Find real-time answers at scale | Elastic

But, why do you want to do that?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 24 janv. 2013 à 21:14, Jimi Parekh <jimip...@gmail.com <javascript:>>
a écrit :

To create multiple nodes in elasticsearh cluster, do we need to start the
multiple elasticsearch instance?
I have a one elasticsearch storage on one server. How can I create cluster
with muliple nodes which reads the same storage?

-Jimi.

--

--

5

So just launch a new node and let Elasticsearch manage that for you.

All data are replicated on nodes by Elasticsearch so you don't have to share anything here.

HTH

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 24 janv. 2013 à 21:56, Jimi Parekh jimiparekh@gmail.com a écrit :

I have one elasticsearch index stored on server-1. Now I want to make sure if server-1 is down, still users can query the index and get the result.
I am not sure whats the best possible way to accomplish it. I thought by adding new nodes i can do it.

On Thursday, January 24, 2013 3:37:52 PM UTC-5, David Pilato wrote:

Each node uses its own storage.
But you can use SharedFS: Elasticsearch Platform — Find real-time answers at scale | Elastic

But, why do you want to do that?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 24 janv. 2013 à 21:14, Jimi Parekh jimip...@gmail.com a écrit :

To create multiple nodes in elasticsearh cluster, do we need to start the multiple elasticsearch instance?
I have a one elasticsearch storage on one server. How can I create cluster with muliple nodes which reads the same storage?

-Jimi.

--

--

6

Thats what my confusion. Suppose I start new node on the same sever
(server-1) and server-1 is down than none of the node will be
availble,right?
So I want to add a new node which runs on another server say ,server-2 but
still access the same index as server-1. How to do that ?

On Thursday, January 24, 2013 4:02:36 PM UTC-5, David Pilato wrote:

So just launch a new node and let Elasticsearch manage that for you.

All data are replicated on nodes by Elasticsearch so you don't have to
share anything here.

HTH

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 24 janv. 2013 à 21:56, Jimi Parekh <jimip...@gmail.com <javascript:>>
a écrit :

I have one elasticsearch index stored on server-1. Now I want to make sure
if server-1 is down, still users can query the index and get the result.
I am not sure whats the best possible way to accomplish it. I thought by
adding new nodes i can do it.

On Thursday, January 24, 2013 3:37:52 PM UTC-5, David Pilato wrote:

Each node uses its own storage.
But you can use SharedFS:
Elasticsearch Platform — Find real-time answers at scale | Elastic

But, why do you want to do that?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 24 janv. 2013 à 21:14, Jimi Parekh jimip...@gmail.com a écrit :

To create multiple nodes in elasticsearh cluster, do we need to start the
multiple elasticsearch instance?
I have a one elasticsearch storage on one server. How can I create
cluster with muliple nodes which reads the same storage?

-Jimi.

--

--

--

7

If the nodes are configured to use the same cluster name, and you have
enough replicas provisioned (e.g. > 0) then Elasticsearch will
automatically migrate a replica to the new node and rebalance everything.

There isn't a good reason to start two nodes on the same server, other than
testing how ES works.

On Thursday, January 24, 2013 4:46:35 PM UTC-5, Jimi Parekh wrote:

Thats what my confusion. Suppose I start new node on the same sever
(server-1) and server-1 is down than none of the node will be
availble,right?
So I want to add a new node which runs on another server say ,server-2 but
still access the same index as server-1. How to do that ?

On Thursday, January 24, 2013 4:02:36 PM UTC-5, David Pilato wrote:

So just launch a new node and let Elasticsearch manage that for you.

All data are replicated on nodes by Elasticsearch so you don't have to
share anything here.

HTH

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 24 janv. 2013 à 21:56, Jimi Parekh jimip...@gmail.com a écrit :

I have one elasticsearch index stored on server-1. Now I want to make
sure if server-1 is down, still users can query the index and get the
result.
I am not sure whats the best possible way to accomplish it. I thought by
adding new nodes i can do it.

On Thursday, January 24, 2013 3:37:52 PM UTC-5, David Pilato wrote:

Each node uses its own storage.
But you can use SharedFS:
Elasticsearch Platform — Find real-time answers at scale | Elastic

But, why do you want to do that?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 24 janv. 2013 à 21:14, Jimi Parekh jimip...@gmail.com a écrit :

To create multiple nodes in elasticsearh cluster, do we need to start
the multiple elasticsearch instance?
I have a one elasticsearch storage on one server. How can I create
cluster with muliple nodes which reads the same storage?

-Jimi.

--

--

8

Hello Jimi,

As David says Elasticsearch starts allocating shards according our setup whenever a new node has been added to the same cluster (if your index is not corrupted).

I believe below link will give you more detailed:
http://www.elasticsearch.org/guide/reference/modules/cluster.html

If you start a new instance in different machine, copy the data directory from failed machine (if index is not crashed & the directory is not shard to new machine) with similar cluster settings. Elasticsearch makes the shards available for you.

If you start a new instance in same machine pointing to same data directory & clustername you are done (also depends on other cluster configurations).

Elasticsearch maintains its storage in below structure (by default) for any new instance started
clustername/nodes/0/indices/indexname/SHARDS

if you start one more instances
clustername/nodes/0/indices/indexname/SHARDS
clustername/nodes/1/indices/indexname/SHARDS (moves some from node0 .. if you dont have any copy setup)

Pounraj Manikandan