Data is not saved equally in each datanode

Hi,I got 4 data nodes,1 master node and 1 search node

For example,At first,the data was equally saved in 4 data nodes
node1 1.6TB
node2 1.6TB
node3 1.6TB
node4 1.6TB

Since My disk is 2TB and it is almost full,I delete some index to get more
storage

after deleting the data nodes are like below

node1 1TB
node2 1TB
node3 1TB
node4 1TB

after a few days, I found the data is not equally saved in each node anymore

node1 1.1TB
node2 1.1TB
node3 1.1TB
node4 1.6TB

node 4 is almost full
I don't know why,and is there anyway to rebalance data in each data node

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/d1405623-9bde-4a51-8818-3f077535aef5%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

I also start a new data node(node 5),and there is new data come into
cluster continuously,but There is no any data in data node 5.I don't know
why,plz help

在 2014年12月25日星期四UTC+8上午10时33分29秒,xiaoliang tian写道:

Hi,I got 4 data nodes,1 master node and 1 search node

For example,At first,the data was equally saved in 4 data nodes
node1 1.6TB
node2 1.6TB
node3 1.6TB
node4 1.6TB

Since My disk is 2TB and it is almost full,I delete some index to get
more storage

after deleting the data nodes are like below

node1 1TB
node2 1TB
node3 1TB
node4 1TB

after a few days, I found the data is not equally saved in each node
anymore

node1 1.1TB
node2 1.1TB
node3 1.1TB
node4 1.6TB

node 4 is almost full
I don't know why,and is there anyway to rebalance data in each data node

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/9766ba6d-f7b1-4071-8f4b-b2b5c6a14085%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

How many index/shards/replicas do you have?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 25 déc. 2014 à 08:28, xiaoliang tian xiaoliang.tian@gmail.com a écrit :

I also start a new data node(node 5),and there is new data come into cluster continuously,but There is no any data in data node 5.I don't know why,plz help

在 2014年12月25日星期四UTC+8上午10时33分29秒,xiaoliang tian写道:

Hi,I got 4 data nodes,1 master node and 1 search node

For example,At first,the data was equally saved in 4 data nodes
node1 1.6TB
node2 1.6TB
node3 1.6TB
node4 1.6TB

Since My disk is 2TB and it is almost full,I delete some index to get more storage

after deleting the data nodes are like below

node1 1TB
node2 1TB
node3 1TB
node4 1TB

after a few days, I found the data is not equally saved in each node anymore

node1 1.1TB
node2 1.1TB
node3 1.1TB
node4 1.6TB

node 4 is almost full
I don't know why,and is there anyway to rebalance data in each data node

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/9766ba6d-f7b1-4071-8f4b-b2b5c6a14085%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/129A7708-03D8-4F29-87BC-E6AC72369602%40pilato.fr.
For more options, visit https://groups.google.com/d/optout.

index number depend on how many days past,the index name is the day epoch.
because we use elasticseach for log storage
shard number is 8
replica is 1

2014-12-25 15:49 GMT+08:00 David Pilato david@pilato.fr:

How many index/shards/replicas do you have?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 25 déc. 2014 à 08:28, xiaoliang tian xiaoliang.tian@gmail.com a
écrit :

I also start a new data node(node 5),and there is new data come into
cluster continuously,but There is no any data in data node 5.I don't know
why,plz help

在 2014年12月25日星期四UTC+8上午10时33分29秒,xiaoliang tian写道:

Hi,I got 4 data nodes,1 master node and 1 search node

For example,At first,the data was equally saved in 4 data nodes
node1 1.6TB
node2 1.6TB
node3 1.6TB
node4 1.6TB

Since My disk is 2TB and it is almost full,I delete some index to get
more storage

after deleting the data nodes are like below

node1 1TB
node2 1TB
node3 1TB
node4 1TB

after a few days, I found the data is not equally saved in each node
anymore

node1 1.1TB
node2 1.1TB
node3 1.1TB
node4 1.6TB

node 4 is almost full
I don't know why,and is there anyway to rebalance data in each data node

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/9766ba6d-f7b1-4071-8f4b-b2b5c6a14085%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/9766ba6d-f7b1-4071-8f4b-b2b5c6a14085%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/ILjo-_VRQxA/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/129A7708-03D8-4F29-87BC-E6AC72369602%40pilato.fr
https://groups.google.com/d/msgid/elasticsearch/129A7708-03D8-4F29-87BC-E6AC72369602%40pilato.fr?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAJ%3DxLsWgSxiVHmFCGw_jKWAKEpfiGs2ROxYVVhBjSFsqSSKukg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

Try increasing the number of shards - maybe to 20 or 40.

On Dec 25, 2014, at 8:10 PM, Xiaoliang Tian xiaoliang.tian@gmail.com wrote:

index number depend on how many days past,the index name is the day epoch. because we use elasticseach for log storage
shard number is 8
replica is 1

2014-12-25 15:49 GMT+08:00 David Pilato <david@pilato.fr mailto:david@pilato.fr>:
How many index/shards/replicas do you have?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 25 déc. 2014 à 08:28, xiaoliang tian <xiaoliang.tian@gmail.com mailto:xiaoliang.tian@gmail.com> a écrit :

I also start a new data node(node 5),and there is new data come into cluster continuously,but There is no any data in data node 5.I don't know why,plz help

在 2014年12月25日星期四UTC+8上午10时33分29秒,xiaoliang tian写道:
Hi,I got 4 data nodes,1 master node and 1 search node

For example,At first,the data was equally saved in 4 data nodes
node1 1.6TB
node2 1.6TB
node3 1.6TB
node4 1.6TB

Since My disk is 2TB and it is almost full,I delete some index to get more storage

after deleting the data nodes are like below

node1 1TB
node2 1TB
node3 1TB
node4 1TB

after a few days, I found the data is not equally saved in each node anymore

node1 1.1TB
node2 1.1TB
node3 1.1TB
node4 1.6TB

node 4 is almost full
I don't know why,and is there anyway to rebalance data in each data node

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com mailto:elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/9766ba6d-f7b1-4071-8f4b-b2b5c6a14085%40googlegroups.com https://groups.google.com/d/msgid/elasticsearch/9766ba6d-f7b1-4071-8f4b-b2b5c6a14085%40googlegroups.com?utm_medium=email&utm_source=footer.
For more options, visit https://groups.google.com/d/optout https://groups.google.com/d/optout.

--
You received this message because you are subscribed to a topic in the Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/elasticsearch/ILjo-_VRQxA/unsubscribe https://groups.google.com/d/topic/elasticsearch/ILjo-_VRQxA/unsubscribe.
To unsubscribe from this group and all its topics, send an email to elasticsearch+unsubscribe@googlegroups.com mailto:elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/129A7708-03D8-4F29-87BC-E6AC72369602%40pilato.fr https://groups.google.com/d/msgid/elasticsearch/129A7708-03D8-4F29-87BC-E6AC72369602%40pilato.fr?utm_medium=email&utm_source=footer.

For more options, visit https://groups.google.com/d/optout https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com mailto:elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAJ%3DxLsWgSxiVHmFCGw_jKWAKEpfiGs2ROxYVVhBjSFsqSSKukg%40mail.gmail.com https://groups.google.com/d/msgid/elasticsearch/CAJ%3DxLsWgSxiVHmFCGw_jKWAKEpfiGs2ROxYVVhBjSFsqSSKukg%40mail.gmail.com?utm_medium=email&utm_source=footer.
For more options, visit https://groups.google.com/d/optout https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/D207CFFB-2B24-4FBA-89A4-CCCF2A100BEB%40deman.com.
For more options, visit https://groups.google.com/d/optout.

Also, higher shards will help with the new indexes but not the existing ones.
You can use the API to force ES to move shards off your ‘full’ disk over to the new one.
Auto-balancing for data size should be on by default if you are running a newer version of ES.

On Dec 25, 2014, at 8:13 PM, Michael deMan (ES) elasticsearch@deman.com wrote:

Try increasing the number of shards - maybe to 20 or 40.

On Dec 25, 2014, at 8:10 PM, Xiaoliang Tian <xiaoliang.tian@gmail.com mailto:xiaoliang.tian@gmail.com> wrote:

index number depend on how many days past,the index name is the day epoch. because we use elasticseach for log storage
shard number is 8
replica is 1

2014-12-25 15:49 GMT+08:00 David Pilato <david@pilato.fr mailto:david@pilato.fr>:
How many index/shards/replicas do you have?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 25 déc. 2014 à 08:28, xiaoliang tian <xiaoliang.tian@gmail.com mailto:xiaoliang.tian@gmail.com> a écrit :

I also start a new data node(node 5),and there is new data come into cluster continuously,but There is no any data in data node 5.I don't know why,plz help

在 2014年12月25日星期四UTC+8上午10时33分29秒,xiaoliang tian写道:
Hi,I got 4 data nodes,1 master node and 1 search node

For example,At first,the data was equally saved in 4 data nodes
node1 1.6TB
node2 1.6TB
node3 1.6TB
node4 1.6TB

Since My disk is 2TB and it is almost full,I delete some index to get more storage

after deleting the data nodes are like below

node1 1TB
node2 1TB
node3 1TB
node4 1TB

after a few days, I found the data is not equally saved in each node anymore

node1 1.1TB
node2 1.1TB
node3 1.1TB
node4 1.6TB

node 4 is almost full
I don't know why,and is there anyway to rebalance data in each data node

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com mailto:elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/9766ba6d-f7b1-4071-8f4b-b2b5c6a14085%40googlegroups.com https://groups.google.com/d/msgid/elasticsearch/9766ba6d-f7b1-4071-8f4b-b2b5c6a14085%40googlegroups.com?utm_medium=email&utm_source=footer.
For more options, visit https://groups.google.com/d/optout https://groups.google.com/d/optout.

--
You received this message because you are subscribed to a topic in the Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/elasticsearch/ILjo-_VRQxA/unsubscribe https://groups.google.com/d/topic/elasticsearch/ILjo-_VRQxA/unsubscribe.
To unsubscribe from this group and all its topics, send an email to elasticsearch+unsubscribe@googlegroups.com mailto:elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/129A7708-03D8-4F29-87BC-E6AC72369602%40pilato.fr https://groups.google.com/d/msgid/elasticsearch/129A7708-03D8-4F29-87BC-E6AC72369602%40pilato.fr?utm_medium=email&utm_source=footer.

For more options, visit https://groups.google.com/d/optout https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com mailto:elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAJ%3DxLsWgSxiVHmFCGw_jKWAKEpfiGs2ROxYVVhBjSFsqSSKukg%40mail.gmail.com https://groups.google.com/d/msgid/elasticsearch/CAJ%3DxLsWgSxiVHmFCGw_jKWAKEpfiGs2ROxYVVhBjSFsqSSKukg%40mail.gmail.com?utm_medium=email&utm_source=footer.
For more options, visit https://groups.google.com/d/optout https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com mailto:elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/D207CFFB-2B24-4FBA-89A4-CCCF2A100BEB%40deman.com https://groups.google.com/d/msgid/elasticsearch/D207CFFB-2B24-4FBA-89A4-CCCF2A100BEB%40deman.com?utm_medium=email&utm_source=footer.
For more options, visit https://groups.google.com/d/optout https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/86BBFA51-19CA-4E0B-9BB7-6445E3DDEA43%40deman.com.
For more options, visit https://groups.google.com/d/optout.

which version? and what is the API url exactly

2014-12-26 12:44 GMT+08:00 Michael deMan (ES) elasticsearch@deman.com:

Also, higher shards will help with the new indexes but not the existing
ones.
You can use the API to force ES to move shards off your ‘full’ disk over
to the new one.
Auto-balancing for data size should be on by default if you are running a
newer version of ES.

On Dec 25, 2014, at 8:13 PM, Michael deMan (ES) elasticsearch@deman.com
wrote:

Try increasing the number of shards - maybe to 20 or 40.

On Dec 25, 2014, at 8:10 PM, Xiaoliang Tian xiaoliang.tian@gmail.com
wrote:

index number depend on how many days past,the index name is the day
epoch. because we use elasticseach for log storage
shard number is 8
replica is 1

2014-12-25 15:49 GMT+08:00 David Pilato david@pilato.fr:

How many index/shards/replicas do you have?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 25 déc. 2014 à 08:28, xiaoliang tian xiaoliang.tian@gmail.com a
écrit :

I also start a new data node(node 5),and there is new data come into
cluster continuously,but There is no any data in data node 5.I don't know
why,plz help

在 2014年12月25日星期四UTC+8上午10时33分29秒,xiaoliang tian写道:

Hi,I got 4 data nodes,1 master node and 1 search node

For example,At first,the data was equally saved in 4 data nodes
node1 1.6TB
node2 1.6TB
node3 1.6TB
node4 1.6TB

Since My disk is 2TB and it is almost full,I delete some index to get
more storage

after deleting the data nodes are like below

node1 1TB
node2 1TB
node3 1TB
node4 1TB

after a few days, I found the data is not equally saved in each node
anymore

node1 1.1TB
node2 1.1TB
node3 1.1TB
node4 1.6TB

node 4 is almost full
I don't know why,and is there anyway to rebalance data in each data node

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/9766ba6d-f7b1-4071-8f4b-b2b5c6a14085%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/9766ba6d-f7b1-4071-8f4b-b2b5c6a14085%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/ILjo-_VRQxA/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/129A7708-03D8-4F29-87BC-E6AC72369602%40pilato.fr
https://groups.google.com/d/msgid/elasticsearch/129A7708-03D8-4F29-87BC-E6AC72369602%40pilato.fr?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAJ%3DxLsWgSxiVHmFCGw_jKWAKEpfiGs2ROxYVVhBjSFsqSSKukg%40mail.gmail.com
https://groups.google.com/d/msgid/elasticsearch/CAJ%3DxLsWgSxiVHmFCGw_jKWAKEpfiGs2ROxYVVhBjSFsqSSKukg%40mail.gmail.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/D207CFFB-2B24-4FBA-89A4-CCCF2A100BEB%40deman.com
https://groups.google.com/d/msgid/elasticsearch/D207CFFB-2B24-4FBA-89A4-CCCF2A100BEB%40deman.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/ILjo-_VRQxA/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/86BBFA51-19CA-4E0B-9BB7-6445E3DDEA43%40deman.com
https://groups.google.com/d/msgid/elasticsearch/86BBFA51-19CA-4E0B-9BB7-6445E3DDEA43%40deman.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAJ%3DxLsWu0cvKbNx1iMC%2B9yZqCWdYK6WfTyn7B4EsR1Gu3F77dg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/cluster-reroute.html http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/cluster-reroute.html

I can’t remember when auto-balancing got enabled by default, I think maybe 1.3.4.

you can find out via api.
http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/modules-cluster.html http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/modules-cluster.html

On Dec 25, 2014, at 10:15 PM, Xiaoliang Tian xiaoliang.tian@gmail.com wrote:

which version? and what is the API url exactly

2014-12-26 12:44 GMT+08:00 Michael deMan (ES) <elasticsearch@deman.com mailto:elasticsearch@deman.com>:
Also, higher shards will help with the new indexes but not the existing ones.
You can use the API to force ES to move shards off your ‘full’ disk over to the new one.
Auto-balancing for data size should be on by default if you are running a newer version of ES.

On Dec 25, 2014, at 8:13 PM, Michael deMan (ES) <elasticsearch@deman.com mailto:elasticsearch@deman.com> wrote:

Try increasing the number of shards - maybe to 20 or 40.

On Dec 25, 2014, at 8:10 PM, Xiaoliang Tian <xiaoliang.tian@gmail.com mailto:xiaoliang.tian@gmail.com> wrote:

index number depend on how many days past,the index name is the day epoch. because we use elasticseach for log storage
shard number is 8
replica is 1

2014-12-25 15:49 GMT+08:00 David Pilato <david@pilato.fr mailto:david@pilato.fr>:
How many index/shards/replicas do you have?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 25 déc. 2014 à 08:28, xiaoliang tian <xiaoliang.tian@gmail.com mailto:xiaoliang.tian@gmail.com> a écrit :

I also start a new data node(node 5),and there is new data come into cluster continuously,but There is no any data in data node 5.I don't know why,plz help

在 2014年12月25日星期四UTC+8上午10时33分29秒,xiaoliang tian写道:
Hi,I got 4 data nodes,1 master node and 1 search node

For example,At first,the data was equally saved in 4 data nodes
node1 1.6TB
node2 1.6TB
node3 1.6TB
node4 1.6TB

Since My disk is 2TB and it is almost full,I delete some index to get more storage

after deleting the data nodes are like below

node1 1TB
node2 1TB
node3 1TB
node4 1TB

after a few days, I found the data is not equally saved in each node anymore

node1 1.1TB
node2 1.1TB
node3 1.1TB
node4 1.6TB

node 4 is almost full
I don't know why,and is there anyway to rebalance data in each data node

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com mailto:elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/9766ba6d-f7b1-4071-8f4b-b2b5c6a14085%40googlegroups.com https://groups.google.com/d/msgid/elasticsearch/9766ba6d-f7b1-4071-8f4b-b2b5c6a14085%40googlegroups.com?utm_medium=email&utm_source=footer.
For more options, visit https://groups.google.com/d/optout https://groups.google.com/d/optout.

--
You received this message because you are subscribed to a topic in the Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/elasticsearch/ILjo-_VRQxA/unsubscribe https://groups.google.com/d/topic/elasticsearch/ILjo-_VRQxA/unsubscribe.
To unsubscribe from this group and all its topics, send an email to elasticsearch+unsubscribe@googlegroups.com mailto:elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/129A7708-03D8-4F29-87BC-E6AC72369602%40pilato.fr https://groups.google.com/d/msgid/elasticsearch/129A7708-03D8-4F29-87BC-E6AC72369602%40pilato.fr?utm_medium=email&utm_source=footer.

For more options, visit https://groups.google.com/d/optout https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com mailto:elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAJ%3DxLsWgSxiVHmFCGw_jKWAKEpfiGs2ROxYVVhBjSFsqSSKukg%40mail.gmail.com https://groups.google.com/d/msgid/elasticsearch/CAJ%3DxLsWgSxiVHmFCGw_jKWAKEpfiGs2ROxYVVhBjSFsqSSKukg%40mail.gmail.com?utm_medium=email&utm_source=footer.
For more options, visit https://groups.google.com/d/optout https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com mailto:elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/D207CFFB-2B24-4FBA-89A4-CCCF2A100BEB%40deman.com https://groups.google.com/d/msgid/elasticsearch/D207CFFB-2B24-4FBA-89A4-CCCF2A100BEB%40deman.com?utm_medium=email&utm_source=footer.
For more options, visit https://groups.google.com/d/optout https://groups.google.com/d/optout.

--
You received this message because you are subscribed to a topic in the Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/elasticsearch/ILjo-_VRQxA/unsubscribe https://groups.google.com/d/topic/elasticsearch/ILjo-_VRQxA/unsubscribe.
To unsubscribe from this group and all its topics, send an email to elasticsearch+unsubscribe@googlegroups.com mailto:elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/86BBFA51-19CA-4E0B-9BB7-6445E3DDEA43%40deman.com https://groups.google.com/d/msgid/elasticsearch/86BBFA51-19CA-4E0B-9BB7-6445E3DDEA43%40deman.com?utm_medium=email&utm_source=footer.

For more options, visit https://groups.google.com/d/optout https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com mailto:elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAJ%3DxLsWu0cvKbNx1iMC%2B9yZqCWdYK6WfTyn7B4EsR1Gu3F77dg%40mail.gmail.com https://groups.google.com/d/msgid/elasticsearch/CAJ%3DxLsWu0cvKbNx1iMC%2B9yZqCWdYK6WfTyn7B4EsR1Gu3F77dg%40mail.gmail.com?utm_medium=email&utm_source=footer.
For more options, visit https://groups.google.com/d/optout https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/B6BB7CF5-90FB-4D04-B680-EF5A6934EB2F%40deman.com.
For more options, visit https://groups.google.com/d/optout.

Thanks,And M using 0.9.13.can it enable auto-balancing manually?

2014-12-26 14:17 GMT+08:00 Michael deMan (ES) elasticsearch@deman.com:

http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/cluster-reroute.html

I can’t remember when auto-balancing got enabled by default, I think maybe
1.3.4.

you can find out via api.

http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/modules-cluster.html

On Dec 25, 2014, at 10:15 PM, Xiaoliang Tian xiaoliang.tian@gmail.com
wrote:

which version? and what is the API url exactly

2014-12-26 12:44 GMT+08:00 Michael deMan (ES) elasticsearch@deman.com:

Also, higher shards will help with the new indexes but not the existing
ones.
You can use the API to force ES to move shards off your ‘full’ disk over
to the new one.
Auto-balancing for data size should be on by default if you are running a
newer version of ES.

On Dec 25, 2014, at 8:13 PM, Michael deMan (ES) elasticsearch@deman.com
wrote:

Try increasing the number of shards - maybe to 20 or 40.

On Dec 25, 2014, at 8:10 PM, Xiaoliang Tian xiaoliang.tian@gmail.com
wrote:

index number depend on how many days past,the index name is the day
epoch. because we use elasticseach for log storage
shard number is 8
replica is 1

2014-12-25 15:49 GMT+08:00 David Pilato david@pilato.fr:

How many index/shards/replicas do you have?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 25 déc. 2014 à 08:28, xiaoliang tian xiaoliang.tian@gmail.com a
écrit :

I also start a new data node(node 5),and there is new data come into
cluster continuously,but There is no any data in data node 5.I don't know
why,plz help

在 2014年12月25日星期四UTC+8上午10时33分29秒,xiaoliang tian写道:

Hi,I got 4 data nodes,1 master node and 1 search node

For example,At first,the data was equally saved in 4 data nodes
node1 1.6TB
node2 1.6TB
node3 1.6TB
node4 1.6TB

Since My disk is 2TB and it is almost full,I delete some index to get
more storage

after deleting the data nodes are like below

node1 1TB
node2 1TB
node3 1TB
node4 1TB

after a few days, I found the data is not equally saved in each node
anymore

node1 1.1TB
node2 1.1TB
node3 1.1TB
node4 1.6TB

node 4 is almost full
I don't know why,and is there anyway to rebalance data in each data
node

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/9766ba6d-f7b1-4071-8f4b-b2b5c6a14085%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/9766ba6d-f7b1-4071-8f4b-b2b5c6a14085%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/ILjo-_VRQxA/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/129A7708-03D8-4F29-87BC-E6AC72369602%40pilato.fr
https://groups.google.com/d/msgid/elasticsearch/129A7708-03D8-4F29-87BC-E6AC72369602%40pilato.fr?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAJ%3DxLsWgSxiVHmFCGw_jKWAKEpfiGs2ROxYVVhBjSFsqSSKukg%40mail.gmail.com
https://groups.google.com/d/msgid/elasticsearch/CAJ%3DxLsWgSxiVHmFCGw_jKWAKEpfiGs2ROxYVVhBjSFsqSSKukg%40mail.gmail.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/D207CFFB-2B24-4FBA-89A4-CCCF2A100BEB%40deman.com
https://groups.google.com/d/msgid/elasticsearch/D207CFFB-2B24-4FBA-89A4-CCCF2A100BEB%40deman.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/ILjo-_VRQxA/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/86BBFA51-19CA-4E0B-9BB7-6445E3DDEA43%40deman.com
https://groups.google.com/d/msgid/elasticsearch/86BBFA51-19CA-4E0B-9BB7-6445E3DDEA43%40deman.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAJ%3DxLsWu0cvKbNx1iMC%2B9yZqCWdYK6WfTyn7B4EsR1Gu3F77dg%40mail.gmail.com
https://groups.google.com/d/msgid/elasticsearch/CAJ%3DxLsWu0cvKbNx1iMC%2B9yZqCWdYK6WfTyn7B4EsR1Gu3F77dg%40mail.gmail.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/ILjo-_VRQxA/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/B6BB7CF5-90FB-4D04-B680-EF5A6934EB2F%40deman.com
https://groups.google.com/d/msgid/elasticsearch/B6BB7CF5-90FB-4D04-B680-EF5A6934EB2F%40deman.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAJ%3DxLsVFJttk142BDG0sHJsxavYhtO_5br88SqpNi4b1YkUuDQ%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

I don’t know.

On Dec 25, 2014, at 10:19 PM, Xiaoliang Tian xiaoliang.tian@gmail.com wrote:

Thanks,And M using 0.9.13.can it enable auto-balancing manually?

2014-12-26 14:17 GMT+08:00 Michael deMan (ES) <elasticsearch@deman.com mailto:elasticsearch@deman.com>:
http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/cluster-reroute.html http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/cluster-reroute.html

I can’t remember when auto-balancing got enabled by default, I think maybe 1.3.4.

you can find out via api.
http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/modules-cluster.html http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/modules-cluster.html

On Dec 25, 2014, at 10:15 PM, Xiaoliang Tian <xiaoliang.tian@gmail.com mailto:xiaoliang.tian@gmail.com> wrote:

which version? and what is the API url exactly

2014-12-26 12:44 GMT+08:00 Michael deMan (ES) <elasticsearch@deman.com mailto:elasticsearch@deman.com>:
Also, higher shards will help with the new indexes but not the existing ones.
You can use the API to force ES to move shards off your ‘full’ disk over to the new one.
Auto-balancing for data size should be on by default if you are running a newer version of ES.

On Dec 25, 2014, at 8:13 PM, Michael deMan (ES) <elasticsearch@deman.com mailto:elasticsearch@deman.com> wrote:

Try increasing the number of shards - maybe to 20 or 40.

On Dec 25, 2014, at 8:10 PM, Xiaoliang Tian <xiaoliang.tian@gmail.com mailto:xiaoliang.tian@gmail.com> wrote:

index number depend on how many days past,the index name is the day epoch. because we use elasticseach for log storage
shard number is 8
replica is 1

2014-12-25 15:49 GMT+08:00 David Pilato <david@pilato.fr mailto:david@pilato.fr>:
How many index/shards/replicas do you have?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 25 déc. 2014 à 08:28, xiaoliang tian <xiaoliang.tian@gmail.com mailto:xiaoliang.tian@gmail.com> a écrit :

I also start a new data node(node 5),and there is new data come into cluster continuously,but There is no any data in data node 5.I don't know why,plz help

在 2014年12月25日星期四UTC+8上午10时33分29秒,xiaoliang tian写道:
Hi,I got 4 data nodes,1 master node and 1 search node

For example,At first,the data was equally saved in 4 data nodes
node1 1.6TB
node2 1.6TB
node3 1.6TB
node4 1.6TB

Since My disk is 2TB and it is almost full,I delete some index to get more storage

after deleting the data nodes are like below

node1 1TB
node2 1TB
node3 1TB
node4 1TB

after a few days, I found the data is not equally saved in each node anymore

node1 1.1TB
node2 1.1TB
node3 1.1TB
node4 1.6TB

node 4 is almost full
I don't know why,and is there anyway to rebalance data in each data node

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com mailto:elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/9766ba6d-f7b1-4071-8f4b-b2b5c6a14085%40googlegroups.com https://groups.google.com/d/msgid/elasticsearch/9766ba6d-f7b1-4071-8f4b-b2b5c6a14085%40googlegroups.com?utm_medium=email&utm_source=footer.
For more options, visit https://groups.google.com/d/optout https://groups.google.com/d/optout.

--
You received this message because you are subscribed to a topic in the Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/elasticsearch/ILjo-_VRQxA/unsubscribe https://groups.google.com/d/topic/elasticsearch/ILjo-_VRQxA/unsubscribe.
To unsubscribe from this group and all its topics, send an email to elasticsearch+unsubscribe@googlegroups.com mailto:elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/129A7708-03D8-4F29-87BC-E6AC72369602%40pilato.fr https://groups.google.com/d/msgid/elasticsearch/129A7708-03D8-4F29-87BC-E6AC72369602%40pilato.fr?utm_medium=email&utm_source=footer.

For more options, visit https://groups.google.com/d/optout https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com mailto:elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAJ%3DxLsWgSxiVHmFCGw_jKWAKEpfiGs2ROxYVVhBjSFsqSSKukg%40mail.gmail.com https://groups.google.com/d/msgid/elasticsearch/CAJ%3DxLsWgSxiVHmFCGw_jKWAKEpfiGs2ROxYVVhBjSFsqSSKukg%40mail.gmail.com?utm_medium=email&utm_source=footer.
For more options, visit https://groups.google.com/d/optout https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com mailto:elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/D207CFFB-2B24-4FBA-89A4-CCCF2A100BEB%40deman.com https://groups.google.com/d/msgid/elasticsearch/D207CFFB-2B24-4FBA-89A4-CCCF2A100BEB%40deman.com?utm_medium=email&utm_source=footer.
For more options, visit https://groups.google.com/d/optout https://groups.google.com/d/optout.

--
You received this message because you are subscribed to a topic in the Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/elasticsearch/ILjo-_VRQxA/unsubscribe https://groups.google.com/d/topic/elasticsearch/ILjo-_VRQxA/unsubscribe.
To unsubscribe from this group and all its topics, send an email to elasticsearch+unsubscribe@googlegroups.com mailto:elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/86BBFA51-19CA-4E0B-9BB7-6445E3DDEA43%40deman.com https://groups.google.com/d/msgid/elasticsearch/86BBFA51-19CA-4E0B-9BB7-6445E3DDEA43%40deman.com?utm_medium=email&utm_source=footer.

For more options, visit https://groups.google.com/d/optout https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com mailto:elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAJ%3DxLsWu0cvKbNx1iMC%2B9yZqCWdYK6WfTyn7B4EsR1Gu3F77dg%40mail.gmail.com https://groups.google.com/d/msgid/elasticsearch/CAJ%3DxLsWu0cvKbNx1iMC%2B9yZqCWdYK6WfTyn7B4EsR1Gu3F77dg%40mail.gmail.com?utm_medium=email&utm_source=footer.
For more options, visit https://groups.google.com/d/optout https://groups.google.com/d/optout.

--
You received this message because you are subscribed to a topic in the Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/elasticsearch/ILjo-_VRQxA/unsubscribe https://groups.google.com/d/topic/elasticsearch/ILjo-_VRQxA/unsubscribe.
To unsubscribe from this group and all its topics, send an email to elasticsearch+unsubscribe@googlegroups.com mailto:elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/B6BB7CF5-90FB-4D04-B680-EF5A6934EB2F%40deman.com https://groups.google.com/d/msgid/elasticsearch/B6BB7CF5-90FB-4D04-B680-EF5A6934EB2F%40deman.com?utm_medium=email&utm_source=footer.

For more options, visit https://groups.google.com/d/optout https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com mailto:elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAJ%3DxLsVFJttk142BDG0sHJsxavYhtO_5br88SqpNi4b1YkUuDQ%40mail.gmail.com https://groups.google.com/d/msgid/elasticsearch/CAJ%3DxLsVFJttk142BDG0sHJsxavYhtO_5br88SqpNi4b1YkUuDQ%40mail.gmail.com?utm_medium=email&utm_source=footer.
For more options, visit https://groups.google.com/d/optout https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/8C3AC853-FEDC-4131-A940-75CB253C5B16%40deman.com.
For more options, visit https://groups.google.com/d/optout.

So you have 16 shards (8 primary and 8 replicas). On a 5 nodes cluster, this should rebalance automatically.

Are you sure your 5th node actually joined the cluster ?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 26 déc. 2014 à 07:21, Michael deMan (ES) elasticsearch@deman.com a écrit :

I don’t know.

On Dec 25, 2014, at 10:19 PM, Xiaoliang Tian xiaoliang.tian@gmail.com wrote:

Thanks,And M using 0.9.13.can it enable auto-balancing manually?

2014-12-26 14:17 GMT+08:00 Michael deMan (ES) elasticsearch@deman.com:

http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/cluster-reroute.html

I can’t remember when auto-balancing got enabled by default, I think maybe 1.3.4.

you can find out via api.
http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/modules-cluster.html

On Dec 25, 2014, at 10:15 PM, Xiaoliang Tian xiaoliang.tian@gmail.com wrote:

which version? and what is the API url exactly

2014-12-26 12:44 GMT+08:00 Michael deMan (ES) elasticsearch@deman.com:

Also, higher shards will help with the new indexes but not the existing ones.
You can use the API to force ES to move shards off your ‘full’ disk over to the new one.
Auto-balancing for data size should be on by default if you are running a newer version of ES.

On Dec 25, 2014, at 8:13 PM, Michael deMan (ES) elasticsearch@deman.com wrote:

Try increasing the number of shards - maybe to 20 or 40.

On Dec 25, 2014, at 8:10 PM, Xiaoliang Tian xiaoliang.tian@gmail.com wrote:

index number depend on how many days past,the index name is the day epoch. because we use elasticseach for log storage
shard number is 8
replica is 1

2014-12-25 15:49 GMT+08:00 David Pilato david@pilato.fr:

How many index/shards/replicas do you have?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 25 déc. 2014 à 08:28, xiaoliang tian xiaoliang.tian@gmail.com a écrit :

I also start a new data node(node 5),and there is new data come into cluster continuously,but There is no any data in data node 5.I don't know why,plz help

在 2014年12月25日星期四UTC+8上午10时33分29秒,xiaoliang tian写道:

Hi,I got 4 data nodes,1 master node and 1 search node

For example,At first,the data was equally saved in 4 data nodes
node1 1.6TB
node2 1.6TB
node3 1.6TB
node4 1.6TB

Since My disk is 2TB and it is almost full,I delete some index to get more storage

after deleting the data nodes are like below

node1 1TB
node2 1TB
node3 1TB
node4 1TB

after a few days, I found the data is not equally saved in each node anymore

node1 1.1TB
node2 1.1TB
node3 1.1TB
node4 1.6TB

node 4 is almost full
I don't know why,and is there anyway to rebalance data in each data node

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/9766ba6d-f7b1-4071-8f4b-b2b5c6a14085%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to a topic in the Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/elasticsearch/ILjo-_VRQxA/unsubscribe.
To unsubscribe from this group and all its topics, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/129A7708-03D8-4F29-87BC-E6AC72369602%40pilato.fr.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAJ%3DxLsWgSxiVHmFCGw_jKWAKEpfiGs2ROxYVVhBjSFsqSSKukg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/D207CFFB-2B24-4FBA-89A4-CCCF2A100BEB%40deman.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to a topic in the Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/elasticsearch/ILjo-_VRQxA/unsubscribe.
To unsubscribe from this group and all its topics, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/86BBFA51-19CA-4E0B-9BB7-6445E3DDEA43%40deman.com.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAJ%3DxLsWu0cvKbNx1iMC%2B9yZqCWdYK6WfTyn7B4EsR1Gu3F77dg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to a topic in the Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/elasticsearch/ILjo-_VRQxA/unsubscribe.
To unsubscribe from this group and all its topics, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/B6BB7CF5-90FB-4D04-B680-EF5A6934EB2F%40deman.com.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAJ%3DxLsVFJttk142BDG0sHJsxavYhtO_5br88SqpNi4b1YkUuDQ%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/8C3AC853-FEDC-4131-A940-75CB253C5B16%40deman.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/7F07FEF3-3F2C-4E45-9E0A-60BAA1ED8873%40pilato.fr.
For more options, visit https://groups.google.com/d/optout.

M so sure.I have to call reroute API to balance,The 5 the node just index
new log data

2014-12-26 14:39 GMT+08:00 David Pilato david@pilato.fr:

So you have 16 shards (8 primary and 8 replicas). On a 5 nodes cluster,
this should rebalance automatically.

Are you sure your 5th node actually joined the cluster ?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 26 déc. 2014 à 07:21, Michael deMan (ES) elasticsearch@deman.com a
écrit :

I don’t know.

On Dec 25, 2014, at 10:19 PM, Xiaoliang Tian xiaoliang.tian@gmail.com
wrote:

Thanks,And M using 0.9.13.can it enable auto-balancing manually?

2014-12-26 14:17 GMT+08:00 Michael deMan (ES) elasticsearch@deman.com:

http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/cluster-reroute.html

I can’t remember when auto-balancing got enabled by default, I think
maybe 1.3.4.

you can find out via api.

http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/modules-cluster.html

On Dec 25, 2014, at 10:15 PM, Xiaoliang Tian xiaoliang.tian@gmail.com
wrote:

which version? and what is the API url exactly

2014-12-26 12:44 GMT+08:00 Michael deMan (ES) elasticsearch@deman.com:

Also, higher shards will help with the new indexes but not the existing
ones.
You can use the API to force ES to move shards off your ‘full’ disk over
to the new one.
Auto-balancing for data size should be on by default if you are running
a newer version of ES.

On Dec 25, 2014, at 8:13 PM, Michael deMan (ES) elasticsearch@deman.com
wrote:

Try increasing the number of shards - maybe to 20 or 40.

On Dec 25, 2014, at 8:10 PM, Xiaoliang Tian xiaoliang.tian@gmail.com
wrote:

index number depend on how many days past,the index name is the day
epoch. because we use elasticseach for log storage
shard number is 8
replica is 1

2014-12-25 15:49 GMT+08:00 David Pilato david@pilato.fr:

How many index/shards/replicas do you have?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 25 déc. 2014 à 08:28, xiaoliang tian xiaoliang.tian@gmail.com a
écrit :

I also start a new data node(node 5),and there is new data come into
cluster continuously,but There is no any data in data node 5.I don't know
why,plz help

在 2014年12月25日星期四UTC+8上午10时33分29秒,xiaoliang tian写道:

Hi,I got 4 data nodes,1 master node and 1 search node

For example,At first,the data was equally saved in 4 data nodes
node1 1.6TB
node2 1.6TB
node3 1.6TB
node4 1.6TB

Since My disk is 2TB and it is almost full,I delete some index to get
more storage

after deleting the data nodes are like below

node1 1TB
node2 1TB
node3 1TB
node4 1TB

after a few days, I found the data is not equally saved in each node
anymore

node1 1.1TB
node2 1.1TB
node3 1.1TB
node4 1.6TB

node 4 is almost full
I don't know why,and is there anyway to rebalance data in each data
node

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/9766ba6d-f7b1-4071-8f4b-b2b5c6a14085%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/9766ba6d-f7b1-4071-8f4b-b2b5c6a14085%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/ILjo-_VRQxA/unsubscribe
.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/129A7708-03D8-4F29-87BC-E6AC72369602%40pilato.fr
https://groups.google.com/d/msgid/elasticsearch/129A7708-03D8-4F29-87BC-E6AC72369602%40pilato.fr?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAJ%3DxLsWgSxiVHmFCGw_jKWAKEpfiGs2ROxYVVhBjSFsqSSKukg%40mail.gmail.com
https://groups.google.com/d/msgid/elasticsearch/CAJ%3DxLsWgSxiVHmFCGw_jKWAKEpfiGs2ROxYVVhBjSFsqSSKukg%40mail.gmail.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/D207CFFB-2B24-4FBA-89A4-CCCF2A100BEB%40deman.com
https://groups.google.com/d/msgid/elasticsearch/D207CFFB-2B24-4FBA-89A4-CCCF2A100BEB%40deman.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/ILjo-_VRQxA/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/86BBFA51-19CA-4E0B-9BB7-6445E3DDEA43%40deman.com
https://groups.google.com/d/msgid/elasticsearch/86BBFA51-19CA-4E0B-9BB7-6445E3DDEA43%40deman.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAJ%3DxLsWu0cvKbNx1iMC%2B9yZqCWdYK6WfTyn7B4EsR1Gu3F77dg%40mail.gmail.com
https://groups.google.com/d/msgid/elasticsearch/CAJ%3DxLsWu0cvKbNx1iMC%2B9yZqCWdYK6WfTyn7B4EsR1Gu3F77dg%40mail.gmail.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/ILjo-_VRQxA/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/B6BB7CF5-90FB-4D04-B680-EF5A6934EB2F%40deman.com
https://groups.google.com/d/msgid/elasticsearch/B6BB7CF5-90FB-4D04-B680-EF5A6934EB2F%40deman.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAJ%3DxLsVFJttk142BDG0sHJsxavYhtO_5br88SqpNi4b1YkUuDQ%40mail.gmail.com
https://groups.google.com/d/msgid/elasticsearch/CAJ%3DxLsVFJttk142BDG0sHJsxavYhtO_5br88SqpNi4b1YkUuDQ%40mail.gmail.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/8C3AC853-FEDC-4131-A940-75CB253C5B16%40deman.com
https://groups.google.com/d/msgid/elasticsearch/8C3AC853-FEDC-4131-A940-75CB253C5B16%40deman.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/ILjo-_VRQxA/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/7F07FEF3-3F2C-4E45-9E0A-60BAA1ED8873%40pilato.fr
https://groups.google.com/d/msgid/elasticsearch/7F07FEF3-3F2C-4E45-9E0A-60BAA1ED8873%40pilato.fr?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAJ%3DxLsX_RDQ%2BODVRsKMnnL%2B8U4D8YpEWgzC%2BOB8D_hdzuHT7Gg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

What is the status now?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 26 déc. 2014 à 10:48, Xiaoliang Tian xiaoliang.tian@gmail.com a écrit :

M so sure.I have to call reroute API to balance,The 5 the node just index new log data

2014-12-26 14:39 GMT+08:00 David Pilato david@pilato.fr:

So you have 16 shards (8 primary and 8 replicas). On a 5 nodes cluster, this should rebalance automatically.

Are you sure your 5th node actually joined the cluster ?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 26 déc. 2014 à 07:21, Michael deMan (ES) elasticsearch@deman.com a écrit :

I don’t know.

On Dec 25, 2014, at 10:19 PM, Xiaoliang Tian xiaoliang.tian@gmail.com wrote:

Thanks,And M using 0.9.13.can it enable auto-balancing manually?

2014-12-26 14:17 GMT+08:00 Michael deMan (ES) elasticsearch@deman.com:

http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/cluster-reroute.html

I can’t remember when auto-balancing got enabled by default, I think maybe 1.3.4.

you can find out via api.
http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/modules-cluster.html

On Dec 25, 2014, at 10:15 PM, Xiaoliang Tian xiaoliang.tian@gmail.com wrote:

which version? and what is the API url exactly

2014-12-26 12:44 GMT+08:00 Michael deMan (ES) elasticsearch@deman.com:

Also, higher shards will help with the new indexes but not the existing ones.
You can use the API to force ES to move shards off your ‘full’ disk over to the new one.
Auto-balancing for data size should be on by default if you are running a newer version of ES.

On Dec 25, 2014, at 8:13 PM, Michael deMan (ES) elasticsearch@deman.com wrote:

Try increasing the number of shards - maybe to 20 or 40.

On Dec 25, 2014, at 8:10 PM, Xiaoliang Tian xiaoliang.tian@gmail.com wrote:

index number depend on how many days past,the index name is the day epoch. because we use elasticseach for log storage
shard number is 8
replica is 1

2014-12-25 15:49 GMT+08:00 David Pilato david@pilato.fr:

How many index/shards/replicas do you have?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 25 déc. 2014 à 08:28, xiaoliang tian xiaoliang.tian@gmail.com a écrit :

I also start a new data node(node 5),and there is new data come into cluster continuously,but There is no any data in data node 5.I don't know why,plz help

在 2014年12月25日星期四UTC+8上午10时33分29秒,xiaoliang tian写道:

Hi,I got 4 data nodes,1 master node and 1 search node

For example,At first,the data was equally saved in 4 data nodes
node1 1.6TB
node2 1.6TB
node3 1.6TB
node4 1.6TB

Since My disk is 2TB and it is almost full,I delete some index to get more storage

after deleting the data nodes are like below

node1 1TB
node2 1TB
node3 1TB
node4 1TB

after a few days, I found the data is not equally saved in each node anymore

node1 1.1TB
node2 1.1TB
node3 1.1TB
node4 1.6TB

node 4 is almost full
I don't know why,and is there anyway to rebalance data in each data node

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/9766ba6d-f7b1-4071-8f4b-b2b5c6a14085%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to a topic in the Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/elasticsearch/ILjo-_VRQxA/unsubscribe.
To unsubscribe from this group and all its topics, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/129A7708-03D8-4F29-87BC-E6AC72369602%40pilato.fr.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAJ%3DxLsWgSxiVHmFCGw_jKWAKEpfiGs2ROxYVVhBjSFsqSSKukg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/D207CFFB-2B24-4FBA-89A4-CCCF2A100BEB%40deman.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to a topic in the Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/elasticsearch/ILjo-_VRQxA/unsubscribe.
To unsubscribe from this group and all its topics, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/86BBFA51-19CA-4E0B-9BB7-6445E3DDEA43%40deman.com.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAJ%3DxLsWu0cvKbNx1iMC%2B9yZqCWdYK6WfTyn7B4EsR1Gu3F77dg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to a topic in the Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/elasticsearch/ILjo-_VRQxA/unsubscribe.
To unsubscribe from this group and all its topics, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/B6BB7CF5-90FB-4D04-B680-EF5A6934EB2F%40deman.com.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAJ%3DxLsVFJttk142BDG0sHJsxavYhtO_5br88SqpNi4b1YkUuDQ%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/8C3AC853-FEDC-4131-A940-75CB253C5B16%40deman.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to a topic in the Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/elasticsearch/ILjo-_VRQxA/unsubscribe.
To unsubscribe from this group and all its topics, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/7F07FEF3-3F2C-4E45-9E0A-60BAA1ED8873%40pilato.fr.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAJ%3DxLsX_RDQ%2BODVRsKMnnL%2B8U4D8YpEWgzC%2BOB8D_hdzuHT7Gg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/C4D12F01-F12A-457E-8DD8-97ACB5D039E6%40pilato.fr.
For more options, visit https://groups.google.com/d/optout.

You really need to upgrade, 0.90.X is no longer supported!

On 26 December 2014 at 17:19, Xiaoliang Tian xiaoliang.tian@gmail.com
wrote:

Thanks,And M using 0.9.13.can it enable auto-balancing manually?

2014-12-26 14:17 GMT+08:00 Michael deMan (ES) elasticsearch@deman.com:

http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/cluster-reroute.html

I can’t remember when auto-balancing got enabled by default, I think
maybe 1.3.4.

you can find out via api.

http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/modules-cluster.html

On Dec 25, 2014, at 10:15 PM, Xiaoliang Tian xiaoliang.tian@gmail.com
wrote:

which version? and what is the API url exactly

2014-12-26 12:44 GMT+08:00 Michael deMan (ES) elasticsearch@deman.com:

Also, higher shards will help with the new indexes but not the existing
ones.
You can use the API to force ES to move shards off your ‘full’ disk over
to the new one.
Auto-balancing for data size should be on by default if you are running
a newer version of ES.

On Dec 25, 2014, at 8:13 PM, Michael deMan (ES) elasticsearch@deman.com
wrote:

Try increasing the number of shards - maybe to 20 or 40.

On Dec 25, 2014, at 8:10 PM, Xiaoliang Tian xiaoliang.tian@gmail.com
wrote:

index number depend on how many days past,the index name is the day
epoch. because we use elasticseach for log storage
shard number is 8
replica is 1

2014-12-25 15:49 GMT+08:00 David Pilato david@pilato.fr:

How many index/shards/replicas do you have?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 25 déc. 2014 à 08:28, xiaoliang tian xiaoliang.tian@gmail.com a
écrit :

I also start a new data node(node 5),and there is new data come into
cluster continuously,but There is no any data in data node 5.I don't know
why,plz help

在 2014年12月25日星期四UTC+8上午10时33分29秒,xiaoliang tian写道:

Hi,I got 4 data nodes,1 master node and 1 search node

For example,At first,the data was equally saved in 4 data nodes
node1 1.6TB
node2 1.6TB
node3 1.6TB
node4 1.6TB

Since My disk is 2TB and it is almost full,I delete some index to get
more storage

after deleting the data nodes are like below

node1 1TB
node2 1TB
node3 1TB
node4 1TB

after a few days, I found the data is not equally saved in each node
anymore

node1 1.1TB
node2 1.1TB
node3 1.1TB
node4 1.6TB

node 4 is almost full
I don't know why,and is there anyway to rebalance data in each data
node

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/9766ba6d-f7b1-4071-8f4b-b2b5c6a14085%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/9766ba6d-f7b1-4071-8f4b-b2b5c6a14085%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/ILjo-_VRQxA/unsubscribe
.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/129A7708-03D8-4F29-87BC-E6AC72369602%40pilato.fr
https://groups.google.com/d/msgid/elasticsearch/129A7708-03D8-4F29-87BC-E6AC72369602%40pilato.fr?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAJ%3DxLsWgSxiVHmFCGw_jKWAKEpfiGs2ROxYVVhBjSFsqSSKukg%40mail.gmail.com
https://groups.google.com/d/msgid/elasticsearch/CAJ%3DxLsWgSxiVHmFCGw_jKWAKEpfiGs2ROxYVVhBjSFsqSSKukg%40mail.gmail.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/D207CFFB-2B24-4FBA-89A4-CCCF2A100BEB%40deman.com
https://groups.google.com/d/msgid/elasticsearch/D207CFFB-2B24-4FBA-89A4-CCCF2A100BEB%40deman.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/ILjo-_VRQxA/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/86BBFA51-19CA-4E0B-9BB7-6445E3DDEA43%40deman.com
https://groups.google.com/d/msgid/elasticsearch/86BBFA51-19CA-4E0B-9BB7-6445E3DDEA43%40deman.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAJ%3DxLsWu0cvKbNx1iMC%2B9yZqCWdYK6WfTyn7B4EsR1Gu3F77dg%40mail.gmail.com
https://groups.google.com/d/msgid/elasticsearch/CAJ%3DxLsWu0cvKbNx1iMC%2B9yZqCWdYK6WfTyn7B4EsR1Gu3F77dg%40mail.gmail.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/ILjo-_VRQxA/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/B6BB7CF5-90FB-4D04-B680-EF5A6934EB2F%40deman.com
https://groups.google.com/d/msgid/elasticsearch/B6BB7CF5-90FB-4D04-B680-EF5A6934EB2F%40deman.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAJ%3DxLsVFJttk142BDG0sHJsxavYhtO_5br88SqpNi4b1YkUuDQ%40mail.gmail.com
https://groups.google.com/d/msgid/elasticsearch/CAJ%3DxLsVFJttk142BDG0sHJsxavYhtO_5br88SqpNi4b1YkUuDQ%40mail.gmail.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAEYi1X_0xCxGp%2BD8%2BxhbE6FrCOBP3pcvsf92zmpmKRk1362-bg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

Thanks,I got that

2014-12-27 4:54 GMT+08:00 Mark Walkom markwalkom@gmail.com:

You really need to upgrade, 0.90.X is no longer supported!

On 26 December 2014 at 17:19, Xiaoliang Tian xiaoliang.tian@gmail.com
wrote:

Thanks,And M using 0.9.13.can it enable auto-balancing manually?

2014-12-26 14:17 GMT+08:00 Michael deMan (ES) elasticsearch@deman.com:

http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/cluster-reroute.html

I can’t remember when auto-balancing got enabled by default, I think
maybe 1.3.4.

you can find out via api.

http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/modules-cluster.html

On Dec 25, 2014, at 10:15 PM, Xiaoliang Tian xiaoliang.tian@gmail.com
wrote:

which version? and what is the API url exactly

2014-12-26 12:44 GMT+08:00 Michael deMan (ES) elasticsearch@deman.com:

Also, higher shards will help with the new indexes but not the existing
ones.
You can use the API to force ES to move shards off your ‘full’ disk
over to the new one.
Auto-balancing for data size should be on by default if you are running
a newer version of ES.

On Dec 25, 2014, at 8:13 PM, Michael deMan (ES) <
elasticsearch@deman.com> wrote:

Try increasing the number of shards - maybe to 20 or 40.

On Dec 25, 2014, at 8:10 PM, Xiaoliang Tian xiaoliang.tian@gmail.com
wrote:

index number depend on how many days past,the index name is the day
epoch. because we use elasticseach for log storage
shard number is 8
replica is 1

2014-12-25 15:49 GMT+08:00 David Pilato david@pilato.fr:

How many index/shards/replicas do you have?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 25 déc. 2014 à 08:28, xiaoliang tian xiaoliang.tian@gmail.com a
écrit :

I also start a new data node(node 5),and there is new data come into
cluster continuously,but There is no any data in data node 5.I don't know
why,plz help

在 2014年12月25日星期四UTC+8上午10时33分29秒,xiaoliang tian写道:

Hi,I got 4 data nodes,1 master node and 1 search node

For example,At first,the data was equally saved in 4 data nodes
node1 1.6TB
node2 1.6TB
node3 1.6TB
node4 1.6TB

Since My disk is 2TB and it is almost full,I delete some index to
get more storage

after deleting the data nodes are like below

node1 1TB
node2 1TB
node3 1TB
node4 1TB

after a few days, I found the data is not equally saved in each node
anymore

node1 1.1TB
node2 1.1TB
node3 1.1TB
node4 1.6TB

node 4 is almost full
I don't know why,and is there anyway to rebalance data in each data
node

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/9766ba6d-f7b1-4071-8f4b-b2b5c6a14085%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/9766ba6d-f7b1-4071-8f4b-b2b5c6a14085%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/ILjo-_VRQxA/unsubscribe
.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/129A7708-03D8-4F29-87BC-E6AC72369602%40pilato.fr
https://groups.google.com/d/msgid/elasticsearch/129A7708-03D8-4F29-87BC-E6AC72369602%40pilato.fr?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAJ%3DxLsWgSxiVHmFCGw_jKWAKEpfiGs2ROxYVVhBjSFsqSSKukg%40mail.gmail.com
https://groups.google.com/d/msgid/elasticsearch/CAJ%3DxLsWgSxiVHmFCGw_jKWAKEpfiGs2ROxYVVhBjSFsqSSKukg%40mail.gmail.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/D207CFFB-2B24-4FBA-89A4-CCCF2A100BEB%40deman.com
https://groups.google.com/d/msgid/elasticsearch/D207CFFB-2B24-4FBA-89A4-CCCF2A100BEB%40deman.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/ILjo-_VRQxA/unsubscribe
.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/86BBFA51-19CA-4E0B-9BB7-6445E3DDEA43%40deman.com
https://groups.google.com/d/msgid/elasticsearch/86BBFA51-19CA-4E0B-9BB7-6445E3DDEA43%40deman.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAJ%3DxLsWu0cvKbNx1iMC%2B9yZqCWdYK6WfTyn7B4EsR1Gu3F77dg%40mail.gmail.com
https://groups.google.com/d/msgid/elasticsearch/CAJ%3DxLsWu0cvKbNx1iMC%2B9yZqCWdYK6WfTyn7B4EsR1Gu3F77dg%40mail.gmail.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/ILjo-_VRQxA/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/B6BB7CF5-90FB-4D04-B680-EF5A6934EB2F%40deman.com
https://groups.google.com/d/msgid/elasticsearch/B6BB7CF5-90FB-4D04-B680-EF5A6934EB2F%40deman.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAJ%3DxLsVFJttk142BDG0sHJsxavYhtO_5br88SqpNi4b1YkUuDQ%40mail.gmail.com
https://groups.google.com/d/msgid/elasticsearch/CAJ%3DxLsVFJttk142BDG0sHJsxavYhtO_5br88SqpNi4b1YkUuDQ%40mail.gmail.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/ILjo-_VRQxA/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAEYi1X_0xCxGp%2BD8%2BxhbE6FrCOBP3pcvsf92zmpmKRk1362-bg%40mail.gmail.com
https://groups.google.com/d/msgid/elasticsearch/CAEYi1X_0xCxGp%2BD8%2BxhbE6FrCOBP3pcvsf92zmpmKRk1362-bg%40mail.gmail.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAJ%3DxLsULzbXJug54X%3DK_16v7TLsLo%3Dk9G5CJkhsoPdAZAkjnaA%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.