# High disk watermark \[90%\] exceeded on node,shards will be relocated away from this node

**URL:** https://discuss.elastic.co/t/high-disk-watermark-90-exceeded-on-node-shards-will-be-relocated-away-from-this-node/99473
**Category:** Elasticsearch
**Created:** [September 5, 2017, 7:11pm UTC](https://discuss.elastic.co/t/high-disk-watermark-90-exceeded-on-node-shards-will-be-relocated-away-from-this-node/99473 "2017-09-05T19:11:29Z")
**Posts on this page:** 6
**Page:** 1

<div class="post-metadata">

### Author: ![shyamalaponnada](https://avatars.discourse-cdn.com/v4/letter/s/ecae2f/32.png) [@shyamalaponnada](https://discuss.elastic.co/u/shyamalaponnada)
#### Post date: [September 5, 2017, 7:11pm UTC](https://discuss.elastic.co/t/high-disk-watermark-90-exceeded-on-node-shards-will-be-relocated-away-from-this-node/99473/1 "2017-09-05T19:11:29Z")

</div>

HI All,

recently elasticsearch stops sending data to kibana as the disk space is exceeded.per day i can see 5 M documents are flowing from other server to Elasticsearch.Please find the error am getting

`[2017-08-31T01:21:49,851][WARN][o.e.c.r.a.DiskThresholdMonitor] [production] high disk watermark [90%] exceeded on [8klVIR6LQfOxAUcELG3wtA][production][/var/lib/elasticsearch/nodes/0] free: 20kb[2.8E-5%], shards will be relocated away from this node`

could any one please suggest how can i avoid this issue?

I have tried to update the heap memory form xms2g to xms16g. still elasticsearch is not working.

Can anyone tell me where json documents actually stored?

Thanks in Advance !!!!!

Thanks  
Shyamala

---

<div class="post-metadata">

### Author: ![jasontedor](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jasontedor/32/66992_2.png) [@jasontedor](https://discuss.elastic.co/u/jasontedor)
#### Post date: [September 6, 2017, 12:00am UTC](https://discuss.elastic.co/t/high-disk-watermark-90-exceeded-on-node-shards-will-be-relocated-away-from-this-node/99473/2 "2017-09-06T00:00:19Z")

</div>

> [@shyamalaponnada](#):
>
> could any one please suggest how can i avoid this issue?

This is a disk space issue, you're low on disk space. You need to get a larger disk or free up space.

---

<div class="post-metadata">

### Author: ![kmsasidhar](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kmsasidhar/32/21838_2.png) [@kmsasidhar](https://discuss.elastic.co/u/kmsasidhar)
#### Post date: [September 6, 2017, 12:22am UTC](https://discuss.elastic.co/t/high-disk-watermark-90-exceeded-on-node-shards-will-be-relocated-away-from-this-node/99473/3 "2017-09-06T00:22:23Z")

</div>

right!

---

<div class="post-metadata">

### Author: ![shyamalaponnada](https://avatars.discourse-cdn.com/v4/letter/s/ecae2f/32.png) [@shyamalaponnada](https://discuss.elastic.co/u/shyamalaponnada)
#### Post date: [September 6, 2017, 2:29pm UTC](https://discuss.elastic.co/t/high-disk-watermark-90-exceeded-on-node-shards-will-be-relocated-away-from-this-node/99473/4 "2017-09-06T14:29:50Z")

</div>

Thanks for the response!!!

If i delete few json documents..will elasticsearch run automatically?

---

<div class="post-metadata">

### Author: ![kmsasidhar](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kmsasidhar/32/21838_2.png) [@kmsasidhar](https://discuss.elastic.co/u/kmsasidhar)
#### Post date: [September 6, 2017, 4:05pm UTC](https://discuss.elastic.co/t/high-disk-watermark-90-exceeded-on-node-shards-will-be-relocated-away-from-this-node/99473/5 "2017-09-06T16:05:07Z")

</div>

Yes, i think. I haven't run into this issue though.

However, you may consider other other options as well - if you have indices, rolling daily, you may delete old indices.

You may refer to retiring data section in the definitive guide and snapshot and restore links below.

[https://www.elastic.co/guide/en/elasticsearch/guide/current/retiring-data.html](https://www.elastic.co/guide/en/elasticsearch/guide/current/retiring-data.html)  
[https://www.elastic.co/guide/en/elasticsearch/reference/2.4/modules-snapshots.html](https://www.elastic.co/guide/en/elasticsearch/reference/2.4/modules-snapshots.html)

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [October 4, 2017, 4:05pm UTC](https://discuss.elastic.co/t/high-disk-watermark-90-exceeded-on-node-shards-will-be-relocated-away-from-this-node/99473/6 "2017-10-04T16:05:15Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
