# How many available disk space need for normal system running?

**URL:** <https://discuss.elastic.co/t/how-many-available-disk-space-need-for-normal-system-running/16603>\
**Category:** Elasticsearch\
**Created:** [March 26, 2014, 9:53am UTC](https://discuss.elastic.co/t/how-many-available-disk-space-need-for-normal-system-running/16603 "2014-03-26T09:53:33Z")\
**Posts on this page:** 8\
**Page:** 1

<div class="post-metadata">

**Author:** ![Ivan\_Ji](https://avatars.discourse-cdn.com/v4/letter/i/d78d45/32.png) [@Ivan\_Ji](https://discuss.elastic.co/u/Ivan_Ji)\
**Post date:** [March 26, 2014, 9:53am UTC](https://discuss.elastic.co/t/how-many-available-disk-space-need-for-normal-system-running/16603/1 "2014-03-26T09:53:33Z")

</div>

Hi all,

I am using ES 1.0.1. I am wondering how many un-used disk space needed for  
the ES's system running?

Because I ran into the error:

[2014-03-26 03:30:52,713][WARN][index.merge.scheduler] [Rick Jones]

> [qusion][1] failed to merge  
> java.io.IOException: No space left on device  
> at java.io.RandomAccessFile.writeBytes0(Native Method)  
> at java.io.RandomAccessFile.writeBytes(RandomAccessFile.java:520)  
> at java.io.RandomAccessFile.write(RandomAccessFile.java:550)  
> at  
> org.apache.lucene.store.FSDirectory$FSIndexOutput.flushBuffer(FSDirectory.java:458)  
> at  
> org.apache.lucene.store.RateLimitedFSDirectory$RateLimitedIndexOutput.flushBuffer(RateLimitedFSDirectory.java:102)  
> at  
> org.apache.lucene.store.BufferedChecksumIndexOutput.flushBuffer(BufferedChecksumIndexOutput.java:71)  
> at  
> org.apache.lucene.store.BufferedIndexOutput.flushBuffer(BufferedIndexOutput.java:113)  
> at  
> org.apache.lucene.store.BufferedIndexOutput.flush(BufferedIndexOutput.java:102)  
> at  
> org.apache.lucene.store.BufferedChecksumIndexOutput.flush(BufferedChecksumIndexOutput.java:86)  
> at  
> org.apache.lucene.store.BufferedIndexOutput.close(BufferedIndexOutput.java:126)  
> at  
> org.apache.lucene.store.BufferedChecksumIndexOutput.close(BufferedChecksumIndexOutput.java:61)  
> at  
> org.elasticsearch.index.store.Store$StoreIndexOutput.close(Store.java:602)  
> at  
> org.apache.lucene.codecs.compressing.CompressingStoredFieldsIndexWriter.close(CompressingStoredFieldsIndexWriter.java:205)  
> at org.apache.lucene.util.IOUtils.close(IOUtils.java:140)  
> at  
> org.apache.lucene.codecs.compressing.CompressingStoredFieldsWriter.close(CompressingStoredFieldsWriter.java:138)  
> at  
> org.apache.lucene.index.SegmentMerger.mergeFields(SegmentMerger.java:318)  
> at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:94)  
> at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4071)  
> at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3668)  
> at  
> org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:405)  
> at  
> org.apache.lucene.index.TrackingConcurrentMergeScheduler.doMerge(TrackingConcurrentMergeScheduler.java:107)  
> at  
> org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:482)  
> [2014-03-26 03:30:53,382][WARN][index.engine.internal] [Rick Jones]  
> [qusion][1] failed engine

Obviously, there need to have some amount of disk during the merge.  
And I think the larger index size, the more disk space needed for the merge  
operation.

Does anyone have the idea how much does it can be?

Ivan

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/272d3fc6-5dd9-4377-b847-bacbbc800fb1%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/272d3fc6-5dd9-4377-b847-bacbbc800fb1%40googlegroups.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![Ivan\_Ji](https://avatars.discourse-cdn.com/v4/letter/i/d78d45/32.png) [@Ivan\_Ji](https://discuss.elastic.co/u/Ivan_Ji)\
**Post date:** [March 26, 2014, 10:06am UTC](https://discuss.elastic.co/t/how-many-available-disk-space-need-for-normal-system-running/16603/2 "2014-03-26T10:06:28Z")

</div>

I just looked up the lucene's document. during the merge, there at least  
need double the index size.  
But does ES tune something on it ? or it just follow the lucene's rule,  
that is 2x the index size.

Ivan Ji於 2014年3月26日星期三UTC+8下午5時53分33秒寫道：

> Hi all,
> 
> I am using ES 1.0.1. I am wondering how many un-used disk space needed for  
> the ES's system running?
> 
> Because I ran into the error:
> 
> [2014-03-26 03:30:52,713][WARN][index.merge.scheduler] [Rick Jones]
> 
> > [qusion][1] failed to merge  
> > java.io.IOException: No space left on device  
> > at java.io.RandomAccessFile.writeBytes0(Native Method)  
> > at java.io.RandomAccessFile.writeBytes(RandomAccessFile.java:520)  
> > at java.io.RandomAccessFile.write(RandomAccessFile.java:550)  
> > at  
> > org.apache.lucene.store.FSDirectory$FSIndexOutput.flushBuffer(FSDirectory.java:458)  
> > at  
> > org.apache.lucene.store.RateLimitedFSDirectory$RateLimitedIndexOutput.flushBuffer(RateLimitedFSDirectory.java:102)  
> > at  
> > org.apache.lucene.store.BufferedChecksumIndexOutput.flushBuffer(BufferedChecksumIndexOutput.java:71)  
> > at  
> > org.apache.lucene.store.BufferedIndexOutput.flushBuffer(BufferedIndexOutput.java:113)  
> > at  
> > org.apache.lucene.store.BufferedIndexOutput.flush(BufferedIndexOutput.java:102)  
> > at  
> > org.apache.lucene.store.BufferedChecksumIndexOutput.flush(BufferedChecksumIndexOutput.java:86)  
> > at  
> > org.apache.lucene.store.BufferedIndexOutput.close(BufferedIndexOutput.java:126)  
> > at  
> > org.apache.lucene.store.BufferedChecksumIndexOutput.close(BufferedChecksumIndexOutput.java:61)  
> > at  
> > org.elasticsearch.index.store.Store$StoreIndexOutput.close(Store.java:602)  
> > at  
> > org.apache.lucene.codecs.compressing.CompressingStoredFieldsIndexWriter.close(CompressingStoredFieldsIndexWriter.java:205)  
> > at org.apache.lucene.util.IOUtils.close(IOUtils.java:140)  
> > at  
> > org.apache.lucene.codecs.compressing.CompressingStoredFieldsWriter.close(CompressingStoredFieldsWriter.java:138)  
> > at  
> > org.apache.lucene.index.SegmentMerger.mergeFields(SegmentMerger.java:318)  
> > at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:94)  
> > at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4071)  
> > at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3668)  
> > at  
> > org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:405)  
> > at  
> > org.apache.lucene.index.TrackingConcurrentMergeScheduler.doMerge(TrackingConcurrentMergeScheduler.java:107)  
> > at  
> > org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:482)  
> > [2014-03-26 03:30:53,382][WARN][index.engine.internal] [Rick Jones]  
> > [qusion][1] failed engine
> 
> Obviously, there need to have some amount of disk during the merge.  
> And I think the larger index size, the more disk space needed for the  
> merge operation.
> 
> Does anyone have the idea how much does it can be?
> 
> Ivan

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/448ff632-0462-436f-b0cf-5a943b8db50f%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/448ff632-0462-436f-b0cf-5a943b8db50f%40googlegroups.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [March 26, 2014, 10:18am UTC](https://discuss.elastic.co/t/how-many-available-disk-space-need-for-normal-system-running/16603/3 "2014-03-26T10:18:12Z")

</div>

Depends on how much data you have.

How much disk space is on the machine? How much data is in ES?

Regards,  
Mark Walkom

Infrastructure Engineer  
Campaign Monitor  
email: [markw@campaignmonitor.com](mailto:markw@campaignmonitor.com)  
web: [www.campaignmonitor.com](http://www.campaignmonitor.com)

On 26 March 2014 21:06, Ivan Ji [hxuanji@gmail.com](mailto:hxuanji@gmail.com) wrote:

> I just looked up the lucene's document. during the merge, there at least  
> need double the index size.  
> But does ES tune something on it ? or it just follow the lucene's rule,  
> that is 2x the index size.
> 
> Ivan Ji於 2014年3月26日星期三UTC+8下午5時53分33秒寫道：
> 
> > Hi all,
> > 
> > I am using ES 1.0.1. I am wondering how many un-used disk space needed  
> > for the ES's system running?
> > 
> > Because I ran into the error:
> > 
> > [2014-03-26 03:30:52,713][WARN][index.merge.scheduler] [Rick Jones]
> > 
> > > [qusion][1] failed to merge  
> > > java.io.IOException: No space left on device  
> > > at java.io.RandomAccessFile.writeBytes0(Native Method)  
> > > at java.io.RandomAccessFile.writeBytes(RandomAccessFile.java:520)  
> > > at java.io.RandomAccessFile.write(RandomAccessFile.java:550)  
> > > at org.apache.lucene.store.FSDirectory$FSIndexOutput.  
> > > flushBuffer(FSDirectory.java:458)  
> > > at org.apache.lucene.store.RateLimitedFSDirectory$  
> > > RateLimitedIndexOutput.flushBuffer(RateLimitedFSDirectory.java:102)  
> > > at org.apache.lucene.store.BufferedChecksumIndexOutput.flushBuffer(  
> > > BufferedChecksumIndexOutput.java:71)  
> > > at org.apache.lucene.store.BufferedIndexOutput.flushBuffer(  
> > > BufferedIndexOutput.java:113)  
> > > at org.apache.lucene.store.BufferedIndexOutput.flush(  
> > > BufferedIndexOutput.java:102)  
> > > at org.apache.lucene.store.BufferedChecksumIndexOutput.flush(  
> > > BufferedChecksumIndexOutput.java:86)  
> > > at org.apache.lucene.store.BufferedIndexOutput.close(  
> > > BufferedIndexOutput.java:126)  
> > > at org.apache.lucene.store.BufferedChecksumIndexOutput.close(  
> > > BufferedChecksumIndexOutput.java:61)  
> > > at org.elasticsearch.index.store.Store$StoreIndexOutput.close(  
> > > Store.java:602)  
> > > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsIndexWr  
> > > iter.close(CompressingStoredFieldsIndexWriter.java:205)  
> > > at org.apache.lucene.util.IOUtils.close(IOUtils.java:140)  
> > > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsWriter.  
> > > close(CompressingStoredFieldsWriter.java:138)  
> > > at org.apache.lucene.index.SegmentMerger.mergeFields(  
> > > SegmentMerger.java:318)  
> > > at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:94)  
> > > at org.apache.lucene.index.IndexWriter.mergeMiddle(  
> > > IndexWriter.java:4071)  
> > > at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3668)  
> > > at org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(  
> > > ConcurrentMergeScheduler.java:405)  
> > > at org.apache.lucene.index.TrackingConcurrentMergeScheduler.doMerge(  
> > > TrackingConcurrentMergeScheduler.java:107)  
> > > at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(  
> > > ConcurrentMergeScheduler.java:482)  
> > > [2014-03-26 03:30:53,382][WARN][index.engine.internal] [Rick Jones]  
> > > [qusion][1] failed engine
> > 
> > Obviously, there need to have some amount of disk during the merge.  
> > And I think the larger index size, the more disk space needed for the  
> > merge operation.
> > 
> > Does anyone have the idea how much does it can be?
> > 
> > Ivan
> 
> --  
> You received this message because you are subscribed to the Google Groups  
> "elasticsearch" group.  
> To unsubscribe from this group and stop receiving emails from it, send an  
> email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> To view this discussion on the web visit  
> [https://groups.google.com/d/msgid/elasticsearch/448ff632-0462-436f-b0cf-5a943b8db50f%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/448ff632-0462-436f-b0cf-5a943b8db50f%40googlegroups.com)[https://groups.google.com/d/msgid/elasticsearch/448ff632-0462-436f-b0cf-5a943b8db50f%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/448ff632-0462-436f-b0cf-5a943b8db50f%40googlegroups.com?utm_medium=email&utm_source=footer)  
> .
> 
> For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAEM624b7LoUSnvgZL1mK6MZiHtrfD9wjQdU0OzsaLsXZFCgogA%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAEM624b7LoUSnvgZL1mK6MZiHtrfD9wjQdU0OzsaLsXZFCgogA%40mail.gmail.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![Ivan\_Ji](https://avatars.discourse-cdn.com/v4/letter/i/d78d45/32.png) [@Ivan\_Ji](https://discuss.elastic.co/u/Ivan_Ji)\
**Post date:** [March 26, 2014, 11:01am UTC](https://discuss.elastic.co/t/how-many-available-disk-space-need-for-normal-system-running/16603/4 "2014-03-26T11:01:21Z")

</div>

Hi Mark,

My index size is about 300GB, the free disk space is about 5G.

Mark Walkom於 2014年3月26日星期三UTC+8下午6時18分12秒寫道：

> Depends on how much data you have.
> 
> How much disk space is on the machine? How much data is in ES?
> 
> Regards,  
> Mark Walkom
> 
> Infrastructure Engineer  
> Campaign Monitor  
> email: [ma...@campaignmonitor.com](mailto:ma...@campaignmonitor.com) \<javascript:\>  
> web: [www.campaignmonitor.com](http://www.campaignmonitor.com)
> 
> On 26 March 2014 21:06, Ivan Ji \<[hxu...@gmail.com](mailto:hxu...@gmail.com) \<javascript:\>\> wrote:
> 
> > I just looked up the lucene's document. during the merge, there at least  
> > need double the index size.  
> > But does ES tune something on it ? or it just follow the lucene's rule,  
> > that is 2x the index size.
> > 
> > Ivan Ji於 2014年3月26日星期三UTC+8下午5時53分33秒寫道：
> > 
> > > Hi all,
> > > 
> > > I am using ES 1.0.1. I am wondering how many un-used disk space needed  
> > > for the ES's system running?
> > > 
> > > Because I ran into the error:
> > > 
> > > [2014-03-26 03:30:52,713][WARN][index.merge.scheduler] [Rick Jones]
> > > 
> > > > [qusion][1] failed to merge  
> > > > java.io.IOException: No space left on device  
> > > > at java.io.RandomAccessFile.writeBytes0(Native Method)  
> > > > at java.io.RandomAccessFile.writeBytes(RandomAccessFile.java:520)  
> > > > at java.io.RandomAccessFile.write(RandomAccessFile.java:550)  
> > > > at org.apache.lucene.store.FSDirectory$FSIndexOutput.  
> > > > flushBuffer(FSDirectory.java:458)  
> > > > at org.apache.lucene.store.RateLimitedFSDirectory$  
> > > > RateLimitedIndexOutput.flushBuffer(RateLimitedFSDirectory.java:102)  
> > > > at org.apache.lucene.store.BufferedChecksumIndexOutput.flushBuffer(  
> > > > BufferedChecksumIndexOutput.java:71)  
> > > > at org.apache.lucene.store.BufferedIndexOutput.flushBuffer(  
> > > > BufferedIndexOutput.java:113)  
> > > > at org.apache.lucene.store.BufferedIndexOutput.flush(  
> > > > BufferedIndexOutput.java:102)  
> > > > at org.apache.lucene.store.BufferedChecksumIndexOutput.flush(  
> > > > BufferedChecksumIndexOutput.java:86)  
> > > > at org.apache.lucene.store.BufferedIndexOutput.close(  
> > > > BufferedIndexOutput.java:126)  
> > > > at org.apache.lucene.store.BufferedChecksumIndexOutput.close(  
> > > > BufferedChecksumIndexOutput.java:61)  
> > > > at org.elasticsearch.index.store.Store$StoreIndexOutput.close(  
> > > > Store.java:602)  
> > > > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsIndexWr  
> > > > iter.close(CompressingStoredFieldsIndexWriter.java:205)  
> > > > at org.apache.lucene.util.IOUtils.close(IOUtils.java:140)  
> > > > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsWriter.  
> > > > close(CompressingStoredFieldsWriter.java:138)  
> > > > at org.apache.lucene.index.SegmentMerger.mergeFields(  
> > > > SegmentMerger.java:318)  
> > > > at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:94)  
> > > > at org.apache.lucene.index.IndexWriter.mergeMiddle(  
> > > > IndexWriter.java:4071)  
> > > > at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3668)  
> > > > at org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(  
> > > > ConcurrentMergeScheduler.java:405)  
> > > > at org.apache.lucene.index.TrackingConcurrentMergeScheduler.doMerge(  
> > > > TrackingConcurrentMergeScheduler.java:107)  
> > > > at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(  
> > > > ConcurrentMergeScheduler.java:482)  
> > > > [2014-03-26 03:30:53,382][WARN][index.engine.internal] [Rick  
> > > > Jones] [qusion][1] failed engine
> > > 
> > > Obviously, there need to have some amount of disk during the merge.  
> > > And I think the larger index size, the more disk space needed for the  
> > > merge operation.
> > > 
> > > Does anyone have the idea how much does it can be?
> > > 
> > > Ivan
> > 
> > --  
> > You received this message because you are subscribed to the Google Groups  
> > "elasticsearch" group.  
> > To unsubscribe from this group and stop receiving emails from it, send an  
> > email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com) \<javascript:\>.  
> > To view this discussion on the web visit  
> > [https://groups.google.com/d/msgid/elasticsearch/448ff632-0462-436f-b0cf-5a943b8db50f%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/448ff632-0462-436f-b0cf-5a943b8db50f%40googlegroups.com)[https://groups.google.com/d/msgid/elasticsearch/448ff632-0462-436f-b0cf-5a943b8db50f%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/448ff632-0462-436f-b0cf-5a943b8db50f%40googlegroups.com?utm_medium=email&utm_source=footer)  
> > .
> > 
> > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/c55ca5dd-f649-4a2c-ba65-6afb2aab0583%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/c55ca5dd-f649-4a2c-ba65-6afb2aab0583%40googlegroups.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [March 26, 2014, 11:11am UTC](https://discuss.elastic.co/t/how-many-available-disk-space-need-for-normal-system-running/16603/5 "2014-03-26T11:11:21Z")

</div>

There's not much you can do, you either need to delete some data or  
increase your disk space.

Maybe someone can clarify how much space is needed for a merge, but I  
imagine it'd be twice the size of a shard.

Regards,  
Mark Walkom

Infrastructure Engineer  
Campaign Monitor  
email: [markw@campaignmonitor.com](mailto:markw@campaignmonitor.com)  
web: [www.campaignmonitor.com](http://www.campaignmonitor.com)

On 26 March 2014 22:01, Ivan Ji [hxuanji@gmail.com](mailto:hxuanji@gmail.com) wrote:

> Hi Mark,
> 
> My index size is about 300GB, the free disk space is about 5G.
> 
> Mark Walkom於 2014年3月26日星期三UTC+8下午6時18分12秒寫道：
> 
> > Depends on how much data you have.
> > 
> > How much disk space is on the machine? How much data is in ES?
> > 
> > Regards,  
> > Mark Walkom
> > 
> > Infrastructure Engineer  
> > Campaign Monitor  
> > email: [ma...@campaignmonitor.com](mailto:ma...@campaignmonitor.com)  
> > web: [www.campaignmonitor.com](http://www.campaignmonitor.com)
> > 
> > On 26 March 2014 21:06, Ivan Ji [hxu...@gmail.com](mailto:hxu...@gmail.com) wrote:
> > 
> > > I just looked up the lucene's document. during the merge, there at least  
> > > need double the index size.  
> > > But does ES tune something on it ? or it just follow the lucene's rule,  
> > > that is 2x the index size.
> > > 
> > > Ivan Ji於 2014年3月26日星期三UTC+8下午5時53分33秒寫道：
> > > 
> > > > Hi all,
> > > > 
> > > > I am using ES 1.0.1. I am wondering how many un-used disk space needed  
> > > > for the ES's system running?
> > > > 
> > > > Because I ran into the error:
> > > > 
> > > > [2014-03-26 03:30:52,713][WARN][index.merge.scheduler] [Rick
> > > > 
> > > > > Jones] [qusion][1] failed to merge  
> > > > > java.io.IOException: No space left on device  
> > > > > at java.io.RandomAccessFile.writeBytes0(Native Method)  
> > > > > at java.io.RandomAccessFile.writeBytes(RandomAccessFile.java:520)  
> > > > > at java.io.RandomAccessFile.write(RandomAccessFile.java:550)  
> > > > > at org.apache.lucene.store.FSDirectory$FSIndexOutput.flushBuffe  
> > > > > r(FSDirectory.java:458)  
> > > > > at org.apache.lucene.store.RateLimitedFSDirectory$RateLimitedIn  
> > > > > dexOutput.flushBuffer(RateLimitedFSDirectory.java:102)  
> > > > > at org.apache.lucene.store.BufferedChecksumIndexOutput.flushBuffer(  
> > > > > BufferedChecksumIndexOutput.java:71)  
> > > > > at org.apache.lucene.store.BufferedIndexOutput.flushBuffer(Buff  
> > > > > eredIndexOutput.java:113)  
> > > > > at org.apache.lucene.store.BufferedIndexOutput.flush(BufferedIn  
> > > > > dexOutput.java:102)  
> > > > > at org.apache.lucene.store.BufferedChecksumIndexOutput.flush(Bu  
> > > > > fferedChecksumIndexOutput.java:86)  
> > > > > at org.apache.lucene.store.BufferedIndexOutput.close(BufferedIn  
> > > > > dexOutput.java:126)  
> > > > > at org.apache.lucene.store.BufferedChecksumIndexOutput.close(Bu  
> > > > > fferedChecksumIndexOutput.java:61)  
> > > > > at org.elasticsearch.index.store.Store$StoreIndexOutput.close(S  
> > > > > tore.java:602)  
> > > > > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsIndexWr  
> > > > > iter.close(CompressingStoredFieldsIndexWriter.java:205)  
> > > > > at org.apache.lucene.util.IOUtils.close(IOUtils.java:140)  
> > > > > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsWriter.  
> > > > > close(CompressingStoredFieldsWriter.java:138)  
> > > > > at org.apache.lucene.index.SegmentMerger.mergeFields(SegmentMer  
> > > > > ger.java:318)  
> > > > > at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:94)  
> > > > > at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.  
> > > > > java:4071)  
> > > > > at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3668)  
> > > > > at org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(Con  
> > > > > currentMergeScheduler.java:405)  
> > > > > at org.apache.lucene.index.TrackingConcurrentMergeScheduler.doMerge(  
> > > > > TrackingConcurrentMergeScheduler.java:107)  
> > > > > at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(  
> > > > > ConcurrentMergeScheduler.java:482)  
> > > > > [2014-03-26 03:30:53,382][WARN][index.engine.internal] [Rick  
> > > > > Jones] [qusion][1] failed engine
> > > > 
> > > > Obviously, there need to have some amount of disk during the merge.  
> > > > And I think the larger index size, the more disk space needed for the  
> > > > merge operation.
> > > > 
> > > > Does anyone have the idea how much does it can be?
> > > > 
> > > > Ivan
> > > 
> > > --  
> > > You received this message because you are subscribed to the Google  
> > > Groups "elasticsearch" group.  
> > > To unsubscribe from this group and stop receiving emails from it, send  
> > > an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com).  
> > > To view this discussion on the web visit [https://groups.google.com/d/](https://groups.google.com/d/)  
> > > msgid/elasticsearch/448ff632-0462-436f-b0cf-5a943b8db50f%  
> > > [40googlegroups.com](http://40googlegroups.com)[https://groups.google.com/d/msgid/elasticsearch/448ff632-0462-436f-b0cf-5a943b8db50f%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/448ff632-0462-436f-b0cf-5a943b8db50f%40googlegroups.com?utm_medium=email&utm_source=footer)  
> > > .
> > > 
> > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).
> > 
> > --  
> > You received this message because you are subscribed to the Google Groups  
> > "elasticsearch" group.  
> > To unsubscribe from this group and stop receiving emails from it, send an  
> > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> > To view this discussion on the web visit  
> > [https://groups.google.com/d/msgid/elasticsearch/c55ca5dd-f649-4a2c-ba65-6afb2aab0583%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/c55ca5dd-f649-4a2c-ba65-6afb2aab0583%40googlegroups.com)[https://groups.google.com/d/msgid/elasticsearch/c55ca5dd-f649-4a2c-ba65-6afb2aab0583%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/c55ca5dd-f649-4a2c-ba65-6afb2aab0583%40googlegroups.com?utm_medium=email&utm_source=footer)  
> > .
> 
> For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAEM624YiasugLk6L9SsMoESOJvfUA3FzGwKJk0mTDe-FRHSy2Q%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAEM624YiasugLk6L9SsMoESOJvfUA3FzGwKJk0mTDe-FRHSy2Q%40mail.gmail.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![Ivan](https://avatars.discourse-cdn.com/v4/letter/i/df788c/32.png) [@Ivan](https://discuss.elastic.co/u/Ivan)\
**Post date:** [March 26, 2014, 4:06pm UTC](https://discuss.elastic.co/t/how-many-available-disk-space-need-for-normal-system-running/16603/6 "2014-03-26T16:06:03Z")

</div>

Lucene segments are immutable, so while segments are merged, the originals  
remain in place. You can increase the number of segments you have so that  
less merging needs to occur. Mike McCandless has lots of good tips about  
merges:

> **[Visualizing Lucene's segment merges](https://blog.mikemccandless.com/2011/02/visualizing-lucenes-segment-merges.html)**
>
> If you've ever wondered how Lucene picks segments to merge during indexing, it looks something like this: That video displays segment merges...

--  
Ivan

On Wed, Mar 26, 2014 at 4:11 AM, Mark Walkom [markw@campaignmonitor.com](mailto:markw@campaignmonitor.com)wrote:

> There's not much you can do, you either need to delete some data or  
> increase your disk space.
> 
> Maybe someone can clarify how much space is needed for a merge, but I  
> imagine it'd be twice the size of a shard.
> 
> Regards,  
> Mark Walkom
> 
> Infrastructure Engineer  
> Campaign Monitor  
> email: [markw@campaignmonitor.com](mailto:markw@campaignmonitor.com)  
> web: [www.campaignmonitor.com](http://www.campaignmonitor.com)
> 
> On 26 March 2014 22:01, Ivan Ji [hxuanji@gmail.com](mailto:hxuanji@gmail.com) wrote:
> 
> > Hi Mark,
> > 
> > My index size is about 300GB, the free disk space is about 5G.
> > 
> > Mark Walkom於 2014年3月26日星期三UTC+8下午6時18分12秒寫道：
> > 
> > > Depends on how much data you have.
> > > 
> > > How much disk space is on the machine? How much data is in ES?
> > > 
> > > Regards,  
> > > Mark Walkom
> > > 
> > > Infrastructure Engineer  
> > > Campaign Monitor  
> > > email: [ma...@campaignmonitor.com](mailto:ma...@campaignmonitor.com)  
> > > web: [www.campaignmonitor.com](http://www.campaignmonitor.com)
> > > 
> > > On 26 March 2014 21:06, Ivan Ji [hxu...@gmail.com](mailto:hxu...@gmail.com) wrote:
> > > 
> > > > I just looked up the lucene's document. during the merge, there at  
> > > > least need double the index size.  
> > > > But does ES tune something on it ? or it just follow the lucene's rule,  
> > > > that is 2x the index size.
> > > > 
> > > > Ivan Ji於 2014年3月26日星期三UTC+8下午5時53分33秒寫道：
> > > > 
> > > > > Hi all,
> > > > > 
> > > > > I am using ES 1.0.1. I am wondering how many un-used disk space needed  
> > > > > for the ES's system running?
> > > > > 
> > > > > Because I ran into the error:
> > > > > 
> > > > > [2014-03-26 03:30:52,713][WARN][index.merge.scheduler] [Rick
> > > > > 
> > > > > > Jones] [qusion][1] failed to merge  
> > > > > > java.io.IOException: No space left on device  
> > > > > > at java.io.RandomAccessFile.writeBytes0(Native Method)  
> > > > > > at java.io.RandomAccessFile.writeBytes(RandomAccessFile.java:520)  
> > > > > > at java.io.RandomAccessFile.write(RandomAccessFile.java:550)  
> > > > > > at org.apache.lucene.store.FSDirectory$FSIndexOutput.flushBuffe  
> > > > > > r(FSDirectory.java:458)  
> > > > > > at org.apache.lucene.store.RateLimitedFSDirectory$RateLimitedIn  
> > > > > > dexOutput.flushBuffer(RateLimitedFSDirectory.java:102)  
> > > > > > at org.apache.lucene.store.BufferedChecksumIndexOutput.flushBuffer(  
> > > > > > BufferedChecksumIndexOutput.java:71)  
> > > > > > at org.apache.lucene.store.BufferedIndexOutput.flushBuffer(Buff  
> > > > > > eredIndexOutput.java:113)  
> > > > > > at org.apache.lucene.store.BufferedIndexOutput.flush(BufferedIn  
> > > > > > dexOutput.java:102)  
> > > > > > at org.apache.lucene.store.BufferedChecksumIndexOutput.flush(Bu  
> > > > > > fferedChecksumIndexOutput.java:86)  
> > > > > > at org.apache.lucene.store.BufferedIndexOutput.close(BufferedIn  
> > > > > > dexOutput.java:126)  
> > > > > > at org.apache.lucene.store.BufferedChecksumIndexOutput.close(Bu  
> > > > > > fferedChecksumIndexOutput.java:61)  
> > > > > > at org.elasticsearch.index.store.Store$StoreIndexOutput.close(S  
> > > > > > tore.java:602)  
> > > > > > at org.apache.lucene.codecs.compressing.CompressingStoredFields  
> > > > > > IndexWriter.close(CompressingStoredFieldsIndexWriter.java:205)  
> > > > > > at org.apache.lucene.util.IOUtils.close(IOUtils.java:140)  
> > > > > > at org.apache.lucene.codecs.compressing.CompressingStoredFields  
> > > > > > Writer.close(CompressingStoredFieldsWriter.java:138)  
> > > > > > at org.apache.lucene.index.SegmentMerger.mergeFields(SegmentMer  
> > > > > > ger.java:318)  
> > > > > > at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:94)  
> > > > > > at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.  
> > > > > > java:4071)  
> > > > > > at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3668)  
> > > > > > at org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(Con  
> > > > > > currentMergeScheduler.java:405)  
> > > > > > at org.apache.lucene.index.TrackingConcurrentMergeScheduler.doMerge(  
> > > > > > TrackingConcurrentMergeScheduler.java:107)  
> > > > > > at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(  
> > > > > > ConcurrentMergeScheduler.java:482)  
> > > > > > [2014-03-26 03:30:53,382][WARN][index.engine.internal] [Rick  
> > > > > > Jones] [qusion][1] failed engine
> > > > > 
> > > > > Obviously, there need to have some amount of disk during the merge.  
> > > > > And I think the larger index size, the more disk space needed for the  
> > > > > merge operation.
> > > > > 
> > > > > Does anyone have the idea how much does it can be?
> > > > > 
> > > > > Ivan
> > > > 
> > > > --  
> > > > You received this message because you are subscribed to the Google  
> > > > Groups "elasticsearch" group.  
> > > > To unsubscribe from this group and stop receiving emails from it, send  
> > > > an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com).  
> > > > To view this discussion on the web visit [https://groups.google.com/d/](https://groups.google.com/d/)  
> > > > msgid/elasticsearch/448ff632-0462-436f-b0cf-5a943b8db50f%  
> > > > [40googlegroups.com](http://40googlegroups.com)[https://groups.google.com/d/msgid/elasticsearch/448ff632-0462-436f-b0cf-5a943b8db50f%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/448ff632-0462-436f-b0cf-5a943b8db50f%40googlegroups.com?utm_medium=email&utm_source=footer)  
> > > > .
> > > > 
> > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).
> > > 
> > > --  
> > > You received this message because you are subscribed to the Google Groups  
> > > "elasticsearch" group.  
> > > To unsubscribe from this group and stop receiving emails from it, send an  
> > > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> > > To view this discussion on the web visit  
> > > [https://groups.google.com/d/msgid/elasticsearch/c55ca5dd-f649-4a2c-ba65-6afb2aab0583%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/c55ca5dd-f649-4a2c-ba65-6afb2aab0583%40googlegroups.com)[https://groups.google.com/d/msgid/elasticsearch/c55ca5dd-f649-4a2c-ba65-6afb2aab0583%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/c55ca5dd-f649-4a2c-ba65-6afb2aab0583%40googlegroups.com?utm_medium=email&utm_source=footer)  
> > > .
> > 
> > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).
> 
> --  
> You received this message because you are subscribed to the Google Groups  
> "elasticsearch" group.  
> To unsubscribe from this group and stop receiving emails from it, send an  
> email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> To view this discussion on the web visit  
> [https://groups.google.com/d/msgid/elasticsearch/CAEM624YiasugLk6L9SsMoESOJvfUA3FzGwKJk0mTDe-FRHSy2Q%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAEM624YiasugLk6L9SsMoESOJvfUA3FzGwKJk0mTDe-FRHSy2Q%40mail.gmail.com)[https://groups.google.com/d/msgid/elasticsearch/CAEM624YiasugLk6L9SsMoESOJvfUA3FzGwKJk0mTDe-FRHSy2Q%40mail.gmail.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/CAEM624YiasugLk6L9SsMoESOJvfUA3FzGwKJk0mTDe-FRHSy2Q%40mail.gmail.com?utm_medium=email&utm_source=footer)  
> .
> 
> For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CALY%3DcQB1v\_HoDTjjOEc6tELY%3DX2WLjupDfHyOz3PYLuRT5d44g%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CALY%3DcQB1v_HoDTjjOEc6tELY%3DX2WLjupDfHyOz3PYLuRT5d44g%40mail.gmail.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![jprante](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jprante/32/44941_2.png) [@jprante](https://discuss.elastic.co/u/jprante)\
**Post date:** [March 26, 2014, 8:16pm UTC](https://discuss.elastic.co/t/how-many-available-disk-space-need-for-normal-system-running/16603/7 "2014-03-26T20:16:29Z")

</div>

You should have 300G free if your index is 300G, for copy over in the  
process of creating new segments.

Jörg

On Wed, Mar 26, 2014 at 12:01 PM, Ivan Ji [hxuanji@gmail.com](mailto:hxuanji@gmail.com) wrote:

> Hi Mark,
> 
> My index size is about 300GB, the free disk space is about 5G.

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAKdsXoHt6WLGNN0O7nDJhxu0xxPoZwsmkFy8swyCNDQukGEj6w%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAKdsXoHt6WLGNN0O7nDJhxu0xxPoZwsmkFy8swyCNDQukGEj6w%40mail.gmail.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 1:40am UTC](https://discuss.elastic.co/t/how-many-available-disk-space-need-for-normal-system-running/16603/8 "2017-07-06T01:40:21Z")

</div>