# Index got corrupted without any crash

**URL:** https://discuss.elastic.co/t/index-got-corrupted-without-any-crash/240895
**Category:** Elasticsearch
**Created:** [July 13, 2020, 6:40am UTC](https://discuss.elastic.co/t/index-got-corrupted-without-any-crash/240895 "2020-07-13T06:40:07Z")
**Posts on this page:** 10
**Page:** 1

<div class="post-metadata">

### Author: ![chelawatankit](https://avatars.discourse-cdn.com/v4/letter/c/3da27b/32.png) [@chelawatankit](https://discuss.elastic.co/u/chelawatankit)
#### Post date: [July 13, 2020, 6:40am UTC](https://discuss.elastic.co/t/index-got-corrupted-without-any-crash/240895/1 "2020-07-13T06:40:07Z")

</div>

Hi,

We have one single node elastic cluster which was running fine till last week. From last week we saw frequently one index got corrupted and went in 'RED' state without any system crash and disk space problem.

When I see a particular index folder I found one corrupted\_\* file was present with following error

?×lstore Ð  
&failed engine (reason: [merge failed])Gchecksum failed (hardware problem?) : expected=8544add4 actual=77fd1c54©BufferedChecksumIndexInput(MMapIndexInput(path="C:\Program Files\Klera\elasticsearch\data\nodes\0\indices\pVdJlhg2SMSA9sjWUtROMA\0\index\_38mus.cfs") [slice=\_38mus.fdt])

Our team also diagnose hardware and found everything is fine.

Please suggest how to resolve this problem.

Thanks in advance.

---

<div class="post-metadata">

### Author: ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)
#### Post date: [July 13, 2020, 6:44am UTC](https://discuss.elastic.co/t/index-got-corrupted-without-any-crash/240895/2 "2020-07-13T06:44:44Z")

</div>

Which version of Elasticsearch are you using? Which operating system? What kind of storage are you using?

---

<div class="post-metadata">

### Author: ![chelawatankit](https://avatars.discourse-cdn.com/v4/letter/c/3da27b/32.png) [@chelawatankit](https://discuss.elastic.co/u/chelawatankit)
#### Post date: [July 13, 2020, 6:49am UTC](https://discuss.elastic.co/t/index-got-corrupted-without-any-crash/240895/3 "2020-07-13T06:49:58Z")

</div>

Hi,

Please find details of system as follow.

Elasticsearch :- 7.1.1  
OS :- Window server 2019 standard  
Storage type :- file system (SSD drive).  
RAM :- 32 GB

We are using single node elastic cluster with configuration  
-Xms4g  
-Xmx4g  
-XX:MaxDirectMemorySize=1g

---

<div class="post-metadata">

### Author: ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)
#### Post date: [July 13, 2020, 6:53am UTC](https://discuss.elastic.co/t/index-got-corrupted-without-any-crash/240895/4 "2020-07-13T06:53:01Z")

</div>

I recall seeing some report related to corruption in some Linux kernels but have no experience with running Elasticsearch on Windows.

---

<div class="post-metadata">

### Author: ![chelawatankit](https://avatars.discourse-cdn.com/v4/letter/c/3da27b/32.png) [@chelawatankit](https://discuss.elastic.co/u/chelawatankit)
#### Post date: [July 13, 2020, 6:56am UTC](https://discuss.elastic.co/t/index-got-corrupted-without-any-crash/240895/5 "2020-07-13T06:56:12Z")

</div>

Thanks @Christian_Dahlqvist.

What can be a possible cause of such a type of corruption? Can you give me some direction so that I can check and identify the reasons for this?

---

<div class="post-metadata">

### Author: ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)
#### Post date: [July 13, 2020, 6:58am UTC](https://discuss.elastic.co/t/index-got-corrupted-without-any-crash/240895/6 "2020-07-13T06:58:13Z")

</div>

I do not know. I would recommend deleting the corrupt index and restoring it from a snapshot.

---

<div class="post-metadata">

### Author: ![chelawatankit](https://avatars.discourse-cdn.com/v4/letter/c/3da27b/32.png) [@chelawatankit](https://discuss.elastic.co/u/chelawatankit)
#### Post date: [July 13, 2020, 7:18am UTC](https://discuss.elastic.co/t/index-got-corrupted-without-any-crash/240895/7 "2020-07-13T07:18:23Z")

</div>

Actually when I removed that corrupted\_\* file from folder and start the elasticsearch index recovered and work fine for some time.

Can you suggest someone who can help me in this problem.

Thanks

---

<div class="post-metadata">

### Author: ![DavidTurner](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/davidturner/32/22453_2.png) [@DavidTurner](https://discuss.elastic.co/u/DavidTurner)
#### Post date: [July 13, 2020, 7:23am UTC](https://discuss.elastic.co/t/index-got-corrupted-without-any-crash/240895/8 "2020-07-13T07:23:15Z")

</div>

Don't ever delete or otherwise alter the contents of the data directory yourself.

This index was found to be corrupt, almost certainly due to a hardware issue as the message suggests. Disks are nowhere near 100% reliable so this will happen from time to time, and with a single node there's no way for Elasticsearch to recover your data itself. The index may well still be corrupt but Elasticsearch is ignoring it for now because you fiddled with the contents of the data path yourself.

---

<div class="post-metadata">

### Author: ![chelawatankit](https://avatars.discourse-cdn.com/v4/letter/c/3da27b/32.png) [@chelawatankit](https://discuss.elastic.co/u/chelawatankit)
#### Post date: [July 13, 2020, 7:41am UTC](https://discuss.elastic.co/t/index-got-corrupted-without-any-crash/240895/9 "2020-07-13T07:41:16Z")

</div>

Thanks @DavidTurner

> [@DavidTurner](#):
>
> Don't ever delete or otherwise alter the contents of the data directory yourself.

I will take care of it.

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [August 10, 2020, 7:41am UTC](https://discuss.elastic.co/t/index-got-corrupted-without-any-crash/240895/10 "2020-08-10T07:41:22Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
