# Strange errors while indexing documents

**URL:** <https://discuss.elastic.co/t/strange-errors-while-indexing-documents/24978>\
**Category:** Elasticsearch\
**Created:** [July 6, 2015, 7:15pm UTC](https://discuss.elastic.co/t/strange-errors-while-indexing-documents/24978 "2015-07-06T19:15:41Z")\
**Posts on this page:** 7\
**Page:** 1

<div class="post-metadata">

**Author:** ![Srinath\_C](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/srinath_c/32/48806_2.png) [@Srinath\_C](https://discuss.elastic.co/u/Srinath_C)\
**Post date:** [July 6, 2015, 7:15pm UTC](https://discuss.elastic.co/t/strange-errors-while-indexing-documents/24978/1 "2015-07-06T19:15:41Z")

</div>

Hi,

We've been observing some strange exceptions in our cluster. Some of the instances are throwing up exceptions like the ones below. We are running a 6 node cluster with ES 1.3.0. Data is being pushed to ES via a storm cluster.

Any clues as to what these exceptions mean and how to overcome?

[2015-07-03 12:24:19,611][WARN][index.store] [metrics-datastore-1-QA2906-perf] [qaautomation3-4-1250537325][1] Can't open file to read checksums  
java.io.FileNotFoundException: No such file [\_pmi.fdt]  
at org.elasticsearch.index.store.DistributorDirectory.getDirectory(DistributorDirectory.java:173)  
at org.elasticsearch.index.store.DistributorDirectory.getDirectory(DistributorDirectory.java:144)  
at org.elasticsearch.index.store.DistributorDirectory.openInput(DistributorDirectory.java:130)  
at org.elasticsearch.index.store.Store$MetadataSnapshot.checksumFromLuceneFile(Store.java:532)  
at org.elasticsearch.index.store.Store$MetadataSnapshot.buildMetadata(Store.java:459)  
at org.elasticsearch.index.store.Store$MetadataSnapshot.(Store.java:433)  
at org.elasticsearch.index.store.Store.getMetadata(Store.java:144)  
at org.elasticsearch.indices.cluster.IndicesClusterStateService.applyInitializingShard(IndicesClusterStateService.java:724)  
at org.elasticsearch.indices.cluster.IndicesClusterStateService.applyNewOrUpdatedShards(IndicesClusterStateService.java:576)  
at org.elasticsearch.indices.cluster.IndicesClusterStateService.clusterChanged(IndicesClusterStateService.java:183)  
at org.elasticsearch.cluster.service.InternalClusterService$UpdateTask.run(InternalClusterService.java:444)  
at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:153)  
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)  
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)  
at java.lang.Thread.run(Thread.java:745)

---

<div class="post-metadata">

**Author:** ![nik9000](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/nik9000/32/44947_2.png) [@nik9000](https://discuss.elastic.co/u/nik9000)\
**Post date:** [July 6, 2015, 7:31pm UTC](https://discuss.elastic.co/t/strange-errors-while-indexing-documents/24978/2 "2015-07-06T19:31:34Z")

</div>

Looks like something nuked that file directory out from under the elasticsearch process.

---

<div class="post-metadata">

**Author:** ![Srinath\_C](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/srinath_c/32/48806_2.png) [@Srinath\_C](https://discuss.elastic.co/u/Srinath_C)\
**Post date:** [July 7, 2015, 12:49am UTC](https://discuss.elastic.co/t/strange-errors-while-indexing-documents/24978/3 "2015-07-07T00:49:55Z")

</div>

These are production systems with very limited access. Any other reasons?  
Its probably worth mentioning - its a cluster of 6 c3.xlarge instances with data being stored on EBS with 1000 provisioned IOPs.

---

<div class="post-metadata">

**Author:** ![Srinath\_C](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/srinath_c/32/48806_2.png) [@Srinath\_C](https://discuss.elastic.co/u/Srinath_C)\
**Post date:** [July 10, 2015, 4:05am UTC](https://discuss.elastic.co/t/strange-errors-while-indexing-documents/24978/4 "2015-07-10T04:05:32Z")

</div>

This issue has been reproduced repeatedly. Would appreciate any kind of help or pointers.

---

<div class="post-metadata">

**Author:** ![nik9000](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/nik9000/32/44947_2.png) [@nik9000](https://discuss.elastic.co/u/nik9000)\
**Post date:** [July 10, 2015, 4:48pm UTC](https://discuss.elastic.co/t/strange-errors-while-indexing-documents/24978/5 "2015-07-10T16:48:35Z")

</div>

Its beyond me, sorry!

---

<div class="post-metadata">

**Author:** ![Srinath\_C](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/srinath_c/32/48806_2.png) [@Srinath\_C](https://discuss.elastic.co/u/Srinath_C)\
**Post date:** [July 12, 2015, 5:48pm UTC](https://discuss.elastic.co/t/strange-errors-while-indexing-documents/24978/6 "2015-07-12T17:48:51Z")

</div>

Anyone from elastic team? How can I get any inputs on this?

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 12:02am UTC](https://discuss.elastic.co/t/strange-errors-while-indexing-documents/24978/7 "2017-07-06T00:02:00Z")

</div>


