# Delete returns IndexMissingException but Index creation hangs

**URL:** https://discuss.elastic.co/t/delete-returns-indexmissingexception-but-index-creation-hangs/14076
**Category:** Elasticsearch
**Created:** [October 23, 2013, 3:19pm UTC](https://discuss.elastic.co/t/delete-returns-indexmissingexception-but-index-creation-hangs/14076 "2013-10-23T15:19:52Z")
**Posts on this page:** 6
**Page:** 1

<div class="post-metadata">

### Author: ![Ashish\_Nigam\_3](https://avatars.discourse-cdn.com/v4/letter/a/f19dbf/32.png) [@Ashish\_Nigam\_3](https://discuss.elastic.co/u/Ashish_Nigam_3)
#### Post date: [October 23, 2013, 3:19pm UTC](https://discuss.elastic.co/t/delete-returns-indexmissingexception-but-index-creation-hangs/14076/1 "2013-10-23T15:19:52Z")

</div>

Hi,  
Lately, I am noticing following use case for few of the indexes in the  
cluster -

When I issue curl DELETE command, cluster comes up with the response that  
index does not exist.

curl -XDELETE '[http://10.0.1.1:9200/du\_shnindex\_14141\_2013\_9/](http://10.0.1.1:9200/du_shnindex_14141_2013_9/)'  
{"error":"IndexMissingException[[du\_shnindex\_14141\_2013\_9]  
missing]","status":404}

But when I issue index creation command, it just hangs.  
This command just hangs and would eventually timeout.

curl -XPUT '[http://10.0.1.1:9200/du\_shnindex\_14141\_2013\_9/](http://10.0.1.1:9200/du_shnindex_14141_2013_9/)'

Why would this happen? I also looked at index folders to check if there are  
any index files but I do not see this index in any node.

Please let me know how can I fix it. I am using 0.19.8 version.

Thanks  
Ashish

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

### Author: ![jprante](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jprante/32/44941_2.png) [@jprante](https://discuss.elastic.co/u/jprante)
#### Post date: [October 23, 2013, 3:27pm UTC](https://discuss.elastic.co/t/delete-returns-indexmissingexception-but-index-creation-hangs/14076/2 "2013-10-23T15:27:25Z")

</div>

There is something blocking the cluster, you have to locate the node having  
a problem, and find out the cause by examining the logs. Easiest way to  
cope with this is restarting the locked node. There are also many  
monitoring tools you can use to watch for the cluster nodes working ok.

Jörg

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

### Author: ![Ashish\_Nigam\_3](https://avatars.discourse-cdn.com/v4/letter/a/f19dbf/32.png) [@Ashish\_Nigam\_3](https://discuss.elastic.co/u/Ashish_Nigam_3)
#### Post date: [October 23, 2013, 3:37pm UTC](https://discuss.elastic.co/t/delete-returns-indexmissingexception-but-index-creation-hangs/14076/3 "2013-10-23T15:37:28Z")

</div>

Thanks.  
I actually restarted the whole cluster and still I am facing same problem  
with that particular index.  
Please help me understand what can I look for in the logs to know if it is  
blocking the cluster.

Another data point is I have 200+ unassigned shards in the cluster at  
present and status is Red.  
And I see that master node logs are churning out these lines for all those  
shards

][WARN][cluster.action.shard] [shn-sjc-prod-v-enod4] received shard  
failed for [shnindex\_11284\_2013\_9][2], node[1vdpicj6TOubMHOgHjy4PQ], [P],  
s[INITIALIZING], reas  
on [Failed to start shard, message  
[IndexShardGatewayRecoveryException[[shnindex\_11284\_2013\_9][2] shard  
allocated for local recovery (post api), should exists, but doesn't]]]

This has been happening since last two weeks now. This is yet another  
problem I am facing with the cluster. But the fact that I am not able to  
re-create some of those indexes, is blocking me to reindex data from DB.

On Wed, Oct 23, 2013 at 8:27 AM, [joergprante@gmail.com](mailto:joergprante@gmail.com) \<  
[joergprante@gmail.com](mailto:joergprante@gmail.com)\> wrote:

> There is something blocking the cluster, you have to locate the node  
> having a problem, and find out the cause by examining the logs. Easiest way  
> to cope with this is restarting the locked node. There are also many  
> monitoring tools you can use to watch for the cluster nodes working ok.
> 
> Jörg
> 
> --  
> You received this message because you are subscribed to the Google Groups  
> "elasticsearch" group.  
> To unsubscribe from this group and stop receiving emails from it, send an  
> email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

### Author: ![jprante](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jprante/32/44941_2.png) [@jprante](https://discuss.elastic.co/u/jprante)
#### Post date: [October 23, 2013, 4:21pm UTC](https://discuss.elastic.co/t/delete-returns-indexmissingexception-but-index-creation-hangs/14076/4 "2013-10-23T16:21:39Z")

</div>

I thought so the cluster is red.

You should dig in the logs to make sure what happened. Maybe OOM, maybe no  
file descriptors, maybe out of disk space, maybe external issues of the OS.  
Maybe you find no message at all.

From the recovery message, ES can't find a shard at it's supposed location,  
which is fatal, and bails out. It is shnindex\_11284\_2013\_9 shard Id 2 on  
node 1vdpicj6TOubMHOgHjy4PQ. If you have replica for this shard, you can  
try to remove the broken shard or broken index and hope ES can pick up the  
replicated index.

A red cluster can not process index deletions of course.

Jörg

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

### Author: ![Ashish\_Nigam\_3](https://avatars.discourse-cdn.com/v4/letter/a/f19dbf/32.png) [@Ashish\_Nigam\_3](https://discuss.elastic.co/u/Ashish_Nigam_3)
#### Post date: [October 23, 2013, 6:46pm UTC](https://discuss.elastic.co/t/delete-returns-indexmissingexception-but-index-creation-hangs/14076/5 "2013-10-23T18:46:31Z")

</div>

If I can't delete an index, then is there any other way to fix the index?  
I need to re-populate the data from DB.

On Wed, Oct 23, 2013 at 9:21 AM, [joergprante@gmail.com](mailto:joergprante@gmail.com) \<  
[joergprante@gmail.com](mailto:joergprante@gmail.com)\> wrote:

> I thought so the cluster is red.
> 
> You should dig in the logs to make sure what happened. Maybe OOM, maybe no  
> file descriptors, maybe out of disk space, maybe external issues of the OS.  
> Maybe you find no message at all.
> 
> From the recovery message, ES can't find a shard at it's supposed  
> location, which is fatal, and bails out. It is shnindex\_11284\_2013\_9  
> shard Id 2 on node 1vdpicj6TOubMHOgHjy4PQ. If you have replica for this  
> shard, you can try to remove the broken shard or broken index and hope ES  
> can pick up the replicated index.
> 
> A red cluster can not process index deletions of course.
> 
> Jörg
> 
> --  
> You received this message because you are subscribed to the Google Groups  
> "elasticsearch" group.  
> To unsubscribe from this group and stop receiving emails from it, send an  
> email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out).

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [July 6, 2017, 2:10am UTC](https://discuss.elastic.co/t/delete-returns-indexmissingexception-but-index-creation-hangs/14076/6 "2017-07-06T02:10:59Z")

</div>


