# Indices gone after upgrade (7.8.0 to 7.9.1)

**URL:** https://discuss.elastic.co/t/indices-gone-after-upgrade-7-8-0-to-7-9-1/254149
**Category:** Elasticsearch
**Created:** [November 3, 2020, 12:07pm UTC](https://discuss.elastic.co/t/indices-gone-after-upgrade-7-8-0-to-7-9-1/254149 "2020-11-03T12:07:27Z")
**Posts on this page:** 7
**Page:** 1

<div class="post-metadata">

### Author: ![rcz](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/rcz/32/59428_2.png) [@rcz](https://discuss.elastic.co/u/rcz)
#### Post date: [November 3, 2020, 12:07pm UTC](https://discuss.elastic.co/t/indices-gone-after-upgrade-7-8-0-to-7-9-1/254149/1 "2020-11-03T12:07:28Z")

</div>

Hello,

I'm in a bit of a pickle. A lot of my indices are gone after an upgrade.

I have a Logstash pumping in data into an alias.  
The alias still pointed to the same index name after upgrading, but the old data was gone. It has just made a new index.  
The indices were rolled every 2 days, and all the previous indices are gone as well.  
Not _all_ indices are gone, but I can't find any managed indices from the past few months.

I'm fairly confident that the raw files are still there, since I have about 2.5 TB of index data distributed across my 3 nodes.  
I don't think anything was _deleted_.

**Is there any way to recover indices from disk?**  
Any help is greatly apprecieated!

Thanks,  
Martin

---

<div class="post-metadata">

### Author: ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)
#### Post date: [November 4, 2020, 6:22am UTC](https://discuss.elastic.co/t/indices-gone-after-upgrade-7-8-0-to-7-9-1/254149/2 "2020-11-04T06:22:06Z")

</div>

How did you do the upgrade?

---

<div class="post-metadata">

### Author: ![rcz](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/rcz/32/59428_2.png) [@rcz](https://discuss.elastic.co/u/rcz)
#### Post date: [November 4, 2020, 10:13am UTC](https://discuss.elastic.co/t/indices-gone-after-upgrade-7-8-0-to-7-9-1/254149/3 "2020-11-04T10:13:58Z")

</div>

Hi Mark. I did the upgrade as I've done many times (per node):

1. Disable shard reallocation
2. Upgrade RPM package
3. Restart Elasticsearch service
4. Enable shard reallocation
5. Wait for cluster to report green health

It is a 3 node cluster with each node having all features enabled (all masters).  
Is it possible to recover indices from disk?

---

<div class="post-metadata">

### Author: ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)
#### Post date: [November 4, 2020, 9:47pm UTC](https://discuss.elastic.co/t/indices-gone-after-upgrade-7-8-0-to-7-9-1/254149/4 "2020-11-04T21:47:44Z")

</div>

Can you try using [https://www.elastic.co/guide/en/elasticsearch/reference/7.9/dangling-indices-list.html](https://www.elastic.co/guide/en/elasticsearch/reference/7.9/dangling-indices-list.html)?

---

<div class="post-metadata">

### Author: ![rcz](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/rcz/32/59428_2.png) [@rcz](https://discuss.elastic.co/u/rcz)
#### Post date: [November 5, 2020, 9:08am UTC](https://discuss.elastic.co/t/indices-gone-after-upgrade-7-8-0-to-7-9-1/254149/5 "2020-11-05T09:08:50Z")

</div>

There seems to be no dangling indices:

```json
# GET /_dangling
{
  "_nodes" : {
    "total" : 3,
    "successful" : 3,
    "failed" : 0
  },
  "cluster_name" : "clm",
  "dangling_indices" : []
}

```

---

<div class="post-metadata">

### Author: ![rcz](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/rcz/32/59428_2.png) [@rcz](https://discuss.elastic.co/u/rcz)
#### Post date: [November 9, 2020, 3:05pm UTC](https://discuss.elastic.co/t/indices-gone-after-upgrade-7-8-0-to-7-9-1/254149/6 "2020-11-09T15:05:55Z")

</div>

Hi again @warkolm,

I found backups of the data directories of each node. They are full filesystem backups. Now I'm wondering which method would be best for restoring those backups.

First I thought I could simply copy all the files (`nodes` directory) over, but now I'm worried what will happen as the index names will probably clash - at least for the newest index of the lost data/first index of new data..?

Another option I see would be to start up a single-node ES cluster with the combined data directories of the 3 backups and then transfer the old indices through snapshots.  
Or maybe it's better to make snapshots of the new data, fully restore the backups, and then restore the snapshots.

What would you suggest?  
Any help is greatly appreciated!

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [December 7, 2020, 3:05pm UTC](https://discuss.elastic.co/t/indices-gone-after-upgrade-7-8-0-to-7-9-1/254149/7 "2020-12-07T15:05:56Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
