# Upgrading ES from 1.7.1 to 2.x Issue

**URL:** <https://discuss.elastic.co/t/upgrading-es-from-1-7-1-to-2-x-issue/35997>\
**Category:** Elasticsearch\
**Created:** [December 1, 2015, 7:57am UTC](https://discuss.elastic.co/t/upgrading-es-from-1-7-1-to-2-x-issue/35997 "2015-12-01T07:57:30Z")\
**Posts on this page:** 20\
**Page:** 1

<div class="post-metadata">

**Author:** ![adviqosupport](https://avatars.discourse-cdn.com/v4/letter/a/9dc877/32.png) [@adviqosupport](https://discuss.elastic.co/u/adviqosupport)\
**Post date:** [December 1, 2015, 7:57am UTC](https://discuss.elastic.co/t/upgrading-es-from-1-7-1-to-2-x-issue/35997/1 "2015-12-01T07:57:30Z")

</div>

Hi all,

yesterday i started a roughly update to ES 2.1 from 1.7.1.  
As purposed i made a complete cluster restart.

During the bootup ES throw some WARN which tells me that no master is known for my indices and other errors which tell me i went really unprepared to this major release upgrade.  
As is was not able to fix i rolled back to 1.7.1.

Unfortunately ES now lost all my indices. The data is still persistent on the file system.  
So how can i can get this data back into my ES?

Any ideas or suggestions?

Cheers,

Ricardo

ps.: I know what i've done was extremly stupid i just hope for anyone maybe knowing some steps retrieving the data.

---

<div class="post-metadata">

**Author:** ![adviqosupport](https://avatars.discourse-cdn.com/v4/letter/a/9dc877/32.png) [@adviqosupport](https://discuss.elastic.co/u/adviqosupport)\
**Post date:** [December 1, 2015, 8:04am UTC](https://discuss.elastic.co/t/upgrading-es-from-1-7-1-to-2-x-issue/35997/2 "2015-12-01T08:04:43Z")

</div>

One of the Warnings thrown.

`[2015-11-30 14:10:12,463][INFO][env] [node-name] using [1] data paths, mounts [[/data/elasticsearch (/dev/mapper/vg_1-datavol)]], net usable_space [350.2gb], net total_space [1.4tb], types [ext4] [2015-11-30 14:10:15,592][ERROR][gateway.local.state.shards] [node-name] failed to read local state (started shards), exiting... org.elasticsearch.ElasticsearchException: unexpected field in shard state [index_uuid] ......`

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [December 1, 2015, 8:13am UTC](https://discuss.elastic.co/t/upgrading-es-from-1-7-1-to-2-x-issue/35997/3 "2015-12-01T08:13:57Z")

</div>

You can not rollback when you started to upgrade.

You should try to make it work with 2.1 and if not possible I'm afraid you have to reindex.

But may be you ran a Snapshot before starting the upgrade process so you could restore?

---

<div class="post-metadata">

**Author:** ![adviqosupport](https://avatars.discourse-cdn.com/v4/letter/a/9dc877/32.png) [@adviqosupport](https://discuss.elastic.co/u/adviqosupport)\
**Post date:** [December 1, 2015, 9:15am UTC](https://discuss.elastic.co/t/upgrading-es-from-1-7-1-to-2-x-issue/35997/4 "2015-12-01T09:15:17Z")

</div>

Hi, thanks for your fast reply.

Yeah.. as i said i made a really poor performance when "planning" the upgrade, so no snapshot.

i just split out one single node out of the cluster to try reindex.

There is still the issue that even ES 2.1 does not see any indices.  
Is there any possibility to put the data back into ES, repair those crushed indices or else?

thanks in advance,

Ricardo

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [December 1, 2015, 9:32am UTC](https://discuss.elastic.co/t/upgrading-es-from-1-7-1-to-2-x-issue/35997/5 "2015-12-01T09:32:34Z")

</div>

But what is the issue with 2.1? Do you have logs?

---

<div class="post-metadata">

**Author:** ![adviqosupport](https://avatars.discourse-cdn.com/v4/letter/a/9dc877/32.png) [@adviqosupport](https://discuss.elastic.co/u/adviqosupport)\
**Post date:** [December 1, 2015, 9:40am UTC](https://discuss.elastic.co/t/upgrading-es-from-1-7-1-to-2-x-issue/35997/6 "2015-12-01T09:40:00Z")

</div>

The issue is that there are no indices inside ES.  
I've about 60 indices containing 1,3 TB data on my file system which do not show up in any way.

Currently i assume that the data is simply wrecked and i'll get my head cut off in the next hours ^^'  
As the data does not show up there are not log for those.  
It's just like "Hey startup is fine but got no indices, feed me!"

cheers,

Ricardo

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [December 1, 2015, 9:45am UTC](https://discuss.elastic.co/t/upgrading-es-from-1-7-1-to-2-x-issue/35997/7 "2015-12-01T09:45:28Z")

</div>

Did you check the cluster name? May be elasticsearch is looking in another dir here?  
May be `path.home` is not correctly set?

---

<div class="post-metadata">

**Author:** ![adviqosupport](https://avatars.discourse-cdn.com/v4/letter/a/9dc877/32.png) [@adviqosupport](https://discuss.elastic.co/u/adviqosupport)\
**Post date:** [December 1, 2015, 9:54am UTC](https://discuss.elastic.co/t/upgrading-es-from-1-7-1-to-2-x-issue/35997/8 "2015-12-01T09:54:25Z")

</div>

the settings are:

path.data: /data/elasticsearch

and thats exacly where the data is placed.

cluster.name: adviqo-restore

and below /data/elasticsearch is the directory adviqo-restore with the correct file permissions

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [December 1, 2015, 10:32am UTC](https://discuss.elastic.co/t/upgrading-es-from-1-7-1-to-2-x-issue/35997/9 "2015-12-01T10:32:49Z")

</div>

And when you start elasticsearch, you don't see anything in logs? May be you could paste them here?

Also, may be change logging level to `DEBUG`?

---

<div class="post-metadata">

**Author:** ![adviqosupport](https://avatars.discourse-cdn.com/v4/letter/a/9dc877/32.png) [@adviqosupport](https://discuss.elastic.co/u/adviqosupport)\
**Post date:** [December 1, 2015, 10:39am UTC](https://discuss.elastic.co/t/upgrading-es-from-1-7-1-to-2-x-issue/35997/10 "2015-12-01T10:39:16Z")

</div>

After changing the logging to DEBUG:

[index\_1] dangling index directory detected, but no state found

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [December 1, 2015, 10:55am UTC](https://discuss.elastic.co/t/upgrading-es-from-1-7-1-to-2-x-issue/35997/11 "2015-12-01T10:55:03Z")

</div>

Is it the index you are missing? Can you print your cluster state?

---

<div class="post-metadata">

**Author:** ![adviqosupport](https://avatars.discourse-cdn.com/v4/letter/a/9dc877/32.png) [@adviqosupport](https://discuss.elastic.co/u/adviqosupport)\
**Post date:** [December 1, 2015, 11:20am UTC](https://discuss.elastic.co/t/upgrading-es-from-1-7-1-to-2-x-issue/35997/12 "2015-12-01T11:20:06Z")

</div>

curl 'localhost:9200/\_cluster/health?pretty=true'  
{  
"cluster\_name" : "adviqo-restore",  
"status" : "yellow",  
"timed\_out" : false,  
"number\_of\_nodes" : 1,  
"number\_of\_data\_nodes" : 1,  
"active\_primary\_shards" : 4,  
"active\_shards" : 4,  
"relocating\_shards" : 0,  
"initializing\_shards" : 0,  
"unassigned\_shards" : 4,  
"delayed\_unassigned\_shards" : 0,  
"number\_of\_pending\_tasks" : 0,  
"number\_of\_in\_flight\_fetch" : 0,  
"task\_max\_waiting\_in\_queue\_millis" : 0,  
"active\_shards\_percent\_as\_number" : 50.0  
}

I miss about 70 indices every produces this log entry ☹

I'm kind of clueless.

---

<div class="post-metadata">

**Author:** ![adviqosupport](https://avatars.discourse-cdn.com/v4/letter/a/9dc877/32.png) [@adviqosupport](https://discuss.elastic.co/u/adviqosupport)\
**Post date:** [December 1, 2015, 11:21am UTC](https://discuss.elastic.co/t/upgrading-es-from-1-7-1-to-2-x-issue/35997/13 "2015-12-01T11:21:46Z")

</div>

The indices shown are from mavel and kibana which got newly created.

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [December 1, 2015, 11:39am UTC](https://discuss.elastic.co/t/upgrading-es-from-1-7-1-to-2-x-issue/35997/14 "2015-12-01T11:39:48Z")

</div>

I meant `curl -XGET 'http://localhost:9200/_cluster/state?pretty'`

Can you print the first 30 lines of your logs (DEBUG)?

---

<div class="post-metadata">

**Author:** ![adviqosupport](https://avatars.discourse-cdn.com/v4/letter/a/9dc877/32.png) [@adviqosupport](https://discuss.elastic.co/u/adviqosupport)\
**Post date:** [December 1, 2015, 11:55am UTC](https://discuss.elastic.co/t/upgrading-es-from-1-7-1-to-2-x-issue/35997/15 "2015-12-01T11:55:30Z")

</div>

> {  
> "cluster\_name" : "adviqo-restore",  
> "version" : 6,  
> "state\_uuid" : "pq6ykO\_ITjCz3jaxg1XbGw",  
> "master\_node" : "3PRpIe82SmmOqbhb84FexA",  
> "blocks" : { },  
> "nodes" : {  
> "3PRpIe82SmmOqbhb84FexA" : {  
> "name" : "Matsu'o Tsurayaba",  
> "transport\_address" : "127.0.0.1:9300",  
> "attributes" : { }  
> }  
> }, ......

> ==\> adviqo-restore.log \<==  
> [2015-12-01 12:54:41,036][DEBUG][index.cache.bitset] [Adri Nital] [.marvel-es-2015.12.01] clearing all bitsets because [close]  
> [2015-12-01 12:54:41,036][DEBUG][indices] [Adri Nital] [.marvel-es-2015.12.01] clearing index field data (reason [shutdown])  
> [2015-12-01 12:54:41,036][DEBUG][indices] [Adri Nital] [.marvel-es-2015.12.01] closing analysis service (reason [shutdown])  
> [2015-12-01 12:54:41,036][DEBUG][indices] [Adri Nital] [.marvel-es-2015.12.01] closing mapper service (reason [shutdown])  
> [2015-12-01 12:54:41,037][DEBUG][indices] [Adri Nital] [.marvel-es-2015.12.01] closing index query parser service (reason [shutdown])  
> [2015-12-01 12:54:41,038][DEBUG][indices] [Adri Nital] [.marvel-es-2015.12.01] closing index service (reason [shutdown])  
> [2015-12-01 12:54:41,038][DEBUG][indices] [Adri Nital] [.marvel-es-2015.12.01] closed... (reason [shutdown])  
> [2015-12-01 12:54:41,038][INFO][node] [Adri Nital] stopped  
> [2015-12-01 12:54:41,039][INFO][node] [Adri Nital] closing ...  
> [2015-12-01 12:54:41,049][INFO][node] [Adri Nital] closed  
> [2015-12-01 12:54:42,519][DEBUG][bootstrap] unable to install syscall filter  
> java.lang.UnsupportedOperationException: seccomp unavailable: CONFIG\_SECCOMP not compiled into kernel, CONFIG\_SECCOMP and CONFIG\_SECCOMP\_FILTER are needed  
> at org.elasticsearch.bootstrap.Seccomp.linuxImpl(Seccomp.java:344)  
> at org.elasticsearch.bootstrap.Seccomp.init(Seccomp.java:546)  
> at org.elasticsearch.bootstrap.JNANatives.trySeccomp(JNANatives.java:183)  
> at org.elasticsearch.bootstrap.Natives.trySeccomp(Natives.java:99)  
> at org.elasticsearch.bootstrap.Bootstrap.initializeNatives(Bootstrap.java:99)  
> at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:144)  
> at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:285)  
> at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:35)

---

<div class="post-metadata">

**Author:** ![adviqosupport](https://avatars.discourse-cdn.com/v4/letter/a/9dc877/32.png) [@adviqosupport](https://discuss.elastic.co/u/adviqosupport)\
**Post date:** [December 1, 2015, 11:56am UTC](https://discuss.elastic.co/t/upgrading-es-from-1-7-1-to-2-x-issue/35997/16 "2015-12-01T11:56:02Z")

</div>

```
[2015-12-01 12:54:42,520][WARN][bootstrap] unable to install syscall filter: seccomp unavailable: CONFIG_SECCOMP not compiled into kernel, CONFIG_SECCOMP and CONFIG_SECCOMP_FILTER are needed
[2015-12-01 12:54:42,524][DEBUG][bootstrap] java.class.path: /opt/elasticsearch/lib/elasticsearch-2.1.0.jar:/opt/elasticsearch/lib/jackson-dataformat-yaml-2.6.2.jar:/opt/elasticsearch/lib/hppc-0.7.1.jar:/opt/elasticsearch/lib/lucene-analyzers-common-5.3.1.jar:/opt/elasticsearch/lib/t-digest-3.0.jar:/opt/elasticsearch/lib/log4j-1.2.17.jar:/opt/elasticsearch/lib/jts-1.13.jar:/opt/elasticsearch/lib/lucene-highlighter-5.3.1.jar:/opt/elasticsearch/lib/joda-time-2.8.2.jar:/opt/elasticsearch/lib/lucene-memory-5.3.1.jar:/opt/elasticsearch/lib/lucene-backward-codecs-5.3.1.jar:/opt/elasticsearch/lib/lucene-core-5.3.1.jar:/opt/elasticsearch/lib/lucene-expressions-5.3.1.jar:/opt/elasticsearch/lib/jackson-dataformat-smile-2.6.2.jar:/opt/elasticsearch/lib/joda-convert-1.2.jar:/opt/elasticsearch/lib/antlr-runtime-3.5.jar:/opt/elasticsearch/lib/groovy-all-2.4.4-indy.jar:/opt/elasticsearch/lib/lucene-spatial3d-5.3.1.jar:/opt/elasticsearch/lib/spatial4j-0.5.jar:/opt/elasticsearch/lib/jna-4.1.0.jar:/opt/elasticsearch/lib/jackson-dataformat-cbor-2.6.2.jar:/opt/elasticsearch/lib/snakeyaml-1.15.jar:/opt/elasticsearch/lib/lucene-spatial-5.3.1.jar:/opt/elasticsearch/lib/lucene-queryparser-5.3.1.jar:/opt/elasticsearch/lib/lucene-grouping-5.3.1.jar:/opt/elasticsearch/lib/jsr166e-1.1.0.jar:/opt/elasticsearch/lib/asm-commons-4.1.jar:/opt/elasticsearch/lib/commons-cli-1.3.1.jar:/opt/elasticsearch/lib/guava-18.0.jar:/opt/elasticsearch/lib/jackson-core-2.6.2.jar:/opt/elasticsearch/lib/compiler-0.8.13.jar:/opt/elasticsearch/lib/netty-3.10.5.Final.jar:/opt/elasticsearch/lib/HdrHistogram-2.1.6.jar:/opt/elasticsearch/lib/compress-lzf-1.0.2.jar:/opt/elasticsearch/lib/lucene-join-5.3.1.jar:/opt/elasticsearch/lib/lucene-misc-5.3.1.jar:/opt/elasticsearch/lib/asm-4.1.jar:/opt/elasticsearch/lib/elasticsearch-2.1.0.jar:/opt/elasticsearch/lib/apache-log4j-extras-1.2.17.jar:/opt/elasticsearch/lib/lucene-sandbox-5.3.1.jar:/opt/elasticsearch/lib/lucene-queries-5.3.1.jar:/opt/elasticsearch/lib/lucene-suggest-5.3.1.ja
```

---

<div class="post-metadata">

**Author:** ![adviqosupport](https://avatars.discourse-cdn.com/v4/letter/a/9dc877/32.png) [@adviqosupport](https://discuss.elastic.co/u/adviqosupport)\
**Post date:** [December 1, 2015, 12:04pm UTC](https://discuss.elastic.co/t/upgrading-es-from-1-7-1-to-2-x-issue/35997/17 "2015-12-01T12:04:03Z")

</div>

```
`[2015-12-01 12:54:42,887][DEBUG][env] [Batragon] using node location [[NodePath{path=/data/elasticsearch/adviqo-restore/nodes/0, spins=true}]], local_node_id [0]
[2015-12-01 12:54:42,889][DEBUG][env] [Batragon] node data locations details:
 -> /data/elasticsearch/adviqo-restore/nodes/0, free_space [432.7gb], usable_space [357.8gb], total_space [1.4tb], spins? [possibly], mount [/data/elasticsearch (/dev/mapper/vg_graylogn1502-data_elasticsearch_vol)], type [ext4]
[2015-12-01 12:54:42,905][DEBUG][threadpool] [Batragon] creating thread_pool [generic], type [cached], keep_alive [30s]
[2015-12-01 12:54:42,910][DEBUG][threadpool] [Batragon] creating thread_pool [index], type [fixed], size [16], queue_size [200]
[2015-12-01 12:54:42,911][DEBUG][threadpool] [Batragon] creating thread_pool [fetch_shard_store], type [scaling], min [1], size [32], keep_alive [5m]
[2015-12-01 12:54:42,911][DEBUG][threadpool] [Batragon] creating thread_pool [get], type [fixed], size [16], queue_size [1k]
[2015-12-01 12:54:42,912][DEBUG][threadpool] [Batragon] creating thread_pool [snapshot], type [scaling], min [1], size [5], keep_alive [5m]
[2015-12-01 12:54:42,912][DEBUG][threadpool] [Batragon] creating thread_pool [force_merge], type [fixed], size [1], queue_size [null]
[2015-12-01 12:54:42,912][DEBUG][threadpool] [Batragon] creating thread_pool [suggest], type [fixed], size [16], queue_size [1k]
[2015-12-01 12:54:42,912][DEBUG][threadpool] [Batragon] creating thread_pool [bulk], type [fixed], size [16], queue_size [50]
[2015-12-01 12:54:42,912][DEBUG][threadpool] [Batragon] creating thread_pool [warmer], type [scaling], min [1], size [5], keep_alive [5m]
[2015-12-01 12:54:42,912][DEBUG][threadpool] [Batragon] creating thread_pool [flush], type [scaling], min [1], size [5], keep_alive [5m]
[2015-12-01 12:54:42,912][DEBUG][threadpool] [Batragon] creating thread_pool [search], type [fixed], size [25], queue_size [1k]
[2015-12-01 12:54:42,912][DEBUG][threadpool] [Batragon] creating thread_pool [fetch_shard_started], type [scaling], min [1], size [32], keep_alive [5m]
[2015-12-01 12:54:42,912][DEBUG][threadpool] [Batragon] creating thread_pool [listener], type [fixed], size [8], queue_size [null]
[2015-12-01 12:54:42,913][DEBUG][threadpool] [Batragon] creating thread_pool [percolate], type [fixed], size [16], queue_size [1k]
[2015-12-01 12:54:42,913][DEBUG][threadpool] [Batragon] creating thread_pool [management], type [scaling], min [1], size [5], keep_alive [5m]
[2015-12-01 12:54:42,913][DEBUG][threadpool] [Batragon] creating thread_pool [refresh], type [scaling], min [1], size [8], keep_alive [5m]
```

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [December 1, 2015, 12:22pm UTC](https://discuss.elastic.co/t/upgrading-es-from-1-7-1-to-2-x-issue/35997/18 "2015-12-01T12:22:14Z")

</div>

Can you upload the full logs please somewhere?

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [December 2, 2015, 8:33am UTC](https://discuss.elastic.co/t/upgrading-es-from-1-7-1-to-2-x-issue/35997/20 "2015-12-02T08:33:56Z")

</div>

I removed your post as this website sounds like a SPAM site or whatever. Lot of annoying ads pop up.  
Please use something like [gist.github.com](http://gist.github.com) for example.

---

<div class="post-metadata">

**Author:** ![adviqosupport](https://avatars.discourse-cdn.com/v4/letter/a/9dc877/32.png) [@adviqosupport](https://discuss.elastic.co/u/adviqosupport)\
**Post date:** [December 2, 2015, 8:44am UTC](https://discuss.elastic.co/t/upgrading-es-from-1-7-1-to-2-x-issue/35997/21 "2015-12-02T08:44:53Z")

</div>

Oh, sorry for that..

here is a new one [https://gist.github.com/anonymous/c2032485eebc0615a7b2](https://gist.github.com/anonymous/c2032485eebc0615a7b2)

thanks for your time again.

cheers,

Ricardo

[Next page](https://discuss.elastic.co/t/upgrading-es-from-1-7-1-to-2-x-issue/35997.md?page=2)
