# Some of the mapping missing after ElasticSearch cluster restart **URL:** \ **Category:** Elasticsearch\ **Created:** [December 18, 2013, 10:58am UTC](https://discuss.elastic.co/t/some-of-the-mapping-missing-after-elasticsearch-cluster-restart/14930 "2013-12-18T10:58:13Z")\ **Posts on this page:** 3\ **Page:** 1
**Author:** ![kakaraft](https://avatars.discourse-cdn.com/v4/letter/k/ed655f/32.png) [@kakaraft](https://discuss.elastic.co/u/kakaraft)\ **Post date:** [December 18, 2013, 10:58am UTC](https://discuss.elastic.co/t/some-of-the-mapping-missing-after-elasticsearch-cluster-restart/14930/1 "2013-12-18T10:58:13Z")
Hi everybody, We are facing a problem that, mapping metadata of some types got lost after ElasticSearch cluster is restarted (got 404 when getting mapping for the type), but without losing actual data. We have encountered this three times already, this happened only after upgrading to 0.90.5, but sadly couldn't find any concrete steps to recreate this yet. At first we thought data of the type was lost, but after we restore data for that type (by using a tool to put original data into the specified type), we saw amount of data in that type was doubled. So the symptom was mapping lost, while actual data still in ElasticSearch. So now if we see this again, to manually fix this, we first use PUT \_mapping action, to put back the mapping metadata, so we can access the type again, then check whether data was lost. But till now, we only see missing mappings, no data lost. As so many indices and so many types in the cluster, it's too tedious to check each type one by one and perform the fix, so trying to find some way to avoid the mapping lost from happening. From log file, only see two or three lines of log as below, not other errors/warnings, not sure whether they are related: _[2013-11-30 23:11:13,537][WARN][cluster.metadata] [xweb01.sys2] failure during [refresh-mapping [log-2013-11-30][[TTS-JP, Band\_K\_android]]]java.lang.NullPointerException_ Does anyone have any idea what happened there, or facing similar problem? Basic information of our ElasticSearch cluster: ES version: 0.90.5 Java version: 1.7.40 OS: 64 bit Linux box ES nodes: Total 29 nodes, there are 4 master nodes and 20 data nodes Using local gateway. Indices are created base on date. Configuration can be found at: [https://gist.github.com/kakaraft/8020408](https://gist.github.com/kakaraft/8020408) Thanks & regards. Ronald -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/64575fb6-0463-4b86-b9af-c0f7b3a3e66e%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/64575fb6-0463-4b86-b9af-c0f7b3a3e66e%40googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![spinscale](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/spinscale/32/25011_2.png) [@spinscale](https://discuss.elastic.co/u/spinscale)\ **Post date:** [December 19, 2013, 2:52pm UTC](https://discuss.elastic.co/t/some-of-the-mapping-missing-after-elasticsearch-cluster-restart/14930/2 "2013-12-19T14:52:34Z")
Hey, do you have a complete stack trace for that NullPointerException in your logfiles? --Alex On Wed, Dec 18, 2013 at 11:58 AM, [kakaraft@gmail.com](mailto:kakaraft@gmail.com) wrote: > Hi everybody, > > We are facing a problem that, mapping metadata of some types got lost > after Elasticsearch cluster is restarted (got 404 when getting mapping for > the type), but without losing actual data. We have encountered this three > times already, this happened only after upgrading to 0.90.5, but sadly > couldn't find any concrete steps to recreate this yet. > > At first we thought data of the type was lost, but after we restore data > for that type (by using a tool to put original data into the specified > type), we saw amount of data in that type was doubled. So the symptom was > mapping lost, while actual data still in Elasticsearch. > > So now if we see this again, to manually fix this, we first use PUT > \_mapping action, to put back the mapping metadata, so we can access the > type again, then check whether data was lost. But till now, we only see > missing mappings, no data lost. > > As so many indices and so many types in the cluster, it's too tedious to > check each type one by one and perform the fix, so trying to find some way > to avoid the mapping lost from happening. > > From log file, only see two or three lines of log as below, not other > errors/warnings, not sure whether they are related: > > _[2013-11-30 23:11:13,537][WARN][cluster.metadata] [xweb01.sys2] > failure during [refresh-mapping [log-2013-11-30][[TTS-JP, > Band\_K\_android]]]java.lang.NullPointerException_ > > Does anyone have any idea what happened there, or facing similar problem? > > Basic information of our Elasticsearch cluster: > > ES version: 0.90.5 > Java version: 1.7.40 > OS: 64 bit Linux box > ES nodes: Total 29 nodes, there are 4 master nodes and 20 data nodes > Using local gateway. > Indices are created base on date. > > Configuration can be found at: [Configurations for ES cluster ยท GitHub](https://gist.github.com/kakaraft/8020408) > > Thanks & regards. > Ronald > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/64575fb6-0463-4b86-b9af-c0f7b3a3e66e%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/64575fb6-0463-4b86-b9af-c0f7b3a3e66e%40googlegroups.com) > . > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAGCwEM9hTBykZmSXdRjJhmqdd3tkt\_FBcO%3D71-7gBARSukdA7A%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAGCwEM9hTBykZmSXdRjJhmqdd3tkt_FBcO%3D71-7gBARSukdA7A%40mail.gmail.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 2:00am UTC](https://discuss.elastic.co/t/some-of-the-mapping-missing-after-elasticsearch-cluster-restart/14930/3 "2017-07-06T02:00:14Z")