# Fields disappear after refreshing on visualization pages

**URL:** <https://discuss.elastic.co/t/fields-disappear-after-refreshing-on-visualization-pages/86171>\
**Category:** Kibana\
**Created:** [May 17, 2017, 8:52pm UTC](https://discuss.elastic.co/t/fields-disappear-after-refreshing-on-visualization-pages/86171 "2017-05-17T20:52:41Z")\
**Posts on this page:** 4\
**Page:** 2

<div class="post-metadata">

**Author:** ![Bargs](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/bargs/32/5429_2.png) [@Bargs](https://discuss.elastic.co/u/Bargs)\
**Post date:** [May 26, 2017, 4:14pm UTC](https://discuss.elastic.co/t/fields-disappear-after-refreshing-on-visualization-pages/86171/21 "2017-05-26T16:14:32Z")

</div>

You could also look at all the indices that exist in your cluster to get an idea of where your logs are going. The [cat APIs](https://www.elastic.co/guide/en/elasticsearch/reference/current/cat-indices.html) are good for this sort of thing

---

<div class="post-metadata">

**Author:** ![Singard123](https://avatars.discourse-cdn.com/v4/letter/s/df788c/32.png) [@Singard123](https://discuss.elastic.co/u/Singard123)\
**Post date:** [May 26, 2017, 4:24pm UTC](https://discuss.elastic.co/t/fields-disappear-after-refreshing-on-visualization-pages/86171/22 "2017-05-26T16:24:20Z")

</div>

Just a quick question about all those garbage fields. What is the best way to clean those up?

My question is since they are dynamically picked up by Kibana through logs, even if I modify my logstash config/log formats, Kibana will still pick up those garbage fields right? Since all the old logs are still there. So How would I actually clean it up?

Also, is it a good idea to change `index.mapping.total_fields.limit` to a big number just to get it to work for now?

---

<div class="post-metadata">

**Author:** ![Bargs](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/bargs/32/5429_2.png) [@Bargs](https://discuss.elastic.co/u/Bargs)\
**Post date:** [May 26, 2017, 5:07pm UTC](https://discuss.elastic.co/t/fields-disappear-after-refreshing-on-visualization-pages/86171/23 "2017-05-26T17:07:11Z")

</div>

The [reindex API](https://www.elastic.co/guide/en/elasticsearch/reference/2.3/docs-reindex.html) could help you clean up your old data. You can write a script that cleans up the documents as they're re-indexed.

Before re-indexing you should create an [index template](https://www.elastic.co/guide/en/elasticsearch/reference/2.3/indices-templates.html) to define your mappings ahead of time.

I don't think `index.mapping.total_fields.limit` will help here, Kibana stores your list of fields as a blob of JSON under a single field in a document in `.kibana`. From the errors I've seen it looks like you're hitting the max http payload size of either ES or Kibana, which you can configure like I described [here](https://discuss.elastic.co/t/fields-disappear-after-refreshing-on-visualization-pages/86171/14?u=bargs).

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [June 23, 2017, 5:07pm UTC](https://discuss.elastic.co/t/fields-disappear-after-refreshing-on-visualization-pages/86171/24 "2017-06-23T17:07:25Z")

</div>

Closed on June 23, 2017, 5:07pm UTC

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.

[Previous page](https://discuss.elastic.co/t/fields-disappear-after-refreshing-on-visualization-pages/86171.md?page=1)