# Limit of total fields \[1000\] in index has been exceeded"

**URL:** <https://discuss.elastic.co/t/limit-of-total-fields-1000-in-index-has-been-exceeded/126929>\
**Category:** Logstash\
**Created:** [April 5, 2018, 12:56pm UTC](https://discuss.elastic.co/t/limit-of-total-fields-1000-in-index-has-been-exceeded/126929 "2018-04-05T12:56:55Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![cowensel](https://avatars.discourse-cdn.com/v4/letter/c/eb9ed0/32.png) [@cowensel](https://discuss.elastic.co/u/cowensel)\
**Post date:** [April 5, 2018, 12:56pm UTC](https://discuss.elastic.co/t/limit-of-total-fields-1000-in-index-has-been-exceeded/126929/1 "2018-04-05T12:56:55Z")

</div>

I know this query keeps cropping up. Is there a way we can identify the event that triggered this error? and if we increase the limit on the template are there any overheads added.

---

<div class="post-metadata">

**Author:** ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)\
**Post date:** [April 6, 2018, 7:42pm UTC](https://discuss.elastic.co/t/limit-of-total-fields-1000-in-index-has-been-exceeded/126929/2 "2018-04-06T19:42:30Z")

</div>

Where do the fields come from? A single rogue event with a ridiculous amount of fields? Or many document that introduce a field or two each?

---

<div class="post-metadata">

**Author:** ![yaauie](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/yaauie/32/23363_2.png) [@yaauie](https://discuss.elastic.co/u/yaauie)\
**Post date:** [April 7, 2018, 1:16am UTC](https://discuss.elastic.co/t/limit-of-total-fields-1000-in-index-has-been-exceeded/126929/3 "2018-04-07T01:16:57Z")

</div>

This error is coming from Elasticsearch, and indicates that a document you are inserting (a) contains field names that are not yet in the index and (b) that Elasticsearch is refusing to add another field to the index because it has already reached the configured limit.

You may have better specific help in the Elasticsearch forum, but from what I understand, in Lucene (which sits underneath an Elasticsearch index), every single document in an index carries overhead for every single field in the index, whether or not the document has those fields populated. The limit is configurable, but hitting it is a good warning sign that you may want to rethink how your data is structured.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [May 5, 2018, 1:17am UTC](https://discuss.elastic.co/t/limit-of-total-fields-1000-in-index-has-been-exceeded/126929/4 "2018-05-05T01:17:01Z")

</div>

Closed on May 5, 2018, 1:17am UTC

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.