# ES crashes when parsing fails due to mapping failure **URL:** \ **Category:** Elasticsearch\ **Created:** [February 5, 2015, 12:56pm UTC](https://discuss.elastic.co/t/es-crashes-when-parsing-fails-due-to-mapping-failure/21992 "2015-02-05T12:56:39Z")\ **Posts on this page:** 3\ **Page:** 1
**Author:** ![assaf](https://avatars.discourse-cdn.com/v4/letter/a/34f0e0/32.png) [@assaf](https://discuss.elastic.co/u/assaf)\ **Post date:** [February 5, 2015, 12:56pm UTC](https://discuss.elastic.co/t/es-crashes-when-parsing-fails-due-to-mapping-failure/21992/1 "2015-02-05T12:56:39Z")
We have automatic mapping turned for our logstash indexes. Every now and then our system logs a record that has a "wrong" (out of the ordinary) field data type. For example, a field that's been automatically mapped to be a number occasionally is logged as a string. This causes ES to crash with the following stack trace: at org.elasticsearch.search.SearchService.parseSource(SearchService.java:681) at org.elasticsearch.search.SearchService.createContext(SearchService.java:537) at org.elasticsearch.search.SearchService.createAndPutContext(SearchService.java:509) at org.elasticsearch.search.SearchService.executeQueryPhase(SearchService.java:264) at org.elasticsearch.search.action.SearchServiceTransportAction$5.call(SearchServiceTransportAction.java:231) at org.elasticsearch.search.action.SearchServiceTransportAction$5.call(SearchServiceTransportAction.java:228) at org.elasticsearch.search.action.SearchServiceTransportAction$23.run(SearchServiceTransportAction.java:559) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: java.lang.NumberFormatException: For input string: "1.0" at java.lang.NumberFormatException.forInputString(NumberFormatException.java:65) at java.lang.Long.parseLong(Long.java:441) at java.lang.Long.parseLong(Long.java:483) at org.elasticsearch.index.mapper.core.NumberFieldMapper.parseLongValue(NumberFieldMapper.java:357) at org.elasticsearch.index.mapper.core.LongFieldMapper.termQuery(LongFieldMapper.java:185) at org.apache.lucene.queryparser.classic.MapperQueryParser.getFieldQuerySingle(MapperQueryParser.java:257) at org.apache.lucene.queryparser.classic.MapperQueryParser.getFieldQuery(MapperQueryParser.java:168) at org.apache.lucene.queryparser.classic.QueryParserBase.getFieldQuery(QueryParserBase.java:487) at org.apache.lucene.queryparser.classic.MapperQueryParser.getFieldQuery(MapperQueryParser.java:287) at org.apache.lucene.queryparser.classic.QueryParserBase.handleQuotedTerm(QueryParserBase.java:875) at org.apache.lucene.queryparser.classic.QueryParser.Term(QueryParser.java:464) at org.apache.lucene.queryparser.classic.QueryParser.Clause(QueryParser.java:259) at org.apache.lucene.queryparser.classic.QueryParser.Query(QueryParser.java:183) at org.apache.lucene.queryparser.classic.QueryParser.Clause(QueryParser.java:263) at org.apache.lucene.queryparser.classic.QueryParser.Query(QueryParser.java:183) at org.apache.lucene.queryparser.classic.QueryParser.TopLevelQuery(QueryParser.java:172) at org.apache.lucene.queryparser.classic.QueryParserBase.parse(QueryParserBase.java:123) at org.apache.lucene.queryparser.classic.MapperQueryParser.parse(MapperQueryParser.java:882) at org.elasticsearch.index.query.QueryStringQueryParser.parse(QueryStringQueryParser.java:223) at org.elasticsearch.index.query.QueryParseContext.parseInnerQuery(QueryParseContext.java:277) at org.elasticsearch.index.query.FQueryFilterParser.parse(FQueryFilterParser.java:66) at org.elasticsearch.index.query.QueryParseContext.executeFilterParser(QueryParseContext.java:343) at org.elasticsearch.index.query.QueryParseContext.parseInnerFilter(QueryParseContext.java:324) at org.elasticsearch.index.query.BoolFilterParser.parse(BoolFilterParser.java:92) at org.elasticsearch.index.query.QueryParseContext.executeFilterParser(QueryParseContext.java:343) at org.elasticsearch.index.query.QueryParseContext.parseInnerFilter(QueryParseContext.java:324) at org.elasticsearch.index.query.FilteredQueryParser.parse(FilteredQueryParser.java:74) at org.elasticsearch.index.query.QueryParseContext.parseInnerQuery(QueryParseContext.java:277) at org.elasticsearch.index.query.IndexQueryParserService.innerParse(IndexQueryParserService.java:382) at org.elasticsearch.index.query.IndexQueryParserService.parse(IndexQueryParserService.java:281) at org.elasticsearch.index.query.IndexQueryParserService.parse(IndexQueryParserService.java:276) at org.elasticsearch.search.query.QueryParseElement.parse(QueryParseElement.java:33) at org.elasticsearch.search.SearchService.parseSource(SearchService.java:665) Is there a way to tell ES not to crash when failing to parse a field? I realize I can override the mapping, and so on, but regardless I'm also interested in getting ES to run reliably without crashing on rare inputs. Thanks, Assaf -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/9b6febf3-5800-40a6-8cf4-fcb24ac8abed%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/9b6febf3-5800-40a6-8cf4-fcb24ac8abed%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![Itamar\_Syn\_Hershko](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/itamar_syn_hershko/32/725_2.png) [@Itamar\_Syn\_Hershko](https://discuss.elastic.co/u/Itamar_Syn_Hershko)\ **Post date:** [February 5, 2015, 1:03pm UTC](https://discuss.elastic.co/t/es-crashes-when-parsing-fails-due-to-mapping-failure/21992/2 "2015-02-05T13:03:26Z")
It's not crashing, it is just a log that says the document insert was rejected -- Itamar Syn-Hershko [http://code972.com](http://code972.com) | @synhershko [https://twitter.com/synhershko](https://twitter.com/synhershko) Freelance Developer & Consultant [Lucene.NET](http://Lucene.NET) committer and PMC member On Thu, Feb 5, 2015 at 2:56 PM, [assaf@singular.net](mailto:assaf@singular.net) wrote: > We have automatic mapping turned for our logstash indexes. Every now and > then our system logs a record that has a "wrong" (out of the ordinary) > field data type. > For example, a field that's been automatically mapped to be a number > occasionally is logged as a string. > This causes ES to crash with the following stack trace: > > at > org.elasticsearch.search.SearchService.parseSource(SearchService.java:681) > at > org.elasticsearch.search.SearchService.createContext(SearchService.java:537) > at > org.elasticsearch.search.SearchService.createAndPutContext(SearchService.java:509) > at > org.elasticsearch.search.SearchService.executeQueryPhase(SearchService.java:264) > at > org.elasticsearch.search.action.SearchServiceTransportAction$5.call(SearchServiceTransportAction.java:231) > at > org.elasticsearch.search.action.SearchServiceTransportAction$5.call(SearchServiceTransportAction.java:228) > at > org.elasticsearch.search.action.SearchServiceTransportAction$23.run(SearchServiceTransportAction.java:559) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:745) > Caused by: java.lang.NumberFormatException: For input string: "1.0" > at > java.lang.NumberFormatException.forInputString(NumberFormatException.java:65) > at java.lang.Long.parseLong(Long.java:441) > at java.lang.Long.parseLong(Long.java:483) > at > org.elasticsearch.index.mapper.core.NumberFieldMapper.parseLongValue(NumberFieldMapper.java:357) > at > org.elasticsearch.index.mapper.core.LongFieldMapper.termQuery(LongFieldMapper.java:185) > at > org.apache.lucene.queryparser.classic.MapperQueryParser.getFieldQuerySingle(MapperQueryParser.java:257) > at > org.apache.lucene.queryparser.classic.MapperQueryParser.getFieldQuery(MapperQueryParser.java:168) > at > org.apache.lucene.queryparser.classic.QueryParserBase.getFieldQuery(QueryParserBase.java:487) > at > org.apache.lucene.queryparser.classic.MapperQueryParser.getFieldQuery(MapperQueryParser.java:287) > at > org.apache.lucene.queryparser.classic.QueryParserBase.handleQuotedTerm(QueryParserBase.java:875) > at > org.apache.lucene.queryparser.classic.QueryParser.Term(QueryParser.java:464) > at > org.apache.lucene.queryparser.classic.QueryParser.Clause(QueryParser.java:259) > at > org.apache.lucene.queryparser.classic.QueryParser.Query(QueryParser.java:183) > at > org.apache.lucene.queryparser.classic.QueryParser.Clause(QueryParser.java:263) > at > org.apache.lucene.queryparser.classic.QueryParser.Query(QueryParser.java:183) > at > org.apache.lucene.queryparser.classic.QueryParser.TopLevelQuery(QueryParser.java:172) > at > org.apache.lucene.queryparser.classic.QueryParserBase.parse(QueryParserBase.java:123) > at > org.apache.lucene.queryparser.classic.MapperQueryParser.parse(MapperQueryParser.java:882) > at > org.elasticsearch.index.query.QueryStringQueryParser.parse(QueryStringQueryParser.java:223) > at > org.elasticsearch.index.query.QueryParseContext.parseInnerQuery(QueryParseContext.java:277) > at > org.elasticsearch.index.query.FQueryFilterParser.parse(FQueryFilterParser.java:66) > at > org.elasticsearch.index.query.QueryParseContext.executeFilterParser(QueryParseContext.java:343) > at > org.elasticsearch.index.query.QueryParseContext.parseInnerFilter(QueryParseContext.java:324) > at > org.elasticsearch.index.query.BoolFilterParser.parse(BoolFilterParser.java:92) > at > org.elasticsearch.index.query.QueryParseContext.executeFilterParser(QueryParseContext.java:343) > at > org.elasticsearch.index.query.QueryParseContext.parseInnerFilter(QueryParseContext.java:324) > at > org.elasticsearch.index.query.FilteredQueryParser.parse(FilteredQueryParser.java:74) > at > org.elasticsearch.index.query.QueryParseContext.parseInnerQuery(QueryParseContext.java:277) > at > org.elasticsearch.index.query.IndexQueryParserService.innerParse(IndexQueryParserService.java:382) > at > org.elasticsearch.index.query.IndexQueryParserService.parse(IndexQueryParserService.java:281) > at > org.elasticsearch.index.query.IndexQueryParserService.parse(IndexQueryParserService.java:276) > at > org.elasticsearch.search.query.QueryParseElement.parse(QueryParseElement.java:33) > at > org.elasticsearch.search.SearchService.parseSource(SearchService.java:665) > > Is there a way to tell ES not to crash when failing to parse a field? I > realize I can override the mapping, and so on, but regardless I'm also > interested in getting ES to run reliably without crashing on rare inputs. > > Thanks, > Assaf > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/9b6febf3-5800-40a6-8cf4-fcb24ac8abed%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/9b6febf3-5800-40a6-8cf4-fcb24ac8abed%40googlegroups.com) > [https://groups.google.com/d/msgid/elasticsearch/9b6febf3-5800-40a6-8cf4-fcb24ac8abed%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/9b6febf3-5800-40a6-8cf4-fcb24ac8abed%40googlegroups.com?utm_medium=email&utm_source=footer) > . > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAHTr4Ztvpc%2BgCDB\_ZGcquLnpxETPuOicovL8UKozhm9\_cNpYew%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAHTr4Ztvpc%2BgCDB_ZGcquLnpxETPuOicovL8UKozhm9_cNpYew%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 12:34am UTC](https://discuss.elastic.co/t/es-crashes-when-parsing-fails-due-to-mapping-failure/21992/3 "2017-07-06T00:34:46Z")