When I do a query for to my index, I am getting the following error:
"The length of [field_21] field of [82213] doc of [jobs] index has exceeded [10000] - maximum allowed to be analyzed for highlighting. This maximum can be set by changing the [index.highlight.max_analyzed_offset] index level setting. For large texts, indexing with offsets or term vectors is recommended!"
When I increase the max_analyzed_offset from 10,000 to 10,000,000, it solves my problem, and the queries are equally as fast. Should I be worried about leaving this setting like this? Would I hit a performance drop off? Or should I use offsets / term vectors? One caveat with using the term vectors, is that they increase the size of the index.
Also, is there a way to disable the highlighting if it contains more than a particular number of characters?