Difference between analyzer and normalizer


what is the difference between analyzer and normalizer?




Normalizers are similar to analyzers except that they may only emit a single token. As a consequence, they do not have a tokenizer and only accept a subset of the available char filters and token filters. Only the filters that work on a per-character basis are allowed. For instance a lowercasing filter would be allowed, but not a stemming filter, which needs to look at the keyword as a whole.

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.