# Are tokens produced by an analyzer == terms? **URL:** \ **Category:** Elasticsearch\ **Created:** [March 12, 2014, 7:40pm UTC](https://discuss.elastic.co/t/are-tokens-produced-by-an-analyzer-terms/16331 "2014-03-12T19:40:45Z")\ **Posts on this page:** 3\ **Page:** 1
**Author:** ![Nikita\_Tovstoles](https://avatars.discourse-cdn.com/v4/letter/n/f17d59/32.png) [@Nikita\_Tovstoles](https://discuss.elastic.co/u/Nikita_Tovstoles)\ **Post date:** [March 12, 2014, 7:40pm UTC](https://discuss.elastic.co/t/are-tokens-produced-by-an-analyzer-terms/16331/1 "2014-03-12T19:40:45Z")
Reference says that an Analyzer takes a piece of text, tokenizes it using a Tokenizer, and then mutates resulting list of tokens using specified Token Filters. Thus, if I understand correctly, the output of an analyzer is some set of tokens. in the context of indexing a Document, are those tokens == Terms? In other words are terms 'Tokens' and 'Terms' synonyms? -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/8590cbb5-911a-46bb-8ed1-a5485cb4f6df%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/8590cbb5-911a-46bb-8ed1-a5485cb4f6df%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![Clinton\_Gormley](https://avatars.discourse-cdn.com/v4/letter/c/50afbb/32.png) [@Clinton\_Gormley](https://discuss.elastic.co/u/Clinton_Gormley)\ **Post date:** [March 12, 2014, 8:25pm UTC](https://discuss.elastic.co/t/are-tokens-produced-by-an-analyzer-terms/16331/2 "2014-03-12T20:25:51Z")
Yes. Tokens and terms are used as synonyms, although officially there is a difference: > **[Tokenization](https://nlp.stanford.edu/IR-book/html/htmledition/tokenization-1.html)** > > Tokenization But for our purposes, wherever you read "token" think "term" On 12 March 2014 20:40, Nikita Tovstoles [nikita.tovstoles@gmail.com](mailto:nikita.tovstoles@gmail.com) wrote: > Reference says that an Analyzer takes a piece of text, tokenizes it using > a Tokenizer, and then mutates resulting list of tokens using specified > Token Filters. Thus, if I understand correctly, the output of an analyzer > is some set of tokens. in the context of indexing a Document, are those > tokens == Terms? In other words are terms 'Tokens' and 'Terms' synonyms? > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/8590cbb5-911a-46bb-8ed1-a5485cb4f6df%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/8590cbb5-911a-46bb-8ed1-a5485cb4f6df%40googlegroups.com)[https://groups.google.com/d/msgid/elasticsearch/8590cbb5-911a-46bb-8ed1-a5485cb4f6df%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/8590cbb5-911a-46bb-8ed1-a5485cb4f6df%40googlegroups.com?utm_medium=email&utm_source=footer) > . > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAPt3XKSV0T2Op5%2BCkTyPzMWw%3Dbdvx6rELZobkH0s2k\_T7HR-Lw%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAPt3XKSV0T2Op5%2BCkTyPzMWw%3Dbdvx6rELZobkH0s2k_T7HR-Lw%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 1:43am UTC](https://discuss.elastic.co/t/are-tokens-produced-by-an-analyzer-terms/16331/3 "2017-07-06T01:43:40Z")
Closed on July 6, 2017, 1:43am UTC