# How can I visit all tokens in an index?

**URL:** <https://discuss.elastic.co/t/how-can-i-visit-all-tokens-in-an-index/87051>\
**Category:** Elasticsearch\
**Created:** [May 24, 2017, 10:22pm UTC](https://discuss.elastic.co/t/how-can-i-visit-all-tokens-in-an-index/87051 "2017-05-24T22:22:19Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![redtopia](https://avatars.discourse-cdn.com/v4/letter/r/f9ae1b/32.png) [@redtopia](https://discuss.elastic.co/u/redtopia)\
**Post date:** [May 24, 2017, 10:22pm UTC](https://discuss.elastic.co/t/how-can-i-visit-all-tokens-in-an-index/87051/1 "2017-05-24T22:22:19Z")

</div>

Is it possible to visit all tokens in an index (not field specific)? And is it also possible to visit all tokens on a per-field basis? To be clear, I'm not necessarily interested in the original text... I only want to see each token. I'm using the shingle tokenizer, so given the text "quick brown fox jumps over the lazy cow", I want to visit each of the tokens, i.e.: "quick", "quick brown", "quick brown fox", "brown", "brown fox", "brown fox jumps", etc...

I'm guessing there's an easy way to do this, but I am scratching my head. Thanks in advance!

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [May 25, 2017, 8:26am UTC](https://discuss.elastic.co/t/how-can-i-visit-all-tokens-in-an-index/87051/2 "2017-05-25T08:26:49Z")

</div>

I don't believe you can do this?

---

<div class="post-metadata">

**Author:** ![redtopia](https://avatars.discourse-cdn.com/v4/letter/r/f9ae1b/32.png) [@redtopia](https://discuss.elastic.co/u/redtopia)\
**Post date:** [May 25, 2017, 3:19pm UTC](https://discuss.elastic.co/t/how-can-i-visit-all-tokens-in-an-index/87051/3 "2017-05-25T15:19:30Z")

</div>

I'm trying to make a list of tokens given a data set. I guess I could always use the analyze api instead of making an index.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [June 22, 2017, 3:19pm UTC](https://discuss.elastic.co/t/how-can-i-visit-all-tokens-in-an-index/87051/4 "2017-06-22T15:19:44Z")

</div>

Closed on June 22, 2017, 3:19pm UTC

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.