How can I visit all tokens in an index?

Is it possible to visit all tokens in an index (not field specific)? And is it also possible to visit all tokens on a per-field basis? To be clear, I'm not necessarily interested in the original text... I only want to see each token. I'm using the shingle tokenizer, so given the text "quick brown fox jumps over the lazy cow", I want to visit each of the tokens, i.e.: "quick", "quick brown", "quick brown fox", "brown", "brown fox", "brown fox jumps", etc...

I'm guessing there's an easy way to do this, but I am scratching my head. Thanks in advance!

I don't believe you can do this?

I'm trying to make a list of tokens given a data set. I guess I could always use the analyze api instead of making an index.

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.