Is it possible to visit all tokens in an index (not field specific)? And is it also possible to visit all tokens on a per-field basis? To be clear, I'm not necessarily interested in the original text... I only want to see each token. I'm using the shingle tokenizer, so given the text "quick brown fox jumps over the lazy cow", I want to visit each of the tokens, i.e.: "quick", "quick brown", "quick brown fox", "brown", "brown fox", "brown fox jumps", etc...
I'm guessing there's an easy way to do this, but I am scratching my head. Thanks in advance!