Is there a way to get all the tokens in the term vector of an index

I don't think there is a way to get all term_vectors for all documents in a single call, but you can get term_vectors for a specific document by id. Maybe you can simply run a search scroll and retrieve term_vectors for each document? That may take a while depending on how many documents you have, but it should do it.