I struggle with large documents in an index.
When we want to extract something via source it is slow since it has to parse the entire source.
We could use stored fields, but this seems like a bad solution, when we have to make many fields stored, and make tricks to save object relations.
An idea is therefore to make two indices, one with the full documents, and one with part of the document.
Thus we can search in the full index, and use the id's to extract them from det partial index.
This however gives problem with the atomicity of an insert/delete/update.
I have not been able to find any documentation for this problem, so maybe someone here knows a solution to either
- Large documents
- Atomicity on multiple indices