We have a system which does stream indexing for an online system that has a large number of filtered queries. As filter scope changes it looks like there is a lot of filter evictions going on. I have a couple of questions if anyone can help:
a) is filter rebuild with each newly indexed file that fits into the scope? does this happen on querey time?
b) what is the order of filter eviction (e.g. FIFO) ?
c) does anyone have experience with preformance with manually contorling some filter?
d) what is the cost of continiously adding documents to filters (e.g. imagine that I have a field "document_type" filter and that every second I index 100 new documents for a type)?
Any help would be highly welcomed. I browsed a code a bit, but am not 100% sure I get everything about filter caching and building.