Slowness in percolator 7.2

[Faiz_Ahmed_Mushtak_H (Faiz Ahmed Mushtak Halde)]

@Daniel_Penning we've found the root cause of our problem

How does PercolatorQuery work when query extraction failed

Let me explain you our percolator architecture Our percolator docs look like this { "domain": <>, "query": { .. } } We have around 100K percolators registered. The number of percolators between domains can vary a lot. Whenever we percolate a document, we want to percolate only against the domains for which the given document is part of In 1.7, we made use of meta filters and filtered out percolators When we migrated to 7.2 with similar architecture, the performance degraded drastical…

We can't use ParNewGC because we are on JDK12. We are experimenting using G1GC and ParallelOldGC. If the objects live for short time, why would I want to have a large useless old gen space? I'd give that space to the young gen instead right? Am I missing anything?

Also other thing, the ES doc says the mini index for percolation is optimized for percolation purpose. My mappings have doc_values as true [default], I'm guessing ES doesn't spend time on extracting doc_values for that single document that gets indexed in the mini index [for percolation]