I was wondering if I could filter our documents before indexing in Elasticsearch based on specific condition. For example, let's say I would like to drop a document from being index if field1="something". Is this something I can address via using out of the box processors in Elasticsearch and use "ingest node" to cover it? Can I write a custom processor if it doesn't exist?
Doing this kind of "dropping" documents based on conditions as part of ingest was previously suggested but dismissed here. I'm not sure if I personally follow the argument but haven't looked into the implications either, but for the time being it seems this is something you have to do in your pre-processing pipeline (e.g. Logstash or your custom process).
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.