# Discard documents when indexing with rules
**URL:** https://discuss.elastic.co/t/discard-documents-when-indexing-with-rules/159696
**Category:** Elasticsearch
**Created:** [December 6, 2018, 9:27am UTC](https://discuss.elastic.co/t/discard-documents-when-indexing-with-rules/159696 "2018-12-06T09:27:51Z")
**Posts on this page:** 6
**Page:** 1
### Author:  [@xavierfacq](https://discuss.elastic.co/u/xavierfacq)
#### Post date: [December 6, 2018, 9:27am UTC](https://discuss.elastic.co/t/discard-documents-when-indexing-with-rules/159696/1 "2018-12-06T09:27:51Z")
Hi,
Is it possible to add something like a "rule" into the index mapping/description or whatever configuration that could to resolve the following trick:
We want to inject lot of data into a dedicated indice, but we would like to do not index some of this documents if they do not match a rule. There is a feature that to this trick but only on the field level:
[https://www.elastic.co/guide/en/elasticsearch/reference/6.5/analysis-keep-words-tokenfilter.html](https://www.elastic.co/guide/en/elasticsearch/reference/6.5/analysis-keep-words-tokenfilter.html)
We would like to do the same but directly reject the indexation of the document is one of the field is
not in a dictionary.
Any idea ?
Thanks !
---
### Author:  [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)
#### Post date: [December 6, 2018, 10:33am UTC](https://discuss.elastic.co/t/discard-documents-when-indexing-with-rules/159696/2 "2018-12-06T10:33:15Z")
You typically identify this before you send the data to Elasticsearch and simply drop the document. As this is a common ingest requirement Logstash has a drop filter you can use for this. I do not see why you would do this in Elasticsearch.
---
### Author:  [@xavierfacq](https://discuss.elastic.co/u/xavierfacq)
#### Post date: [December 6, 2018, 12:35pm UTC](https://discuss.elastic.co/t/discard-documents-when-indexing-with-rules/159696/3 "2018-12-06T12:35:15Z")
Yes, it's what we use to do for other data, but in this new use-case it would have be interesting to filter documents during the indexation, based on a special dictionary.
---
### Author:  [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)
#### Post date: [December 6, 2018, 12:53pm UTC](https://discuss.elastic.co/t/discard-documents-when-indexing-with-rules/159696/4 "2018-12-06T12:53:55Z")
You could use an ingest pipeline with a [drop processor](https://www.elastic.co/guide/en/elasticsearch/reference/current/drop-processor.html).
---
### Author:  [@xavierfacq](https://discuss.elastic.co/u/xavierfacq)
#### Post date: [December 6, 2018, 12:59pm UTC](https://discuss.elastic.co/t/discard-documents-when-indexing-with-rules/159696/5 "2018-12-06T12:59:26Z")
Ok thank you ! This is very interesting for our usecase ! 👍
Before we would have to switch from 2.4 to 6.x !!!
Thanks !
Xavier
---
### Author:  [@system](https://discuss.elastic.co/u/system)
#### Post date: [January 3, 2019, 12:59pm UTC](https://discuss.elastic.co/t/discard-documents-when-indexing-with-rules/159696/6 "2019-01-03T12:59:30Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.