# Classification pattern: Percolate, Tag, Index **URL:** \ **Category:** Elasticsearch\ **Created:** [July 8, 2014, 2:49pm UTC](https://discuss.elastic.co/t/classification-pattern-percolate-tag-index/18531 "2014-07-08T14:49:41Z")\ **Posts on this page:** 3\ **Page:** 1
**Author:** ![Peter\_Passaro](https://avatars.discourse-cdn.com/v4/letter/p/5f8ce5/32.png) [@Peter\_Passaro](https://discuss.elastic.co/u/Peter_Passaro)\ **Post date:** [July 8, 2014, 2:49pm UTC](https://discuss.elastic.co/t/classification-pattern-percolate-tag-index/18531/1 "2014-07-08T14:49:41Z")
I'm fairly new to ES, and wanted to get some guidance about implementing something similar to what I've done with other systems. I have a set of queries I use for classifying documents written in a modified version of the Lucene query syntax. I would like to tag each new document coming into my system with the classes generated by my queries. From my experimentation and reading so far, I assume the best pattern to use for this purpose is to percolate each new doc using my queries, then tag them outside of ES based on the percolate results, and then to index based on the tag array. My questions: 1. In general is this the most efficient pattern to use for classification? I'm particularly concerned about the round trip of having to use two calls for each new document. 2. The classification queries can be quite complex and use a mixture of nested booleans, wildcards, spans, and regexes. The query string query could cover some of this, but I'll likely have to use a variety of nested queries to catch things like intensifiers and negations of my terms of interest. Any suggestions on good tutorials/tools for efficiently (both in sanity and computation) implementing complex queries in ES? 3. I think the answer is no, but is there a way to write my tags on during percolation (e.g. via a script)? 4. Any efforts in this direction in terms of plugins? I think the percolate, tag, index pattern for classification is one that is fairly popular. -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/ad71e333-71a2-422b-90a3-59d0ba093a08%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/ad71e333-71a2-422b-90a3-59d0ba093a08%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![Peter\_Passaro](https://avatars.discourse-cdn.com/v4/letter/p/5f8ce5/32.png) [@Peter\_Passaro](https://discuss.elastic.co/u/Peter_Passaro)\ **Post date:** [July 9, 2014, 8:17am UTC](https://discuss.elastic.co/t/classification-pattern-percolate-tag-index/18531/2 "2014-07-09T08:17:29Z")
I came across a good overview talk on percolation from Martijn van Groningen. [https://www.youtube.com/watch?v=ETxJO2FQ\_jw](https://www.youtube.com/watch?v=ETxJO2FQ_jw) This answered some of my questions, but I'd still like to get some insight from others trying to do similar things with document classification and tagging. On Tuesday, July 8, 2014 3:49:41 PM UTC+1, Peter Passaro wrote: > I'm fairly new to ES, and wanted to get some guidance about implementing > something similar to what I've done with other systems. I have a set of > queries I use for classifying documents written in a modified version of > the Lucene query syntax. I would like to tag each new document coming into > my system with the classes generated by my queries. > > From my experimentation and reading so far, I assume the best pattern to > use for this purpose is to percolate each new doc using my queries, then > tag them outside of ES based on the percolate results, and then to index > based on the tag array. > > My questions: > > 1. In general is this the most efficient pattern to use for > classification? I'm particularly concerned about the round trip of having > to use two calls for each new document. > > 2. The classification queries can be quite complex and use a mixture of > nested booleans, wildcards, spans, and regexes. The query string query > could cover some of this, but I'll likely have to use a variety of nested > queries to catch things like intensifiers and negations of my terms of > interest. Any suggestions on good tutorials/tools for efficiently (both in > sanity and computation) implementing complex queries in ES? > > 3. I think the answer is no, but is there a way to write my tags on during > percolation (e.g. via a script)? > > 4. Any efforts in this direction in terms of plugins? I think the > percolate, tag, index pattern for classification is one that is fairly > popular. -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/e48bf503-f836-4acc-9a63-9c50c5e63c63%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/e48bf503-f836-4acc-9a63-9c50c5e63c63%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 1:17am UTC](https://discuss.elastic.co/t/classification-pattern-percolate-tag-index/18531/3 "2017-07-06T01:17:05Z")