# Auto Classification **URL:** \ **Category:** Elasticsearch\ **Created:** [April 5, 2013, 11:28am UTC](https://discuss.elastic.co/t/auto-classification/11463 "2013-04-05T11:28:00Z")\ **Posts on this page:** 9\ **Page:** 1
**Author:** ![kuwar\_sahani\_2](https://avatars.discourse-cdn.com/v4/letter/k/fbc32d/32.png) [@kuwar\_sahani\_2](https://discuss.elastic.co/u/kuwar_sahani_2)\ **Post date:** [April 5, 2013, 11:28am UTC](https://discuss.elastic.co/t/auto-classification/11463/1 "2013-04-05T11:28:00Z")
> I'm working on a model where i will have the input data in _AVRO_ format > and index the data into _ES_. > Before indexing I would like to add catagories to the data i.e _Auto_-\* > Classification\*. > > eg: the data contains books. Each book will have a field topics or text. > Now before indexing i would like to assign catagories to it. Say a > particular book is for hadoop, servlets etc.there may be n number of > catagories assigned. For assigning catagories i shall have dictionary in text format. > Any suggestions as to how i can proceed. > Is there any plugin available for the same? -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![Ivan](https://avatars.discourse-cdn.com/v4/letter/i/df788c/32.png) [@Ivan](https://discuss.elastic.co/u/Ivan)\ **Post date:** [April 5, 2013, 8:25pm UTC](https://discuss.elastic.co/t/auto-classification/11463/2 "2013-04-05T20:25:50Z")
There are no existing plugins for classification. I would be great to see an Elasticsearch wrapper around a library like Weka or LingPipe. There are many variables involved, it would be tough to get a general classifier to work from everybody. If you already have auto-classification running, I would keep the logic on the client-indexing side. -- Ivan On Fri, Apr 5, 2013 at 4:28 AM, kuwar sahani [kuwarsahani@gmail.com](mailto:kuwarsahani@gmail.com) wrote: > I'm working on a model where i will have the input data in _AVRO_ format > > > and index the data into _ES_. > > Before indexing I would like to add catagories to the data i.e _Auto_-\* > > Classification\*. > > > > eg: the data contains books. Each book will have a field topics or text. > > Now before indexing i would like to assign catagories to it. Say a > > particular book is for hadoop, servlets etc.there may be n number of > > catagories assigned. > > For assigning catagories i shall have dictionary in text format. > > > Any suggestions as to how i can proceed. > > Is there any plugin available for the same? > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![jprante](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jprante/32/44941_2.png) [@jprante](https://discuss.elastic.co/u/jprante)\ **Post date:** [April 5, 2013, 9:23pm UTC](https://discuss.elastic.co/t/auto-classification/11463/3 "2013-04-05T21:23:59Z")
Lucene 4.2 has started a simple classification package [http://lucene.apache.org/core/4\_2\_0/classification/org/apache/lucene/classification/package-summary.html](http://lucene.apache.org/core/4_2_0/classification/org/apache/lucene/classification/package-summary.html) Lucene 5.0 will get a classification module, I'm sure it will be usable by Elasticsearch API then. [https://issues.apache.org/jira/browse/LUCENE-4345](https://issues.apache.org/jira/browse/LUCENE-4345) Jörg Am 05.04.13 22:25, schrieb Ivan Brusic: > There are no existing plugins for classification. I would be great to > see an Elasticsearch wrapper around a library like Weka or LingPipe. > There are many variables involved, it would be tough to get a general > classifier to work from everybody. > > If you already have auto-classification running, I would keep the > logic on the client-indexing side. > > -- > Ivan > > On Fri, Apr 5, 2013 at 4:28 AM, kuwar sahani \<[kuwarsahani@gmail.com](mailto:kuwarsahani@gmail.com) > [mailto:kuwarsahani@gmail.com](mailto:kuwarsahani@gmail.com)\> wrote: > > ``` > I'm working on a model where i will have the input data in > *AVRO* format and index the data into *ES*. > Before indexing I would like to add catagories to the data i.e > *Auto*-*Classification*. > eg: the data contains books. Each book will have a field > topics or text. Now before indexing i would like to assign > catagories to it. Say a particular book is for hadoop, > servlets etc.there may be n number of catagories assigned. > > For assigning catagories i shall have dictionary in text format. > Any suggestions as to how i can proceed. > Is there any plugin available for the same? > > -- > You received this message because you are subscribed to the Google > Groups "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, > send an email to elasticsearch+unsubscribe@googlegroups.com > . > For more options, visit https://groups.google.com/groups/opt_out. > > ``` > > -- > You received this message because you are subscribed to the Google > Groups "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send > an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [April 6, 2013, 6:07am UTC](https://discuss.elastic.co/t/auto-classification/11463/4 "2013-04-06T06:07:16Z")
Another idea could be to use percolator feature. Before indexing a doc, percolate it and find the list of corresponding queries (percolators names). Add this list to your document as tags or categories. Index this doc. That said, you'll probably have to register many percolators. My 2 cents. -- David 😉 Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs Le 5 avr. 2013 à 22:25, Ivan Brusic [ivan@brusic.com](mailto:ivan@brusic.com) a écrit : There are no existing plugins for classification. I would be great to see an Elasticsearch wrapper around a library like Weka or LingPipe. There are many variables involved, it would be tough to get a general classifier to work from everybody. If you already have auto-classification running, I would keep the logic on the client-indexing side. -- Ivan On Fri, Apr 5, 2013 at 4:28 AM, kuwar sahani [kuwarsahani@gmail.com](mailto:kuwarsahani@gmail.com) wrote: > > I'm working on a model where i will have the input data in AVRO format and index the data into ES. > > Before indexing I would like to add catagories to the data i.e Auto-Classification. > > > > eg: the data contains books. Each book will have a field topics or text. Now before indexing i would like to assign catagories to it. Say a particular book is for hadoop, servlets etc.there may be n number of catagories assigned. > > For assigning catagories i shall have dictionary in text format. > > Any suggestions as to how i can proceed. > > Is there any plugin available for the same? > > -- > > You received this message because you are subscribed to the Google Groups "elasticsearch" group. > > To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![Borislav\_Gankov](https://avatars.discourse-cdn.com/v4/letter/b/b5ac83/32.png) [@Borislav\_Gankov](https://discuss.elastic.co/u/Borislav_Gankov)\ **Post date:** [April 8, 2013, 12:56pm UTC](https://discuss.elastic.co/t/auto-classification/11463/5 "2013-04-08T12:56:11Z")
I've come across an OpenNLP plugin though I've never used it: > **[spinscale/elasticsearch-opennlp-plugin](https://github.com/spinscale/elasticsearch-opennlp-plugin)** > > elasticsearch-opennlp-plugin - Additional opennlp mapping type for elasticsearch in order to perform named entity recognition -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![spinscale](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/spinscale/32/25011_2.png) [@spinscale](https://discuss.elastic.co/u/spinscale)\ **Post date:** [April 8, 2013, 1:52pm UTC](https://discuss.elastic.co/t/auto-classification/11463/6 "2013-04-08T13:52:48Z")
Hey, the opennlp plugin does not do classification, but only named entity recognition. I merely wrote to find out as a practice to convert parts of the excellent "Taming Text" book into elasticsearch architecture. Loading up the models requires half a gig of additional memory iirc - this is definately something you rather would want to have in an external application. But maybe it is a nice boilerplate for further work.. like a classification module. Need to take a closer look at the lucene classification, maybe it is easier to implement. --Alex On Mon, Apr 8, 2013 at 2:56 PM, Borislav Gankov [bgankov@gmail.com](mailto:bgankov@gmail.com) wrote: > I've come across an OpenNLP plugin though I've never used it: > [GitHub - spinscale/elasticsearch-opennlp-plugin: Additional opennlp mapping type for elasticsearch in order to perform named entity recognition](https://github.com/spinscale/elasticsearch-opennlp-plugin) > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![Muhammad\_Adel](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/muhammad_adel/32/1866_2.png) [@Muhammad\_Adel](https://discuss.elastic.co/u/Muhammad_Adel)\ **Post date:** [January 12, 2014, 2:21pm UTC](https://discuss.elastic.co/t/auto-classification/11463/7 "2014-01-12T14:21:54Z")
I perform automatic classification using the "fuzzy like this" query. I search for documents similar to the one i am indexing and give them the same classification. I tried this technique and It works nicely for me, but at first you will have to classify some documents manually to be used as learning data. -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/8e4ecc90-5397-4c35-8c1a-e3db3951ce3c%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/8e4ecc90-5397-4c35-8c1a-e3db3951ce3c%40googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![Tomas0413](https://avatars.discourse-cdn.com/v4/letter/t/ecccb3/32.png) [@Tomas0413](https://discuss.elastic.co/u/Tomas0413)\ **Post date:** [May 27, 2016, 12:55pm UTC](https://discuss.elastic.co/t/auto-classification/11463/8 "2016-05-27T12:55:26Z")
Hello, I was looking at document classification problem and I found that Solr 6.1 version (not yet released) has the "Document Classification" feature. It's based on "Lucene Classification Module". More details in this blog post: > **[Solr Document Classification - Part 1 - Indexing Time](http://alexbenedetti.blogspot.co.uk/2015/07/solr-document-classification-part-1.html)** > > Introduction In the previous blog \[1\] we have explored the world of Lucene Classification and the extension to use it for Document Classi... I tried to find if the equivalent feature exists in Elasticsearch, but it doesn't seem so. This topic also mentions that "Lucene 4.2 has started a simple classification package", but the topic itself is 865 days old. Do you know if there any plans to integrate "Lucene Classification Module" into Elasticsearch? ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 5, 2017, 10:48pm UTC](https://discuss.elastic.co/t/auto-classification/11463/9 "2017-07-05T22:48:29Z")