# Gibberish Classifier with Elastic Search - Is it Possible?

**URL:** <https://discuss.elastic.co/t/gibberish-classifier-with-elastic-search-is-it-possible/20098>\
**Category:** Elasticsearch\
**Created:** [October 6, 2014, 8:45pm UTC](https://discuss.elastic.co/t/gibberish-classifier-with-elastic-search-is-it-possible/20098 "2014-10-06T20:45:45Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![Mauricio\_Moraes](https://avatars.discourse-cdn.com/v4/letter/m/54ee81/32.png) [@Mauricio\_Moraes](https://discuss.elastic.co/u/Mauricio_Moraes)\
**Post date:** [October 6, 2014, 8:45pm UTC](https://discuss.elastic.co/t/gibberish-classifier-with-elastic-search-is-it-possible/20098/1 "2014-10-06T20:45:45Z")

</div>

I have a system that stores user suggestions. Since the answers come from a  
touchscreen, the kids love to insert comments like:

_asduhaduh3189189'uih'dh_  
_\<3_  
_asdasdasdas_  
_gfdghgfhe_  
_n035gh9091v_

I created a bayesian classifier and trained it with thousands of answers.  
Now it filters the user inputs quite well and very few gibberishes are  
passing.  
Although, I wanted to know if someone has faced similar problems and found  
a way to deal with it using any Elastic Search capability.

How would you separate the gibberish from valid answers with ES?  
Any idea?

Thanks

Mauricio Moraes

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/9c3c9421-9941-4859-9e82-2ef942742297%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/9c3c9421-9941-4859-9e82-2ef942742297%40googlegroups.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![jprante](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jprante/32/44941_2.png) [@jprante](https://discuss.elastic.co/u/jprante)\
**Post date:** [October 6, 2014, 9:57pm UTC](https://discuss.elastic.co/t/gibberish-classifier-with-elastic-search-is-it-possible/20098/2 "2014-10-06T21:57:59Z")

</div>

Lucene comes with some classifier implementations, but they are not  
integrated into Elasticsearch API yet.

For more details, see

[http://soleami.com/blog/comparing-document-classification-functions-of-lucene-and-mahout.html](http://soleami.com/blog/comparing-document-classification-functions-of-lucene-and-mahout.html)

Jörg

On Mon, Oct 6, 2014 at 10:45 PM, Mauricio Moraes \<  
[mauricioflaviomoraes@gmail.com](mailto:mauricioflaviomoraes@gmail.com)\> wrote:

> I have a system that stores user suggestions. Since the answers come from  
> a touchscreen, the kids love to insert comments like:
> 
> _asduhaduh3189189'uih'dh_  
> _\<3_  
> _asdasdasdas_  
> _gfdghgfhe_  
> _n035gh9091v_
> 
> I created a bayesian classifier and trained it with thousands of answers.  
> Now it filters the user inputs quite well and very few gibberishes are  
> passing.  
> Although, I wanted to know if someone has faced similar problems and found  
> a way to deal with it using any Elastic Search capability.
> 
> How would you separate the gibberish from valid answers with ES?  
> Any idea?
> 
> Thanks
> 
> Mauricio Moraes
> 
> --  
> You received this message because you are subscribed to the Google Groups  
> "elasticsearch" group.  
> To unsubscribe from this group and stop receiving emails from it, send an  
> email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> To view this discussion on the web visit  
> [https://groups.google.com/d/msgid/elasticsearch/9c3c9421-9941-4859-9e82-2ef942742297%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/9c3c9421-9941-4859-9e82-2ef942742297%40googlegroups.com)  
> [https://groups.google.com/d/msgid/elasticsearch/9c3c9421-9941-4859-9e82-2ef942742297%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/9c3c9421-9941-4859-9e82-2ef942742297%40googlegroups.com?utm_medium=email&utm_source=footer)  
> .  
> For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAKdsXoFtdOzOno48oFQnWZXpTX%3DcJJR-Dp16u2VSc6fr0RFj5w%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAKdsXoFtdOzOno48oFQnWZXpTX%3DcJJR-Dp16u2VSc6fr0RFj5w%40mail.gmail.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 12:58am UTC](https://discuss.elastic.co/t/gibberish-classifier-with-elastic-search-is-it-possible/20098/3 "2017-07-06T00:58:02Z")

</div>

Closed on July 6, 2017, 12:58am UTC