# Improved stemming for Arabic

**URL:** https://discuss.elastic.co/t/improved-stemming-for-arabic/17172
**Category:** Elasticsearch
**Created:** [April 24, 2014, 11:11am UTC](https://discuss.elastic.co/t/improved-stemming-for-arabic/17172 "2014-04-24T11:11:57Z")
**Posts on this page:** 3
**Page:** 1

<div class="post-metadata">

### Author: ![angella](https://avatars.discourse-cdn.com/v4/letter/a/6f9a4e/32.png) [@angella](https://discuss.elastic.co/u/angella)
#### Post date: [April 24, 2014, 11:11am UTC](https://discuss.elastic.co/t/improved-stemming-for-arabic/17172/1 "2014-04-24T11:11:57Z")

</div>

Hello everyone,  
I'm trying to improve stemming for Arabic language.  
We already use elasticsearch stemmer for Arabic, but it is still not good  
enough to make all our stemmer tests pass.  
I spent few days wondering the internet but wasn't able to found something  
else.  
Only hunspell. But now I can't find working dictionary.  
The only one that actually looks like matching (this one[http://ayaspell.sourceforge.net/index.php?content=english](http://ayaspell.sourceforge.net/index.php?content=english))  
doesn't work, throwing different parsing exceptions that ends up in _String  
index out of range: 11_ which I actually don't have an idea how to fix.

Does anyone know something about good Arabic stemmer, or where can I find a  
dictionary? Would really appreciate any help.

Thanks.

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/fbb23791-cf59-4255-bd0f-7ffa487c2b28%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/fbb23791-cf59-4255-bd0f-7ffa487c2b28%40googlegroups.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

### Author: ![Itamar\_Syn\_Hershko](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/itamar_syn_hershko/32/725_2.png) [@Itamar\_Syn\_Hershko](https://discuss.elastic.co/u/Itamar_Syn_Hershko)
#### Post date: [April 24, 2014, 11:18am UTC](https://discuss.elastic.co/t/improved-stemming-for-arabic/17172/2 "2014-04-24T11:18:27Z")

</div>

There's this: [AraMorph](http://www.nongnu.org/aramorph/) (which I believe was  
contributed to Lucene a while ago). Elasticsearch uses the snowball Arabic  
stemmer, which is different than Lucene's provided Arabic stemmer.

But there's a paper showing that the light-10 algorithm/stemmer and even  
4-5 grams perform much better than the above two, you should try those.  
They do not require a dictionary.

I can't seem to find that paper now, the link I had to it seems to be  
broken.

--

Itamar Syn-Hershko  
[http://code972.com](http://code972.com) | @synhershko [https://twitter.com/synhershko](https://twitter.com/synhershko)  
Freelance Developer & Consultant  
Author of RavenDB in Action [http://manning.com/synhershko/](http://manning.com/synhershko/)

On Thu, Apr 24, 2014 at 2:11 PM, Angel Cross [niegis19@gmail.com](mailto:niegis19@gmail.com) wrote:

> Hello everyone,  
> I'm trying to improve stemming for Arabic language.  
> We already use elasticsearch stemmer for Arabic, but it is still not good  
> enough to make all our stemmer tests pass.  
> I spent few days wondering the internet but wasn't able to found something  
> else.  
> Only hunspell. But now I can't find working dictionary.  
> The only one that actually looks like matching (this one[http://ayaspell.sourceforge.net/index.php?content=english](http://ayaspell.sourceforge.net/index.php?content=english))  
> doesn't work, throwing different parsing exceptions that ends up in _String  
> index out of range: 11_ which I actually don't have an idea how to fix.
> 
> Does anyone know something about good Arabic stemmer, or where can I find  
> a dictionary? Would really appreciate any help.
> 
> Thanks.
> 
> --  
> You received this message because you are subscribed to the Google Groups  
> "elasticsearch" group.  
> To unsubscribe from this group and stop receiving emails from it, send an  
> email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> To view this discussion on the web visit  
> [https://groups.google.com/d/msgid/elasticsearch/fbb23791-cf59-4255-bd0f-7ffa487c2b28%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/fbb23791-cf59-4255-bd0f-7ffa487c2b28%40googlegroups.com)[https://groups.google.com/d/msgid/elasticsearch/fbb23791-cf59-4255-bd0f-7ffa487c2b28%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/fbb23791-cf59-4255-bd0f-7ffa487c2b28%40googlegroups.com?utm_medium=email&utm_source=footer)  
> .  
> For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAHTr4ZsBGLjG7YCNhMKxRJAQCdX5Twk%3D6mLJgUo5iVQ0H1ZpZQ%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAHTr4ZsBGLjG7YCNhMKxRJAQCdX5Twk%3D6mLJgUo5iVQ0H1ZpZQ%40mail.gmail.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [July 6, 2017, 1:33am UTC](https://discuss.elastic.co/t/improved-stemming-for-arabic/17172/3 "2017-07-06T01:33:47Z")

</div>


