# \[ANNOUNCEMENT\] Elasticsearch analysis lemmagen plugin update

**URL:** <https://discuss.elastic.co/t/announcement-elasticsearch-analysis-lemmagen-plugin-update/120707>\
**Category:** Community Ecosystem\
**Created:** [February 20, 2018, 6:33pm UTC](https://discuss.elastic.co/t/announcement-elasticsearch-analysis-lemmagen-plugin-update/120707 "2018-02-20T18:33:05Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![vhyza](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/vhyza/32/44869_2.png) [@vhyza](https://discuss.elastic.co/u/vhyza)\
**Post date:** [February 20, 2018, 6:33pm UTC](https://discuss.elastic.co/t/announcement-elasticsearch-analysis-lemmagen-plugin-update/120707/1 "2018-02-20T18:33:05Z")

</div>

Hi,

back in 2013 I wrote plugin which provides [jLemmaGen](https://bitbucket.org/hlavki/jlemmagen) lematizer with some prebuilt lexicons as elasticsearch token filter. As it turned out, lexicon license was very restrictive. The plugin was usable only for non-commercial _research_ projects. You can take a look at the original thread [[ANN] LemmaGen Analysis for ElasticSearch plugin](https://discuss.elastic.co/t/ann-lemmagen-analysis-for-elasticsearch-plugin/14585).

Some time ago I found that source data [MULTEXT-East free lexicons 4.0](https://www.clarin.si/repository/xmlui/handle/11356/1041) are distributed under [Creative Commons - Attribution-ShareAlike 4.0 International (CC BY-SA 4.0)](https://creativecommons.org/licenses/by-sa/4.0/) which I believe means, that we can generate lexicons from this source, publish them with the same license (CC BY-SA 4.0)]([https://creativecommons.org/licenses/by-sa/4.0/](https://creativecommons.org/licenses/by-sa/4.0/)) and use them with the plugin.

For this reason I removed built-in lexicons from the plugin (beginning with the plugin v6.0.0) and prepared separate [repository for the lexicons](https://github.com/vhyza/lemmagen-lexicons).

- **free lexicons** ([CC BY-SA 4.0](https://creativecommons.org/licenses/by-sa/4.0/))
  - Bulgarian
  - Czech
  - English
  - Estonian
  - French
  - Hungarian
  - Romanian
  - Slovak
  - Resian (sl dialect)
  - Slovene
  - Ukrainian

- **non-free lexicons** ([CC BY-NC 4.0](https://creativecommons.org/licenses/by-nc/4.0/))
  - Farsi / Persian
  - Macedonian
  - Polish
  - Russian
  - Serbian

I also updated plugin to work well with (almost) all elasticsearch 5.x and 6.x versions. But with the beginning of the version 6.0.0 there is need to download particular lexicon from [lexicons](https://github.com/vhyza/lemmagen-lexicons) repository.

I believe this breaking change will allow us to use this elasticsearch plugin even for commercial projects (with the **free** lexicons).

More information can be found at [elasticsearch-analysis-lemmagen](https://github.com/vhyza/elasticsearch-analysis-lemmagen) and [lemmagen-lexicons](https://github.com/vhyza/lemmagen-lexicons) repositories.

Regards,  
Vojta

---

<div class="post-metadata">

**Author:** ![vhyza](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/vhyza/32/44869_2.png) [@vhyza](https://discuss.elastic.co/u/vhyza)\
**Post date:** [June 14, 2018, 9:45am UTC](https://discuss.elastic.co/t/announcement-elasticsearch-analysis-lemmagen-plugin-update/120707/2 "2018-06-14T09:45:07Z")

</div>

Version for the new elasticsearch 6.3.0 released [https://github.com/vhyza/elasticsearch-analysis-lemmagen/releases/tag/v6.3.0](https://github.com/vhyza/elasticsearch-analysis-lemmagen/releases/tag/v6.3.0)

---

<div class="post-metadata">

**Author:** ![vhyza](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/vhyza/32/44869_2.png) [@vhyza](https://discuss.elastic.co/u/vhyza)\
**Post date:** [May 18, 2020, 4:15pm UTC](https://discuss.elastic.co/t/announcement-elasticsearch-analysis-lemmagen-plugin-update/120707/3 "2020-05-18T16:15:52Z")

</div>

Version for the elasticsearch 7.7.0 released as 100th release of the plugin 🥳 - [https://github.com/vhyza/elasticsearch-analysis-lemmagen/releases/tag/v7.7.0](https://github.com/vhyza/elasticsearch-analysis-lemmagen/releases/tag/v7.7.0)

Also the elasticsearch version 6.8.9 got its own release - [https://github.com/vhyza/elasticsearch-analysis-lemmagen/releases/tag/v6.8.9](https://github.com/vhyza/elasticsearch-analysis-lemmagen/releases/tag/v6.8.9)

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [June 23, 2020, 6:03am UTC](https://discuss.elastic.co/t/announcement-elasticsearch-analysis-lemmagen-plugin-update/120707/4 "2020-06-23T06:03:53Z")

</div>