Searching vor numbers

eutychus · February 21, 2016, 10:41am

are there any analyzers to translate numbers to text?

I want to have the ability to find values like 20 and zwanzig (twenty) as equals.

TIA
Eutychus

warkolm · February 21, 2016, 8:00pm

You could leverage synonyms - https://www.elastic.co/guide/en/elasticsearch/reference/2.2/analysis-synonym-tokenfilter.html

jprante · February 22, 2016, 8:39am

There are two methods:

parsing text to generate numbers: "zwanzig" -> 20
writing numbers as text: 20 -> "zwanzig"

Should the index contain numbers or text?

jprante · February 22, 2016, 4:37pm

I have added a "spellout" locale-based number format token filter to my customized ICU implementation, see

It translates numbers to text, and the text is indexed. So if you have a text with "20" or with "zwanzig", both are indexed as "zwanzig".

Example of a setting:

github.com

jprante/elasticsearch-plugin-bundle/blob/6ff3a41cfaf7d1b7d185e8b55e78465dfd41e1b6/src/test/resources/org/xbib/elasticsearch/index/analysis/icu/icu_numberformat.json

{
    "index":{
        "analysis":{
            "filter" : {
                "spellout_de" : {
                  "type" : "icu_numberformat",
                  "locale" : "de",
                  "format" : "spellout"
                },
                "spellout_en" : {
                  "type" : "icu_numberformat",
                  "locale" : "en_US",
                  "format" : "spellout"
                }
            },
            "tokenizer" : {
                "my_tokenizer" : {
                  "type" : "icu_tokenizer",
                  "filter" : "spellout_de"
                }

This file has been truncated. show original

Note, the RuleBasedNumberFormat class of ICU which I use for this token filter is working in lenient mode, which is quite slow.

eutychus · February 23, 2016, 5:23pm

Thank you for your help.

even if you suggestion seems to be particularly promising it is not possible to me to try it out, because the servers running the elasticsearch service are using openjava 7