SynonymTokenFilterFactory class passes indexSettings to TokenizerFactory

Elastic Stack Elasticsearch
1

Hi.
I have a question about behavior of SynonymTokenFilterFactory class.

I expect that "settings" parameter of TokenizerFactory is tokenizer's
settings. However, SynonymTokenFilterFactory passes indexSettings to
"settings" parameter of TokenizerFactory.

final TokenizerFactory tokenizerFactory =

tokenizerFactoryFactory.create(tokenizerName, indexSettings);

SynonymTokenFilterFactory was changed by the following commit.

Is the behavior changed?

At Elasticsearch 1.3, the following setting works. "bigramTokenizer" of
synonymTest gets (min_gram/max_gram) settings.

curl -XPUT localhost:9200/test -d '{
"settings" : {
"analysis" : {
"analyzer" : {
"bigram_analyzer" : {
"type" : "custom",
"tokenizer" : "bigramTokenizer",
"filter" : ["synonymTest"]
}
},
"tokenizer" : {
"bigramTokenizer" : {
"type" : "ngram",
"min_gram" : 2,
"max_gram" : 2
}
},
"filter" : {
"synonymTest" : {
"type" : "synonym",
"synonyms_path" : "synonym.txt",
"tokenizer" : "bigramTokenizer",
"min_gram" : 2,
"max_gram" : 2
}
}
}
}
}'

At Elasticsearch 1.5, it does not work.

Thanks in advance,
Yosuke

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/dbcceb52-7b7a-45a3-ae48-2a844f414263%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

2

Hi Yosuke,

Thanks for reporting.
I think that is bug, it should work 1.5.
I will open Issue and create PR, soon.

2015-03-31 14:55 GMT+09:00 yfujita@n2sm.net:

Hi.
I have a question about behavior of SynonymTokenFilterFactory class.

I expect that "settings" parameter of TokenizerFactory is tokenizer's
settings. However, SynonymTokenFilterFactory passes indexSettings to
"settings" parameter of TokenizerFactory.

final TokenizerFactory tokenizerFactory =

tokenizerFactoryFactory.create(tokenizerName, indexSettings);

SynonymTokenFilterFactory was changed by the following commit.

[CORE] Be more explicit if index.version.created is not set · elastic/elasticsearch@ac4b39b · GitHub

Is the behavior changed?

At Elasticsearch 1.3, the following setting works. "bigramTokenizer" of
synonymTest gets (min_gram/max_gram) settings.

curl -XPUT localhost:9200/test -d '{
"settings" : {
"analysis" : {
"analyzer" : {
"bigram_analyzer" : {
"type" : "custom",
"tokenizer" : "bigramTokenizer",
"filter" : ["synonymTest"]
}
},
"tokenizer" : {
"bigramTokenizer" : {
"type" : "ngram",
"min_gram" : 2,
"max_gram" : 2
}
},
"filter" : {
"synonymTest" : {
"type" : "synonym",
"synonyms_path" : "synonym.txt",
"tokenizer" : "bigramTokenizer",
"min_gram" : 2,
"max_gram" : 2
}
}
}
}
}'

At Elasticsearch 1.5, it does not work.

Thanks in advance,
Yosuke

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/dbcceb52-7b7a-45a3-ae48-2a844f414263%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/dbcceb52-7b7a-45a3-ae48-2a844f414263%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--

Jun Ohtani
blog : http://blog.johtani.info

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAPW8A5wXsN8jUB0zSBJwGyKPfFSPS9JD2GoKAqu5OJU0y4eEyw%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.