Language analyzer


(nachiket) #1

Hi.
I am working on analyzer and I want to customize my analyzer so that
it can look up words from ditcionary.
I have noticed that there is an option of language analyser in Elastic
Search. But unfortunately there is no documentation of how to use it.
Can somebody tell me correct syntex of how to use it and what kind of
dictionary file is required?
Can I build my own dictionary?

Regards.


(Shay Banon) #2

Which dictionary is that? Have you built your own Lucene analyzer and want to plug it into elasticsearch?

On Monday, July 4, 2011 at 4:57 PM, nachiket bhagwat wrote:

Hi.
I am working on analyzer and I want to customize my analyzer so that
it can look up words from ditcionary.
I have noticed that there is an option of language analyser in Elastic
Search. But unfortunately there is no documentation of how to use it.
Can somebody tell me correct syntex of how to use it and what kind of
dictionary file is required?
Can I build my own dictionary?

Regards.


(yugi_oh) #3

Hi Kimchy and all,

I'm new guy in ES. I'm doing some research on internet and I get some information (just a little) about language search.
For example oe -> Ö in Germany language.

So could you please share to me how to let ES detect it? Is there any special configuration?

Thanks and wish you have a nice day!


(nachiket) #4

Yes. I have my own analyzer and I want to use a dictionary for that. I
don't know what kind of dictionary can be used. Actually I want to
know what kind of dictionary can be used. Also I want to know how to
plug it in my analyzer.

On Jul 5, 12:35 am, Shay Banon shay.ba...@elasticsearch.com wrote:

Which dictionary is that? Have you built your own Lucene analyzer and want to plug it into elasticsearch?

On Monday, July 4, 2011 at 4:57 PM, nachiket bhagwat wrote:

Hi.
I am working on analyzer and I want to customize my analyzer so that
it can look up words from ditcionary.
I have noticed that there is an option of language analyser in Elastic
Search. But unfortunately there is no documentation of how to use it.
Can somebody tell me correct syntex of how to use it and what kind of
dictionary file is required?
Can I build my own dictionary?

Regards.


(Lukáš Vlček) #5

Hi,

may be if you can give some example that would help.
If all you want is to plugin your custom analyzer and load some dictionary
from flat file then this should be really easy (you can check synonym filter
or stemmer override filter [as of writing in master] for inspiration).

Regards,
Lukas

On Tue, Jul 5, 2011 at 1:32 PM, nachiket bhagwat
nachiketbhagwat@gmail.comwrote:

Yes. I have my own analyzer and I want to use a dictionary for that. I
don't know what kind of dictionary can be used. Actually I want to
know what kind of dictionary can be used. Also I want to know how to
plug it in my analyzer.

On Jul 5, 12:35 am, Shay Banon shay.ba...@elasticsearch.com wrote:

Which dictionary is that? Have you built your own Lucene analyzer and
want to plug it into elasticsearch?

On Monday, July 4, 2011 at 4:57 PM, nachiket bhagwat wrote:

Hi.
I am working on analyzer and I want to customize my analyzer so that
it can look up words from ditcionary.
I have noticed that there is an option of language analyser in Elastic
Search. But unfortunately there is no documentation of how to use it.
Can somebody tell me correct syntex of how to use it and what kind of
dictionary file is required?
Can I build my own dictionary?

Regards.


(Otis Gospodnetić) #6

Hi,

I have my own analyzer and I want to use a dictionary for that. I
don't know what kind of dictionary can be used. Actually I want to
know what kind of dictionary can be used.

Because of the above, it sounds to me like Nachiket may be better of
first using Lucene directly and figuring out what dictionary to use
and how exactly to use it, and then once that is clear figure out how
to plug his/her Analyzer into ES.

Otis

Sematext is hiring search people! http://sematext.com/about/jobs.html

On Jul 6, 3:41 pm, Lukáš Vlček lukas.vl...@gmail.com wrote:

Hi,

may be if you can give some example that would help.
If all you want is to plugin your custom analyzer and load some dictionary
from flat file then this should be really easy (you can check synonym filter
or stemmer override filter [as of writing in master] for inspiration).

Regards,
Lukas

On Tue, Jul 5, 2011 at 1:32 PM, nachiket bhagwat
nachiketbhag...@gmail.comwrote:

Yes. I have my own analyzer and I want to use a dictionary for that. I
don't know what kind of dictionary can be used. Actually I want to
know what kind of dictionary can be used. Also I want to know how to
plug it in my analyzer.

On Jul 5, 12:35 am, Shay Banon shay.ba...@elasticsearch.com wrote:

Which dictionary is that? Have you built your own Lucene analyzer and
want to plug it into elasticsearch?

On Monday, July 4, 2011 at 4:57 PM, nachiket bhagwat wrote:

Hi.
I am working on analyzer and I want to customize my analyzer so that
it can look up words from ditcionary.
I have noticed that there is an option of language analyser in Elastic
Search. But unfortunately there is no documentation of how to use it.
Can somebody tell me correct syntex of how to use it and what kind of
dictionary file is required?
Can I build my own dictionary?

Regards.


(sandeep15mca) #7

HI any one told me how be use mysql db in place of couchdb for apply
searching may it is possible or not.

                                            thanks.

On Thu, Jul 7, 2011 at 2:55 AM, Otis otis.gospodnetic@gmail.com wrote:

Hi,

I have my own analyzer and I want to use a dictionary for that. I
don't know what kind of dictionary can be used. Actually I want to
know what kind of dictionary can be used.

Because of the above, it sounds to me like Nachiket may be better of
first using Lucene directly and figuring out what dictionary to use
and how exactly to use it, and then once that is clear figure out how
to plug his/her Analyzer into ES.

Otis

Sematext is hiring search people! http://sematext.com/about/jobs.html

On Jul 6, 3:41 pm, Lukáš Vlček lukas.vl...@gmail.com wrote:

Hi,

may be if you can give some example that would help.
If all you want is to plugin your custom analyzer and load some
dictionary
from flat file then this should be really easy (you can check synonym
filter
or stemmer override filter [as of writing in master] for inspiration).

Regards,
Lukas

On Tue, Jul 5, 2011 at 1:32 PM, nachiket bhagwat
nachiketbhag...@gmail.comwrote:

Yes. I have my own analyzer and I want to use a dictionary for that. I
don't know what kind of dictionary can be used. Actually I want to
know what kind of dictionary can be used. Also I want to know how to
plug it in my analyzer.

On Jul 5, 12:35 am, Shay Banon shay.ba...@elasticsearch.com wrote:

Which dictionary is that? Have you built your own Lucene analyzer and
want to plug it into elasticsearch?

On Monday, July 4, 2011 at 4:57 PM, nachiket bhagwat wrote:

Hi.
I am working on analyzer and I want to customize my analyzer so
that

it can look up words from ditcionary.
I have noticed that there is an option of language analyser in
Elastic

Search. But unfortunately there is no documentation of how to use
it.

Can somebody tell me correct syntex of how to use it and what kind
of

dictionary file is required?
Can I build my own dictionary?

Regards.


(system) #8