Index with documents in multiple languages

Elastic Stack Elasticsearch
1

Hello. I would like to index some documents, keep them in the same index,
but the documents are in different languages.
I'm thinking I must use a specific analyzer for each language. Should I
declare a mapping with a different type for each language and at index time
I specify that specific type?
Could this be done simpler? Thank you!

2

I'm looking at dynamic_templates feature. Can this be used to choose
specify a different analyzer based on a field value? Like a "language"
field in the document?

joi, 19 aprilie 2012, 16:01:54 UTC+3, Raaadu a scris:

Hello. I would like to index some documents, keep them in the same index,
but the documents are in different languages.
I'm thinking I must use a specific analyzer for each language. Should I
declare a mapping with a different type for each language and at index time
I specify that specific type?
Could this be done simpler? Thank you!

3

You can specify analyzer name in a
field: Elasticsearch Platform — Find real-time answers at scale | Elastic

On Thursday, April 19, 2012 11:51:15 AM UTC-4, Raaadu wrote:

I'm looking at dynamic_templates feature. Can this be used to choose
specify a different analyzer based on a field value? Like a "language"
field in the document?

joi, 19 aprilie 2012, 16:01:54 UTC+3, Raaadu a scris:

Hello. I would like to index some documents, keep them in the same index,
but the documents are in different languages.
I'm thinking I must use a specific analyzer for each language. Should I
declare a mapping with a different type for each language and at index time
I specify that specific type?
Could this be done simpler? Thank you!

4

You are right, and that is the feature I want to use. But I'll have
documents on all the languages and I'm asking if maybe there is another way
to to this beside defining a type for each document in a different language.
So dynamic mappings seem a cool feature, but I was wondering if I can vary
the language using a field value or I should vary a special field name in
order to dynamic map that document to a certain analyser

joi, 19 aprilie 2012, 20:54:46 UTC+3, Igor Motov a scris:

You can specify analyzer name in a field:
Elasticsearch Platform — Find real-time answers at scale | Elastic

On Thursday, April 19, 2012 11:51:15 AM UTC-4, Raaadu wrote:

I'm looking at dynamic_templates feature. Can this be used to choose
specify a different analyzer based on a field value? Like a "language"
field in the document?

joi, 19 aprilie 2012, 16:01:54 UTC+3, Raaadu a scris:

Hello. I would like to index some documents, keep them in the same
index, but the documents are in different languages.
I'm thinking I must use a specific analyzer for each language. Should I
declare a mapping with a different type for each language and at index time
I specify that specific type?
Could this be done simpler? Thank you!

5

I think I got it. Thank you:)

vineri, 20 aprilie 2012, 09:59:36 UTC+3, Raaadu a scris:

You are right, and that is the feature I want to use. But I'll have
documents on all the languages and I'm asking if maybe there is another way
to to this beside defining a type for each document in a different language.
So dynamic mappings seem a cool feature, but I was wondering if I can vary
the language using a field value or I should vary a special field name in
order to dynamic map that document to a certain analyser

joi, 19 aprilie 2012, 20:54:46 UTC+3, Igor Motov a scris:

You can specify analyzer name in a field:
Elasticsearch Platform — Find real-time answers at scale | Elastic

On Thursday, April 19, 2012 11:51:15 AM UTC-4, Raaadu wrote:

I'm looking at dynamic_templates feature. Can this be used to choose
specify a different analyzer based on a field value? Like a "language"
field in the document?

joi, 19 aprilie 2012, 16:01:54 UTC+3, Raaadu a scris:

Hello. I would like to index some documents, keep them in the same
index, but the documents are in different languages.
I'm thinking I must use a specific analyzer for each language. Should I
declare a mapping with a different type for each language and at index time
I specify that specific type?
Could this be done simpler? Thank you!

6

Hi Raaadu,

Can you please tell me how you archive that?
I have same requirement for multiple languages.
I want to store Product data and in that Product name & description can be
in any language and other information are in english
Can you please explain with example?

Thanks

On Friday, April 20, 2012 1:20:27 PM UTC+5:30, Raaadu wrote:

I think I got it. Thank you:)