Detect language on import


(James-3) #1

Hi,

I want to import a lot of data into my index and tag each entry with the
language with which it is in. Does elasticsearch have any capability to
detect and tag my entries with the language that they are written in?

It seems to be done in SOLR but I couldn't see an equivalent in ES:
http://wiki.apache.org/solr/LanguageDetection

Any help or info would be much appreciated.

James

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/5ed83469-3f37-45d5-b164-8f083a2d866a%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.


(Matt Weber) #2

Here you go.

Thanks,
Matt Weber

On Mon, Dec 2, 2013 at 8:39 AM, James mail@employ.com wrote:

Hi,

I want to import a lot of data into my index and tag each entry with the
language with which it is in. Does elasticsearch have any capability to
detect and tag my entries with the language that they are written in?

It seems to be done in SOLR but I couldn't see an equivalent in ES:
http://wiki.apache.org/solr/LanguageDetection

Any help or info would be much appreciated.

James

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/5ed83469-3f37-45d5-b164-8f083a2d866a%40googlegroups.com
.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAJ3KEoDi76rAoE5bGE8eZms727VtwbDyrSEK7eaioSeSy4799g%40mail.gmail.com.
For more options, visit https://groups.google.com/groups/opt_out.


(James-3) #3

Ok, I'll look into this. Can I assume that there is nothing built in then,
all solutions would be additional plugins?

On 2 December 2013 16:49, Matt Weber matt.weber@gmail.com wrote:

Here you go.

https://github.com/jprante/elasticsearch-langdetect

Thanks,
Matt Weber

On Mon, Dec 2, 2013 at 8:39 AM, James mail@employ.com wrote:

Hi,

I want to import a lot of data into my index and tag each entry with the
language with which it is in. Does elasticsearch have any capability to
detect and tag my entries with the language that they are written in?

It seems to be done in SOLR but I couldn't see an equivalent in ES:
http://wiki.apache.org/solr/LanguageDetection

Any help or info would be much appreciated.

James

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.

To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/5ed83469-3f37-45d5-b164-8f083a2d866a%40googlegroups.com
.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/d8RKuej7yHI/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAJ3KEoDi76rAoE5bGE8eZms727VtwbDyrSEK7eaioSeSy4799g%40mail.gmail.com
.

For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAPng%3D3fRy2%3DNp3-9ML3PLrAp7JGAwGMVm5BJL2WkbvjV0FiDhQ%40mail.gmail.com.
For more options, visit https://groups.google.com/groups/opt_out.


(system) #4