Unexpected (and failed) attempts to add field analyzer mappings


(John Chang) #1

We add field mappings to our document types upon new index creation and it works well.

However, we see odd attempts to re-add the analyzer mappings at the startup time of our services that instantiate no-data elastic search nodes. There is nothing in our startup sequence that send off these mappings that we can see. It just looks like it is re-adding the mappings (or at least some of them), and it fails. For example from our logs at startup time:

19:55:53,388 WARN [elasticsearch[Scrambler]clusterService#updateTask-pool-7-thread-1] [indices.cluster] - [Scrambler] [index0] failed to add mapping [mail], source [org.elasticsearch.common.compress.CompressedString@bb75f1ce]
org.elasticsearch.index.mapper.MapperParsingException: Analyzer [kihaSnowball] not found for field [to]

We've started seeing this after startup time as well.

Again, all is working fine, and when we check the mappings, they are happy. We just see these concerning errors in the logs.


(Shay Banon) #2

I am guessing this is because the analyzer is not defined in the non data
nodes settings as well. In 0.12, the high level indexes were created on all
nodes (each high level index can have zero or more shards allocated), and
some data is associated with it, for example, parsed mappings, analyzers and
so on.

As part of the effort to improve cases where many indices are created, in
master (0.13) there as been quite a big refactoring, causing those high
level index constructs to be created only if a shard is allocated on that
node. Of course, for non data nodes, this will never happen, so you won't
need to define these analyzers on the node itself.

-shay.banon

On Thu, Nov 4, 2010 at 9:59 PM, John Chang jchangkihtest2@gmail.com wrote:

We add field mappings to our document types upon new index creation and it
works well.

However, we see odd attempts to re-add the analyzer mappings at the startup
time of our services that instantiate no-data elastic search nodes. There
is nothing in our startup sequence that send off these mappings that we can
see. It just looks like it is re-adding the mappings (or at least some of
them), and it fails. For example from our logs at startup time:

19:55:53,388 WARN
[elasticsearch[Scrambler]clusterService#updateTask-pool-7-thread-1]
[indices.cluster] - [Scrambler] [index0] failed to add mapping [mail],
source [org.elasticsearch.common.compress.CompressedString@bb75f1ce]
org.elasticsearch.index.mapper.MapperParsingException: Analyzer
[kihaSnowball] not found for field [to]

We've started seeing this after startup time as well.

Again, all is working fine, and when we check the mappings, they are happy.
We just see these concerning errors in the logs.

--
View this message in context:
http://elasticsearch-users.115913.n3.nabble.com/Unexpected-and-failed-attempts-to-add-field-analyzer-mappings-tp1844246p1844246.html
Sent from the ElasticSearch Users mailing list archive at Nabble.com.


(James Cook) #3

I hope the book will be released at the same time ES 1.0!

:smiley:

On Thu, Nov 4, 2010 at 5:55 PM, Shay Banon shay.banon@elasticsearch.comwrote:

I am guessing this is because the analyzer is not defined in the non data
nodes settings as well. In 0.12, the high level indexes were created on all
nodes (each high level index can have zero or more shards allocated), and
some data is associated with it, for example, parsed mappings, analyzers and
so on.

As part of the effort to improve cases where many indices are created, in
master (0.13) there as been quite a big refactoring, causing those high
level index constructs to be created only if a shard is allocated on that
node. Of course, for non data nodes, this will never happen, so you won't
need to define these analyzers on the node itself.

-shay.banon

On Thu, Nov 4, 2010 at 9:59 PM, John Chang jchangkihtest2@gmail.comwrote:

We add field mappings to our document types upon new index creation and it
works well.

However, we see odd attempts to re-add the analyzer mappings at the
startup
time of our services that instantiate no-data elastic search nodes. There
is nothing in our startup sequence that send off these mappings that we
can
see. It just looks like it is re-adding the mappings (or at least some of
them), and it fails. For example from our logs at startup time:

19:55:53,388 WARN
[elasticsearch[Scrambler]clusterService#updateTask-pool-7-thread-1]
[indices.cluster] - [Scrambler] [index0] failed to add mapping [mail],
source [org.elasticsearch.common.compress.CompressedString@bb75f1ce]
org.elasticsearch.index.mapper.MapperParsingException: Analyzer
[kihaSnowball] not found for field [to]

We've started seeing this after startup time as well.

Again, all is working fine, and when we check the mappings, they are
happy.
We just see these concerning errors in the logs.

--
View this message in context:
http://elasticsearch-users.115913.n3.nabble.com/Unexpected-and-failed-attempts-to-add-field-analyzer-mappings-tp1844246p1844246.html
Sent from the ElasticSearch Users mailing list archive at Nabble.com.


(system) #4