Stuck in 're-syncing mappings with cluster state for types xxx'

Filirom1 · October 9, 2012, 9:38am

Hi,

I am doing a lot of inserts in ElasticSearch (v0.19.7), and in the logs I
see a lot of re-syncing mappings on the same index, same type :

$ tail -n 1000 -f /MIDDLE/smartdata/elasticsearch/logs/search-0.19.log
|grep 4f192de7ac617edb1a0005d8 |head

[2012-10-09 11:09:38,094][INFO ][cluster.metadata ]
[tpsmdt04s] [4f180a2f9dba645d0d000001] update_mapping
[4f192de7ac617edb1a0005d8] (dynamic)

[2012-10-09 11:09:38,128][INFO ][cluster.metadata ]
[tpsmdt04s] [4f180a2f9dba645d0d000001] update_mapping
[4f192de7ac617edb1a0005d8] (dynamic)

[2012-10-09 11:10:07,198][INFO ][cluster.metadata ]
[tpsmdt04s] [4f180a2f9dba645d0d000001] update_mapping
[4f192de7ac617edb1a0005d8] (dynamic)

[2012-10-09 11:12:42,406][WARN ][cluster.metadata ]
[tpsmdt04s] [4f180a2f9dba645d0d000001] re-syncing mappings with
cluster state for types [[4f192de7ac617edb1a0005d8]]

[2012-10-09 11:12:43,609][WARN ][cluster.metadata ]
[tpsmdt04s] [4f180a2f9dba645d0d000001] re-syncing mappings with
cluster state for types [[4f192de7ac617edb1a0005d8]]

[2012-10-09 11:12:44,807][WARN ][cluster.metadata ]
[tpsmdt04s] [4f180a2f9dba645d0d000001] re-syncing mappings with
cluster state for types [[4f192de7ac617edb1a0005d8]]

[2012-10-09 11:12:46,172][WARN ][cluster.metadata ]
[tpsmdt04s] [4f180a2f9dba645d0d000001] re-syncing mappings with
cluster state for types [[4f192de7ac617edb1a0005d8]]

[2012-10-09 11:12:48,678][WARN ][cluster.metadata ]
[tpsmdt04s] [4f180a2f9dba645d0d000001] re-syncing mappings with
cluster state for types [[4f192de7ac617edb1a0005d8]]

[2012-10-09 11:12:50,418][WARN ][cluster.metadata ]
[tpsmdt04s] [4f180a2f9dba645d0d000001] re-syncing mappings with
cluster state for types [[4f192de7ac617edb1a0005d8]]

[2012-10-09 11:12:51,380][WARN ][cluster.metadata ]
[tpsmdt04s] [4f180a2f9dba645d0d000001] re-syncing mappings with
cluster state for types [[4f192de7ac617edb1a0005d8]]

...

grep "4f192de7ac617edb1a0005d8"
/MIDDLE/smartdata/elasticsearch/logs/search-0.19.log |grep
"re-syncing" | wc -l
944

In the mapping there is something wrong :

/3857638/2edfadda1a4ea4666a9578a395db35aa962fa9d5/mapping.json
https://raw.github.com/gist/3857638/2edfadda1a4ea4666a9578a395db35aa962fa9d5/mapping.json

"source":{ "excludes": [ "*.smart_typed_number",
".smart_typed_location", "smart_typed_number_", "smart_typed_location",
".smart_typed_number_", ".smart_typed_location", "smart_typed_number_",
"smart_typed_location", ".smart_typed_number_", ".smart_typed_location",
"smart_typed_number_", "smart_typed_location", ".smart_typed_number_",
".smart_typed_location", "smart_typed_number_", "smart_typed_location",
".smart_typed_number_", ".smart_typed_location", "smart_typed_number_",
"smart_typed_location", ".smart_typed_number_", ".smart_typed_location",
"smart_typed_number_", "smart_typed_location", ".smart_typed_number_",
".smart_typed_location", "smart_typed_number_", "smart_typed_location",
".smart_typed_number_", ".smart_typed_location", "smart_typed_number_",
"smart_typed_location", ".smart_typed_number_", ".smart_typed_location",
"smart_typed_number_", "smart_typed_location", ".smart_typed_number_",
".smart_typed_location", "smart_typed_number_", "smart_typed_location",
".smart_typed_number_", ".smart_typed_location", "smart_typed_number_",
"smart_typed_location", ".smart_typed_number_", ".smart_typed_location",
"smart_typed_number_", "smart_typed_location", ".smart_typed_number_",
".smart_typed_location", "smart_typed_number_", "smart_typed_location",
".smart_typed_number_", ".smart_typed_location", "smart_t ....

I will simplify the default
mappinghttps://raw.github.com/gist/3857638/40fb33df1184a73b60e6dddb936a946a6bb17bba/default_mapping.jsonand
keep you informed if it solve the problem.

Romain

--

Filirom1 · October 9, 2012, 1:03pm

With a simpler default
mappinghttps://raw.github.com/gist/3858683/0b12e9b0d6719cce8a33a9251496e5ab74693447/mapping.json,
it still keeps growing :

"_source":{"excludes":["smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_type
d","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed"

2012/10/9 Romain filirom1@gmail.com

Hi,

I am doing a lot of inserts in Elasticsearch (v0.19.7), and in the logs I
see a lot of re-syncing mappings on the same index, same type :

$ tail -n 1000 -f /MIDDLE/smartdata/elasticsearch/logs/search-0.19.log |grep 4f192de7ac617edb1a0005d8 |head

[2012-10-09 11:09:38,094][INFO ][cluster.metadata ] [tpsmdt04s] [4f180a2f9dba645d0d000001] update_mapping [4f192de7ac617edb1a0005d8] (dynamic)

[2012-10-09 11:09:38,128][INFO ][cluster.metadata ] [tpsmdt04s] [4f180a2f9dba645d0d000001] update_mapping [4f192de7ac617edb1a0005d8] (dynamic)

[2012-10-09 11:10:07,198][INFO ][cluster.metadata ] [tpsmdt04s] [4f180a2f9dba645d0d000001] update_mapping [4f192de7ac617edb1a0005d8] (dynamic)

[2012-10-09 11:12:42,406][WARN ][cluster.metadata ] [tpsmdt04s] [4f180a2f9dba645d0d000001] re-syncing mappings with cluster state for types [[4f192de7ac617edb1a0005d8]]

[2012-10-09 11:12:43,609][WARN ][cluster.metadata ] [tpsmdt04s] [4f180a2f9dba645d0d000001] re-syncing mappings with cluster state for types [[4f192de7ac617edb1a0005d8]]

[2012-10-09 11:12:44,807][WARN ][cluster.metadata ] [tpsmdt04s] [4f180a2f9dba645d0d000001] re-syncing mappings with cluster state for types [[4f192de7ac617edb1a0005d8]]

[2012-10-09 11:12:46,172][WARN ][cluster.metadata ] [tpsmdt04s] [4f180a2f9dba645d0d000001] re-syncing mappings with cluster state for types [[4f192de7ac617edb1a0005d8]]

[2012-10-09 11:12:48,678][WARN ][cluster.metadata ] [tpsmdt04s] [4f180a2f9dba645d0d000001] re-syncing mappings with cluster state for types [[4f192de7ac617edb1a0005d8]]

[2012-10-09 11:12:50,418][WARN ][cluster.metadata ] [tpsmdt04s] [4f180a2f9dba645d0d000001] re-syncing mappings with cluster state for types [[4f192de7ac617edb1a0005d8]]

[2012-10-09 11:12:51,380][WARN ][cluster.metadata ] [tpsmdt04s] [4f180a2f9dba645d0d000001] re-syncing mappings with cluster state for types [[4f192de7ac617edb1a0005d8]]

...

grep "4f192de7ac617edb1a0005d8" /MIDDLE/smartdata/elasticsearch/logs/search-0.19.log |grep "re-syncing" | wc -l

944

In the mapping there is something wrong :

/3857638/2edfadda1a4ea4666a9578a395db35aa962fa9d5/mapping.json

https://raw.github.com/gist/3857638/2edfadda1a4ea4666a9578a395db35aa962fa9d5/mapping.json

"source":{ "excludes": [ "*.smart_typed_number",
".smart_typed_location", "smart_typed_number_", "smart_typed_location",
".smart_typed_number_", ".smart_typed_location", "smart_typed_number_",
"smart_typed_location", ".smart_typed_number_", ".smart_typed_location",
"smart_typed_number_", "smart_typed_location", ".smart_typed_number_",
".smart_typed_location", "smart_typed_number_", "smart_typed_location",
".smart_typed_number_", ".smart_typed_location", "smart_typed_number_",
"smart_typed_location", ".smart_typed_number_", ".smart_typed_location",
"smart_typed_number_", "smart_typed_location", ".smart_typed_number_",
".smart_typed_location", "smart_typed_number_", "smart_typed_location",
".smart_typed_number_", ".smart_typed_location", "smart_typed_number_",
"smart_typed_location", ".smart_typed_number_", ".smart_typed_location",
"smart_typed_number_", "smart_typed_location", ".smart_typed_number_",
".smart_typed_location", "smart_typed_number_", "smart_typed_location",
".smart_typed_number_", ".smart_typed_location", "smart_typed_number_",
"smart_typed_location", ".smart_typed_number_", ".smart_typed_location",
"smart_typed_number_", "smart_typed_location", ".smart_typed_number_",
".smart_typed_location", "smart_typed_number_", "smart_typed_location",
".smart_typed_number_", ".smart_typed_location", "smart_t ....

I will simplify the default mappinghttps://raw.github.com/gist/3857638/40fb33df1184a73b60e6dddb936a946a6bb17bba/default_mapping.jsonand keep you informed if it solve the problem.

Romain

--

kimchy · October 11, 2012, 3:11pm

Seems like a problem. Can you open an issue with the mapping, and possibly a curl that causes the mapping to keep on being resync'ed (I am guessing an index API of some sort?).

On Oct 9, 2012, at 6:03 AM, Romain filirom1@gmail.com wrote:

With a simpler default mapping, it still keeps growing :

"_source":{"excludes":["smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed"

2012/10/9 Romain filirom1@gmail.com
Hi,

I am doing a lot of inserts in Elasticsearch (v0.19.7), and in the logs I see a lot of re-syncing mappings on the same index, same type :

$ tail -n 1000 -f /MIDDLE/smartdata/elasticsearch/logs/search-0.19.log |grep 4f192de7ac617edb1a0005d8 |head

[2012-10-09 11:09:38,094][INFO ][cluster.metadata ] [tpsmdt04s] [4f180a2f9dba645d0d000001] update_mapping [4f192de7ac617edb1a0005d8] (dynamic)

[2012-10-09 11:09:38,128][INFO ][cluster.metadata ] [tpsmdt04s] [4f180a2f9dba645d0d000001] update_mapping [4f192de7ac617edb1a0005d8] (dynamic)

[2012-10-09 11:10:07,198][INFO ][cluster.metadata ] [tpsmdt04s] [4f180a2f9dba645d0d000001] update_mapping [4f192de7ac617edb1a0005d8] (dynamic)

[2012-10-09 11:12:42,406][WARN ][cluster.metadata ] [tpsmdt04s] [4f180a2f9dba645d0d000001] re-syncing mappings with cluster state for types [[4f192de7ac617edb1a0005d8]]

[2012-10-09 11:12:43,609][WARN ][cluster.metadata ] [tpsmdt04s] [4f180a2f9dba645d0d000001] re-syncing mappings with cluster state for types [[4f192de7ac617edb1a0005d8]]

[2012-10-09 11:12:44,807][WARN ][cluster.metadata ] [tpsmdt04s] [4f180a2f9dba645d0d000001] re-syncing mappings with cluster state for types [[4f192de7ac617edb1a0005d8]]

[2012-10-09 11:12:46,172][WARN ][cluster.metadata ] [tpsmdt04s] [4f180a2f9dba645d0d000001] re-syncing mappings with cluster state for types [[4f192de7ac617edb1a0005d8]]

[2012-10-09 11:12:48,678][WARN ][cluster.metadata ] [tpsmdt04s] [4f180a2f9dba645d0d000001] re-syncing mappings with cluster state for types [[4f192de7ac617edb1a0005d8]]

[2012-10-09 11:12:50,418][WARN ][cluster.metadata ] [tpsmdt04s] [4f180a2f9dba645d0d000001] re-syncing mappings with cluster state for types [[4f192de7ac617edb1a0005d8]]

[2012-10-09 11:12:51,380][WARN ][cluster.metadata ] [tpsmdt04s] [4f180a2f9dba645d0d000001] re-syncing mappings with cluster state for types [[4f192de7ac617edb1a0005d8]]

...

grep "4f192de7ac617edb1a0005d8" /MIDDLE/smartdata/elasticsearch/logs/search-0.19.log |grep "re-syncing" | wc -l

944

In the mapping there is something wrong :

/3857638/2edfadda1a4ea4666a9578a395db35aa962fa9d5/mapping.json
https://raw.github.com/gist/3857638/2edfadda1a4ea4666a9578a395db35aa962fa9d5/mapping.json

"source":{
"excludes": [ "*.smart_typed_number", ".smart_typed_location", "smart_typed_number_", "smart_typed_location", ".smart_typed_number_", ".smart_typed_location", "smart_typed_number_", "smart_typed_location", ".smart_typed_number_", ".smart_typed_location", "smart_typed_number_", "smart_typed_location", ".smart_typed_number_", ".smart_typed_location", "smart_typed_number_", "smart_typed_location", ".smart_typed_number_", ".smart_typed_location", "smart_typed_number_", "smart_typed_location", ".smart_typed_number_", ".smart_typed_location", "smart_typed_number_", "smart_typed_location", ".smart_typed_number_", ".smart_typed_location", "smart_typed_number_", "smart_typed_location", ".smart_typed_number_", ".smart_typed_location", "smart_typed_number_", "smart_typed_location", ".smart_typed_number_", ".smart_typed_location", "smart_typed_number_", "smart_typed_location", ".smart_typed_number_", ".smart_typed_location", "smart_typed_number_", "smart_typed_location", ".smart_typed_number_", ".smart_typed_location", "smart_typed_number_", "smart_typed_location", ".smart_typed_number_", ".smart_typed_location", "smart_typed_number_", "smart_typed_location", ".smart_typed_number_", ".smart_typed_location", "smart_typed_number_", "smart_typed_location", ".smart_typed_number_", ".smart_typed_location", "smart_t ....

I will simplify the default mapping and keep you informed if it solve the problem.

Romain

--

--

kimchy · October 12, 2012, 2:01am

Recreated the problem, opened an issue, should be fixed soon: Mapping: Using _default_ mapping type with _source excludes (or array based config) can cause the array to grow indefinitely · Issue #2317 · elastic/elasticsearch · GitHub and pushed to 0.19 branch (will be part of a next 0.19 release) and master (upcoming 0.20).

On Oct 11, 2012, at 8:11 AM, Shay Banon kimchy@gmail.com wrote:

Seems like a problem. Can you open an issue with the mapping, and possibly a curl that causes the mapping to keep on being resync'ed (I am guessing an index API of some sort?).

On Oct 9, 2012, at 6:03 AM, Romain filirom1@gmail.com wrote:

With a simpler default mapping, it still keeps growing :

"_source":{"excludes":["smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed"

2012/10/9 Romain filirom1@gmail.com
Hi,

I am doing a lot of inserts in Elasticsearch (v0.19.7), and in the logs I see a lot of re-syncing mappings on the same index, same type :

$ tail -n 1000 -f /MIDDLE/smartdata/elasticsearch/logs/search-0.19.log |grep 4f192de7ac617edb1a0005d8 |head

[2012-10-09 11:09:38,094][INFO ][cluster.metadata ] [tpsmdt04s] [4f180a2f9dba645d0d000001] update_mapping [4f192de7ac617edb1a0005d8] (dynamic)

[2012-10-09 11:09:38,128][INFO ][cluster.metadata ] [tpsmdt04s] [4f180a2f9dba645d0d000001] update_mapping [4f192de7ac617edb1a0005d8] (dynamic)

[2012-10-09 11:10:07,198][INFO ][cluster.metadata ] [tpsmdt04s] [4f180a2f9dba645d0d000001] update_mapping [4f192de7ac617edb1a0005d8] (dynamic)

[2012-10-09 11:12:42,406][WARN ][cluster.metadata ] [tpsmdt04s] [4f180a2f9dba645d0d000001] re-syncing mappings with cluster state for types [[4f192de7ac617edb1a0005d8]]

[2012-10-09 11:12:43,609][WARN ][cluster.metadata ] [tpsmdt04s] [4f180a2f9dba645d0d000001] re-syncing mappings with cluster state for types [[4f192de7ac617edb1a0005d8]]

[2012-10-09 11:12:44,807][WARN ][cluster.metadata ] [tpsmdt04s] [4f180a2f9dba645d0d000001] re-syncing mappings with cluster state for types [[4f192de7ac617edb1a0005d8]]

[2012-10-09 11:12:46,172][WARN ][cluster.metadata ] [tpsmdt04s] [4f180a2f9dba645d0d000001] re-syncing mappings with cluster state for types [[4f192de7ac617edb1a0005d8]]

[2012-10-09 11:12:48,678][WARN ][cluster.metadata ] [tpsmdt04s] [4f180a2f9dba645d0d000001] re-syncing mappings with cluster state for types [[4f192de7ac617edb1a0005d8]]

[2012-10-09 11:12:50,418][WARN ][cluster.metadata ] [tpsmdt04s] [4f180a2f9dba645d0d000001] re-syncing mappings with cluster state for types [[4f192de7ac617edb1a0005d8]]

[2012-10-09 11:12:51,380][WARN ][cluster.metadata ] [tpsmdt04s] [4f180a2f9dba645d0d000001] re-syncing mappings with cluster state for types [[4f192de7ac617edb1a0005d8]]

...

grep "4f192de7ac617edb1a0005d8" /MIDDLE/smartdata/elasticsearch/logs/search-0.19.log |grep "re-syncing" | wc -l

944

In the mapping there is something wrong :

/3857638/2edfadda1a4ea4666a9578a395db35aa962fa9d5/mapping.json
https://raw.github.com/gist/3857638/2edfadda1a4ea4666a9578a395db35aa962fa9d5/mapping.json

"source":{
"excludes": [ "*.smart_typed_number", ".smart_typed_location", "smart_typed_number_", "smart_typed_location", ".smart_typed_number_", ".smart_typed_location", "smart_typed_number_", "smart_typed_location", ".smart_typed_number_", ".smart_typed_location", "smart_typed_number_", "smart_typed_location", ".smart_typed_number_", ".smart_typed_location", "smart_typed_number_", "smart_typed_location", ".smart_typed_number_", ".smart_typed_location", "smart_typed_number_", "smart_typed_location", ".smart_typed_number_", ".smart_typed_location", "smart_typed_number_", "smart_typed_location", ".smart_typed_number_", ".smart_typed_location", "smart_typed_number_", "smart_typed_location", ".smart_typed_number_", ".smart_typed_location", "smart_typed_number_", "smart_typed_location", ".smart_typed_number_", ".smart_typed_location", "smart_typed_number_", "smart_typed_location", ".smart_typed_number_", ".smart_typed_location", "smart_typed_number_", "smart_typed_location", ".smart_typed_number_", ".smart_typed_location", "smart_typed_number_", "smart_typed_location", ".smart_typed_number_", ".smart_typed_location", "smart_typed_number_", "smart_typed_location", ".smart_typed_number_", ".smart_typed_location", "smart_typed_number_", "smart_typed_location", ".smart_typed_number_", ".smart_typed_location", "smart_t ....

I will simplify the default mapping and keep you informed if it solve the problem.

Romain

--

--

Filirom1 · October 12, 2012, 8:13am

Wao !!! Great !!

Thank you !

2012/10/12 Shay Banon kimchy@gmail.com

Recreated the problem, opened an issue, should be fixed soon:
Mapping: Using _default_ mapping type with _source excludes (or array based config) can cause the array to grow indefinitely · Issue #2317 · elastic/elasticsearch · GitHub and pushed to
0.19 branch (will be part of a next 0.19 release) and master (upcoming
0.20).

On Oct 11, 2012, at 8:11 AM, Shay Banon kimchy@gmail.com wrote:

Seems like a problem. Can you open an issue with the mapping, and possibly
a curl that causes the mapping to keep on being resync'ed (I am guessing an
index API of some sort?).

On Oct 9, 2012, at 6:03 AM, Romain filirom1@gmail.com wrote:

With a simpler default mappinghttps://raw.github.com/gist/3858683/0b12e9b0d6719cce8a33a9251496e5ab74693447/mapping.json,
it still keeps growing :

"_source":{"excludes":["smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_type
d","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed","smart_typed"

2012/10/9 Romain filirom1@gmail.com

Hi,

I am doing a lot of inserts in Elasticsearch (v0.19.7), and in the logs I
see a lot of re-syncing mappings on the same index, same type :

$ tail -n 1000 -f /MIDDLE/smartdata/elasticsearch/logs/search-0.19.log |grep 4f192de7ac617edb1a0005d8 |head

[2012-10-09 11:09:38,094][INFO ][cluster.metadata ] [tpsmdt04s] [4f180a2f9dba645d0d000001] update_mapping [4f192de7ac617edb1a0005d8] (dynamic)

[2012-10-09 11:09:38,128][INFO ][cluster.metadata ] [tpsmdt04s] [4f180a2f9dba645d0d000001] update_mapping [4f192de7ac617edb1a0005d8] (dynamic)

[2012-10-09 11:10:07,198][INFO ][cluster.metadata ] [tpsmdt04s] [4f180a2f9dba645d0d000001] update_mapping [4f192de7ac617edb1a0005d8] (dynamic)

[2012-10-09 11:12:42,406][WARN ][cluster.metadata ] [tpsmdt04s] [4f180a2f9dba645d0d000001] re-syncing mappings with cluster state for types [[4f192de7ac617edb1a0005d8]]

[2012-10-09 11:12:43,609][WARN ][cluster.metadata ] [tpsmdt04s] [4f180a2f9dba645d0d000001] re-syncing mappings with cluster state for types [[4f192de7ac617edb1a0005d8]]

[2012-10-09 11:12:44,807][WARN ][cluster.metadata ] [tpsmdt04s] [4f180a2f9dba645d0d000001] re-syncing mappings with cluster state for types [[4f192de7ac617edb1a0005d8]]

[2012-10-09 11:12:46,172][WARN ][cluster.metadata ] [tpsmdt04s] [4f180a2f9dba645d0d000001] re-syncing mappings with cluster state for types [[4f192de7ac617edb1a0005d8]]

[2012-10-09 11:12:48,678][WARN ][cluster.metadata ] [tpsmdt04s] [4f180a2f9dba645d0d000001] re-syncing mappings with cluster state for types [[4f192de7ac617edb1a0005d8]]

[2012-10-09 11:12:50,418][WARN ][cluster.metadata ] [tpsmdt04s] [4f180a2f9dba645d0d000001] re-syncing mappings with cluster state for types [[4f192de7ac617edb1a0005d8]]

[2012-10-09 11:12:51,380][WARN ][cluster.metadata ] [tpsmdt04s] [4f180a2f9dba645d0d000001] re-syncing mappings with cluster state for types [[4f192de7ac617edb1a0005d8]]

...

grep "4f192de7ac617edb1a0005d8" /MIDDLE/smartdata/elasticsearch/logs/search-0.19.log |grep "re-syncing" | wc -l

944

In the mapping there is something wrong :

/3857638/2edfadda1a4ea4666a9578a395db35aa962fa9d5/mapping.json

https://raw.github.com/gist/3857638/2edfadda1a4ea4666a9578a395db35aa962fa9d5/mapping.json

"source":{ "excludes": [ "*.smart_typed_number",
".smart_typed_location", "smart_typed_number_", "smart_typed_location",
".smart_typed_number_", ".smart_typed_location", "smart_typed_number_",
"smart_typed_location", ".smart_typed_number_", ".smart_typed_location",
"smart_typed_number_", "smart_typed_location", ".smart_typed_number_",
".smart_typed_location", "smart_typed_number_", "smart_typed_location",
".smart_typed_number_", ".smart_typed_location", "smart_typed_number_",
"smart_typed_location", ".smart_typed_number_", ".smart_typed_location",
"smart_typed_number_", "smart_typed_location", ".smart_typed_number_",
".smart_typed_location", "smart_typed_number_", "smart_typed_location",
".smart_typed_number_", ".smart_typed_location", "smart_typed_number_",
"smart_typed_location", ".smart_typed_number_", ".smart_typed_location",
"smart_typed_number_", "smart_typed_location", ".smart_typed_number_",
".smart_typed_location", "smart_typed_number_", "smart_typed_location",
".smart_typed_number_", ".smart_typed_location", "smart_typed_number_",
"smart_typed_location", ".smart_typed_number_", ".smart_typed_location",
"smart_typed_number_", "smart_typed_location", ".smart_typed_number_",
".smart_typed_location", "smart_typed_number_", "smart_typed_location",
".smart_typed_number_", ".smart_typed_location", "smart_t ....

I will simplify the default mappinghttps://raw.github.com/gist/3857638/40fb33df1184a73b60e6dddb936a946a6bb17bba/default_mapping.jsonand keep you informed if it solve the problem.

Romain

--

--

--