I can't attach it (When communicating with the server 340-error has
occurred.). So I post it directly:
[10:56:44,855][INFO ][bootstrap ] max_open_files [249978]
[10:56:44,876][INFO ][node ] [Gaea] {0.19.10}[32244]:
initializing ...
[10:56:44,880][INFO ][plugins ] [Gaea] loaded [], sites []
[10:56:45,735][DEBUG][discovery.zen.ping.multicast] [Gaea] using group
[224.2.2.4], with port [54328], ttl [3], and address [null]
[10:56:45,738][DEBUG][discovery.zen.ping.unicast] [Gaea] using initial
hosts [], with concurrent_connects [10]
[10:56:45,738][DEBUG][discovery.zen ] [Gaea] using ping.timeout
[3s], master_election.filter_client [true], master_election.filter_data
[false]
[10:56:45,742][DEBUG][discovery.zen.elect ] [Gaea] using
minimum_master_nodes [-1]
[10:56:45,743][DEBUG][discovery.zen.fd ] [Gaea] [master] uses
ping_interval [1s], ping_timeout [30s], ping_retries [3]
[10:56:45,745][DEBUG][discovery.zen.fd ] [Gaea] [node ] uses
ping_interval [1s], ping_timeout [30s], ping_retries [3]
[10:56:46,528][DEBUG][gateway.local ] [Gaea] using
initial_shards [quorum], list_timeout [30s]
[10:56:46,655][DEBUG][gateway.local.state.meta ] [Gaea] using
gateway.local.auto_import_dangled [YES], with
gateway.local.dangling_timeout [2h]
[10:56:46,655][DEBUG][gateway.local.state.meta ] [Gaea] took 0s to load
state
[10:56:46,655][DEBUG][gateway.local.state.shards] [Gaea] took 0s to load
started shards state
[10:56:46,658][INFO ][node ] [Gaea] {0.19.10}[32244]:
initialized
[10:56:46,658][INFO ][node ] [Gaea] {0.19.10}[32244]:
starting ...
[10:56:46,731][INFO ][transport ] [Gaea] bound_address
{inet[/0.0.0.0:9300]}, publish_address {inet[/172.22.52.34:9300]}
[10:56:49,756][DEBUG][discovery.zen ] [Gaea] filtered ping
responses: (filter_client[true], filter_data[false]) {none}
[10:56:49,758][INFO ][cluster.service ] [Gaea] new_master
[Gaea][Ovip2gcHSgC85ZnoDZfJFQ][inet[/172.22.52.34:9300]], reason:
zen-disco-join (elected_as_master)
[10:56:49,770][INFO ][discovery ] [Gaea]
elasticsearch/Ovip2gcHSgC85ZnoDZfJFQ
[10:56:49,781][INFO ][http ] [Gaea] bound_address
{inet[/0.0.0.0:9200]}, publish_address {inet[/172.22.52.34:9200]}
[10:56:49,782][INFO ][node ] [Gaea] {0.19.10}[32244]:
started
[10:56:49,840][INFO ][gateway ] [Gaea] recovered [0]
indices into cluster_state
[10:56:50,490][INFO ][cluster.service ] [Gaea] added {[Stryker,
William][QUbkMX1cTyy93GqnZEPRbg][inet[/172.22.52.34:9304]]{client=true,
data=false},}, reason: zen-disco-receive(join from node[[Stryker,
William][QUbkMX1cTyy93GqnZEPRbg][inet[/172.22.52.34:9304]]{client=true,
data=false}])
[10:58:36,160][INFO ][cluster.service ] [Gaea] added {[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]],}, reason:
zen-disco-receive(join from node[[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]])
[10:58:36,202][INFO ][gateway.local.state.meta ] [Gaea] auto importing
dangled indices
[logstash-2012.11.06/OPEN][logstash-2012.11.05/OPEN][logstash-2012.11.08/OPEN][logstash-2012.11.07/OPEN]
from [[Kiden Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]
[10:58:36,209][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][3]: allocating [[logstash-2012.11.08][3], node[null],
[P], s[UNASSIGNED]] to [[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]] on primary
allocation
[10:58:36,221][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.06][3]: allocating [[logstash-2012.11.06][3], node[null],
[P], s[UNASSIGNED]] to [[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]] on primary
allocation
[10:58:36,222][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][0]: allocating [[logstash-2012.11.08][0], node[null],
[P], s[UNASSIGNED]] to [[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]] on primary
allocation
[10:58:36,228][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.06][2]: allocating [[logstash-2012.11.06][2], node[null],
[P], s[UNASSIGNED]] to [[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]] on primary
allocation
[10:58:36,230][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.06][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:36,233][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.05][4]: throttling allocation [[logstash-2012.11.05][4],
node[null], [P], s[UNASSIGNED]] to [[[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]] on primary
allocation
[10:58:36,235][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.05][2]: throttling allocation [[logstash-2012.11.05][2],
node[null], [P], s[UNASSIGNED]] to [[[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]] on primary
allocation
[10:58:36,236][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][1]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:36,241][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.05][1]: throttling allocation [[logstash-2012.11.05][1],
node[null], [P], s[UNASSIGNED]] to [[[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]] on primary
allocation
[10:58:36,241][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.06][0]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:36,242][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][2]: throttling allocation [[logstash-2012.11.08][2],
node[null], [P], s[UNASSIGNED]] to [[[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]] on primary
allocation
[10:58:36,243][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:36,244][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:36,246][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.05][3]: throttling allocation [[logstash-2012.11.05][3],
node[null], [P], s[UNASSIGNED]] to [[[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]] on primary
allocation
[10:58:36,247][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][3]: throttling allocation [[logstash-2012.11.07][3],
node[null], [P], s[UNASSIGNED]] to [[[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]] on primary
allocation
[10:58:36,248][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][2]: throttling allocation [[logstash-2012.11.07][2],
node[null], [P], s[UNASSIGNED]] to [[[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]] on primary
allocation
[10:58:36,248][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][1]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:36,255][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.05][0]: throttling allocation [[logstash-2012.11.05][0],
node[null], [P], s[UNASSIGNED]] to [[[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]] on primary
allocation
[10:58:36,256][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][0]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:36,259][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.06][1]: throttling allocation [[logstash-2012.11.06][1],
node[null], [P], s[UNASSIGNED]] to [[[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]] on primary
allocation
[10:58:36,650][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.08][3], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [after recovery from gateway]
[10:58:36,651][DEBUG][cluster.action.shard ] [Gaea] applying started
shards [[logstash-2012.11.08][3], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING]], reason [after recovery from gateway]
[10:58:36,652][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:36,652][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.05][1]: allocating [[logstash-2012.11.05][1], node[null],
[P], s[UNASSIGNED]] to [[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]] on primary
allocation
[10:58:36,652][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.06][1]: throttling allocation [[logstash-2012.11.06][1],
node[null], [P], s[UNASSIGNED]] to [[[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]] on primary
allocation
[10:58:36,652][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.05][2]: throttling allocation [[logstash-2012.11.05][2],
node[null], [P], s[UNASSIGNED]] to [[[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]] on primary
allocation
[10:58:36,652][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][3]: throttling allocation [[logstash-2012.11.07][3],
node[null], [P], s[UNASSIGNED]] to [[[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]] on primary
allocation
[10:58:36,652][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][2]: throttling allocation [[logstash-2012.11.07][2],
node[null], [P], s[UNASSIGNED]] to [[[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]] on primary
allocation
[10:58:36,652][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][1]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:36,652][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.06][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:36,652][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.05][4]: throttling allocation [[logstash-2012.11.05][4],
node[null], [P], s[UNASSIGNED]] to [[[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]] on primary
allocation
[10:58:36,653][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.05][3]: throttling allocation [[logstash-2012.11.05][3],
node[null], [P], s[UNASSIGNED]] to [[[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]] on primary
allocation
[10:58:36,653][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.06][0]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:36,653][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][0]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:36,653][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.05][0]: throttling allocation [[logstash-2012.11.05][0],
node[null], [P], s[UNASSIGNED]] to [[[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]] on primary
allocation
[10:58:36,653][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][2]: throttling allocation [[logstash-2012.11.08][2],
node[null], [P], s[UNASSIGNED]] to [[[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]] on primary
allocation
[10:58:36,653][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][1]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:36,653][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:36,687][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.06][2], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [after recovery from gateway]
[10:58:36,722][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.06][3], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [after recovery from gateway]
[10:58:36,801][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.06][3], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [master
[Gaea][Ovip2gcHSgC85ZnoDZfJFQ][inet[/172.22.52.34:9300]] marked shard as
initializing, but shard already started, mark shard as started]
[10:58:36,805][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.06][2], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [master
[Gaea][Ovip2gcHSgC85ZnoDZfJFQ][inet[/172.22.52.34:9300]] marked shard as
initializing, but shard already started, mark shard as started]
[10:58:36,865][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.05][1], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [after recovery from gateway]
[10:58:36,917][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.08][0], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [after recovery from gateway]
[10:58:36,942][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.08][3] state: [CREATED]
[10:58:36,946][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.08][3] state: [CREATED]->[RECOVERING], reason [from
[Kiden Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]
[10:58:36,947][DEBUG][cluster.action.shard ] [Gaea] applying started
shards [[logstash-2012.11.06][2], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], [logstash-2012.11.06][3], node[rDKyOTqpTeStQirDZ-yBMg],
[P], s[INITIALIZING], [logstash-2012.11.06][3],
node[rDKyOTqpTeStQirDZ-yBMg], [P], s[INITIALIZING],
[logstash-2012.11.06][2], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], [logstash-2012.11.05][1], node[rDKyOTqpTeStQirDZ-yBMg],
[P], s[INITIALIZING], [logstash-2012.11.08][0],
node[rDKyOTqpTeStQirDZ-yBMg], [P], s[INITIALIZING]], reason [after recovery
from gateway]
[10:58:36,948][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][2]: allocating [[logstash-2012.11.07][2], node[null],
[P], s[UNASSIGNED]] to [[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]] on primary
allocation
[10:58:36,948][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][2]: allocating [[logstash-2012.11.08][2], node[null],
[P], s[UNASSIGNED]] to [[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]] on primary
allocation
[10:58:36,948][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.05][2]: allocating [[logstash-2012.11.05][2], node[null],
[P], s[UNASSIGNED]] to [[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]] on primary
allocation
[10:58:36,948][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][1]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:36,948][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.06][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:36,948][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.05][4]: allocating [[logstash-2012.11.05][4], node[null],
[P], s[UNASSIGNED]] to [[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]] on primary
allocation
[10:58:36,948][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.05][3]: throttling allocation [[logstash-2012.11.05][3],
node[null], [P], s[UNASSIGNED]] to [[[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]] on primary
allocation
[10:58:36,949][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.06][1]: throttling allocation [[logstash-2012.11.06][1],
node[null], [P], s[UNASSIGNED]] to [[[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]] on primary
allocation
[10:58:36,949][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.06][0]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:36,949][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][0]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:36,949][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:36,949][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][1]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:36,949][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.05][0]: throttling allocation [[logstash-2012.11.05][0],
node[null], [P], s[UNASSIGNED]] to [[[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]] on primary
allocation
[10:58:36,949][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][3]: throttling allocation [[logstash-2012.11.07][3],
node[null], [P], s[UNASSIGNED]] to [[[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]] on primary
allocation
[10:58:36,949][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:36,993][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.08][0] state: [CREATED]
[10:58:36,994][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.08][0] state: [CREATED]->[RECOVERING], reason [from
[Kiden Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]
[10:58:37,120][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.08][0] state: [RECOVERING]->[STARTED], reason [post
recovery]
[10:58:37,121][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.08][0] scheduling refresher every 1s
[10:58:37,121][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.08][0] scheduling optimizer / merger every 1s
[10:58:37,123][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.08][3] state: [RECOVERING]->[STARTED], reason [post
recovery]
[10:58:37,123][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.08][3] scheduling refresher every 1s
[10:58:37,123][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.08][3] scheduling optimizer / merger every 1s
[10:58:37,126][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.07][2], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [after recovery from gateway]
[10:58:37,127][DEBUG][cluster.action.shard ] [Gaea] applying started
shards [[logstash-2012.11.07][2], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING]], reason [after recovery from gateway]
[10:58:37,127][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,127][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.05][0]: allocating [[logstash-2012.11.05][0], node[null],
[P], s[UNASSIGNED]] to [[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]] on primary
allocation
[10:58:37,127][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,127][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][1]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,127][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.06][0]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,128][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][1]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,128][DEBUG][cluster.action.shard ] [Gaea] sending shard
started for [logstash-2012.11.08][0], node[Ovip2gcHSgC85ZnoDZfJFQ], [R],
s[INITIALIZING], reason [after recovery (replica) from node [[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]]
[10:58:37,128][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][3]: throttling allocation [[logstash-2012.11.07][3],
node[null], [P], s[UNASSIGNED]] to [[[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]] on primary
allocation
[10:58:37,128][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.08][0], node[Ovip2gcHSgC85ZnoDZfJFQ], [R],
s[INITIALIZING], reason [after recovery (replica) from node [[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]]
[10:58:37,128][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.06][1]: throttling allocation [[logstash-2012.11.06][1],
node[null], [P], s[UNASSIGNED]] to [[[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]] on primary
allocation
[10:58:37,128][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.06][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,128][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][0]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,128][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.05][3]: throttling allocation [[logstash-2012.11.05][3],
node[null], [P], s[UNASSIGNED]] to [[[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]] on primary
allocation
[10:58:37,129][DEBUG][cluster.action.shard ] [Gaea] sending shard
started for [logstash-2012.11.08][3], node[Ovip2gcHSgC85ZnoDZfJFQ], [R],
s[INITIALIZING], reason [after recovery (replica) from node [[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]]
[10:58:37,129][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.08][3], node[Ovip2gcHSgC85ZnoDZfJFQ], [R],
s[INITIALIZING], reason [after recovery (replica) from node [[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]]
[10:58:37,132][DEBUG][cluster.action.shard ] [Gaea] sending shard
started for [logstash-2012.11.08][0], node[Ovip2gcHSgC85ZnoDZfJFQ], [R],
s[INITIALIZING], reason [master
[Gaea][Ovip2gcHSgC85ZnoDZfJFQ][inet[/172.22.52.34:9300]] marked shard as
initializing, but shard already started, mark shard as started]
[10:58:37,132][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.08][0], node[Ovip2gcHSgC85ZnoDZfJFQ], [R],
s[INITIALIZING], reason [master
[Gaea][Ovip2gcHSgC85ZnoDZfJFQ][inet[/172.22.52.34:9300]] marked shard as
initializing, but shard already started, mark shard as started]
[10:58:37,132][DEBUG][cluster.action.shard ] [Gaea] sending shard
started for [logstash-2012.11.08][3], node[Ovip2gcHSgC85ZnoDZfJFQ], [R],
s[INITIALIZING], reason [master
[Gaea][Ovip2gcHSgC85ZnoDZfJFQ][inet[/172.22.52.34:9300]] marked shard as
initializing, but shard already started, mark shard as started]
[10:58:37,132][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.08][3], node[Ovip2gcHSgC85ZnoDZfJFQ], [R],
s[INITIALIZING], reason [master
[Gaea][Ovip2gcHSgC85ZnoDZfJFQ][inet[/172.22.52.34:9300]] marked shard as
initializing, but shard already started, mark shard as started]
[10:58:37,133][DEBUG][cluster.action.shard ] [Gaea] applying started
shards [[logstash-2012.11.08][0], node[Ovip2gcHSgC85ZnoDZfJFQ], [R],
s[INITIALIZING], [logstash-2012.11.08][3], node[Ovip2gcHSgC85ZnoDZfJFQ],
[R], s[INITIALIZING], [logstash-2012.11.08][0],
node[Ovip2gcHSgC85ZnoDZfJFQ], [R], s[INITIALIZING],
[logstash-2012.11.08][3], node[Ovip2gcHSgC85ZnoDZfJFQ], [R],
s[INITIALIZING]], reason [after recovery (replica) from node [[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]]
[10:58:37,133][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.06][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,133][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.05][3]: throttling allocation [[logstash-2012.11.05][3],
node[null], [P], s[UNASSIGNED]] to [[[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]] on primary
allocation
[10:58:37,133][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][3]: throttling allocation [[logstash-2012.11.07][3],
node[null], [P], s[UNASSIGNED]] to [[[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]] on primary
allocation
[10:58:37,133][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][1]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,133][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.06][0]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,133][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,133][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][0]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,134][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][1]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,134][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,134][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.06][1]: throttling allocation [[logstash-2012.11.06][1],
node[null], [P], s[UNASSIGNED]] to [[[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]] on primary
allocation
[10:58:37,149][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.05][2], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [after recovery from gateway]
[10:58:37,175][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.05][4], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [after recovery from gateway]
[10:58:37,189][WARN ][cluster.action.shard ] [Gaea] received shard
failed for [logstash-2012.11.08][2], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [Failed to start shard, message
[IndexShardGatewayRecoveryException[[logstash-2012.11.08][2] shard
allocated for local recovery (post api), should exists, but doesn't]]]
[10:58:37,220][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.06][3] state: [CREATED]
[10:58:37,221][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.06][3] state: [CREATED]->[RECOVERING], reason [from
[Kiden Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]
[10:58:37,249][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.06][3] state: [RECOVERING]->[STARTED], reason [post
recovery]
[10:58:37,250][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.06][3] scheduling refresher every 1s
[10:58:37,250][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.06][3] scheduling optimizer / merger every 1s
[10:58:37,250][DEBUG][cluster.action.shard ] [Gaea] sending shard
started for [logstash-2012.11.06][3], node[Ovip2gcHSgC85ZnoDZfJFQ], [R],
s[INITIALIZING], reason [after recovery (replica) from node [[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]]
[10:58:37,250][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.06][3], node[Ovip2gcHSgC85ZnoDZfJFQ], [R],
s[INITIALIZING], reason [after recovery (replica) from node [[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]]
[10:58:37,258][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.05][2], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [master
[Gaea][Ovip2gcHSgC85ZnoDZfJFQ][inet[/172.22.52.34:9300]] marked shard as
initializing, but shard already started, mark shard as started]
[10:58:37,258][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.05][4], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [master
[Gaea][Ovip2gcHSgC85ZnoDZfJFQ][inet[/172.22.52.34:9300]] marked shard as
initializing, but shard already started, mark shard as started]
[10:58:37,260][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.05][1] state: [CREATED]
[10:58:37,261][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.05][1] state: [CREATED]->[RECOVERING], reason [from
[Kiden Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]
[10:58:37,265][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.05][0], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [after recovery from gateway]
[10:58:37,271][WARN ][cluster.action.shard ] [Gaea] received shard
failed for [logstash-2012.11.08][2], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [Failed to start shard, message
[IndexShardGatewayRecoveryException[[logstash-2012.11.08][2] shard
allocated for local recovery (post api), should exists, but doesn't]]]
[10:58:37,279][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.05][1] state: [RECOVERING]->[STARTED], reason [post
recovery]
[10:58:37,279][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.05][1] scheduling refresher every 1s
[10:58:37,279][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.05][1] scheduling optimizer / merger every 1s
[10:58:37,280][DEBUG][cluster.action.shard ] [Gaea] sending shard
started for [logstash-2012.11.05][1], node[Ovip2gcHSgC85ZnoDZfJFQ], [R],
s[INITIALIZING], reason [after recovery (replica) from node [[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]]
[10:58:37,280][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.05][1], node[Ovip2gcHSgC85ZnoDZfJFQ], [R],
s[INITIALIZING], reason [after recovery (replica) from node [[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]]
[10:58:37,280][DEBUG][cluster.action.shard ] [Gaea] applying started
shards [[logstash-2012.11.05][2], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], [logstash-2012.11.05][4], node[rDKyOTqpTeStQirDZ-yBMg],
[P], s[INITIALIZING], [logstash-2012.11.06][3],
node[Ovip2gcHSgC85ZnoDZfJFQ], [R], s[INITIALIZING],
[logstash-2012.11.05][2], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], [logstash-2012.11.05][4], node[rDKyOTqpTeStQirDZ-yBMg],
[P], s[INITIALIZING], [logstash-2012.11.05][0],
node[rDKyOTqpTeStQirDZ-yBMg], [P], s[INITIALIZING],
[logstash-2012.11.05][1], node[Ovip2gcHSgC85ZnoDZfJFQ], [R],
s[INITIALIZING]], reason [after recovery (replica) from node [[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]]
[10:58:37,281][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][0]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,281][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,281][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][1]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,281][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,281][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.06][0]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,281][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.05][3]: allocating [[logstash-2012.11.05][3], node[null],
[P], s[UNASSIGNED]] to [[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]] on primary
allocation
[10:58:37,281][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.06][1]: allocating [[logstash-2012.11.06][1], node[null],
[P], s[UNASSIGNED]] to [[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]] on primary
allocation
[10:58:37,282][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][3]: allocating [[logstash-2012.11.07][3], node[null],
[P], s[UNASSIGNED]] to [[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]] on primary
allocation
[10:58:37,282][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.06][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,282][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][1]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,313][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.05][0], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [master
[Gaea][Ovip2gcHSgC85ZnoDZfJFQ][inet[/172.22.52.34:9300]] marked shard as
initializing, but shard already started, mark shard as started]
[10:58:37,314][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.05][4], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [master
[Gaea][Ovip2gcHSgC85ZnoDZfJFQ][inet[/172.22.52.34:9300]] marked shard as
initializing, but shard already started, mark shard as started]
[10:58:37,314][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.05][2], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [master
[Gaea][Ovip2gcHSgC85ZnoDZfJFQ][inet[/172.22.52.34:9300]] marked shard as
initializing, but shard already started, mark shard as started]
[10:58:37,314][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.05][2] state: [CREATED]
[10:58:37,315][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.05][2] state: [CREATED]->[RECOVERING], reason [from
[Kiden Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]
[10:58:37,320][WARN ][cluster.action.shard ] [Gaea] received shard
failed for [logstash-2012.11.08][2], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [Failed to start shard, message
[IndexShardGatewayRecoveryException[[logstash-2012.11.08][2] shard
allocated for local recovery (post api), should exists, but doesn't]]]
[10:58:37,342][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.05][4] state: [CREATED]
[10:58:37,342][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.05][4] state: [CREATED]->[RECOVERING], reason [from
[Kiden Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]
[10:58:37,345][DEBUG][cluster.action.shard ] [Gaea] applying started
shards [[logstash-2012.11.05][4], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING]], reason [master
[Gaea][Ovip2gcHSgC85ZnoDZfJFQ][inet[/172.22.52.34:9300]] marked shard as
initializing, but shard already started, mark shard as started]
[10:58:37,345][DEBUG][cluster.action.shard ] [Gaea] Received failed
shard [logstash-2012.11.08][2], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [Failed to start shard, message
[IndexShardGatewayRecoveryException[[logstash-2012.11.08][2] shard
allocated for local recovery (post api), should exists, but doesn't]]]
[10:58:37,345][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.06][0]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,345][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][1]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,346][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.06][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,346][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,346][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,346][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][0]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,346][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][1]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,350][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][2]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,353][DEBUG][cluster.action.shard ] [Gaea] Applying failed
shard [logstash-2012.11.08][2], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [Failed to start shard, message
[IndexShardGatewayRecoveryException[[logstash-2012.11.08][2] shard
allocated for local recovery (post api), should exists, but doesn't]]]
[10:58:37,354][DEBUG][cluster.action.shard ] [Gaea] Received failed
shard [logstash-2012.11.08][2], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [Failed to start shard, message
[IndexShardGatewayRecoveryException[[logstash-2012.11.08][2] shard
allocated for local recovery (post api), should exists, but doesn't]]]
[10:58:37,354][DEBUG][cluster.action.shard ] [Gaea] Received failed
shard [logstash-2012.11.08][2], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [Failed to start shard, message
[IndexShardGatewayRecoveryException[[logstash-2012.11.08][2] shard
allocated for local recovery (post api), should exists, but doesn't]]]
[10:58:37,358][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.05][2] state: [RECOVERING]->[STARTED], reason [post
recovery]
[10:58:37,358][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.05][2] scheduling refresher every 1s
[10:58:37,358][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.05][2] scheduling optimizer / merger every 1s
[10:58:37,359][DEBUG][cluster.action.shard ] [Gaea] sending shard
started for [logstash-2012.11.05][2], node[Ovip2gcHSgC85ZnoDZfJFQ], [R],
s[INITIALIZING], reason [after recovery (replica) from node [[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]]
[10:58:37,359][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.05][2], node[Ovip2gcHSgC85ZnoDZfJFQ], [R],
s[INITIALIZING], reason [after recovery (replica) from node [[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]]
[10:58:37,359][DEBUG][cluster.action.shard ] [Gaea] applying started
shards [[logstash-2012.11.05][2], node[Ovip2gcHSgC85ZnoDZfJFQ], [R],
s[INITIALIZING]], reason [after recovery (replica) from node [[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]]
[10:58:37,359][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,359][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][2]: allocating [[logstash-2012.11.08][2], node[null],
[P], s[UNASSIGNED]] to [[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]] on primary
allocation
[10:58:37,360][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][1]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,360][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][0]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,360][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.06][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,360][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][1]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,360][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.06][0]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,360][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,390][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.05][0] state: [CREATED]
[10:58:37,393][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.05][0] state: [CREATED]->[RECOVERING], reason [from
[Kiden Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]
[10:58:37,394][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.05][4] state: [RECOVERING]->[STARTED], reason [post
recovery]
[10:58:37,395][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.05][4] scheduling refresher every 1s
[10:58:37,395][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.05][4] scheduling optimizer / merger every 1s
[10:58:37,398][DEBUG][cluster.action.shard ] [Gaea] sending shard
started for [logstash-2012.11.05][4], node[Ovip2gcHSgC85ZnoDZfJFQ], [R],
s[INITIALIZING], reason [after recovery (replica) from node [[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]]
[10:58:37,398][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.05][4], node[Ovip2gcHSgC85ZnoDZfJFQ], [R],
s[INITIALIZING], reason [after recovery (replica) from node [[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]]
[10:58:37,398][DEBUG][cluster.action.shard ] [Gaea] applying started
shards [[logstash-2012.11.05][4], node[Ovip2gcHSgC85ZnoDZfJFQ], [R],
s[INITIALIZING]], reason [after recovery (replica) from node [[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]]
[10:58:37,398][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,398][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.06][0]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,398][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][1]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,399][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.06][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,399][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][1]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,399][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][0]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,399][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,413][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.05][0] state: [RECOVERING]->[STARTED], reason [post
recovery]
[10:58:37,414][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.05][0] scheduling refresher every 1s
[10:58:37,414][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.05][0] scheduling optimizer / merger every 1s
[10:58:37,422][DEBUG][cluster.action.shard ] [Gaea] sending shard
started for [logstash-2012.11.05][0], node[Ovip2gcHSgC85ZnoDZfJFQ], [R],
s[INITIALIZING], reason [after recovery (replica) from node [[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]]
[10:58:37,422][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.05][0], node[Ovip2gcHSgC85ZnoDZfJFQ], [R],
s[INITIALIZING], reason [after recovery (replica) from node [[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]]
[10:58:37,447][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.07][2] state: [CREATED]
[10:58:37,447][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.07][2] state: [CREATED]->[RECOVERING], reason [from
[Kiden Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]
[10:58:37,447][DEBUG][cluster.action.shard ] [Gaea] sending shard
started for [logstash-2012.11.05][0], node[Ovip2gcHSgC85ZnoDZfJFQ], [R],
s[INITIALIZING], reason [master
[Gaea][Ovip2gcHSgC85ZnoDZfJFQ][inet[/172.22.52.34:9300]] marked shard as
initializing, but shard already started, mark shard as started]
[10:58:37,447][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.05][0], node[Ovip2gcHSgC85ZnoDZfJFQ], [R],
s[INITIALIZING], reason [master
[Gaea][Ovip2gcHSgC85ZnoDZfJFQ][inet[/172.22.52.34:9300]] marked shard as
initializing, but shard already started, mark shard as started]
[10:58:37,450][DEBUG][cluster.action.shard ] [Gaea] applying started
shards [[logstash-2012.11.05][0], node[Ovip2gcHSgC85ZnoDZfJFQ], [R],
s[INITIALIZING], [logstash-2012.11.05][0], node[Ovip2gcHSgC85ZnoDZfJFQ],
[R], s[INITIALIZING]], reason [after recovery (replica) from node [[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]]
[10:58:37,451][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][1]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,451][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,451][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][0]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,451][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][1]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,451][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,451][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.06][0]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,451][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.06][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,480][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.06][2] state: [CREATED]
[10:58:37,480][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.06][2] state: [CREATED]->[RECOVERING], reason [from
[Kiden Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]
[10:58:37,506][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.07][3], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [after recovery from gateway]
[10:58:37,507][DEBUG][cluster.action.shard ] [Gaea] applying started
shards [[logstash-2012.11.07][3], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING]], reason [after recovery from gateway]
[10:58:37,507][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][1]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,507][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.06][0]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,507][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.06][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,507][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,507][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][0]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,507][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,507][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][1]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,526][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.06][1], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [after recovery from gateway]
[10:58:37,526][DEBUG][cluster.action.shard ] [Gaea] applying started
shards [[logstash-2012.11.06][1], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING]], reason [after recovery from gateway]
[10:58:37,527][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][1]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,527][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,527][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][0]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,527][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.06][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,527][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.06][0]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,528][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][1]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,528][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,562][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.05][3], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [after recovery from gateway]
[10:58:37,562][DEBUG][cluster.action.shard ] [Gaea] applying started
shards [[logstash-2012.11.05][3], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING]], reason [after recovery from gateway]
[10:58:37,563][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][1]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,563][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][1]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,563][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,564][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.06][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,564][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,564][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][0]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,564][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.06][0]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,574][WARN ][cluster.action.shard ] [Gaea] received shard
failed for [logstash-2012.11.08][2], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [Failed to start shard, message
[IndexShardGatewayRecoveryException[[logstash-2012.11.08][2] shard
allocated for local recovery (post api), should exists, but doesn't]]]
[10:58:37,574][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.07][3], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [master
[Gaea][Ovip2gcHSgC85ZnoDZfJFQ][inet[/172.22.52.34:9300]] marked shard as
initializing, but shard already started, mark shard as started]
[10:58:37,574][DEBUG][cluster.action.shard ] [Gaea] Received failed
shard [logstash-2012.11.08][2], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [Failed to start shard, message
[IndexShardGatewayRecoveryException[[logstash-2012.11.08][2] shard
allocated for local recovery (post api), should exists, but doesn't]]]
[10:58:37,574][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,576][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,576][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.06][0]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,576][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][1]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,574][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.05][3], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [master
[Gaea][Ovip2gcHSgC85ZnoDZfJFQ][inet[/172.22.52.34:9300]] marked shard as
initializing, but shard already started, mark shard as started]
[10:58:37,575][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.06][1], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [master
[Gaea][Ovip2gcHSgC85ZnoDZfJFQ][inet[/172.22.52.34:9300]] marked shard as
initializing, but shard already started, mark shard as started]
[10:58:37,576][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][1]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,576][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][0]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,577][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.06][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,583][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.07][2] state: [RECOVERING]->[STARTED], reason [post
recovery]
[10:58:37,583][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.07][2] scheduling refresher every 1s
[10:58:37,583][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.06][2] state: [RECOVERING]->[STARTED], reason [post
recovery]
[10:58:37,583][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.07][2] scheduling optimizer / merger every 1s
[10:58:37,583][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.06][2] scheduling refresher every 1s
[10:58:37,583][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.06][2] scheduling optimizer / merger every 1s
[10:58:37,584][DEBUG][cluster.action.shard ] [Gaea] sending shard
started for [logstash-2012.11.06][2], node[Ovip2gcHSgC85ZnoDZfJFQ], [R],
s[INITIALIZING], reason [after recovery (replica) from node [[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]]
[10:58:37,584][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][2]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,584][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.06][2], node[Ovip2gcHSgC85ZnoDZfJFQ], [R],
s[INITIALIZING], reason [after recovery (replica) from node [[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]]
[10:58:37,584][DEBUG][cluster.action.shard ] [Gaea] sending shard
started for [logstash-2012.11.07][2], node[Ovip2gcHSgC85ZnoDZfJFQ], [R],
s[INITIALIZING], reason [after recovery (replica) from node [[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]]
[10:58:37,584][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.07][2], node[Ovip2gcHSgC85ZnoDZfJFQ], [R],
s[INITIALIZING], reason [after recovery (replica) from node [[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]]
[10:58:37,586][DEBUG][cluster.action.shard ] [Gaea] Applying failed
shard [logstash-2012.11.08][2], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [Failed to start shard, message
[IndexShardGatewayRecoveryException[[logstash-2012.11.08][2] shard
allocated for local recovery (post api), should exists, but doesn't]]]
[10:58:37,587][DEBUG][cluster.action.shard ] [Gaea] sending shard
started for [logstash-2012.11.07][2], node[Ovip2gcHSgC85ZnoDZfJFQ], [R],
s[INITIALIZING], reason [master
[Gaea][Ovip2gcHSgC85ZnoDZfJFQ][inet[/172.22.52.34:9300]] marked shard as
initializing, but shard already started, mark shard as started]
[10:58:37,587][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.07][2], node[Ovip2gcHSgC85ZnoDZfJFQ], [R],
s[INITIALIZING], reason [master
[Gaea][Ovip2gcHSgC85ZnoDZfJFQ][inet[/172.22.52.34:9300]] marked shard as
initializing, but shard already started, mark shard as started]
[10:58:37,587][DEBUG][cluster.action.shard ] [Gaea] sending shard
started for [logstash-2012.11.06][2], node[Ovip2gcHSgC85ZnoDZfJFQ], [R],
s[INITIALIZING], reason [master
[Gaea][Ovip2gcHSgC85ZnoDZfJFQ][inet[/172.22.52.34:9300]] marked shard as
initializing, but shard already started, mark shard as started]
[10:58:37,587][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.06][2], node[Ovip2gcHSgC85ZnoDZfJFQ], [R],
s[INITIALIZING], reason [master
[Gaea][Ovip2gcHSgC85ZnoDZfJFQ][inet[/172.22.52.34:9300]] marked shard as
initializing, but shard already started, mark shard as started]
[10:58:37,588][DEBUG][cluster.action.shard ] [Gaea] applying started
shards [[logstash-2012.11.05][3], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], [logstash-2012.11.06][2], node[Ovip2gcHSgC85ZnoDZfJFQ],
[R], s[INITIALIZING], [logstash-2012.11.07][2],
node[Ovip2gcHSgC85ZnoDZfJFQ], [R], s[INITIALIZING],
[logstash-2012.11.07][2], node[Ovip2gcHSgC85ZnoDZfJFQ], [R],
s[INITIALIZING], [logstash-2012.11.06][2], node[Ovip2gcHSgC85ZnoDZfJFQ],
[R], s[INITIALIZING]], reason [master
[Gaea][Ovip2gcHSgC85ZnoDZfJFQ][inet[/172.22.52.34:9300]] marked shard as
initializing, but shard already started, mark shard as started]
[10:58:37,588][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][1]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,588][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,588][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][1]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,588][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.06][0]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,588][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][2]: allocating [[logstash-2012.11.08][2], node[null],
[P], s[UNASSIGNED]] to [[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]] on primary
allocation
[10:58:37,588][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.06][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,588][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,590][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][0]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,610][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.07][3], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [master
[Gaea][Ovip2gcHSgC85ZnoDZfJFQ][inet[/172.22.52.34:9300]] marked shard as
initializing, but shard already started, mark shard as started]
[10:58:37,617][WARN ][cluster.action.shard ] [Gaea] received shard
failed for [logstash-2012.11.08][2], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [Failed to start shard, message
[IndexShardGatewayRecoveryException[[logstash-2012.11.08][2] shard
allocated for local recovery (post api), should exists, but doesn't]]]
[10:58:37,621][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.05][3], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [master
[Gaea][Ovip2gcHSgC85ZnoDZfJFQ][inet[/172.22.52.34:9300]] marked shard as
initializing, but shard already started, mark shard as started]
[10:58:37,621][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.06][1], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [master
[Gaea][Ovip2gcHSgC85ZnoDZfJFQ][inet[/172.22.52.34:9300]] marked shard as
initializing, but shard already started, mark shard as started]
[10:58:37,640][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.07][3] state: [CREATED]
[10:58:37,640][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.07][3] state: [CREATED]->[RECOVERING], reason [from
[Kiden Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]
[10:58:37,666][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.05][3] state: [CREATED]
[10:58:37,666][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.05][3] state: [CREATED]->[RECOVERING], reason [from
[Kiden Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]
[10:58:37,668][DEBUG][cluster.action.shard ] [Gaea] applying started
shards [[logstash-2012.11.05][3], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING]], reason [master
[Gaea][Ovip2gcHSgC85ZnoDZfJFQ][inet[/172.22.52.34:9300]] marked shard as
initializing, but shard already started, mark shard as started]
[10:58:37,668][DEBUG][cluster.action.shard ] [Gaea] Received failed
shard [logstash-2012.11.08][2], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [Failed to start shard, message
[IndexShardGatewayRecoveryException[[logstash-2012.11.08][2] shard
allocated for local recovery (post api), should exists, but doesn't]]]
[10:58:37,669][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,669][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][1]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,669][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][0]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,669][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.06][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,669][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][1]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,669][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,669][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.06][0]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,670][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.06][1], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [master
[Gaea][Ovip2gcHSgC85ZnoDZfJFQ][inet[/172.22.52.34:9300]] marked shard as
initializing, but shard already started, mark shard as started]
[10:58:37,671][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][2]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,673][DEBUG][cluster.action.shard ] [Gaea] Applying failed
shard [logstash-2012.11.08][2], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [Failed to start shard, message
[IndexShardGatewayRecoveryException[[logstash-2012.11.08][2] shard
allocated for local recovery (post api), should exists, but doesn't]]]
[10:58:37,682][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.07][3], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [master
[Gaea][Ovip2gcHSgC85ZnoDZfJFQ][inet[/172.22.52.34:9300]] marked shard as
initializing, but shard already started, mark shard as started]
[10:58:37,683][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.05][3], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [master
[Gaea][Ovip2gcHSgC85ZnoDZfJFQ][inet[/172.22.52.34:9300]] marked shard as
initializing, but shard already started, mark shard as started]
[10:58:37,692][WARN ][cluster.action.shard ] [Gaea] received shard
failed for [logstash-2012.11.08][2], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [Failed to start shard, message
[IndexShardGatewayRecoveryException[[logstash-2012.11.08][2] shard
allocated for local recovery (post api), should exists, but doesn't]]]
[10:58:37,692][DEBUG][cluster.action.shard ] [Gaea] Received failed
shard [logstash-2012.11.08][2], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [Failed to start shard, message
[IndexShardGatewayRecoveryException[[logstash-2012.11.08][2] shard
allocated for local recovery (post api), should exists, but doesn't]]]
[10:58:37,757][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.07][3], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [master
[Gaea][Ovip2gcHSgC85ZnoDZfJFQ][inet[/172.22.52.34:9300]] marked shard as
initializing, but shard already started, mark shard as started]
[10:58:37,761][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.05][3], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [master
[Gaea][Ovip2gcHSgC85ZnoDZfJFQ][inet[/172.22.52.34:9300]] marked shard as
initializing, but shard already started, mark shard as started]
[10:58:37,761][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.06][1], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [master
[Gaea][Ovip2gcHSgC85ZnoDZfJFQ][inet[/172.22.52.34:9300]] marked shard as
initializing, but shard already started, mark shard as started]
[10:58:37,762][WARN ][cluster.action.shard ] [Gaea] received shard
failed for [logstash-2012.11.08][2], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [Failed to start shard, message
[IndexShardGatewayRecoveryException[[logstash-2012.11.08][2] shard
allocated for local recovery (post api), should exists, but doesn't]]]
[10:58:37,765][DEBUG][cluster.action.shard ] [Gaea] applying started
shards [[logstash-2012.11.06][1], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING]], reason [master
[Gaea][Ovip2gcHSgC85ZnoDZfJFQ][inet[/172.22.52.34:9300]] marked shard as
initializing, but shard already started, mark shard as started]
[10:58:37,766][DEBUG][cluster.action.shard ] [Gaea] Received failed
shard [logstash-2012.11.08][2], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [Failed to start shard, message
[IndexShardGatewayRecoveryException[[logstash-2012.11.08][2] shard
allocated for local recovery (post api), should exists, but doesn't]]]
[10:58:37,770][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.05][3] state: [RECOVERING]->[STARTED], reason [post
recovery]
[10:58:37,770][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.05][3] scheduling refresher every 1s
[10:58:37,770][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.05][3] scheduling optimizer / merger every 1s
[10:58:37,774][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.07][3] state: [RECOVERING]->[STARTED], reason [post
recovery]
[10:58:37,774][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.07][3] scheduling refresher every 1s
[10:58:37,774][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.07][3] scheduling optimizer / merger every 1s
[10:58:37,774][DEBUG][cluster.action.shard ] [Gaea] sending shard
started for [logstash-2012.11.05][3], node[Ovip2gcHSgC85ZnoDZfJFQ], [R],
s[INITIALIZING], reason [after recovery (replica) from node [[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]]
[10:58:37,774][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.05][3], node[Ovip2gcHSgC85ZnoDZfJFQ], [R],
s[INITIALIZING], reason [after recovery (replica) from node [[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]]
[10:58:37,774][DEBUG][cluster.action.shard ] [Gaea] applying started
shards [[logstash-2012.11.05][3], node[Ovip2gcHSgC85ZnoDZfJFQ], [R],
s[INITIALIZING]], reason [after recovery (replica) from node [[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]]
[10:58:37,774][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,774][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.06][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,775][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][1]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,775][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,775][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][0]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,775][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][2]: allocating [[logstash-2012.11.08][2], node[null],
[P], s[UNASSIGNED]] to [[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]] on primary
allocation
[10:58:37,775][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.06][0]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,775][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][1]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,777][DEBUG][cluster.action.shard ] [Gaea] sending shard
started for [logstash-2012.11.07][3], node[Ovip2gcHSgC85ZnoDZfJFQ], [R],
s[INITIALIZING], reason [master
[Gaea][Ovip2gcHSgC85ZnoDZfJFQ][inet[/172.22.52.34:9300]] marked shard as
initializing, but shard already started, mark shard as started]
[10:58:37,777][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.07][3], node[Ovip2gcHSgC85ZnoDZfJFQ], [R],
s[INITIALIZING], reason [master
[Gaea][Ovip2gcHSgC85ZnoDZfJFQ][inet[/172.22.52.34:9300]] marked shard as
initializing, but shard already started, mark shard as started]
[10:58:37,782][DEBUG][cluster.action.shard ] [Gaea] sending shard
started for [logstash-2012.11.07][3], node[Ovip2gcHSgC85ZnoDZfJFQ], [R],
s[INITIALIZING], reason [after recovery (replica) from node [[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]]
[10:58:37,782][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.07][3], node[Ovip2gcHSgC85ZnoDZfJFQ], [R],
s[INITIALIZING], reason [after recovery (replica) from node [[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]]
[10:58:37,804][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.06][1] state: [CREATED]
[10:58:37,804][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.06][1] state: [CREATED]->[RECOVERING], reason [from
[Kiden Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]
[10:58:37,810][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.06][1], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [master
[Gaea][Ovip2gcHSgC85ZnoDZfJFQ][inet[/172.22.52.34:9300]] marked shard as
initializing, but shard already started, mark shard as started]
[10:58:37,810][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.05][3], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [master
[Gaea][Ovip2gcHSgC85ZnoDZfJFQ][inet[/172.22.52.34:9300]] marked shard as
initializing, but shard already started, mark shard as started]
[10:58:37,810][DEBUG][cluster.action.shard ] [Gaea] applying started
shards [[logstash-2012.11.07][3], node[Ovip2gcHSgC85ZnoDZfJFQ], [R],
s[INITIALIZING], [logstash-2012.11.07][3], node[Ovip2gcHSgC85ZnoDZfJFQ],
[R], s[INITIALIZING], [logstash-2012.11.05][3],
node[rDKyOTqpTeStQirDZ-yBMg], [P], s[INITIALIZING]], reason [master
[Gaea][Ovip2gcHSgC85ZnoDZfJFQ][inet[/172.22.52.34:9300]] marked shard as
initializing, but shard already started, mark shard as started]
[10:58:37,811][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,811][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][1]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,811][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,811][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][0]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,811][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][1]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,811][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.06][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,811][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.06][0]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,819][WARN ][cluster.action.shard ] [Gaea] received shard
failed for [logstash-2012.11.08][2], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [Failed to start shard, message
[IndexShardGatewayRecoveryException[[logstash-2012.11.08][2] shard
allocated for local recovery (post api), should exists, but doesn't]]]
[10:58:37,819][DEBUG][cluster.action.shard ] [Gaea] Received failed
shard [logstash-2012.11.08][2], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [Failed to start shard, message
[IndexShardGatewayRecoveryException[[logstash-2012.11.08][2] shard
allocated for local recovery (post api), should exists, but doesn't]]]
[10:58:37,819][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.06][0]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,819][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,820][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.06][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,820][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][1]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,820][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][1]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,820][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,820][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][0]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,824][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][2]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,825][DEBUG][cluster.action.shard ] [Gaea] Applying failed
shard [logstash-2012.11.08][2], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [Failed to start shard, message
[IndexShardGatewayRecoveryException[[logstash-2012.11.08][2] shard
allocated for local recovery (post api), should exists, but doesn't]]]
[10:58:37,839][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.06][1] state: [RECOVERING]->[STARTED], reason [post
recovery]
[10:58:37,839][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.06][1] scheduling refresher every 1s
[10:58:37,839][DEBUG][index.shard.service ] [Gaea]
[logstash-2012.11.06][1] scheduling optimizer / merger every 1s
[10:58:37,840][DEBUG][cluster.action.shard ] [Gaea] sending shard
started for [logstash-2012.11.06][1], node[Ovip2gcHSgC85ZnoDZfJFQ], [R],
s[INITIALIZING], reason [after recovery (replica) from node [[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]]
[10:58:37,840][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.06][1], node[Ovip2gcHSgC85ZnoDZfJFQ], [R],
s[INITIALIZING], reason [after recovery (replica) from node [[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]]
[10:58:37,840][DEBUG][cluster.action.shard ] [Gaea] applying started
shards [[logstash-2012.11.06][1], node[Ovip2gcHSgC85ZnoDZfJFQ], [R],
s[INITIALIZING]], reason [after recovery (replica) from node [[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]]]
[10:58:37,840][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][1]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,840][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,841][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][1]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,841][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][0]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,841][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.06][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,841][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][2]: allocating [[logstash-2012.11.08][2], node[null],
[P], s[UNASSIGNED]] to [[Kiden
Nixon][rDKyOTqpTeStQirDZ-yBMg][inet[/172.22.52.34:9301]]] on primary
allocation
[10:58:37,841][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.06][0]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,841][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,850][DEBUG][cluster.action.shard ] [Gaea] received shard
started for [logstash-2012.11.05][3], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [master
[Gaea][Ovip2gcHSgC85ZnoDZfJFQ][inet[/172.22.52.34:9300]] marked shard as
initializing, but shard already started, mark shard as started]
[10:58:37,854][WARN ][cluster.action.shard ] [Gaea] received shard
failed for [logstash-2012.11.08][2], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [Failed to start shard, message
[IndexShardGatewayRecoveryException[[logstash-2012.11.08][2] shard
allocated for local recovery (post api), should exists, but doesn't]]]
[10:58:37,854][DEBUG][cluster.action.shard ] [Gaea] Received failed
shard [logstash-2012.11.08][2], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [Failed to start shard, message
[IndexShardGatewayRecoveryException[[logstash-2012.11.08][2] shard
allocated for local recovery (post api), should exists, but doesn't]]]
[10:58:37,854][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][0]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,854][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][1]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,854][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][1]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,854][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.07][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,854][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,854][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.06][0]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,855][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.06][4]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,855][DEBUG][gateway.local ] [Gaea]
[logstash-2012.11.08][2]: not allocating, number_of_allocated_shards_found
[0], required_number [1]
[10:58:37,857][DEBUG][cluster.action.shard ] [Gaea] Applying failed
shard [logstash-2012.11.08][2], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [Failed to start shard, message
[IndexShardGatewayRecoveryException[[logstash-2012.11.08][2] shard
allocated for local recovery (post api), should exists, but doesn't]]]
[10:58:37,876][WARN ][cluster.action.shard ] [Gaea] received shard
failed for [logstash-2012.11.08][2], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [Failed to start shard, message
[IndexShardGatewayRecoveryException[[logstash-2012.11.08][2] shard
allocated for local recovery (post api), should exists, but doesn't]]]
[10:58:37,876][DEBUG][cluster.action.shard ] [Gaea] Received failed
shard [logstash-2012.11.08][2], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [Failed to start shard, message
[IndexShardGatewayRecoveryException[[logstash-2012.11.08][2] shard
allocated for local recovery (post api), should exists, but doesn't]]]
[10:58:37,899][WARN ][cluster.action.shard ] [Gaea] received shard
failed for [logstash-2012.11.08][2], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [Failed to start shard, message
[IndexShardGatewayRecoveryException[[logstash-2012.11.08][2] shard
allocated for local recovery (post api), should exists, but doesn't]]]
[10:58:37,899][DEBUG][cluster.action.shard ] [Gaea] Received failed
shard [logstash-2012.11.08][2], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [Failed to start shard, message
[IndexShardGatewayRecoveryException[[logstash-2012.11.08][2] shard
allocated for local recovery (post api), should exists, but doesn't]]]
[10:58:37,924][WARN ][cluster.action.shard ] [Gaea] received shard
failed for [logstash-2012.11.08][2], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [Failed to start shard, message
[IndexShardGatewayRecoveryException[[logstash-2012.11.08][2] shard
allocated for local recovery (post api), should exists, but doesn't]]]
[10:58:37,924][DEBUG][cluster.action.shard ] [Gaea] Received failed
shard [logstash-2012.11.08][2], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [Failed to start shard, message
[IndexShardGatewayRecoveryException[[logstash-2012.11.08][2] shard
allocated for local recovery (post api), should exists, but doesn't]]]
[10:58:37,945][WARN ][cluster.action.shard ] [Gaea] received shard
failed for [logstash-2012.11.08][2], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [Failed to start shard, message
[IndexShardGatewayRecoveryException[[logstash-2012.11.08][2] shard
allocated for local recovery (post api), should exists, but doesn't]]]
[10:58:37,945][DEBUG][cluster.action.shard ] [Gaea] Received failed
shard [logstash-2012.11.08][2], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [Failed to start shard, message
[IndexShardGatewayRecoveryException[[logstash-2012.11.08][2] shard
allocated for local recovery (post api), should exists, but doesn't]]]
[10:58:37,966][WARN ][cluster.action.shard ] [Gaea] received shard
failed for [logstash-2012.11.08][2], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [Failed to start shard, message
[IndexShardGatewayRecoveryException[[logstash-2012.11.08][2] shard
allocated for local recovery (post api), should exists, but doesn't]]]
[10:58:37,967][DEBUG][cluster.action.shard ] [Gaea] Received failed
shard [logstash-2012.11.08][2], node[rDKyOTqpTeStQirDZ-yBMg], [P],
s[INITIALIZING], reason [Failed to start shard, message
[IndexShardGatewayRecoveryException[[logstash-2012.11.08][2] shard
allocated for local recovery (post api), should exists, but doesn't]]]
--