i have a very weird problem. I am sending all my jenkins logs via redis to logstash.
Now every single event that has a grokparsing failure is shown in kibana and the events that i am usually tracking and evalute don´t appear at all. So every grok filtered message just vanishes. There is no log entry in logstash or elasticsearch that i can connect to this problem.
I have follwoing message in elasticsearch:
[DEBUG][action.admin.indices.stats] [Sentry] [indices:monitor/stats] failed to execute operation for shard [[logstash-2016.01.20], node[HXKvmdxSTXWvFwPnP-Swdg], [P], v, s[INITIALIZING], a[id=uhxHv7TrRpaUpiJb7VcNuA], unassigned_info[[reason=CLUSTER_RECOVERED]
Last week the hole setup run smoothly with no problem.
Does somebody have a clue what could be happened?