Kibana showing "Red" status, need help diagnosing/fixing

[LeeDr (Lee Drengenberg)]

Hi niteshkumar,
That looks like a good question for the Elasticsearch forum. Please include the Elasticsearch version, and Operating System. Maybe also the Java info.

You might also check this post;

[ElasticSearch 2.2.0] I am occasionally getting Process Cluster Event Timeout Exception[failed to process cluster event (put-mapping [as]) within 30s] while bulk indexing documents

Would this be the same reason why the cluster throws ProcessClusterEventTimeoutException[failed to process cluster event (put-mapping [as]) within 30s]?

Which then leads to this;

What happends if I change master: true, data: true node to master-only node?

Force-deleting half of index directories didn't help making the cluster back alive. I tried doubling the master node's memory, but it still dies. My initial plan was to make the cluster back alive and re-indexing everything. (with my-index-YYYYMM pattern) Since the cluster doesn't easily get back on, I plan to create new cluster and find a way to restore data from the dead cluster. (Not sure this is possible at the moment.)

Regards,
Lee