Recovery restore

(Özgür Özkan Akdemirci) #1

Hi all,
I've downloaded ES and setup a 3 node VM cluster. Everything was fine, I was helloworlding. And I decided to put around 100 million records to an index for my performance benchmark. I ran my c# multithreaded console app and left. When I return on monday :wink: , the cluster mode was red.
I googled and found this topic and

deleted Kibana index. :smile:
Now I think I have a bigger problem,

[search_phase_execution_exception] all shards failed :: {"path":"/.marvel-es-data/cluster_info/_search","query":{},"body":"{"size":10000}","statusCode":503,"response":"{"error":{"root_cause":[],"type":"search_phase_execution_exception","reason":"all shards failed","phase":"query_fetch","grouped":true,"failed_shards":[]},"status":503}"}
at respond (/usr/share/kibana/node_modules/elasticsearch/src/lib/transport.js:238:15)
at checkRespForFailure (/usr/share/kibana/node_modules/elasticsearch/src/lib/transport.js:201:7)
at HttpConnector. (/usr/share/kibana/node_modules/elasticsearch/src/lib/connectors/http.js:155:7)
at IncomingMessage.wrapper (/usr/share/kibana/node_modules/lodash/index.js:3095:19)
at IncomingMessage.emit (events.js:129:20)
at _stream_readable.js:908:16
at process._tickDomainCallback (node.js:381:11)

my 3 nodes are not listed anymore, the following is output of _cluster/health?pretty
"cluster_name" : "elasticsearch-dev",
"status" : "red",
"timed_out" : false,
"number_of_nodes" : 1,
"number_of_data_nodes" : 1,
"active_primary_shards" : 5,
"active_shards" : 5,
"relocating_shards" : 0,
"initializing_shards" : 1,
"unassigned_shards" : 24,
"delayed_unassigned_shards" : 0,
"number_of_pending_tasks" : 0,
"number_of_in_flight_fetch" : 0,
"task_max_waiting_in_queue_millis" : 0,
"active_shards_percent_as_number" : 16.666666666666664

How can I restore,
appreciate for your answers.


(Spencer Alger) #2

You should focus on making your elasticsearch cluster "yellow" or "green" before worrying about Kibana.

(system) #3