.marvel-es-YYYY.MM.DD index deleted HOW-TO create it again

Elastic Stack Kibana
21

[2015-11-22 09:10:30,849][DEBUG][marvel.agent.collector.indices] [nl-ams02c-ispdat01] starting collector [index-recovery-collector]
[2015-11-22 09:10:30,849][DEBUG][marvel.agent.collector.node] [nl-ams02c-ispdat01] starting collector [node-stats-collector]
[2015-11-22 09:10:34,134][DEBUG][marvel.agent.exporter.local] local exporter [default_local] - waiting until gateway has recovered from disk

- marvel

[2015-11-22 09:10:34,321][DEBUG][marvel.agent.exporter.local] local exporter [default_local] - currently installed marvel template version [2.0.0] is up-to-date
[2015-11-22 09:10:34,322][DEBUG][marvel.agent.exporter.local] local exporter [default_local] - started!
[2015-11-22 09:10:34,675][DEBUG][marvel.agent.exporter.local] local exporter [default_local] - currently installed marvel template version [2.0.0] is up-to-date
[2015-11-22 09:10:34,910][DEBUG][marvel.agent.exporter.local] local exporter [default_local] - currently installed marvel template version [2.0.0] is up-to-date
[2015-11-22 09:10:47,164][INFO ][rest.suppressed ] /.marvel-es-data/cluster_info/_search Params: {index=.marvel-es-data, type=cluster_info}
[.marvel-es-data] IndexNotFoundException[no such index]
[2015-11-22 09:11:17,551][INFO ][rest.suppressed ] /.marvel-es-data/cluster_info/_search Params: {index=.marvel-es-data, type=cluster_info}
[.marvel-es-data] IndexNotFoundException[no such index]
[2015-11-22 09:11:42,429][INFO ][marvel.agent.settings ] [nl-ams02c-ispdat01] marvel setting [marvel.agent.interval : 30s] updated
[2015-11-22 09:11:42,430][INFO ][marvel.agent ] [nl-ams02c-ispdat01] sampling interval updated to [30s]
[2015-11-22 09:11:42,430][DEBUG][marvel.agent.exporter.local] local exporter [default_local] - currently installed marvel template version [2.0.0] is up-to-date
[2015-11-22 09:11:48,535][INFO ][rest.suppressed ] /.marvel-es-data/cluster_info/_search Params: {index=.marvel-es-data, type=cluster_info}
[.marvel-es-data] IndexNotFoundException[no such index]
[2015-11-22 09:12:19,528][INFO ][rest.suppressed ] /.marvel-es-data/cluster_info/_search Params: {index=.marvel-es-data, type=cluster_info}
[.marvel-es-data] IndexNotFoundException[no such index]
[2015-11-22 09:12:49,814][INFO ][rest.suppressed ] /.marvel-es-data/cluster_info/_search Params: {index=.marvel-es-data, type=cluster_info}
[.marvel-es-data] IndexNotFoundException[no such index]
[2015-11-22 09:12:54,680][INFO ][rest.suppressed ] /.marvel-es-data/cluster_info/_search Params: {index=.marvel-es-data, type=cluster_info}
[.marvel-es-data] IndexNotFoundException[no such index]
[2015-11-22 09:14:03,591][INFO ][rest.suppressed ] /.marvel-es-data/cluster_info/_search Params: {index=.marvel-es-data, type=cluster_info}
[.marvel-es-data] IndexNotFoundException[no such index]
[2015-11-22 09:15:04,576][INFO ][rest.suppressed ] /.marvel-es-data/cluster_info/_search Params: {index=.marvel-es-data, type=cluster_info}
[.marvel-es-data] IndexNotFoundException[no such index]
[2015-11-22 09:16:05,561][INFO ][rest.suppressed ] /.marvel-es-data/cluster_info/_search Params: {index=.marvel-es-data, type=cluster_info}
[.marvel-es-data] IndexNotFoundException[no such index]

22

You can create a new index for marvel on the setup page with the ".marvel-es*" for example

Pasted image794×604 33.9 KB

23

@dfr0 the issue is not about creating the index only...

24

f*** any update for your issue???

25

@dfr0 thanks for the tip about re-naming the cluster. had;t thought of it. but unfortunately it didn't help.
permissions are elasticsearch:elasticsearch
no proxy is used for the time being.

26

@nskalis I'm afraid I can't reproduce this issue.

Can you please give us a quick update of your situation now?

  • versions of ES/Marvel Agent/Kibana/Marvel Plugin (on your cluster and eventually your monitoring cluster)
  • which exporters (local/http) configured on your cluster
  • output of GET /_cat/indices and GET /_cat/shards
27 
index         shard prirep state         docs   store ip        node               
de-fra04a-rr1 0     p      STARTED          0    127b 127.0.0.1 nl-ams02c-ispdat01 
ie-dub01a-rr1 0     p      STARTED    1073717 241.1mb 127.0.0.1 nl-ams02c-ispdat01 
cz-prg01a-rr1 0     p      STARTED          0    127b 127.0.0.1 nl-ams02c-ispdat01 
uk-lon02a-rr1 0     p      STARTED          0    127b 127.0.0.1 nl-ams02c-ispdat01 
ch-zrh03a-rr1 0     p      STARTED    1101818 245.2mb 127.0.0.1 nl-ams02c-ispdat01 
ch-nax01a-rr1 0     p      STARTED          0    127b 127.0.0.1 nl-ams02c-ispdat01 
hu-bud02a-rr1 0     p      STARTED    1090573   243mb 127.0.0.1 nl-ams02c-ispdat01 
us-was03a-rr1 0     p      STARTED          0    127b 127.0.0.1 nl-ams02c-ispdat01 
uk-lon01b-rr1 0     p      STARTED    1022148   233mb 127.0.0.1 nl-ams02c-ispdat01 
.kibana       0     p      STARTED         66  69.5kb 127.0.0.1 nl-ams02c-ispdat01 
.kibana       0     r      UNASSIGNED                                              
us-nyc01b-rr1 0     p      STARTED    1132460 253.4mb 127.0.0.1 nl-ams02c-ispdat01 
at-vie15a-rr1 0     p      STARTED          0    127b 127.0.0.1 nl-ams02c-ispdat01 
at-vie01a-rr1 0     p      STARTED    3123564 614.6mb 127.0.0.1 nl-ams02c-ispdat01 
pl-waw26b-rr1 0     p      STARTED          0    127b 127.0.0.1 nl-ams02c-ispdat01 
ch-otf01b-rr1 0     p      STARTED          0    127b 127.0.0.1 nl-ams02c-ispdat01 
pl-waw04a-rr1 0     p      STARTED    1046756 234.2mb 127.0.0.1 nl-ams02c-ispdat01 
nl-ams02a-rr1 0     p      STARTED          0    127b 127.0.0.1 nl-ams02c-ispdat01 
nl-ams05a-rr1 0     p      STARTED    1041033 239.2mb 127.0.0.1 nl-ams02c-ispdat01 
cz-prg02a-rr1 0     p      STARTED    4346034   1.1gb 127.0.0.1 nl-ams02c-ispdat01 
fr-par02b-rr1 0     p      STARTED    2328671 471.1mb 127.0.0.1 nl-ams02c-ispdat01 
de-fra01b-rr1 0     p      STARTED    1142849 254.2mb 127.0.0.1 nl-ams02c-ispdat01 
ro-buh01a-rr1 0     p      STARTED    1055523 244.6mb 127.0.0.1 nl-ams02c-ispdat01 
fr-par02c-rr1 0     p      STARTED          0    127b 127.0.0.1 nl-ams02c-ispdat01 
ro-tm01a-rr1  0     p      STARTED          0    127b 127.0.0.1 nl-ams02c-ispdat01 
sk-bts04a-rr1 0     p      STARTED    4157580 825.9mb 127.0.0.1 nl-ams02c-ispdat01
28 
health status index         pri rep docs.count docs.deleted store.size pri.store.size 
green  open   fr-par02c-rr1   1   0          0            0       127b           127b 
green  open   ie-dub01a-rr1   1   0    1077728            0    241.7mb        241.7mb 
green  open   cz-prg01a-rr1   1   0          0            0       127b           127b 
green  open   cz-prg02a-rr1   1   0    4349724            0    831.9mb        831.9mb 
green  open   at-vie01a-rr1   1   0    3123564            0    614.8mb        614.8mb 
green  open   us-nyc01b-rr1   1   0    1133234            0      246mb          246mb 
green  open   sk-bts04a-rr1   1   0    4162512            0    959.8mb        959.8mb 
green  open   ch-zrh03a-rr1   1   0    1102581            0    246.2mb        246.2mb 
green  open   nl-ams02a-rr1   1   0          0            0       127b           127b 
green  open   de-fra01b-rr1   1   0    1143761            0    254.4mb        254.4mb 
green  open   ch-nax01a-rr1   1   0          0            0       127b           127b 
green  open   pl-waw26b-rr1   1   0          0            0       127b           127b 
green  open   ro-tm01a-rr1    1   0          0            0       127b           127b 
green  open   fr-par02b-rr1   1   0    2328671            0    467.2mb        467.2mb 
green  open   ch-otf01b-rr1   1   0          0            0       127b           127b 
green  open   hu-bud02a-rr1   1   0    1091712            0    243.4mb        243.4mb 
yellow open   .kibana         1   1         66            0     69.5kb         69.5kb 
green  open   uk-lon01b-rr1   1   0    1022984            0    233.1mb        233.1mb 
green  open   de-fra04a-rr1   1   0          0            0       127b           127b 
green  open   at-vie15a-rr1   1   0          0            0       127b           127b 
green  open   us-was03a-rr1   1   0          0            0       127b           127b 
green  open   uk-lon02a-rr1   1   0          0            0       127b           127b 
green  open   ro-buh01a-rr1   1   0    1059223            0    245.2mb        245.2mb 
green  open   nl-ams05a-rr1   1   0    1042138            0    241.9mb        241.9mb 
green  open   pl-waw04a-rr1   1   0    1048067            0    235.6mb        235.6mb
29

Elasticsearch:

"version" : {
"number" : "2.0.0",

Kibana:

4.2.1

Marvel; how can i check which version of Marvel is installed ?

30

thanks Tanguy, for your help, it is much appreciated.
Elasticsearch, Kibana, Marvel, et al. all running on the same node. so i guess the exporter is local, correct ?