"Legacy Collection" for Stack Monitoring

[Aniket_Pant (kaal)]

It appears you are using "Legacy Collection" for Stack Monitoring. This method of monitoring will no longer be supported in the next major release
I am using metricbeat and filebeat for monitoring our cluster Why it is showing this message

[warkolm (Mark Walkom)]

Did you click the Learn more link?

[chrisronline (Chris Roberson)]

In Kibana dev tools, can you issue this request and return the results?

GET _cat/indices/.monitoring-*

[Aniket_Pant (kaal)]

I read the documentation and follow the procedure but some nodes are not monitored i have 8 node cluster 3 master node 3 data node and 2 coordinate nodes.Only coordinate nodes and one master node out of three is monitoring. Data node and 2 master are not monitored.The metricbeat is working fine in each node of elasticsearch and they pointing coordinate nodes

[Aniket_Pant (kaal)]

some nodes are not monitored

after few seconds

[Aniket_Pant (kaal)]

hey @chrisronline

health status index                                uuid                   pri rep docs.count docs.deleted store.size pri.store.size
green  open   .monitoring-kibana-7-2021.01.01      bCxbDk1-SBi-9ifjwrqAsw   1   1      17280            0      5.4mb          2.7mb
green  open   .monitoring-kibana-7-2021.01.03      Xl7GznkKQHqW4MUrB6i5sA   1   1      15899            0      5.2mb          2.6mb
green  open   .monitoring-kibana-7-2021.01.02      PpEaks76QG2wHFlnAZO7bw   1   1      17278            0      5.5mb          2.7mb
green  open   .monitoring-kibana-7-2021.01.04      VzsOw3uPQliznbA8y1hr6w   1   1       6536            0      2.5mb          1.2mb
green  open   .monitoring-logstash-7-2020.12.31    xpow9BCsQAaKWCJ_9g-oXg   1   1    2864429            0      1.6gb        857.8mb
green  open   .monitoring-logstash-7-2020.12.30    x7K7Xqr0QpOdh0OHOuKVKw   1   1    1737434            0        1gb        522.4mb
green  open   .monitoring-kibana-7-2020.12.31      FrKbNp0CSbCVp3NP9bi-LQ   1   1      15446            0      5.1mb          2.5mb
green  open   .monitoring-kibana-7-2020.12.30      5abtMm2tR2uOY9sVyj3bBg   1   1      12120            0      3.9mb            2mb
green  open   .monitoring-es-7-mb-2021.01.04       t3X9MAG9RWa8Ee73EU5X5g   1   1    1496029            0      2.3gb          1.1gb
green  open   .monitoring-es-7-mb-2021.01.05       EnW1wM4pT1KoSAAiAOC7_g   1   1     269446            0    431.3mb        217.5mb
green  open   .monitoring-es-7-2020.12.30          j0b9cQksRL2t5poyNf9ewA   1   1    2134299       523784      2.2gb          1.1gb
green  open   .monitoring-kibana-7-mb-2021.01.05   QYUEuspkR3eQnJ2KutPuFQ   1   1       5204            0      2.4mb          1.2mb
green  open   .monitoring-es-7-2020.12.31          GxqFbqBvTI-fY3rez-_c8w   1   1    3327008      1766952      3.6gb          1.8gb
green  open   .monitoring-kibana-7-mb-2021.01.04   fbXXpNUiS7KoWwkFQhjzfw   1   1       5544            0      2.4mb          1.2mb
green  open   .monitoring-logstash-7-2021.01.02    UYMKly9-QZu0y68-eUDxgg   1   1    3191250            0      1.8gb        947.1mb
green  open   .monitoring-logstash-7-2021.01.01    thANjfLgQCy_4oIwmKCIcw   1   1    1876691            0        1gb        555.7mb
green  open   .monitoring-logstash-7-2021.01.04    t3WR2Af6ReS2a2FZfk26GQ   1   1     618103            0    373.3mb        186.6mb
green  open   .monitoring-logstash-7-2021.01.03    w8XLIjPmR6moYnXjiHO6og   1   1    3177528            0      1.8gb        947.8mb
green  open   .monitoring-logstash-7-mb-2021.01.04 4HT2vEjMSx2hsrOWpwUt9w   1   1     267500            0     34.3mb         17.3mb
green  open   .monitoring-logstash-7-mb-2021.01.05 Zcni2CNtQoKRAMi8j4Ldgw   1   1    2930443            0    382.1mb        190.8mb
green  open   .monitoring-es-7-2021.01.01          JKaTVOuRSl6hv9X1ji1nSg   1   1    4400500       283486      4.8gb          2.3gb
green  open   .monitoring-es-7-2021.01.05          MNHx06WeSu-2Z6sbpRm8VQ   1   1     314398       284618    342.5mb        168.2mb
green  open   .monitoring-es-7-2021.01.04          b0YQ9-0uQkSBTk0e1bK3iQ   1   1    2867216       757526      2.8gb          1.4gb
green  open   .monitoring-es-7-2021.01.03          qYhKf90dQk2oOYMTNqFRKw   1   1    4361279      1704641      4.6gb          2.3gb
green  open   .monitoring-es-7-2021.01.02          45K-nK9tSVO-tiKfahlbtQ   1   1    1365195         7905      1.4gb          742mb

[chrisronline (Chris Roberson)]

Thanks @Aniket_Pant!

The presence of .monitoring-{stackProduct}-7-2021* indices indicate there is legacy monitoring happening. Based on the screenshots, my guess is you have both collection methods used at the same time.

Verify you have properly disabled legacy monitoring collection. For example, please ensure you have properly set cluster settings for Elasticsearch monitoring via step 8 in https://www.elastic.co/guide/en/elasticsearch/reference/current/configuring-metricbeat.html

[Aniket_Pant (kaal)]

I've disabled this 5 minutes before but it showing me few nodes

[chrisronline (Chris Roberson)]

This particular code looks back 12 hours: https://github.com/elastic/kibana/blob/master/x-pack/plugins/monitoring/server/routes/api/v1/elasticsearch_settings/check/internal_monitoring.ts#L28 so you'll need to wait until 12h to stop seeing those.

[Aniket_Pant (kaal)]

@chrisronline Thanks it worked