# Kibana monitoring shows empty nodes

**URL:** <https://discuss.elastic.co/t/kibana-monitoring-shows-empty-nodes/249829>\
**Category:** Kibana\
**Tags:** elastic-stack-monitoring\
**Created:** [September 24, 2020, 2:14pm UTC](https://discuss.elastic.co/t/kibana-monitoring-shows-empty-nodes/249829 "2020-09-24T14:14:05Z")\
**Posts on this page:** 7\
**Page:** 1

<div class="post-metadata">

**Author:** ![fanqiaoqing](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/fanqiaoqing/32/49698_2.png) [@fanqiaoqing](https://discuss.elastic.co/u/fanqiaoqing)\
**Post date:** [September 24, 2020, 2:14pm UTC](https://discuss.elastic.co/t/kibana-monitoring-shows-empty-nodes/249829/1 "2020-09-24T14:14:05Z")

</div>

Hi Elastic,

We are using the kibana 7.2.1, we have around 200 nodes in our clusters. Recently, we found the kibana monitoring shows empty nodes

 ![WX20200924-070848](https://us1.discourse-cdn.com/elastic/original/3X/9/7/978ad981180e96adfbeab22c03415d580271efe9.png)  
I uploaded a screenshot, you can check that. Meanwhile we had try many solutions but none is work.

This is our cluster setttings.

```auto
{
  "persistent" : {
    "cluster" : {
      "routing" : {
        "allocation" : {
          "enable" : "all"
        }
      }
    },
    "xpack" : {
      "monitoring" : {
        "collection" : {
          "enabled" : "true"
        }
      }
    }
  },
  "transient" : {
    "search" : {
      "max_buckets" : "65535"
    },
    "xpack" : {
      "monitoring" : {
        "collection" : {
          "enabled" : "true"
        }
      }
    }
  }
}

```

Could someone gave us any suggestions?

Thanks,

---

<div class="post-metadata">

**Author:** ![bhavyarm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/bhavyarm/32/22392_2.png) [@bhavyarm](https://discuss.elastic.co/u/bhavyarm)\
**Post date:** [September 24, 2020, 6:54pm UTC](https://discuss.elastic.co/t/kibana-monitoring-shows-empty-nodes/249829/2 "2020-09-24T18:54:17Z")

</div>

Hello,

Can you please check if there are any errors in your browser console on the monitoring page?

Thanks,  
Bhavya

---

<div class="post-metadata">

**Author:** ![Igor\_Zaytsev](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/igor_zaytsev/32/50662_2.png) [@Igor\_Zaytsev](https://discuss.elastic.co/u/Igor_Zaytsev)\
**Post date:** [September 24, 2020, 8:09pm UTC](https://discuss.elastic.co/t/kibana-monitoring-shows-empty-nodes/249829/3 "2020-09-24T20:09:06Z")

</div>

@fanqiaoqing

Are there any errors in the Kibana (or ES) terminal console?

I'm assuming that one of the queries is either timing-out, failing, or hitting the "max buckets" error, in that API call.

Can you please try the following queries and post the results here (be sure to replace `cluster_uuid` with yours )

```auto
# node shards query
POST .monitoring-es*/_search
{
  "size": 0,
  "sort": {
    "timestamp": {
      "order": "desc",
      "unmapped_type": "long"
    }
  },
  "query": {
    "bool": {
      "filter": [
        {
          "bool": {
            "should": [
              {
                "term": {
                  "type": "shards"
                }
              },
              {
                "term": {
                  "metricset.name": "shards"
                }
              }
            ]
          }
        },
        {
          "term": {
            "cluster_uuid": "wuXG3QJKThmajyOWMx20hw"
          }
        },
        {
          "range": {
            "timestamp": {
              "gte": "now-12h"
            }
          }
        }
      ]
    }
  },
  "aggs": {
    "nodes": {
      "terms": {
        "field": "shard.node",
        "size": 10000
      }
    }
  }
}

```

and

```auto
#node unassigned shards query
POST .monitoring-es*/_search
{
  "sort": {
    "timestamp": {
      "order": "desc",
      "unmapped_type": "long"
    }
  },
  "query": {
    "bool": {
      "filter": [
        {
          "bool": {
            "should": [
              {
                "term": {
                  "type": "shards"
                }
              },
              {
                "term": {
                  "metricset.name": "shards"
                }
              }
            ]
          }
        },
        {
          "term": {
            "cluster_uuid": "wuXG3QJKThmajyOWMx20hw"
          }
        },
        {
          "range": {
            "timestamp": {
              "gte": "now-12h"
            }
          }
        }
      ]
    }
  },
  "aggs": {
    "indices": {
      "terms": {
        "field": "shard.index",
        "size": 10000
      },
      "aggs": {
        "state": {
          "filter": {
            "terms": {
              "shard.state": [
                "UNASSIGNED",
                "INITIALIZING"
              ]
            }
          },
          "aggs": {
            "primary": {
              "terms": {
                "field": "shard.primary",
                "size": 2
              }
            }
          }
        }
      }
    }
  }
}

```

Also, can you please try higher time ranges (like 24 hours ago or 48), and see if that does anything

---

<div class="post-metadata">

**Author:** ![fanqiaoqing](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/fanqiaoqing/32/49698_2.png) [@fanqiaoqing](https://discuss.elastic.co/u/fanqiaoqing)\
**Post date:** [September 25, 2020, 2:00pm UTC](https://discuss.elastic.co/t/kibana-monitoring-shows-empty-nodes/249829/4 "2020-09-25T14:00:00Z")

</div>

![query2](https://us1.discourse-cdn.com/elastic/original/3X/e/b/eb6f21887fd07eb682342fb3c5da1e311a8bf145.png) [quote="Igor\_Zaytsev, post:3, topic:249829"]

```auto
POST .monitoring-es*/_search
{
  "size": 0,
  "sort": {
    "timestamp": {
      "order": "desc",
      "unmapped_type": "long"
    }
  },
  "query": {
    "bool": {
      "filter": [
        {
          "bool": {
            "should": [
              {
                "term": {
                  "type": "shards"
                }
              },
              {
                "term": {
                  "metricset.name": "shards"
                }
              }
            ]
          }
        },
        {
          "term": {
            "cluster_uuid": "wuXG3QJKThmajyOWMx20hw"
          }
        },
        {
          "range": {
            "timestamp": {
              "gte": "now-12h"
            }
          }
        }
      ]
    }
  },
  "aggs": {
    "nodes": {
      "terms": {
        "field": "shard.node",
        "size": 10000
      }
    }
  }
}

```

[/quote]

Thanks Igor for youe suggestion.  
I tried the two queries to get the data in past 4800, they are showed below.  
1st:

 ![query1](https://us1.discourse-cdn.com/elastic/original/3X/8/e/8e39ad61e575bc9939034dd407394279f7e77537.png)  
2nd  
 ![query2](https://us1.discourse-cdn.com/elastic/original/3X/e/b/eb6f21887fd07eb682342fb3c5da1e311a8bf145.png)  
The number of characters in the query result exceeds the limit, I can only give a screenshot.

and I also uploaded the screenshot of the console,

 ![console_error](https://us1.discourse-cdn.com/elastic/original/3X/e/3/e364816034307b28fa0e5fa9ca4245f5955d4f16.png)

---

<div class="post-metadata">

**Author:** ![fanqiaoqing](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/fanqiaoqing/32/49698_2.png) [@fanqiaoqing](https://discuss.elastic.co/u/fanqiaoqing)\
**Post date:** [September 25, 2020, 2:01pm UTC](https://discuss.elastic.co/t/kibana-monitoring-shows-empty-nodes/249829/5 "2020-09-25T14:01:57Z")

</div>

Thanks Bhavya,

 ![console_error](https://us1.discourse-cdn.com/elastic/original/3X/e/3/e364816034307b28fa0e5fa9ca4245f5955d4f16.png)  
I took a screenshot when loading the nodes, no obvious abnormalities found.

---

<div class="post-metadata">

**Author:** ![Igor\_Zaytsev](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/igor_zaytsev/32/50662_2.png) [@Igor\_Zaytsev](https://discuss.elastic.co/u/Igor_Zaytsev)\
**Post date:** [October 1, 2020, 2:02am UTC](https://discuss.elastic.co/t/kibana-monitoring-shows-empty-nodes/249829/6 "2020-10-01T02:02:45Z")

</div>

@fanqiaoqing Still need a couple of things:

- Check Kibana and ES terminal console logs (not the browser) to see if there are any errors there?
- And, also try the 48h time-range in the UI time picker (top-right). Play around with it see if small or big timeranges have any affect

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [October 29, 2020, 2:03am UTC](https://discuss.elastic.co/t/kibana-monitoring-shows-empty-nodes/249829/7 "2020-10-29T02:03:18Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
