# All Data nodes are offline except master node in Stack monitoring

**URL:** <https://discuss.elastic.co/t/all-data-nodes-are-offline-except-master-node-in-stack-monitoring/216169>\
**Category:** Kibana\
**Created:** [January 23, 2020, 4:09am UTC](https://discuss.elastic.co/t/all-data-nodes-are-offline-except-master-node-in-stack-monitoring/216169 "2020-01-23T04:09:15Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![Sagar\_Mandal](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/sagar_mandal/32/57073_2.png) [@Sagar\_Mandal](https://discuss.elastic.co/u/Sagar_Mandal)\
**Post date:** [January 23, 2020, 4:09am UTC](https://discuss.elastic.co/t/all-data-nodes-are-offline-except-master-node-in-stack-monitoring/216169/1 "2020-01-23T04:09:15Z")

</div>

Hi Team,

So my cluster with one master node and two data node is up and running but when i check in stack monitoring in kibana, only data nodes are offline and master is up.

 ![screencapture-192-168-0-76-5601-app-monitoring-1579692842264](https://us1.discourse-cdn.com/elastic/original/3X/b/e/be9dc79b9f2c902d355c3c7fcdd616e7e70aadc3.png)

but when i check indices in each node they are all same.  
I'm able to get data and everything but this is only in **stack monitoring**

really need help on this,  
any possible solution would help me.

Thanks and regards,  
Sagar Mandal

---

<div class="post-metadata">

**Author:** ![rashmi](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/rashmi/32/16391_2.png) [@rashmi](https://discuss.elastic.co/u/rashmi)\
**Post date:** [January 23, 2020, 10:16pm UTC](https://discuss.elastic.co/t/all-data-nodes-are-offline-except-master-node-in-stack-monitoring/216169/2 "2020-01-23T22:16:56Z")

</div>

I'm not seeing anything obvious to me.

What about the `elasticsearch.yml` for the data nodes? And just to double check, I'm assuming you are not seeing any errors in the data nodes server logs?

It looks like the other two nodes are not reporting node\_stats at all. Let's see if they are reporting _any_ monitoring data.

Try running:

```auto
POST .monitoring-es-*/_search
{
  "size": 1,
  "sort": [
    {
      "timestamp": {
        "order": "desc"
      }
    }
  ],
  "query": {
    "term": {
      "type": {
        "value": "shards"
      }
    }
  },
  "collapse": {
    "field": "shard.node"
  }
}

```

Check if the only node you see is also the only one showing up in the UI.

If so, we need to figure out why those nodes aren't reporting.

A couple of things that will help figure that out:

1. `GET _cluster/settings` for the cluster
2. The `elasticsearch.yml` for each node

hope it helps  
Thanks  
Rashmi

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [February 20, 2020, 10:17pm UTC](https://discuss.elastic.co/t/all-data-nodes-are-offline-except-master-node-in-stack-monitoring/216169/3 "2020-02-20T22:17:02Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.