# Watch Marvel node\_left event. Requesting fields from .marvel-\* search

**URL:** <https://discuss.elastic.co/t/watch-marvel-node-left-event-requesting-fields-from-marvel-search/29405>\
**Category:** Elasticsearch\
**Tags:** elastic-stack-alerting\
**Created:** [September 16, 2015, 12:26pm UTC](https://discuss.elastic.co/t/watch-marvel-node-left-event-requesting-fields-from-marvel-search/29405 "2015-09-16T12:26:50Z")\
**Posts on this page:** 9\
**Page:** 1

<div class="post-metadata">

**Author:** ![tom\_jonge](https://avatars.discourse-cdn.com/v4/letter/t/7ba0ec/32.png) [@tom\_jonge](https://discuss.elastic.co/u/tom_jonge)\
**Post date:** [September 16, 2015, 12:26pm UTC](https://discuss.elastic.co/t/watch-marvel-node-left-event-requesting-fields-from-marvel-search/29405/1 "2015-09-16T12:26:50Z")

</div>

Hello again!  
Below watch:

```
> {
> "trigger": {
> "schedule": {
> "interval": "60s"
> }
> },
> "input": {
> "search": {
> "request": {
> "indices": [
> ".marvel-*"
> ],
> "search_type": "query_then_fetch",
> "body": {
> "query": {
> "filtered": {
> "query": {
> "bool": {
> "should": [
> {
> "match": {
> "event": "node_left"
> }
> }
> ]
> }
> },
> "filter": {
> "range": {
> "@timestamp": {
> "from": "{{ctx.trigger.scheduled_time}}||-60s",
> "to": "{{ctx.trigger.triggered_time}}"
> }
> }
> }
> }
> },
> "fields": [
> "event",
> "node.name",
> "node.ip_port",
> "message",
> "cluster_name"
> ],
> "sort": [
> {
> "@timestamp": {
> "order": "desc"
> }
> }
> ]
> }
> }
> }
> },
> "throttle_period": "60s",
> "condition": {
> "script": {
> "inline": "ctx.payload.hits.size() > 0 "
> }
> },
> "actions": {
> "send_email": { 
> "email": {
> "to": "elkreceive@gmail.com", 
> "subject": " Watcher Notification - Event: {{ctx.payload.hits.hits.0.fields.node.name}}{{ctx.payload.hits.hits.0.fields.node.ip_port}}{{ctx.payload.hits.hits.0.fields.message}} the cluster at {{ctx.trigger.triggered_time}}",
> "body": "{{ctx.payload.hits.hits.0.fields.message}}{{ctx.payload.hits.hits.0.fields.node.name}}{{ctx.payload.hits.hits.0.fields.node.ip_port}} the cluster {{ctx.payload.hits.hits.0.fields.cluster_name}} "
> }
> }
> }
> }

```

Resulting mail returns:

```
> Watcher Notification - Event: {0=[esclient1][10.0.0.202:9300] joined} the cluster at 2015-09-16T11:49:34.978Z 

```

Notice `fields.message` and `fields.cluster_name` return their values. However `node.name` and `node.ip_port` do not. I have also tried `{{ctx.payload.hits.hits.0._source.node.name}}` yet these are returned empty.

The .marvel-\* indice in kibana shows these terms filled with the desired values.

Does anyone have any idea where I have made mistakes?

---

<div class="post-metadata">

**Author:** ![tom\_jonge](https://avatars.discourse-cdn.com/v4/letter/t/7ba0ec/32.png) [@tom\_jonge](https://discuss.elastic.co/u/tom_jonge)\
**Post date:** [September 17, 2015, 11:10am UTC](https://discuss.elastic.co/t/watch-marvel-node-left-event-requesting-fields-from-marvel-search/29405/2 "2015-09-17T11:10:20Z")

</div>

Update:  
If I grab a watch in .watch\_history\*, I get the following: `> "node.name":["esclient1"],"event":["node_left"],"node.ip_port":["10.0.0.202:9300"]` So the watch is grabbing the desired fields. They are just not being placed in the mail. So the problem is in:

> `"subject": " Watcher Notification - Event: {{ctx.payload.hits.hits.0.fields.node.name}}{{ctx.payload.hits.hits.0.fields.node.ip_port}}{{ctx.payload.hits.hits.0.fields.message}} the cluster at {{ctx.trigger.triggered_time}}", "body": "{{ctx.payload.hits.hits.0.fields.message}}{{ctx.payload.hits.hits.0.fields.node.name}}{{ctx.payload.hits.hits.0.fields.node.ip_port}} the cluster {{ctx.payload.hits.hits.0.fields.cluster_name}} "`

Another issue I've noticed is that `{{ctx.trigger.triggered_time}}` shows UTC even when timezones have been adjusted and even after adding a timezone filter to logstash. Kibana seems to adjust the timestamp when indexing to the correct time, but it seems this does not happen when sending watch triggered mails.

---

<div class="post-metadata">

**Author:** ![tom\_jonge](https://avatars.discourse-cdn.com/v4/letter/t/7ba0ec/32.png) [@tom\_jonge](https://discuss.elastic.co/u/tom_jonge)\
**Post date:** [September 23, 2015, 11:32am UTC](https://discuss.elastic.co/t/watch-marvel-node-left-event-requesting-fields-from-marvel-search/29405/3 "2015-09-23T11:32:16Z")

</div>

Update:  
Still have not been able to find anything to get this working. Does anyone have an idea?

---

<div class="post-metadata">

**Author:** ![mvg](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/mvg/32/98890_2.png) [@mvg](https://discuss.elastic.co/u/mvg)\
**Post date:** [September 23, 2015, 2:57pm UTC](https://discuss.elastic.co/t/watch-marvel-node-left-event-requesting-fields-from-marvel-search/29405/4 "2015-09-23T14:57:26Z")

</div>

If you use `_source` instead `fields` then I think it should work. So for example:

```auto
{{ctx.payload.hits.hits.0._source.node.name}}

```

---

<div class="post-metadata">

**Author:** ![tom\_jonge](https://avatars.discourse-cdn.com/v4/letter/t/7ba0ec/32.png) [@tom\_jonge](https://discuss.elastic.co/u/tom_jonge)\
**Post date:** [September 23, 2015, 3:17pm UTC](https://discuss.elastic.co/t/watch-marvel-node-left-event-requesting-fields-from-marvel-search/29405/5 "2015-09-23T15:17:43Z")

</div>

Hi, afraid it does not.

```
{
"trigger": {
    "schedule": {
      "interval": "60s"
    }
  },
  "input": {
    "search": {
      "request": {
        "indices": [
          ".marvel-*"
        ],
        "search_type": "query_then_fetch",
        "body": {
          "query": {
            "filtered": {
              "query": {
                "bool": {
                  "should": [
                    {
                      "match": {
                        "event": "node_left"
                      }
                    }
                  ]
                }
              },
              "filter": {
                "range": {
                  "@timestamp": {
                    "from": "{{ctx.trigger.scheduled_time}}||-60s",
                    "to": "{{ctx.trigger.triggered_time}}"
                  }
                }
              }
            }
          },
          "fields": [
            "event",
            "node.name",
            "node.ip_port",
            "message",
            "cluster_name",
            "node.attributes.data",
            "node.attributes.master",
            "@timestamp"
          ],
          "sort": [
            {
              "@timestamp": {
                "order": "desc"
              }
            }
          ]
        }
      }
    }
  },
  "throttle_period": "60s",
  "condition": {
    "script": {
      "inline": "ctx.payload.hits.size() > 0 "
    }
  },
  "actions": {
    "send_email": { 
      "email": {
        "to": "elkreceive@gmail.com", 
        "subject": " Watcher Notification - Event: NODE:{{ctx.payload.hits.hits.0._source.node.name}} ON IP:{{ctx.payload.hits.hits.0._source.node.ip_port}} MESSAGE:{{ctx.payload.hits.hits.0.fields.message}} the cluster at {{ctx.trigger.triggered_time}} UTC",
        "body": { 
        "html": "<HTML><b>Trigger time: </b>{{ctx.trigger.triggered_time}} UTC<br><b>Node: </b>{{ctx.payload.hits.hits.0._source.node.name}}<br><b>IP and Port: </b>{{ctx.payload.hits.hits.0._source.node.ip_port}}<br><b>Master node: </b>{{ctx.payload.hits.hits.0._source.node.attributes.master}}<br><b>Data node: </b>{{ctx.payload.hits.hits.0._source.node.attributes.data}}<br><b>Message: </b>{{ctx.payload.hits.hits.0.fields.message}}<br><b>Cluster: </b>{{ctx.payload.hits.hits.0.fields.cluster_name}}</HTML>"
        }
      }
    }
  }
}

```

Results in empty returns:

![](https://us1.discourse-cdn.com/elastic/original/2X/c/c3c7080accfeef7ba04f28b2f48a0c08b630237f.png)

Wish the documentation would go into a bit more detail.

---

<div class="post-metadata">

**Author:** ![tom\_jonge](https://avatars.discourse-cdn.com/v4/letter/t/7ba0ec/32.png) [@tom\_jonge](https://discuss.elastic.co/u/tom_jonge)\
**Post date:** [September 23, 2015, 3:25pm UTC](https://discuss.elastic.co/t/watch-marvel-node-left-event-requesting-fields-from-marvel-search/29405/6 "2015-09-23T15:25:57Z")

</div>

Got it working with:

```
          "fields": [
            "event",
            "message",
            "cluster_name",
            "@timestamp"
          ],
           "_source": [
            "node.name",
            "node.ip_port",
            "node.attributes.data",
            "node.attributes.master"
          ],
```

---

<div class="post-metadata">

**Author:** ![mvg](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/mvg/32/98890_2.png) [@mvg](https://discuss.elastic.co/u/mvg)\
**Post date:** [September 25, 2015, 8:36am UTC](https://discuss.elastic.co/t/watch-marvel-node-left-event-requesting-fields-from-marvel-search/29405/7 "2015-09-25T08:36:38Z")

</div>

Ah I missed that you specifically asking for fields. The `fields` option should only be used if you configure in the mappings that you store fields. If `fields` was left out of the search request the `_source` would be able to pick your values up. By default the entire \_source of a hit is returned. (but that isn't the case if `fields` is used in the search request)

---

<div class="post-metadata">

**Author:** ![lennylinux](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/lennylinux/32/9727_2.png) [@lennylinux](https://discuss.elastic.co/u/lennylinux)\
**Post date:** [May 12, 2016, 1:05pm UTC](https://discuss.elastic.co/t/watch-marvel-node-left-event-requesting-fields-from-marvel-search/29405/8 "2016-05-12T13:05:21Z")

</div>

Hi guys,

I´ve tried the example watch, but in my Marvel indices aren't an event field. Someone has an idea?

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 1:45pm UTC](https://discuss.elastic.co/t/watch-marvel-node-left-event-requesting-fields-from-marvel-search/29405/9 "2017-07-06T13:45:39Z")

</div>