# Don't see the metrics I expect

**URL:** https://discuss.elastic.co/t/dont-see-the-metrics-i-expect/265871
**Category:** Beats
**Tags:** metricbeat
**Created:** [March 1, 2021, 9:04pm UTC](https://discuss.elastic.co/t/dont-see-the-metrics-i-expect/265871 "2021-03-01T21:04:10Z")
**Posts on this page:** 7
**Page:** 1

<div class="post-metadata">

### Author: ![mcco0l](https://avatars.discourse-cdn.com/v4/letter/m/c57346/32.png) [@mcco0l](https://discuss.elastic.co/u/mcco0l)
#### Post date: [March 1, 2021, 9:04pm UTC](https://discuss.elastic.co/t/dont-see-the-metrics-i-expect/265871/1 "2021-03-01T21:04:10Z")

</div>

Hi there,  
I'm trying to get some Fargate metrics using Cloudwatch namespaces, but I don't see a way to get them to Kibana.  
modules.d/aws.yml

```auto
    - module: aws
      period: 5m
      access_key_id: 'xxxxxxxxxxxxx'
      secret_access_key: 'xxxxxxxxxxxxxxxxxxxxxxx'
      metricsets:
        - rds
        - usage
        - ebs
        - ec2
        - cloudwatch
      metrics:
        - namespace: "*"

```

in the logs output I can see this, but not sure how to check this in kibana:

```auto
      "aws": {
        "ecs": {
          "metrics": {
            "MemoryUtilization": {
              "avg": 15.336588541666666,
              "max": 15.4296875,
              "min": 15.234375,
              "sum": 153.36588541666666,
              "count": 10
            },
            "CPUUtilization": {
              "sum": 5.197281962927915,
              "count": 10,
              "avg": 0.5197281962927915,
              "max": 1.1245832656975834,
              "min": 0.2879062617197633
            }
          }
        },
        "cloudwatch": {
          "namespace": "AWS/ECS"
        },
        "dimensions": {
          "ServiceName": "web-service",
          "ClusterName": "tt-ecs"
        }
      },
      "event": {
        "dataset": "aws.cloudwatch",
        "module": "aws",
        "duration": 120682193
      },
      "metricset": {
        "name": "cloudwatch",
        "period": 300000
      }
    }

```

How would I be able to visualize these metrics?

---

<div class="post-metadata">

### Author: ![mtojek](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/mtojek/32/63863_2.png) [@mtojek](https://discuss.elastic.co/u/mtojek)
#### Post date: [March 2, 2021, 9:51am UTC](https://discuss.elastic.co/t/dont-see-the-metrics-i-expect/265871/2 "2021-03-02T09:51:27Z")

</div>

Did you integrate filebeat with Elasticsearch? See: [Filebeat quick start: installation and configuration | Filebeat Reference [master] | Elastic](https://www.elastic.co/guide/en/beats/filebeat/master/filebeat-installation-configuration.html)

---

<div class="post-metadata">

### Author: ![mcco0l](https://avatars.discourse-cdn.com/v4/letter/m/c57346/32.png) [@mcco0l](https://discuss.elastic.co/u/mcco0l)
#### Post date: [March 2, 2021, 12:25pm UTC](https://discuss.elastic.co/t/dont-see-the-metrics-i-expect/265871/3 "2021-03-02T12:25:50Z")

</div>

Hi Marcin,  
so you mean I should install filebeat inside the containers running on ECS? I've installed firelens container with fluentbit as AWS recommends for log streaming to fluentd.

---

<div class="post-metadata">

### Author: ![mtojek](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/mtojek/32/63863_2.png) [@mtojek](https://discuss.elastic.co/u/mtojek)
#### Post date: [March 2, 2021, 2:09pm UTC](https://discuss.elastic.co/t/dont-see-the-metrics-i-expect/265871/4 "2021-03-02T14:09:59Z")

</div>

Could you please post configuration for filebeat? I don't see where did you configure the connection to Elasticsearch.

---

<div class="post-metadata">

### Author: ![mcco0l](https://avatars.discourse-cdn.com/v4/letter/m/c57346/32.png) [@mcco0l](https://discuss.elastic.co/u/mcco0l)
#### Post date: [March 2, 2021, 2:27pm UTC](https://discuss.elastic.co/t/dont-see-the-metrics-i-expect/265871/5 "2021-03-02T14:27:20Z")

</div>

not using filebeat but metricbeat to get the metrics from AWS Cloudwatch AWS/ContainerInsights namespace.  
Metricbeat configuration is pretty simple,

```auto
metricbeat.config.modules:

  path: ${path.config}/modules.d/*.yml

reload.enabled: yes

setup.template.settings:
  index.number_of_shards: 1
  index.codec: best_compression

setup.kibana:
output.elasticsearch:
  hosts: ["localhost:9200"]

processors:
  - add_host_metadata: ~
  - add_cloud_metadata: ~
  - add_docker_metadata: ~
  - add_kubernetes_metadata: ~
  - add_observer_metadata: ~

logging.level: debug
logging.to_files: true
logging.files:
  path: /var/log/metricbeat
  name: metricbeat
  keepfiles: 7
  permissions: 0644

```

---

<div class="post-metadata">

### Author: ![mtojek](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/mtojek/32/63863_2.png) [@mtojek](https://discuss.elastic.co/u/mtojek)
#### Post date: [March 2, 2021, 2:52pm UTC](https://discuss.elastic.co/t/dont-see-the-metrics-i-expect/265871/6 "2021-03-02T14:52:15Z")

</div>

Sorry misread the fact that you're using metricbeat. Actually this is the snippet I was looking for:

```auto
output.elasticsearch:
  hosts: ["localhost:9200"]

```

Could you please check if any data land in the ES cluster? As you said you can see outputted logs (process stdout?)

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [March 30, 2021, 4:52pm UTC](https://discuss.elastic.co/t/dont-see-the-metrics-i-expect/265871/7 "2021-03-30T16:52:44Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
