Metricbeat AWS Cloudwatch & AWS ELB

[Anton91]

Hello, everybody,
unfortunately I do not get any data on AWS Cloudwatch & AWS ELB with Metricbeat. With AWS Cloudwatch I only get the data for EC2 and S3.
All other modules work ec2,sqs,rds,ebs
The following settings are stored:

- module: aws
  period: 300s
  metrics sets:
   - cloudwatch
  metrics:
   - namespace: "*"
  credential_profile_name: default
- module: aws
  period: 60s
  metrics sets:
    - elb
credential_profile_name: default

Cloudwatch is running and also metrics from ELB are displayed.

The message I get:

 INFO    [monitoring]    log/log.go:145  Non-zero metrics in the last 30s        {"monitoring": {"metrics": {"beat":{"cpu":{"system":{"ticks":31},"total":{"ticks":265,"value":265},"user":{"ticks":234}},"handles":{"open":387},"info":{"ephemeral_id":"9744af87-3654-4685-a458-59f671a71409","uptime":{"ms":156252}},"memstats":{"gc_next":13588272,"memory_alloc":6796136,"memory_total":22810928,"rss":12288},"runtime":{"goroutines":25}},"libbeat":{"config":{"module":{"running":0}},"pipeline":{"clients":1,"events":{"active":0}}}}}} 

Does anyone have an idea?

[ChrsMark (Chris Mark)]

Hi!

Is your configuration correct? I see indentation issues as well as metrics sets which is wrong.

Reference: https://www.elastic.co/guide/en/beats/metricbeat/current/metricbeat-metricset-aws-elb.html#_configuration_example_4

C.

[Anton91]

Hi, Chris,

thank you for the answer.

The indentation error occurred to me only here.

What exactly do you recognize as an error? That I didn't leave any credentials? Otherwise my config looks exactly like the example.

I am now running metricbeat on an ec2 instance. This has full access to everything in the account.

# Module: aws
# Docs: https://www.elastic.co/guide/en/beats/metricbeat/7.5/metricbeat-module-aws.html

#- module: aws
#  period: 300s
#  metricsets:
#    - ec2
#  regions:
#    - us-east-1
#- module: aws
#  period: 300s
#  metricsets:
#    - cloudwatch
#  metrics:
#    - namespace: AWS/EC2
#      name: ["CPUUtilization", "DiskWriteOps"]
#      tags.resource_type_filter: ec2:instance
#      #dimensions:
      #  - name: InstanceId
      #    value: i-0686946e22cf9494a
 #     statistic: ["Average", "Maximum"]

#- module: aws
#  period: 60s
# metricsets:
#    - rds
#  credential_profile_name: default
- module: aws
  period: 60s
  metricsets:
    - ec2
#  credential_profile_name: default
- module: aws
  period: 60s
  metricsets:
    - sqs
#  credential_profile_name: default
- module: aws
  period: 86400s
  metricsets:
    - s3_daily_storage
#  credential_profile_name: default
- module: aws
  period: 86400s
  metricsets:
    - s3_request
#  credential_profile_name: default
- module: aws
  period: 300s
  metricsets:
    - ebs
#  credential_profile_name: default
- module: aws
  period: 300s
  metricsets:
   - cloudwatch
  metrics:
   - namespace: "*"
  credential_profile_name: default
- module: aws
  period: 60s
  metricsets:
    - elb
#  credential_profile_name: default

The whole config works except ELB and Cloudwatch partially.

For example I don't find any fields like:

aws.cloudwatch.dimensions.LoadBalancerName

aws.cloudwatch.dimensions.FunctionName

[kmroz (Kenneth Mroz)]

Running into this as well. After digging into it, seems the visualizations fields are not set. They are empty when i tried to edit them.