Metricbeat AWS RDS Module for Aurora Serverless

Elastic Stack Beats
1

Hi,

Are there plans to scrape metrics for aurora serverless databases?

Best, Justin

2

Hi @justinw, sorry for the late response. Amazon Aurora sends monitoring metrics to Cloudwatch under AWS/RDS namespace based on https://docs.aws.amazon.com/AmazonRDS/latest/AuroraUserGuide/Aurora.Monitoring.html

That means you can use aws module cloudwatch metricset in Metricbeat to scrape these metrics:

- module: aws
  period: 300s
  metricsets:
    - cloudwatch
  credential_profile_name: <your profile name>
  metrics:
    - namespace: AWS/RDS
      tags.resource_type_filter: rds
      statistic: ["Average"]

You can specify the statistic method you'd prefer and tags.resource_type_filter enables tag collection.

Please let me know if this helps. Thanks!

3

Thanks @Kaiyan_Sheng for the response! That would work. Are there plans to integrate this into the RDS module for a higher period (better than 300s)? We'd like to create some alerts on these metrics too.

Best,
Justin

4

I see some of the cloudwatch metrics for Amazon Aurora get reported every 5 minutes and some of them are reported every minute. Is that why you are looking for higher period? If that's the case, probably it's easier to use cloudwatch metricset for now to control the different collection period. For example, you can specify periods with a list of metric names:

- module: aws
  period: 60s
  metricsets:
    - cloudwatch
  credential_profile_name: <your profile name>
  metrics:
    - namespace: AWS/RDS
      tags.resource_type_filter: rds
      statistic: ["Average"]
      names: ["WriteIOPS", "ReadIOPS"]
- module: aws
  period: 300s
  metricsets:
    - cloudwatch
  credential_profile_name: <your profile name>
  metrics:
    - namespace: AWS/RDS
      tags.resource_type_filter: rds
      statistic: ["Average"]
      names: ["VolumeWriteIOPs", "VolumeReadIOPs"]

For adding support in RDS metricset, it should be a fairly easy task. I can create a github issue to track it and we can start from there :smile: But with the nature of RDS metricset, it won't have the capability/flexibility cloudwatch metricset has to specify metric names to collect for different frequency.

5

I see. Thanks for the help! Let me know the ticket number so I can track there too :smile:

Best, Justin

6

Here it is: https://github.com/elastic/beats/issues/14142
Please feel free to add more info to the issue :+1:

7

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.