# Metricbeat AWS RDS Module not retrieving db\_instance.identifiers

**URL:** <https://discuss.elastic.co/t/metricbeat-aws-rds-module-not-retrieving-db-instance-identifiers/258174>\
**Category:** Beats\
**Tags:** metricbeat\
**Created:** [December 9, 2020, 6:47pm UTC](https://discuss.elastic.co/t/metricbeat-aws-rds-module-not-retrieving-db-instance-identifiers/258174 "2020-12-09T18:47:34Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![achalamalasetti](https://avatars.discourse-cdn.com/v4/letter/a/73ab20/32.png) [@achalamalasetti](https://discuss.elastic.co/u/achalamalasetti)\
**Post date:** [December 9, 2020, 6:47pm UTC](https://discuss.elastic.co/t/metricbeat-aws-rds-module-not-retrieving-db-instance-identifiers/258174/1 "2020-12-09T18:47:34Z")

</div>

we are using metricbeat (7.10.0) -\> AWS module, RDS metrics. The metric data that is pulled looks incomplete. it doesn't retrieve aws.rds.db\_instance.engine\_name for some and for some it doesn't retrieve aws.rds.db\_instance.identifier, or aws.rds.db\_instance.identifier, or aws.rds.db\_instance.class (see sample screenshot below). What am I missing here?

```auto
text- module: aws
  period: 1m
  metricsets:
    - rds
  regions:
    - us-west-2

```

 ![tempsnip](https://us1.discourse-cdn.com/elastic/original/3X/b/0/b0b76b21c77a25a626635974bc254c4e7937e881.png)

---

<div class="post-metadata">

**Author:** ![achalamalasetti](https://avatars.discourse-cdn.com/v4/letter/a/73ab20/32.png) [@achalamalasetti](https://discuss.elastic.co/u/achalamalasetti)\
**Post date:** [December 10, 2020, 8:54pm UTC](https://discuss.elastic.co/t/metricbeat-aws-rds-module-not-retrieving-db-instance-identifiers/258174/2 "2020-12-10T20:54:30Z")

</div>

Debugging for another day with out replies, looks like I am able narrow down that problem to not having the permission - rds:ListTagsForResource.

[https://github.com/elastic/beats/blob/master/x-pack/metricbeat/module/aws/rds/rds.go](https://github.com/elastic/beats/blob/master/x-pack/metricbeat/module/aws/rds/rds.go) Line : 192-198, It was an most likely an error in our case, though the return statement doesn't make sense. If its a warning, throw a warning, continue and if its an error, throw any error. Returning partially constructed data is incorrect, most likely resulting in the weird behavior i noticed.

```auto
reqListTags := svc.ListTagsForResourceRequest(&listTagsInput)
		outputListTags, err := reqListTags.Send(context.TODO())
		if err != nil {
			m.Logger().Warn("ListTagsForResourceRequest failed, rds:ListTagsForResource permission is required for getting tags.")
			dbDetailsMap[*dbInstance.DBInstanceIdentifier] = dbDetails
			return dbInstanceIDs, dbDetailsMap, nil
		}

```

Another unrelated bug, same class, Line 180-182, looks like an error.

```auto
if dbInstance.DBInstanceClass != nil {
			dbDetails.dbStatus = *dbInstance.DBInstanceStatus
		}

```

The `aws.rds.db_instance.engine_name` is another mystery still unsolved.

---

<div class="post-metadata">

**Author:** ![Kaiyan\_Sheng](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kaiyan_sheng/32/38247_2.png) [@Kaiyan\_Sheng](https://discuss.elastic.co/u/Kaiyan_Sheng)\
**Post date:** [December 16, 2020, 1:51am UTC](https://discuss.elastic.co/t/metricbeat-aws-rds-module-not-retrieving-db-instance-identifiers/258174/3 "2020-12-16T01:51:12Z")

</div>

Hello! Thanks for reporting this problem. We consider these fields optional, that's why we logged a warning in the log and still published the metrics. For `engine_name`, this is actually a dimension from the original RDS CloudWatch metrics. Some of the CloudWatch metrics have EngineName as dimension, some have other fields as dimension. For example: DBInstanceIdentifier, DBClusterIdentifier and etc. Please see the section `Amazon RDS Dimensions` in [https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/MonitoringOverview.html#USER\_Monitoring](https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/MonitoringOverview.html#USER_Monitoring) for more details. Thanks!

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [January 13, 2021, 1:51am UTC](https://discuss.elastic.co/t/metricbeat-aws-rds-module-not-retrieving-db-instance-identifiers/258174/4 "2021-01-13T01:51:31Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
