Metricbeat - error... ERROR timeout waiting for event

Elastic Stack Beats
1

I am attempting to ingest AWS data using metricbeat aws module. I am not getting configuration errors, but I am however getting timeout errors when running metricbeat test modules command.
aws...
cloudwatch...
error... ERROR timeout waiting for an event
aws...
cloudwatch...
error... ERROR timeout waiting for an event

I looked in the logs and cannot seem to find any logs to help me troubleshoot this problem. I verified IAM permissions based on documentation as well.

Here is my current aws.yml configuration file:

Module: aws

Docs: https://www.elastic.co/guide/en/beats/metricbeat/main/metricbeat-module-aws.html

  • module: aws
    period: 300s
    access_key_id: '${AWS_ACCESS_KEY_ID:""}'
    secret_access_key: '${AWS_SECRET_ACCESS_KEY:""}'
    role_arn: '${AWS_Role_Elastic_Prod:""}'
    #role_arn: '${AWS_Role_Elastic_QB:""}'
    role_arn: '${AWS_Role_Elastic_Dev:""}'
    #role_arn: '${AWS_Role_Elastic_Demo:""}'
    #endpoint: amazonaws.com
    #region: us-east-1
    metricsets:
    • elb
      metrics:
    • name:
      • ActiveConnectionCount
      • HTTP_Fixed_Response_Count
      • HTTPCode_ELB_3XX_Count
      • HTTPCode_Backend_3XX
      • HTTPCode_Backend_4XX
      • HTTPCode_Backend_5XX
      • HTTPCode_ELB_4XX
      • HTTPCode_ELB_5XX
      • RequestCount
      • SpilloverCount
        statistic:
      • Sum
        namespace: AWS/ELB
        resource_type: elasticloadbalancing
    • name:
      • HealthyHostCount
      • SurgeQueueLength
      • UnHealthyHostCount
        statistic:
      • Maximum
        namespace: AWS/ELB
        resource_type: elasticloadbalancing
    • name:
      • Latency
      • EstimatedALBActiveConnectionCount
      • EstimatedALBConsumedLCUs
      • EstimatedALBNewConnectionCount
      • EstimatedProcessedBytes
        statistic:
      • Average
        namespace: AWS/ELB
        resource_type: elasticloadbalancing
    • name:
      • Latency
      • EstimatedALBActiveConnectionCount
      • EstimatedALBConsumedLCUs
      • EstimatedALBNewConnectionCount
      • EstimatedProcessedBytes
        statistic:
      • Average
        namespace: AWS/ELB
        resource_type: elasticloadbalancing
    • name:
      • ActiveConnectionCount
      • ClientTLSNegotiationErrorCount
      • HTTP_Fixed_Response_Count
      • HTTP_Redirect_Count
      • HTTP_Redirect_Url_Limit_Exceeded_Count
      • HTTPCode_ELB_3XX_Count
      • HTTPCode_ELB_4XX_Count
      • HTTPCode_ELB_5XX_Count
      • HTTPCode_ELB_500_Count
      • HTTPCode_ELB_502_Count
      • HTTPCode_ELB_503_Count
      • HTTPCode_ELB_504_Count
      • IPv6ProcessedBytes
      • IPv6RequestCount
      • NewConnectionCount
      • ProcessedBytes
      • RejectedConnectionCount
      • RequestCount
      • RuleEvaluations
        statistic:
      • Sum
        namespace: AWS/ELB
        resource_type: elasticloadbalancing
    • name:
      • ConsumedLCUs
        statistic:
      • Average
        namespace: AWS/ELB
        resource_type: elasticloadbalancing
    • name:
      • HealthyHostCount
      • UnHealthyHostCount
        statistic:
      • Maximum
        namespace: AWS/ApplicationELB
        resource_type: elasticloadbalancing
    • name:
      • ActiveFlowCount
      • ActiveFlowCount_TCP
      • ActiveFlowCount_TLS
      • ActiveFlowCount_UDP
      • ConsumedLCUs
      • ConsumedLCUs_TCP
      • ConsumedLCUs_TLS
      • ConsumedLCUs_UDP
        statistic:
      • Average
        namespace: AWS/NetworkELB
        resource_type: elasticloadbalancing
    • name:
      • ClientTLSNegotiationErrorCount
      • NewFlowCount
      • NewFlowCount_TLS
      • NewFlowCount_TCP
      • NewFlowCount_UDP
      • ProcessedBytes
      • ProcessedBytes_TCP
      • ProcessedBytes_TLS
      • ProcessedBytes_UDP
      • TargetTLSNegotiationErrorCount
      • TCP_Client_Reset_Count
      • TCP_ELB_Reset_Count
      • TCP_Target_Reset_Count
        statistic:
      • Sum
        namespace: AWS/NetworkELB
        resource_type: elasticloadbalancing
    • name:
      • HealthyHostCount
      • UnHealthyHostCount
        statistic:
      • Maximum
        namespace: AWS/NetworkELB
        resource_type: elasticloadbalancing
        metrics:
    • name:
      • AllRequests
      • GetRequests
      • PutRequests
      • DeleteRequests
      • HeadRequests
      • PostRequests
      • SelectRequests
      • SelectScannedBytes
      • SelectReturnedBytes
      • ListRequests
      • BytesDownloaded
      • BytesUploaded
      • 4xxErrors
      • 5xxErrors
      • FirstByteLatency
      • TotalRequestLatency
        statistic:
      • Average
        namespace: AWS/NetworkELB
        resource_type: elasticloadbalancing
    • namespace: AWS/S3
    • namespace: AWS/NATGATEWAY
    • namespace: AWS/RDS
    • namespace: AWS/USAGE
  • module: aws
    period: 300s
    access_key_id: '${AWS_ACCESS_KEY_ID:""}'
    secret_access_key: '${AWS_SECRET_ACCESS_KEY:""}'
    role_arn: '${AWS_Role_Elastic_Prod:""}'
    role_arn: '${AWS_Role_Elastic_QB:""}'
    role_arn: '${AWS_Role_Elastic_Dev:""}'
    #role_arn: '${AWS_Role_Elastic_Demo:""}'
    #endpoint: amazonaws.com
    #region: us-east-1
    metricsets:
    • ec2
      metrics:
    • name:
      • CPUUtilization
      • CPUCreditUsage
      • CPUCreditBalance
      • CPUSurplusCreditBalance
      • CPUSurplusCreditsCharged
      • StatusCheckFailed
      • StatusCheckFailed_Instance
      • StatusCheckFailed_System
        statistic: ["Average"]
        namespace: AWS/EC2
        resource_type: ec2:instance
    • name:
      • DiskReadBytes
      • DiskReadOps
      • DiskWriteBytes
      • DiskWriteOps
      • NetworkIn
      • NetworkPacketsIn
      • NetworkOut
      • NetworkPacketsOut
        statistic:
      • Sum
        namespace: AWS/EC2
        resource_type: ec2:instance
  • module: aws
    period: 24h
    access_key_id: '${AWS_ACCESS_KEY_ID:""}'
    secret_access_key: '${AWS_SECRET_ACCESS_KEY:""}'
    role_arn: '${AWS_Role_Elastic_Prod:""}'
    role_arn: '${AWS_Role_Elastic_QB:""}'
    role_arn: '${AWS_Role_Elastic_Dev:""}'
    #role_arn: '${AWS_Role_Elastic_Demo:""}'
    #endpoint: amazonaws.com
    #region: us-east-1
    metricsets:
    • billing
      cost_explorer_config:
      group_by_dimension_keys:
      • "AZ"
      • "INSTANCE_TYPE"
      • "SERVICE"
      • "LINKED_ACCOUNT"
        group_by_tag_keys:
      • "aws:createdBy"
  • module: aws
    access_key_id: '${AWS_ACCESS_KEY_ID:""}'
    secret_access_key: '${AWS_SECRET_ACCESS_KEY:""}'
    role_arn: '${AWS_Role_Elastic_Prod:""}'
    role_arn: '${AWS_Role_Elastic_QB:""}'
    role_arn: '${AWS_Role_Elastic_Dev:""}'
    #role_arn: '${AWS_Role_Elastic_Demo:""}'
    #endpoint: amazonaws.com
    #region: us-east-1
    period: 24h
    metricsets:
    • s3_daily_storage
      namespace: AWS/S3
  • module: aws
    access_key_id: '${AWS_ACCESS_KEY_ID:""}'
    secret_access_key: '${AWS_SECRET_ACCESS_KEY:""}'
    role_arn: '${AWS_Role_Elastic_Prod:""}'
    role_arn: '${AWS_Role_Elastic_QB:""}'
    role_arn: '${AWS_Role_Elastic_Dev:""}'
    #role_arn: '${AWS_Role_Elastic_Demo:""}'

    endpoint: amazonaws.com

region: us-east-1

period: 1m
latency: 300s
metricsets:
- s3_request
namespace: AWS/S3

2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.