There was no error in the debug log, and there was no events pulled from AWS (in metricbeat-* index there was no message).
Please help, thanks in advance!
Here is the config:
# Module: aws
# Docs: https://www.elastic.co/guide/en/beats/metricbeat/7.3/metricbeat-module-aws.html
- module: aws
period: 300s
metricsets:
- ec2
access_key_id: 'XXXXXXXXXXXXXXXXXXXXXXXX'
secret_access_key: 'XXXXXXXXXXXXXXXXXXXXXXXX'
default_region: 'us-west-2'
- module: aws
period: 300s
metricsets:
- sqs
access_key_id: 'XXXXXXXXXXXXXXXXXXXXXXXX'
secret_access_key: 'XXXXXXXXXXXXXXXXXXXXXXXX'
default_region: 'us-west-2'
#regions:
# - us-west-1
- module: aws
period: 86400s
metricsets:
- s3_request
- s3_daily_storage
access_key_id: 'XXXXXXXXXXXXXXXXXXXXXXXX'
secret_access_key: 'XXXXXXXXXXXXXXXXXXXXXXXX'
default_region: 'us-west-2'
#regions:
# - us-west-1
Here is the debug log:
[root@elk ~]# metricbeat -e -d "*"
2019-09-01T06:36:51.932-0400 INFO instance/beat.go:606 Home path: [/usr/share/metricbeat] Config path: [/etc/metricbeat] Data path: [/var/lib/metricbeat] Logs path: [/var/log/metricbeat]
2019-09-01T06:36:51.932-0400 DEBUG [beat] instance/beat.go:658 Beat metadata path: /var/lib/metricbeat/meta.json
2019-09-01T06:36:51.932-0400 INFO instance/beat.go:614 Beat ID: cb4997de-b548-4ea4-9a48-9ab8fbb9dabe
2019-09-01T06:36:51.935-0400 DEBUG [filters] add_cloud_metadata/add_cloud_metadata.go:164 add_cloud_metadata: starting to fetch metadata, timeout=3s
2019-09-01T06:36:51.948-0400 DEBUG [filters] add_cloud_metadata/add_cloud_metadata.go:196 add_cloud_metadata: received disposition for gcp after 12.560124ms. result=[provider:gcp, error=failed requesting gcp metadata: Get http://169.254.169.254/computeMetadata/v1/?recursive=true&alt=json: dial tcp 169.254.169.254:80: connect: connection refused, metadata={}]
2019-09-01T06:36:51.948-0400 DEBUG [filters] add_cloud_metadata/add_cloud_metadata.go:196 add_cloud_metadata: received disposition for openstack after 12.731171ms. result=[provider:openstack, error=failed requesting openstack metadata: Get http://169.254.169.254/2009-04-04/meta-data/instance-id: dial tcp 169.254.169.254:80: connect: connection refused, metadata={}]
2019-09-01T06:36:51.948-0400 DEBUG [filters] add_cloud_metadata/add_cloud_metadata.go:196 add_cloud_metadata: received disposition for aws after 12.812023ms. result=[provider:aws, error=failed requesting aws metadata: Get http://169.254.169.254/2014-02-25/dynamic/instance-identity/document: dial tcp 169.254.169.254:80: connect: connection refused, metadata={}]
2019-09-01T06:36:51.948-0400 DEBUG [filters] add_cloud_metadata/add_cloud_metadata.go:196 add_cloud_metadata: received disposition for digitalocean after 12.964448ms. result=[provider:digitalocean, error=failed requesting digitalocean metadata: Get http://169.254.169.254/metadata/v1.json: dial tcp 169.254.169.254:80: connect: connection refused, metadata={}]
2019-09-01T06:36:51.950-0400 DEBUG [filters] add_cloud_metadata/add_cloud_metadata.go:196 add_cloud_metadata: received disposition for az after 14.051429ms. result=[provider:az, error=failed requesting az metadata: Get http://169.254.169.254/metadata/instance/compute?api-version=2017-04-02: dial tcp 169.254.169.254:80: connect: connection refused, metadata={}]
2019-09-01T06:36:52.558-0400 DEBUG [filters] add_cloud_metadata/add_cloud_metadata.go:196 add_cloud_metadata: received disposition for qcloud after 622.875441ms. result=[provider:qcloud, error=failed requesting qcloud metadata: Get http://metadata.tencentyun.com/meta-data/instance-id: dial tcp: lookup metadata.tencentyun.com on 192.168.245.2:53: no such host, metadata={}]
2019-09-01T06:36:54.937-0400 DEBUG [filters] add_cloud_metadata/add_cloud_metadata.go:196 add_cloud_metadata: received disposition for ecs after 3.001561093s. result=[provider:ecs, error=failed requesting ecs metadata: Get http://100.100.100.200/latest/meta-data/region-id: net/http: request canceled (Client.Timeout exceeded while awaiting headers), metadata={}]
2019-09-01T06:36:54.937-0400 DEBUG [filters] add_cloud_metadata/add_cloud_metadata.go:167 add_cloud_metadata: fetchMetadata ran for 3.001629667s
2019-09-01T06:36:54.937-0400 INFO add_cloud_metadata/add_cloud_metadata.go:347 add_cloud_metadata: hosting provider type not detected.
2019-09-01T06:36:54.937-0400 DEBUG [processors] processors/processor.go:93 Generated new processors: add_host_metadata=[netinfo.enabled=[false], cache.ttl=[5m0s]], add_cloud_metadata=null
2019-09-01T06:36:54.937-0400 INFO [seccomp] seccomp/seccomp.go:101 Syscall filter could not be installed because the kernel does not support seccomp
