AWS Billing Dashboard using metricbeat

[Divyank_Mahalle]

Hi,
I am trying to create AWS Billing Dashboard in Kibana using metricbeat.

In metricbeat.yml, I want to load the dashboard in Space Name "Divyank" and not in default space. How to get space id for "Divyank" space. also, Hostname is showing incorrect how to get the correct one.

If I just want to injest Aws data in metricbeat-* index and don't want dashboard then can I comment "host" and "space" field.I am using cloud id Authentication in the metricbeat.yml file.
same in this vid.

https://www.youtube.com/watch?v=JO-1PhA7XuU

# =================================== Kibana ===================================

# Starting with Beats version 6.0.0, the dashboards are loaded via the Kibana API.
# This requires a Kibana endpoint configuration.
setup.kibana:
 username: "<U>"
 password: "<P>"

  # Kibana Host
  # Scheme and port can be left out and will be set to the default (http and 5601)
  # In case you specify and additional path, the scheme is required: http://localhost:5601/path
  # IPv6 addresses should always be defined as: https://[2001:db8::1]:5601
  host: "https://[<hostname>]:1234"

  # Kibana Space ID
  # ID of the Kibana Space into which the dashboards should be loaded. By default,
  # the Default Space will be used.
   space.id: <space id>

[afgomez (Alejandro Fernández Gómez)]

Hi @Divyank_Mahalle,

You can get both the host and the space.id from the URL you use to access your kibana. When you enter kibana, the URL should look something like this

https://localhost:5601/s/default/app/home#/
        ^^^^^^^^^^^^^^   ^^^^^^^
             Host        space.id

Let me know if it's clear.

[Divyank_Mahalle]

Got it.

Thanks!!!

One Query-

If I just want to injest Aws data in metricbeat-* index and don't want dashboard then can I comment "host" and "space" field.I am using cloud id Authentication in the metricbeat.yml file?

sudo vi /etc/metricbeat/modules.d/aws.yml-

Is this correct config?I don't add AWS token to it or anything else to add?

# Module: aws
# Docs: https://www.elastic.co/guide/en/beats/metricbeat/7.8/metricbeat-module-aws.html
metricbeat.modules:
- module: aws
  period: 24h
  metricsets:
    - billing
  access_key_id: '${AWS_ACCESS_KEY_ID:"<AWS KEY ID>"}'
  secret_access_key: '${AWS_SECRET_ACCESS_KEY:"<AWS_KEY>"}'

[Divyank_Mahalle]

Hi,

I need only billing data in metricbeat* index or only billing dashboard.
I found that data is coming from system.yml file as it is enabled. After disabling system,yml no data flowing into metricbeat index.

Is my aws.yml conf valid? I am not seeing any data in Billing dashboard.
My AWS.yml configuration-

# Module: aws
# Docs: https://www.elastic.co/guide/en/beats/metricbeat/7.8/metricbeat-module-aws.html
metricbeat.modules:
- module: aws
  period: 1h
  metricsets:
    - billing
  access_key_id: '${AWS_ACCESS_KEY_ID:"<AWS KEY ID>"}'
  secret_access_key: '${AWS_SECRET_ACCESS_KEY:"<AWS_KEY>"}'

IAM Policy Applied

cloudwatch:GetMetricData
cloudwatch:ListMetrics
tag:getResources
sts:GetCallerIdentity
iam:ListAccountAliases
ce:GetCostAndUsage

I am getting 100 dashboards uploaded in kibana and 3.5k fields in metricbeat* index.
I am not getting where I am doing wrong.Any suggestion will be highy appreciable.