OTEL - Prometheus receiver and missing metrics

Elastic Observability
10

Just to follow up as I addressed this with the developer of the exporter

Using otel-colector-contrib:0.122.0 or otel-colector-contrib:0.124.0 I'm now seeing no errors about duplicate metrics. Our hosted Elastic cluster is running 8.16.6
Ultimately we needed to add a component template using

PUT _component_template/metrics-otel@custom 
{
  "template": { 
    "mappings": {
      "properties": {
        "_metric_names_hash": { 
          "type": "keyword",
          "time_series_dimension": true 
        } 
      } 
    }
  }
}

Then roll over the data stream to use a new index (docs don't get routed into the new index for 30m) with

POST metrics-prometheusreceiver.otel-default/_rollover

Although the _metric_names_hash is indexed dynamically, i think it'll be missing the time_series_dimension: true on that field.
Also, i think you've helped us discover a bug in releasing this _metric_names_hash workaround.

1 Like