Any way to get ingest node stats/metrics/visibility?

Elastic Stack Elasticsearch
1

Hey there, I was just wondering if there is any way to get throughput/failure metrics to ingest pipelines. I don't know of any way to query this currently.
Stuff like:

  • How many documents has this pipeline ingested
  • How many failures has this pipeline seen
  • Time spent processing documents

Cheers,

2

See the nodes stats ingest part, which contain per-pipeline and total stats. https://www.elastic.co/guide/en/elasticsearch/reference/7.3/cluster-nodes-stats.html

3

I checked the node stats, but I suppose I'm just blind. Greatly appreciated!