Status/progress API for filebeat

Hi, I am familiar with Configure an HTTP endpoint for metrics | Filebeat Reference [7.10] | Elastic but it is too low level for my use case.

I would like to be able to drop a bundle of files in a directory that is watched by filebeat and have it sent to Elasticsearch. It would be great if there's a way to query FileBeat to figure out stats regarding a particular file or harvester? That way I can determine when the file has finished being progressed.

Is there a way to do this via a local API or other mechanism? If that isn't possible, is there an easy and robust way that I would be able to find this out from Elasticsearch?

Thanks so much!

Filebeat has a new API that might be what you are looking for: /dataset. It's not yet documented on Configure an HTTP endpoint for metrics | Filebeat Reference [7.10] | Elastic.