This is a follow-up to this question about understanding how the registry file works: How to understand "registry" file in filebeat
Since version 7, the registry file has changed to a sub-directory structure and I need to understand how the file is updated now, since the contents don't seem to be valid json anymore.
How is the file updated and how does it track the state of the harvesting? e.g. is the last line of the registry/filebeat.log.json file the most recent check?
We need this information to update the Datadog check for filebeat (https://docs.datadoghq.com/integrations/filebeat/) to handle this new format.