I'm currently drawing logs from around 30 Docker containers with a single input and it works perfectly. However, I have recently discovered that one of these containers exports XML which will need a separate configuration that utilises multi line message patterns (which I have already tested and got working). My issue now is getting two inputs to work alongside each other independently. I've recently found autodiscovery which lets me point a unique config at a single container which is great, but I ran into an error where Filebeat is trying to read the same containers more than once. So my main task is getting the rest of the config to work on the remaining 29 containers, but also getting it to ignore the XML container.
I also entertained the idea of possibly using autodiscover with a normal Filebeat input, but I again ran into the issue of getting the rest of the config to ignore the XML container as the container ID's are constantly changing so I cannot enter a specific path. Any help would be much appreciated.
If you are going to have more different configurations, you may consider using hints-based autodiscover, that allows you to define a default configuration that can be overriden per pod or per container using annotations.