Although the subject sounds interesting (maybe for some) but I don't really have a clue what I'm doing! I've been trying to search for an answer but no luck so I'm seeing if someone can help or point me to something that makes sense!
I have a number of logstash config files (grok mutate etc) and they work perfectly fine when directly starting logstash with -c, additionally adding them to pipelines.yml works fine too and I can see them referenced in the logstash console.
Within my logstash config files I'm doing something like this (*not a real example just psudo code)
if [customtag] == "tagA" do something
and in a separate file the same thing but referencing a different servername
if [customtag] == "tagB" do something else...
Now if the tag is actually tagA I don't have any problems, however if it's not, it doesn't proceed onto the other config files to check if they match any of those defined there. Looking at the console, it looks like it drops the connection and restarts logstash (in some way) in a massive infinite loop, only if it doesn't work with the first defined config file.
My question is 2 part, firstly what's going on here and secondary how do I get Logstash to work either via:
a) Recurse all config files for the correct match, b) Somehow have a "check next config file" line without having to define all the config filea
c) anything else more sensible..
The custimtag field is added via filebeat depending on the directory the logs pickup from but seems to be a "I don't understand" problem rather than a technical fault.
Can anyone assist?