We have multiple applications running on a single server and we are collecting the logs from these application and sending it to a intermediate queues using logstash forwarders.
As, the log formats, processing and the output queues were different for different applications logs, I prepared multiple config files which are complete in themselves i.e. each config file has the input, filter and output section.
what is the best way to start all the configs,
- logstash -f /configDirPath is giving jumbling up the logs, i.e. it is sending log of one type to the queue of another.
- logstash -f /configDirPath/* is only starting the first file in the directory.
Is the only option in this case is to start multiple daemon threads as that is the only option working.
or am i missing something.
Again, each config file is complete in itself i.e. with input, filter and output section and the processing logic in all these config is also different so am not able to combine them as that is just making the config file not readable.