Good Afternoon All,
I have filebeat set up to harvest files in the log directory of an application and the application developers just changed the logging format to include sub-directories containing client specific information.
I modified my prospector paths to be \machine-name\drive$\company\application\log** and I did this for each machine in the application cluster.
Under the log directory than can be any number of sub-directories for example:
New sub-directories are created every time a new partition is created for a client and within each sub-directory client specific logging information is contained.
The problem I'm running into is that all of the log files in the log root directory are being harvested just fine but none of the files in any of the sub-directories are being harvested.
Setting filebeat logging level to 'debug' I can see that the prospector is seeing all of the sub-directories but it is skipping them even when there are log files present so my question is what am I doing wrong? Do I have my prospector paths declared wrong?