I'm trying to get logs from short-living pods such as jobs and cronJobs.
For example I have cronJob that starts every minute and produces three lines of output in json format, but the fact is that not all the runs of this cronJob are spotted by filebeat daemonset and the picture I see in kibana is looking like this http://prntscr.com/snfzws
So my questions are, how does k8s autodiscover actually work? Does it pull pod lists from k8s api periodically? What the interval of theese pulls? Does it read logs only for running containers or also for the "completed" ones? How can I make it work the way I need?