Hi,
I am interested in how logstash handles scheduled jdbc inputs.
If I schedule the jdbc input plugin to read some data every 5 mins but the query itself takes around 10 mins to run depending on server load.
How will logstash react in this case ? will it try to run data every 5 mins or will it wait for the first schedule batch to complete and then start the next scheduled batch ?
I have not tested this myself, but reading the code and issues in Github indicates that because the next scheduled task's run time would be in the past - the scheduler runs that task immediately. Also note that the scheduler calculates the next tasks run time at the end of the previous task - this means that some times in the cron schedule might be skipped.
Look into using a Materialized View or similar.
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.