I am using jdbc plugin and schedule for fetching data from database. Currently cron is running fine for schedule => "* * * * *".
My requirement is cron ingestion should start at given time (10 pm) and end at given time (12pm) rather than stopping after ingestion is completed.
Need help in syntax and time format.
Thanks for the quick reply.
My use case is such i want to fetch the logs on per day basis. So it doesnt matter how many times it runs in the given time frame. If the data is missed out it would be fetched on the next day.
So basically i want it to run for the entire time frame so can run either every minute or every 5 minutes.
How would the syntax be for it ?
It will run until the process is over and start again at the top of the next hour. The schedule looks like below.
10:00PM - Until all records are ingested. No idea how long that takes with your data.
11:00PM - Until all records are ingested.
12:00PM - Until all records are ingested.
So it would run 3 times a night which sounds like that is plenty for your use case.
Thanks @aaron-nimocks
I guess 3 cycles as you suggested will do the job. Just that had to show some range with stopping point to the management for approval of further testing.
I guess i can use this with a stopping point. 0 21-23 * * *
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.