I am using JDBC input plugin, i have 10,000 records in Database
I am setting jdbc_page_size as 500
It goes in loop 20, to get all the 10,000 records
for this, i schedule this as
schedule => */2 * * * *
With this schedule, every 2 min it will fetch 500 records from database
But once the 20 loop is completed, the LS is again going and bringing data from Database
so the pipeline is continuously bringing the data, how can we avoid to stop bringing duplicate data once 10,000 records are completed?