I have enabled paging ("jdbc_paging_enabled" => true) in "JDBC-INPUT" plugin in a Logstash pipeline.
I would like to save 'sql_last_value' at the end of each page instead of the whole query.
Is there any way to do that?
I am running this plugin to read a database having over a hundred millions of records and it is most likely that the PC or Logstash service shuts down, e.g. because of electricity cut or etc, before the query has already finished, though many pages have been fetched and they are done.
Thanks in advance