How to save 'sql_last_value' in between reading pages in jdbc-input plugin?

Elastic Stack Logstash
1

Hi,

I have enabled paging ("jdbc_paging_enabled" => true) in "JDBC-INPUT" plugin in a Logstash pipeline.
I would like to save 'sql_last_value' at the end of each page instead of the whole query.
Is there any way to do that?

I am running this plugin to read a database having over a hundred millions of records and it is most likely that the PC or Logstash service shuts down, e.g. because of electricity cut or etc, before the query has already finished, though many pages have been fetched and they are done.

Thanks in advance
Mojtaba

2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.