I am seeing delay in getting the data from postgresql, here is the configuration i have
input {
jdbc {
# Postgres jdbc connection string to our database, mydb
jdbc_connection_string => "jdbc:postgresql://<>:5432/svcpgst"
# The user we wish to execute our statement as
jdbc_user => "user"
jdbc_password=>"user"
# The path to our downloaded jdbc driver
jdbc_driver_library => "/root/software/postgresql-9.4.1208.jar"
# The name of the driver class for Postgresql
jdbc_driver_class => "org.postgresql.Driver"
#sql_log_level => "debug"
jdbc_paging_enabled => "true"
jdbc_page_size => "5000"
schedule => "* * * * *"
# our query
clean_run => true
last_run_metadata_path => "/apps/logstash/.actmon_metadata"
use_column_value => true
tracking_column => id
statement => "SELECT id,global_transaction_id,service_name,status,date_time from transaction_monitor where id > :sql_last_value"
}
}
the scheduler is schedule => "* * * * *"
, The records are getting generated in PostgreSQL DB but they are showing up after 30/45 minutes in ES, anything wrong with the above config, also how we can check what queries are getting executed at any interval,