hello i am trying to load data from postgresql db to ES , below is my configuration on the INPUT
input {
jdbc {
# Postgres jdbc connection string to our database, mydb
jdbc_connection_string => "jdbc:postgresql://xxx:5432/svcpgst"
# The user we wish to execute our statement as
jdbc_user => "xxx"
jdbc_password=>"xxx"
# The path to our downloaded jdbc driver
jdbc_driver_library => "/root/software/postgresql-9.4.1208.jar"
# The name of the driver class for Postgresql
jdbc_driver_class => "org.postgresql.Driver"
jdbc_paging_enabled => "true"
jdbc_page_size => "10000"
schedule => "* * * * *"
# our query
statement => "SELECT t.id,t.global_transaction_id,t.service_name,t.status,t.date_time from table t where t.DATE_TIME > :sql_last_start"
}
}
when i try to run the logstash i see below error
Java::OrgPostgresqlUtil::PSQLException: ERROR: syntax error at or near ":"
Position: 170: SELECT count(*) AS "count" FROM (SELECT t.id,t.global_transaction_id,t.service_name,t.status,t.date_time from table t where t.DATE_TIME > :sql_last_start) AS "t1" LIMIT 1 {:level=>:error}
Exception when executing JDBC query {:exception=>#<Sequel::DatabaseError: Java::OrgPostgresqlUtil::PSQLException: ERROR: syntax error at or near ":"
Position: 170>, :level=>:warn}
i have refered Logstash and databse - #4 by talevy to use sql_last_start
so any input is very helpful here