I am suing elasticsearch 1.7 with logstash 1.3 and trying to use Logstash to add new data added from an oracle database to a elasticsearch index. For this we are using the jdbc plugin but the refresh job doesnt seem to work.
I am defining the following in my config file:
schedule => "5 * * * *"
last_run_metadata_path => "/opt/logstash/bin/TIME/custom_table.logstash_jdbc_last_run"
and the following in my sql to get the new data:
select & from custom_table WHERE TO_TIMESTAMP(TO_CHAR(TO_TIMESTAMP_TZ(LAST_UPDATE_DATE_TIME,'DD-MONTH-YY HH:MI:SS.FF AM')AT TIME ZONE 'UTC', 'YYYY-MM-DD HH24:MI:SSXFF'), 'YYYY-MM-DD HH24:MI:SSXFF') > :sql_last_start