Last_run_metadata_path not updating

Elastic Stack Logstash
1

First day with logstash (so excuse stupid posts)
(using version 6.2.3 on Windows server)

Importing from Mysql - facing 2 issues

  1. last_run_metadata_path not updating , remains 0 after every query (though the file timestamp is updated - the file is being updated every minute, only value is not)
  2. The number of records written in ES is 95 instead of 100 which are fetched.

below is the config

schedule => "* * * * *"

statement => "select * from tbl_activity_log where time > '2018-06-01' and time > :sql_last_value order by time asc limit 100"

	use_column_value => true
	tracking_column => "time"
	tracking_column_type => "numeric"
	clean_run => true 
	last_run_metadata_path => "d:\es\.logstash_jdbc_last_run"
}

}

output {
elasticsearch
{
hosts => "http://192.168.15.24:9200"
index => "th_ar_since_jun_2018"
document_id => "%{time}"
}
stdout {}
}

2

delete that and add new file,and make path
eg:last_run_metadata_path => "d:\es\new file"

3

I have deleted the file before every iteration.
No luck.

4

OK now created a new file for meta. Still value remains 0.

5

Solved.
tracking_column_type => "numeric"
Time filed should not be numeric!

6

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.