Last_run_metadata_path not updating


(Sunil Khullar) #1

First day with logstash (so excuse stupid posts)
(using version 6.2.3 on Windows server)

Importing from Mysql - facing 2 issues

  1. last_run_metadata_path not updating , remains 0 after every query (though the file timestamp is updated - the file is being updated every minute, only value is not)
  2. The number of records written in ES is 95 instead of 100 which are fetched.

below is the config


schedule => "* * * * *"

statement => "select * from tbl_activity_log where time > '2018-06-01' and time > :sql_last_value order by time asc limit 100"

	use_column_value => true
	tracking_column => "time"
	tracking_column_type => "numeric"
	clean_run => true 
	last_run_metadata_path => "d:\es\.logstash_jdbc_last_run"
}

}

output {
elasticsearch
{
hosts => "http://192.168.15.24:9200"
index => "th_ar_since_jun_2018"
document_id => "%{time}"
}
stdout {}
}


(Gokul Kathirvel) #2

delete that and add new file,and make path
eg:last_run_metadata_path => "d:\es\new file"


(Sunil Khullar) #3

I have deleted the file before every iteration.
No luck.


(Sunil Khullar) #4

OK now created a new file for meta. Still value remains 0.


(Sunil Khullar) #5

Solved.
tracking_column_type => "numeric"
Time filed should not be numeric!


(system) #6

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.