Tracking_column in JDBC input plugin

Elastic Stack Logstash
1

I just want to understand how it really works in deep.

In my case, I have a table where I have a datetime column last_modified_date.

I kept this as tracking column and I want to achieve:

  • If the row is getting updated in SQL, tracking column will also updated. In such case the document should also update in elasticsearch if exists with the same ID. It will not create a duplicate document if the same ID already exists in elasticsearch.

Correct me if I am wrong.

2

This is correct. Of course, your jdbc input and elasticsearch output need to be configured accordingly.

3

Thanks @magnusbaeck.... I have done this in right manner then. I am surprised to see few rows (5-6 out of 50000) are indexed as duplicate documents. I will recheck my jdbc configuration and documentIDs.

4

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.