Update data from mysql to elasticsearch

Elastic Stack Logstash
1

There is any way to fetch only update data from mysql to elasticsearch. I am using sql_last_value...but it will fetch only new row which comes in mysql....

Any way if I did change any previous index row in mysql...logstash fetch it and while indexing update its' version from 1 to 2.

Thank you.

2

If there's a "last modified" column in the table you can use that to determine which rows need to be updated in ES, but apart from fetching all rows all the time there's nothing much you can do.

3

So Sir, there is no currently method to update bulk of rows ...who are already index ....

Thanks in advance

4

Logstash has no problem doing bulk updates but it needs help finding which rows from the database have changed since the last run.

5

Ok Sir. Thank you.

6

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.