# How to run Incremental update(addition of new rows) + updation of existing rows simultaneously, when running SQL query through logstash jdbc plug in

**URL:** <https://discuss.elastic.co/t/how-to-run-incremental-update-addition-of-new-rows-updation-of-existing-rows-simultaneously-when-running-sql-query-through-logstash-jdbc-plug-in/168985>\
**Category:** Logstash\
**Created:** [February 19, 2019, 9:53am UTC](https://discuss.elastic.co/t/how-to-run-incremental-update-addition-of-new-rows-updation-of-existing-rows-simultaneously-when-running-sql-query-through-logstash-jdbc-plug-in/168985 "2019-02-19T09:53:42Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![ApekshaB](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/apekshab/32/63273_2.png) [@ApekshaB](https://discuss.elastic.co/u/ApekshaB)\
**Post date:** [February 19, 2019, 9:53am UTC](https://discuss.elastic.co/t/how-to-run-incremental-update-addition-of-new-rows-updation-of-existing-rows-simultaneously-when-running-sql-query-through-logstash-jdbc-plug-in/168985/1 "2019-02-19T09:53:42Z")

</div>

Dear Team,

I have a table in oracle DB, which consists of 4 columns, say-- 'Serial\_no', 'Transaction\_Amt', 'User\_Name', 'modification\_timestamp'.

Now i run sql select query in logstash conf file(using jdbc connection) and save last serial\_no in 'sql\_last\_value', and save it in 'last\_run\_metadata\_path', with which i see no issues.

Now I add new rows to my table, along with which i update existing row information also. How do i use 'Serial\_no' along with 'modification\_timestamp' column to retrieve only newly inserted rows and old rows which have an updated data in them.

Regards,  
Apeksha

---

<div class="post-metadata">

**Author:** ![danhermann](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/danhermann/32/33024_2.png) [@danhermann](https://discuss.elastic.co/u/danhermann)\
**Post date:** [February 20, 2019, 9:27pm UTC](https://discuss.elastic.co/t/how-to-run-incremental-update-addition-of-new-rows-updation-of-existing-rows-simultaneously-when-running-sql-query-through-logstash-jdbc-plug-in/168985/2 "2019-02-20T21:27:11Z")

</div>

@ApekshaB, it sounds like using `modification_timestamp` instead of `Serial_no` as your `sql_last_value` would achieve what you want.

---

<div class="post-metadata">

**Author:** ![ApekshaB](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/apekshab/32/63273_2.png) [@ApekshaB](https://discuss.elastic.co/u/ApekshaB)\
**Post date:** [February 21, 2019, 5:58am UTC](https://discuss.elastic.co/t/how-to-run-incremental-update-addition-of-new-rows-updation-of-existing-rows-simultaneously-when-running-sql-query-through-logstash-jdbc-plug-in/168985/3 "2019-02-21T05:58:16Z")

</div>

But my issue is i want to update existing rows, as well as add new rows in the table simultaneously. I cant simply use **modification\_timestamp** as **sql\_last\_value** , because i can have same **modification\_timestamp** for more than one row in the table, in which, query will drop rows with same **modification\_timestamp** in the initial run.  
For my JDBC select query i can set **sql\_last\_value** either as **Serial\_no** or **modification\_timestamp**. i want to use both of them with a logical OR operator, that means, retrieve rows from table, where **sql\_last\_value** \> **Serial\_no** OR **sql\_last\_value** \> **modification\_timestamp**.

How do i achieve this?

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [March 21, 2019, 5:58am UTC](https://discuss.elastic.co/t/how-to-run-incremental-update-addition-of-new-rows-updation-of-existing-rows-simultaneously-when-running-sql-query-through-logstash-jdbc-plug-in/168985/4 "2019-03-21T05:58:24Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.