Hi All,
I would like to parse a jdbc log and I'm just learning the process. The log looks like this:
40703|master|180615-09:36:22:315|7 ms|statement|UPDATE tasks SET p_runningonclusternode = ? WHERE p_runningonclusternode = ? AND PK = ? AND hjmpTS = ? |UPDATE tasks SET p_runningonclusternode = 0 WHERE p_runningonclusternode = -1 AND PK = 8796125856694 AND hjmpTS = 1076364
40703|master|180615-09:36:22:322|5 ms|statement|UPDATE taskconditions SET p_consumed = ? WHERE p_task = ?|UPDATE taskconditions SET p_consumed = 1 WHERE p_task = 8796125856694
40703|master|180615-09:36:22:328|1 ms|statement|SELECT item_t0.PK FROM tasks item_t0 WHERE ( item_t0.p_trigger = 8796125856246) AND (item_t0.TypePkString=? )|SELECT item_t0.PK FROM tasks item_t0 WHERE ( item_t0.p_trigger = 8796125856246) AND (item_t0.TypePkString=8796107178066 )
40703|master|180615-09:36:22:333|2 ms|statement|UPDATE triggerscj SET hjmpTS = ? ,modifiedTS=?,p_activationtime=? WHERE PK = ? AND (sealed IS NULL OR sealed=0)|UPDATE triggerscj SET hjmpTS = 538183 ,modifiedTS='2018-06-15 09:36:22.329',p_activationtime='2018-06-15 09:36:23.0' WHERE PK = 8796125856246 AND (sealed IS NULL OR sealed=0)
40703|master|180615-09:36:22:337|2 ms|statement|UPDATE tasks SET hjmpTS = ? ,modifiedTS=?,p_executiontimemillis=? WHERE PK = ? AND (sealed IS NULL OR sealed=0)|UPDATE tasks SET hjmpTS = 1076365 ,modifiedTS='2018-06-15 09:36:22.334',p_executiontimemillis=1529080583000 WHERE PK = 8796125856694 AND (sealed IS NULL OR sealed=0)
40703|master|180615-09:36:22:341|3 ms|commit||
40703|master|180615-09:36:22:344|1 ms|statement|SELECT * FROM triggerscj WHERE PK=?|SELECT * FROM triggerscj WHERE PK=8796125856246
40703|master|180615-09:36:22:347|1 ms|statement|SELECT * FROM tasks WHERE PK=?|SELECT * FROM tasks WHERE PK=8796125856694
40703|master|180615-09:36:22:354|5 ms|statement|UPDATE tasks SET hjmpTS = ? ,modifiedTS=?,p_retry=? WHERE PK = ? AND (sealed IS NULL OR sealed=0)|UPDATE tasks SET hjmpTS = 1076366 ,modifiedTS='2018-06-15 09:36:22.348',p_retry=538183 WHERE PK = 8796125856694 AND (sealed IS NULL OR sealed=0)
40703|master|180615-09:36:22:360|4 ms|statement|UPDATE tasks SET p_runningonclusternode = ? WHERE PK = ?|UPDATE tasks SET p_runningonclusternode = -1 WHERE PK = 8796125856694
40703|master|180615-09:36:22:364|2 ms|statement|DELETE FROM tasks_aux_queue WHERE PK IN (?)|DELETE FROM tasks_aux_queue WHERE PK IN ('8796125856694')
40703|master|180615-09:36:22:371|6 ms|commit||
61|master|180615-09:36:22:386|0 ms|statement|SELECT isInitialized FROM metainformations WHERE PK = ?|SELECT isInitialized FROM metainformations WHERE PK = 15481123719086096
61|master|180615-09:36:22:389|1 ms|statement|SELECT * FROM tasks WHERE PK=?|SELECT * FROM tasks WHERE PK=8796125856694
38|master|180615-09:36:22:791|4 ms|statement|DELETE FROM tasks_aux_workers WHERE ID = ? AND IS_ACTIVE = 0|DELETE FROM tasks_aux_workers WHERE ID = 0 AND IS_ACTIVE = 0
Looking at the fields it looks like they are:
PID | Node? | timestamp | duration | command type? | sql statement | additional sql statement?
Does anyone know how I can confirm what each field corresponds to? The first field appears like it could be PID but numbers less than 100 seem odd. Thoughts?
Any guidance on how I can get started on creating the logstash input block?
Thanks in advance..
HB