I am using Elk to display status of jobs. I am connecting to oracle and displaying in kibana. For the first time I am doing select * and indexing to ES. Now I want job status to change as they change in backend. Also the new jobs added with time should be displayed. How to handle that in logstash.conf? I was thinking to select * to index and then delete all previously indexed data from Es before doing select * new updated data. Is there any other way to do that? This way doesn't seem to be efficient.
Is there a column in the database that gets updated with a sequence or timestamp when a row is updated? If so, search the discussions here for sql_last_value to get some hints.
@Badger the only columns related to time are start time and end time of the jobs
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.