We have following set up: data for elasticsearch is offered in a work table. There we get the records with insert/update/delete and fetch these records via logstash.
Thats working. But how can we delete/update the processed records via logstash? If we had the chance to delete the just successfully updated record in the worktable via logstash-is there a way? Please also suggest other solutions...
Best solution would be: logstash fetches 10 records, the 10 records get included in the index, the 10 records are deleted in the work table...
Thanks and regards,
Florian