I have to update elasticsearch with each new entry in log file and each new record inserted in rdbms database, is their any way for that. I was able to migrate data once but now sure how to do it for any further change in log file and database
The file input is made for continuous monitoring of a log file which is exactly what you're looking for.
Use the jdbc input for reading from your relational database. It can be configured to run on a schedule. There are a couple of ways to avoid duplicate insertions from the database. At least one of the methods is described in the plugin documentation.
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.