File monitoring dashboard

Elastic Stack Kibana
1

Has anyone created a dashboard that could track files that are moved between different systems using logs from the different systems? So if you have system a, b and c. A file landing on system a would get sent to system b. The dashboard would show the success and show that it failed to make it to c.

In the logs that you could feed in to ELK you can parse out the file name or other info for tracking.

2

Good question, I haven't done it before so hopefully someone else can chime in. To get the ball rolling though, what are you using to transfer files? Does it a output a log file that can be ingested into es with filebeat or similar?

3

Could be anything. FTP logs, Logs that are written to a SQL database, Text files. Beats would manage shipping the data to "L" and use "K" to create the dashboard.

Server "A" could be writing success logs to SQL
Server "B" could be writing success logs to a file
Server "C" could have logs from another point.

The dashboard or query should be smart enough to know that the file name it gathered from A should be check off the list (green) if it made it to B and then C.

If the file makes it to server A but does not make it to server B then you would be red.
If the file makes it to server A and B but does not make it to server C then you would be red.

4

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.