Ingesting meta data from database and file from file system

Elastic Stack Logstash
1

Hi -

New to logstash.

I am looking to ingest files along with related metadata into ES. I have metadata and file path in database.

Just wondering if there is a way to get meta data (like created date), and file path from database and then ingest the meta data and file together using existing input plugins.

I can use JDBC to get the data from database. I need to use that data and read the file from disk and then ingest data and file together into ES.

Appreciate the comments.

2

You'd either need to build your own plugin, or ingest the DB data and then use the ES filter with the file input to merge it.