I want to use information from 2 files and insert to elasticsearh as a document

I have the situation where I want to parse from the log file and insert each log as a document in elasticsearch but same time I want to get log metadata from another file and insert to the documents created by log file in each document. So I thought of some solutions. So I come up with following questions.

  1. I'm not sure how to do in a same logstash job.
  2. Is there any way of triggering another logstash after finish parsing of a log file. (As I can use unique id to do that)

Logstash and its standard plugins doesn't support this kind of content merging very well. I'm sure it's possible to string it together but there's no shrinkwrapped solution.

Thanks for the reply, yes I did not find any solution either.

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.