Best Way to Combine chain two output plugins


(Adrian) #1

Hello, I have device data currently stored in ElasticSearch, what I need to do is to export the data using Logstash (I'm using the elasticsearch input plugin) do some formatting ETL (extract days into seperate fields) and then output the results into a csv file.

Finally I need to send that csv file to either an S3 bucket, or directly by email. My question is: Is it possible to chain output plugins through Logstash, or is there a work around to this?


(Jake Landis) #2

Is it possible to chain output plugins through Logstash, or is there a work around to this?

In addition to supporting multiple outputs in the same pipeline , you can send data from Logstash to Logstash https://www.elastic.co/guide/en/logstash/current/ls-to-ls.html , and just released (beta) you can chain sending events from pipeline to pipeline: https://www.elastic.co/guide/en/logstash/6.3/pipeline-to-pipeline.html

However, pushing a whole csv file (or any whole file) to different destinations isn't Logstash's sweet spot , rather smaller individual events (like log lines) is more the typical use case.


(system) #3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.