Hello, I have device data currently stored in ElasticSearch, what I need to do is to export the data using Logstash (I'm using the elasticsearch input plugin) do some formatting ETL (extract days into seperate fields) and then output the results into a csv file.
Finally I need to send that csv file to either an S3 bucket, or directly by email. My question is: Is it possible to chain output plugins through Logstash, or is there a work around to this?
Is it possible to chain output plugins through Logstash, or is there a work around to this?
In addition to supporting multiple outputs in the same pipeline , you can send data from Logstash to Logstash Logstash-to-Logstash communication | Logstash Reference [8.11] | Elastic , and just released (beta) you can chain sending events from pipeline to pipeline: Pipeline-to-Pipeline Communication (Beta) | Logstash Reference [6.3] | Elastic
However, pushing a whole csv file (or any whole file) to different destinations isn't Logstash's sweet spot , rather smaller individual events (like log lines) is more the typical use case.
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
© 2020. All Rights Reserved - Elasticsearch
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant logo are trademarks of the Apache Software Foundation in the United States and/or other countries.