Load Data from S3 with Rest Call for each record and merge response

Elastic Stack Logstash
1

Hi,
We have use case to

  • Read data from S3 bucket (zip Files).
  • For each record make rest call to another service and merge the response with Input Data from File
  • Load final data to elastic search
  • Follow this process multiple times a day and all the loaded data need to indexed on all the fields with enable aggregation and ML capabilities.

Thanks
Vipin

2

I'm moving your question to #logstash as it looks like to me an ETL topic.

3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.