Getting S3 file metadata into Kibana through logstash S3 input plugin

Elastic Stack Logstash
1

Hello. Is there a way to get S3 file metadata into Kibana using the logstash S3 plugin or any other method?
For example, we have files that when you run 'aws s3api head-object --bucket bucketname --key filename' return something similar to

"Metadata": {
"date": "09222017",
"customer_phone": "985xxxxxxx",
"session_id": "9AEDE4D863CE4C0EBAC87CC639BBA227",
"duration": "00%3A01%3A17",
"agent": "mtm.xxxx%40xxxplans.com",
"direction": "Unknown+Calltype",
"arw_phone_number": "",
"campaign": "Main+IVR",
"result": "None"
},

But I'm not able to search for any of those tags in Kibana. My Stack is as follows:

S3 -> SQS <- Logstash SQS input plugin -> AWS Elasticsearch <- Kibana

Thanks!

2

Anyone? :frowning:

3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.