Data conversion & enrichment with Logstash


(Ranieri Mazili De Oliveira) #1

I'm developing a product with Logstash + Elasticsearch + Kibana.

I needed to make Logstash listen a JMS queue and I made it using JMS Input Plugin.
I needed to convert the xml to json and I made it using JMS XML filter plugin.

  1. Now I need to query elasticsearch based on an id I receveid on my input message
  2. Consume a rest service based on an id received from the elasticsearch query
  3. Merge the content of elasticsearch result, input message and rest service responses and update the elasticsearch record.

Can I perform all these remaining steps only with logstash? If so, which plugins(filters/codecs) should I use? If not, any ideas of how to do it?

I really appreciate any help
Thanks


(Magnus B├Ąck) #2

Can I perform all these remaining steps only with logstash?

No, not with the standard plugins. There is an elasticsearch filter so you get obtain the id from the input message but I don't think there's a REST lookup plugin.


(system) #3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.