Hello,
Thank you, Tim, for taking some time out and looking into my problem. I was following the first approach that you have mentioned but our use case demands to show the live data over a single geographical map.
I understand that ES is a NoSQL datastore and doesn't support JOINS. I have managed to find a workaround however, following jureken answer in this post. Now I am appending each packet of my live data with location information.
Still, I wanted to ask you two things:
- Is it the right approach?
- Right now I am doing this programmatically (have written a script to append location information in each packet and then dump it in Logstash and ES). How can I do this thing
- take ID from each packet, search ES index containing location information and fetch the document with this ID,
- add the fetched document to the packet
in Logstash Conf, as Jureken has mentioned?