I would like to send data from mongodb in Elasticsearch, I saw a lot of different plugins like monstache, mongo-connector, but I'd like to have your recommendations for indexing this data, knowing that I will have some enrichment to do, I'm thinking of using Logstash to make them (or an ingest pipeline but I have to cross indices and there is no processor to do it).
Thanks in advance
I shared most of my thoughts there: http://david.pilato.fr/blog/2015/05/09/advanced-search-for-your-legacy-application/
Basically, I'd recommend modifying the application layer if possible and send data to elasticsearch in the same "transaction" as you are sending your data to the database.
Have also a look at this "live coding" recording.
But if you don't have access to the application layer, then you need to solve this in another way.
I think that the closer you are from the source the better, so plugins in MongoDB might help.
Otherwise, you can use the input jdbc connector for logstash, and use the mongodb jdbc driver.
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.