Data ingestion to elastic in near real time from mongo db

[Christian_Dahlqvist]

@Moni_Hazarika

When using MongoDB streams to asynchronously ingest data into Elasticsearch for full-text search any potential issues to be aware of? We are using Mongo 6 and Elastic 8. FYI we have both on-prem and cloud deployments. For message queue since we already have RabbitMQ running on both trying to leverage it vs introducing Kafka.

Also since MongoDB and Elasticsearch have different data models. Any suggestions/recommendations in defining the schema mapping strategy to transform MongoDB documents into Elasticsearch documents?

I have never replicated MongoDB data to Elasticsearch, so have no suggestions or commets here.