# Trying to implement CDC transfer from MongoDB to Elasticsearch 8.4

**URL:** <https://discuss.elastic.co/t/trying-to-implement-cdc-transfer-from-mongodb-to-elasticsearch-8-4/316007>\
**Category:** Elastic Search\
**Created:** [October 6, 2022, 7:53pm UTC](https://discuss.elastic.co/t/trying-to-implement-cdc-transfer-from-mongodb-to-elasticsearch-8-4/316007 "2022-10-06T19:53:29Z")\
**Posts on this page:** 9\
**Page:** 1

<div class="post-metadata">

**Author:** ![Venkatesh\_Guruprasad](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/venkatesh_guruprasad/32/50887_2.png) [@Venkatesh\_Guruprasad](https://discuss.elastic.co/u/Venkatesh_Guruprasad)\
**Post date:** [October 6, 2022, 7:53pm UTC](https://discuss.elastic.co/t/trying-to-implement-cdc-transfer-from-mongodb-to-elasticsearch-8-4/316007/1 "2022-10-06T19:53:29Z")

</div>

We are trying to implement CDC transfer from MongoDB to Elasticsearch 8.4. Do we have to manually create index mappings for each Mongo collection or can we enable dynamic mappings on create within Elasticsearch

---

<div class="post-metadata">

**Author:** ![Sean\_Story](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/sean_story/32/69987_2.png) [@Sean\_Story](https://discuss.elastic.co/u/Sean_Story)\
**Post date:** [October 6, 2022, 8:04pm UTC](https://discuss.elastic.co/t/trying-to-implement-cdc-transfer-from-mongodb-to-elasticsearch-8-4/316007/2 "2022-10-06T20:04:34Z")

</div>

Hi @Venkatesh_Guruprasad,

First, can you clarify what "CDC" stands for? I'm unsure if that adds important context for your question.

Second, are you using Elasticsearch API, or Elastic Enterprise Search? If you're using Elasticsearch directly, we may want to re-tag this post to `stack-elasticsearch`.

However, you may be interested to know that Enterprise Search has been developing a connector specifically for syncing MongoDB data to Elasticsearch. See: [Elastic connectors | Elastic Enterprise Search documentation [8.4] | Elastic](https://www.elastic.co/guide/en/enterprise-search/current/connectors.html)  
This feature is in "technical preview", which means we're actively developing on and iterating on this. Stay tuned as future releases come out.

If you'd like to be an early adopter and provide us some feedback, we'd be very interested to hear it.

---

<div class="post-metadata">

**Author:** ![Serena\_Chou](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/serena_chou/32/100087_2.png) [@Serena\_Chou](https://discuss.elastic.co/u/Serena_Chou)\
**Post date:** [October 6, 2022, 8:13pm UTC](https://discuss.elastic.co/t/trying-to-implement-cdc-transfer-from-mongodb-to-elasticsearch-8-4/316007/3 "2022-10-06T20:13:05Z")

</div>

@Venkatesh_Guruprasad we'd love to get your use case details to see how our MongoDB connector can facilitate your work flow!

---

<div class="post-metadata">

**Author:** ![Venkatesh\_Guruprasad](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/venkatesh_guruprasad/32/50887_2.png) [@Venkatesh\_Guruprasad](https://discuss.elastic.co/u/Venkatesh_Guruprasad)\
**Post date:** [October 6, 2022, 8:25pm UTC](https://discuss.elastic.co/t/trying-to-implement-cdc-transfer-from-mongodb-to-elasticsearch-8-4/316007/4 "2022-10-06T20:25:55Z")

</div>

We are trying to move modified data in MongoDB cluster to an Elasticsearch instance on the cloud. CDC we referring is for Change Data Capture. If you have a beta version of the connector being built would like to gain access to that. We are in the process of trying to find a solution.

---

<div class="post-metadata">

**Author:** ![maryna.cherniavska](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/maryna.cherniavska/32/89935_2.png) [@maryna.cherniavska](https://discuss.elastic.co/u/maryna.cherniavska)\
**Post date:** [October 7, 2022, 8:06am UTC](https://discuss.elastic.co/t/trying-to-implement-cdc-transfer-from-mongodb-to-elasticsearch-8-4/316007/5 "2022-10-07T08:06:46Z")

</div>

> [@Venkatesh\_Guruprasad](#):
>
> CDC we referring is for Change Data Capture.

Just to clarify @Venkatesh_Guruprasad - this is about [MondoDB change streams](https://www.mongodb.com/docs/manual/changeStreams/), right? They're watching [change events](https://www.mongodb.com/docs/manual/reference/change-events/#std-label-change-stream-output) on the collection and these are what you want then be exported to another data source - to Elastic?

---

<div class="post-metadata">

**Author:** ![Venkatesh\_Guruprasad](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/venkatesh_guruprasad/32/50887_2.png) [@Venkatesh\_Guruprasad](https://discuss.elastic.co/u/Venkatesh_Guruprasad)\
**Post date:** [October 7, 2022, 2:58pm UTC](https://discuss.elastic.co/t/trying-to-implement-cdc-transfer-from-mongodb-to-elasticsearch-8-4/316007/6 "2022-10-07T14:58:21Z")

</div>

Yes that's correct. We want our sync with Mongo in Elastic as close as possible.

---

<div class="post-metadata">

**Author:** ![Venkatesh\_Guruprasad](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/venkatesh_guruprasad/32/50887_2.png) [@Venkatesh\_Guruprasad](https://discuss.elastic.co/u/Venkatesh_Guruprasad)\
**Post date:** [October 7, 2022, 2:59pm UTC](https://discuss.elastic.co/t/trying-to-implement-cdc-transfer-from-mongodb-to-elasticsearch-8-4/316007/7 "2022-10-07T14:59:42Z")

</div>

We are using Mongo as our operational DB and Elastic as the analytical DB. We want to do transformation for the analytical pipeline using ELT rather than ETL. By doing ELT we are localizing the transforms within Elastic & removing any other tool in between. For ELT to happen we want to the change streams from Mongo sync with Elastic always.

---

<div class="post-metadata">

**Author:** ![Serena\_Chou](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/serena_chou/32/100087_2.png) [@Serena\_Chou](https://discuss.elastic.co/u/Serena_Chou)\
**Post date:** [October 11, 2022, 4:55pm UTC](https://discuss.elastic.co/t/trying-to-implement-cdc-transfer-from-mongodb-to-elasticsearch-8-4/316007/8 "2022-10-11T16:55:25Z")

</div>

in 8.4 we released a technical preview of MongoDB connector client [8.4.0 release notes | Elastic Enterprise Search documentation [8.4] | Elastic](https://www.elastic.co/guide/en/enterprise-search/current/release-notes-8.4.0.html)  
we'd love your feedback on this! The code for this connector client to Mongo can be found in our open code repo [GitHub - elastic/connectors-ruby: Official Connector Clients for Elastic Elasticsearch, Enterprise Search, App Search and Workplace Search](https://github.com/elastic/connectors-ruby), you just need to deploy it on self managed infrastructure and connect to Enterprise Search. We also have a native connector hosted in Enterprise Search on the short term roadmap. If you'd like to try that out, i can DM you to set up a user feedback session

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [November 8, 2022, 4:56pm UTC](https://discuss.elastic.co/t/trying-to-implement-cdc-transfer-from-mongodb-to-elasticsearch-8-4/316007/9 "2022-11-08T16:56:12Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
