# Incremental Sync for S3 Connectors

**URL:** <https://discuss.elastic.co/t/incremental-sync-for-s3-connectors/355202>\
**Category:** Elastic Search\
**Tags:** elastic-app-search\
**Created:** [March 12, 2024, 3:53am UTC](https://discuss.elastic.co/t/incremental-sync-for-s3-connectors/355202 "2024-03-12T03:53:17Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![aisyaharifin](https://avatars.discourse-cdn.com/v4/letter/a/b9e5f3/32.png) [@aisyaharifin](https://discuss.elastic.co/u/aisyaharifin)\
**Post date:** [March 12, 2024, 3:53am UTC](https://discuss.elastic.co/t/incremental-sync-for-s3-connectors/355202/1 "2024-03-12T03:53:17Z")

</div>

Hello Elastic,

I want to confirm on content sync for S3, can we do incremental sync in S3?

Or does S3 only applicable for full document sync?

I do notice that for incremental sync not all connectors support, and it seems like for sharepoint only available on the incremental sync.

> **[Content syncs | Enterprise Search documentation \[8.12\] | Elastic](https://www.elastic.co/guide/en/enterprise-search/current/connectors-sync-types.html)**

I need confirmation on this asap, if S3 does not support on the incremental sync may I know when will it available for S3?

Thanks!

---

<div class="post-metadata">

**Author:** ![nfeekery](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/nfeekery/32/117349_2.png) [@nfeekery](https://discuss.elastic.co/u/nfeekery)\
**Post date:** [March 12, 2024, 9:38am UTC](https://discuss.elastic.co/t/incremental-sync-for-s3-connectors/355202/2 "2024-03-12T09:38:20Z")

</div>

Hi @aisyaharifin

You're correct; S3 connector doesn't support incremental syncs right now. We only support incremental syncs for the SharePoint Online connector.

> if S3 does not support on the incremental sync may I know when will it available for S3?

I don't think this is on our roadmap but I'm confirming with the team just in case. I'll get back to you when I have an answer.

---

<div class="post-metadata">

**Author:** ![Dana\_Juratoni](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dana_juratoni/32/109207_2.png) [@Dana\_Juratoni](https://discuss.elastic.co/u/Dana_Juratoni)\
**Post date:** [March 12, 2024, 11:08am UTC](https://discuss.elastic.co/t/incremental-sync-for-s3-connectors/355202/3 "2024-03-12T11:08:32Z")

</div>

Hi @aisyaharifin, incremental sync support for more connectors is on our roadmap, but S3 did not make it on the immediate roadmap. If you're a customer, filing a gap would help with with prioritization.  
Thanks!

---

<div class="post-metadata">

**Author:** ![Dana\_Juratoni](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dana_juratoni/32/109207_2.png) [@Dana\_Juratoni](https://discuss.elastic.co/u/Dana_Juratoni)\
**Post date:** [March 12, 2024, 5:25pm UTC](https://discuss.elastic.co/t/incremental-sync-for-s3-connectors/355202/4 "2024-03-12T17:25:21Z")

</div>

Following up on this, have you looked at our [Extraction Service](https://www.elastic.co/guide/en/enterprise-search/current/connectors-content-extraction.html#connectors-content-extraction-local)? The service can be used for [extracting contents of large files](https://www.elastic.co/guide/en/enterprise-search/current/connectors-filter-extract-transform.html#connectors-filter-extract-transform) on your own infrastructure when using self-managed connector clients.

> Instead of sending the file as an `attachment` to Elasticsearch, the file’s content is extracted at the edge by the extraction service before ingestion. The extracted text is then included as the `body` field of a document when it is ingested.

Maybe this would be helpful for your use case?

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [April 9, 2024, 5:25pm UTC](https://discuss.elastic.co/t/incremental-sync-for-s3-connectors/355202/5 "2024-04-09T17:25:53Z")

</div>

Closed on April 9, 2024, 5:25pm UTC

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.