# Running multiple S3 ingests

**URL:** <https://discuss.elastic.co/t/running-multiple-s3-ingests/105855>\
**Category:** Logstash\
**Created:** [October 31, 2017, 9:22am UTC](https://discuss.elastic.co/t/running-multiple-s3-ingests/105855 "2017-10-31T09:22:05Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![damianconnolly](https://avatars.discourse-cdn.com/v4/letter/d/90db22/32.png) [@damianconnolly](https://discuss.elastic.co/u/damianconnolly)\
**Post date:** [October 31, 2017, 9:22am UTC](https://discuss.elastic.co/t/running-multiple-s3-ingests/105855/1 "2017-10-31T09:22:05Z")

</div>

Hi all, first post here!

I have set up an ELK installation to ingest files using the S3 filter. As there is quite a large backlog of files sitting in the bucket, is it possible to run multiple instances of LS to clear this down? To further complicate affairs, all files are in the same bucket and have the same prefix.

If I fire up another instance of LS, is it likely to ingest the same files simultanously or is there some sort of locking mechanism?

Thanks!

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [November 28, 2017, 9:22am UTC](https://discuss.elastic.co/t/running-multiple-s3-ingests/105855/2 "2017-11-28T09:22:17Z")

</div>

Closed on November 28, 2017, 9:22am UTC

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.