# How to index s3 files and transfer that index to my ES server

**URL:** <https://discuss.elastic.co/t/how-to-index-s3-files-and-transfer-that-index-to-my-es-server/220930>\
**Category:** Elasticsearch\
**Created:** [February 25, 2020, 10:16pm UTC](https://discuss.elastic.co/t/how-to-index-s3-files-and-transfer-that-index-to-my-es-server/220930 "2020-02-25T22:16:00Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![Lisahtwy](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/lisahtwy/32/53910_2.png) [@Lisahtwy](https://discuss.elastic.co/u/Lisahtwy)\
**Post date:** [February 25, 2020, 10:16pm UTC](https://discuss.elastic.co/t/how-to-index-s3-files-and-transfer-that-index-to-my-es-server/220930/1 "2020-02-25T22:16:00Z")

</div>

Hi,

I have been indexing files from different servers using FSCrawler and storing them in my Elastic search server.  
But now I have files in s3 bucket. Could anyone please guide me how to index files that are in S3 and store them to my ES server?  
From the previous discussions, I got to know I need to use log stash-s3-input plugin, but I am not able to find the procedure to do that.  
Another novice question, Can I use my ES server to store the s3 index or is it necessary to have a EC2 instance to index s3 files?  
Is it possible to store all my indexes in normal ES cluster instead of using Amazon ElasticSearch??

Please guide me or post a link that explains s3 indexing for beginners. TIA!!

-Lisa

---

<div class="post-metadata">

**Author:** ![Lisahtwy](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/lisahtwy/32/53910_2.png) [@Lisahtwy](https://discuss.elastic.co/u/Lisahtwy)\
**Post date:** [March 9, 2020, 6:21pm UTC](https://discuss.elastic.co/t/how-to-index-s3-files-and-transfer-that-index-to-my-es-server/220930/2 "2020-03-09T18:21:15Z")

</div>

Anyone???

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [March 10, 2020, 12:55am UTC](https://discuss.elastic.co/t/how-to-index-s3-files-and-transfer-that-index-to-my-es-server/220930/3 "2020-03-10T00:55:45Z")

</div>

May be you'd like this not implemented feature?

> <https://github.com/dadoonet/fscrawler/issues/263>
>
> I have documents stored in S3 - I need to use ElasticSearch for indexing and also for searching within the contents...

I don't know S3 enough but may be you can mount the s3 repo as a mounted drive and index the drive with FSCrawler from the ec2 machine?

---

<div class="post-metadata">

**Author:** ![Lisahtwy](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/lisahtwy/32/53910_2.png) [@Lisahtwy](https://discuss.elastic.co/u/Lisahtwy)\
**Post date:** [March 10, 2020, 2:12pm UTC](https://discuss.elastic.co/t/how-to-index-s3-files-and-transfer-that-index-to-my-es-server/220930/4 "2020-03-10T14:12:14Z")

</div>

Thank you so much!

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [April 7, 2020, 2:12pm UTC](https://discuss.elastic.co/t/how-to-index-s3-files-and-transfer-that-index-to-my-es-server/220930/5 "2020-04-07T14:12:15Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.