I have been indexing files from different servers using FSCrawler and storing them in my Elastic search server.
But now I have files in s3 bucket. Could anyone please guide me how to index files that are in S3 and store them to my ES server?
From the previous discussions, I got to know I need to use log stash-s3-input plugin, but I am not able to find the procedure to do that.
Another novice question, Can I use my ES server to store the s3 index or is it necessary to have a EC2 instance to index s3 files?
Is it possible to store all my indexes in normal ES cluster instead of using Amazon ElasticSearch??
Please guide me or post a link that explains s3 indexing for beginners. TIA!!