I have an mysql table with multiple pdfs and an associated item_name for
title pdf_s3_link
-------- --------------
Harry Potter linktopdfons3
Batman s3_link_to_pdfons3
I am trying to injest these data into my Elasticsearch index so that if there's a match I need to display the title. I am trying to use injest api but I dont know how to run this automatically. (I am doing a POC so this is not on escloud yet but in the future the whole system, injestion should be serverless + es cloud).
I came across fscrawler but even with that I cannot download all those pdf to a local directory. Whats the best way out of this ?