I currently use Sphinx and import hundreds of product feeds into this.
I am just trying to get this working with Elastic Search but I need to figure out the best way to:
- I have mapped the product ID to the Elastic Search ID, I assume going forward it will just update this record instead of creating a new one?
- How do I remove old products no longer in the feeds? I was thinking to have an "updated" field which has the current time and date when it was added / updated and if older than a week then removing it with some sort of cron job?
I am using Embulk to import the CSV files I am testing at the moment using this method: http://www.embulk.org/docs/recipe/scheduled-csv-load-to-elasticsearch-kibana5.html
Any pointers would be greay.