Has anyone successfully integrated LiVRE and elasticsearch? I'm looking for an open-source plugin or possible solution for a video content based image retrieval system using elasticsearch.
I'm not familiar with LiVRE... did you mean LIRE? There are some published articles and plugins using LIRE to do image search in ES:
- https://www.elastic.co/blog/found-getting-started-with-lire-and-elasticsearch
- https://github.com/kzwang/elasticsearch-image
There's also been some more recent articles/tutorials on using DeepDetect to do image search in ES:
- https://www.elastic.co/blog/categorizing-images-with-deep-learning-into-elasticsearch
- http://www.deepdetect.com/tutorials/es-image-classifier/
And then there are more manual methods, such as using perceptual hashing or just extracting color palette compositions:
- https://stackoverflow.com/questions/32785803/similar-image-search-by-phash-distance-in-elasticsearch
- http://blog.sandeepchivukula.com/posts/2016/03/06/photo-search/
- https://sujitpal.blogspot.com/2016/05/elasticsearch-based-image-search-using.html
- https://www.elastic.co/elasticon/conf/2016/sf/opensource-connections-the-ghost-in-the-search-machine
They all revolve around the same idea though: take an image (or still frame from a video) and produce a set of tokens which can be indexed. These tokens can correspond to colors, contrast, scale, orientation, etc. And then at search time, you tokenize the query image the same way and let lucene find the matching tokens / docs (images).
1 Like
Its similar to LiRE but based on videos.
Ah, I'm not aware of any plugins/tutorials that use that. Just static images, so you'd have to pull out keyframes yourself and use existing methods. Or start to integrate LIvRE yourself in a plugin.