I have a specialized index for binary data (non lucene) which has a
requirement of having at most 500k documents in it, so if there are
more to be indexed i have to creat a new shard.
i was wondering if it is possible to use elasticsearch in this case to
query and index the custom index(s), so that i dont have to program
the sharding and search process, as elasticsearch does this very well.
Are there points in the source code of es where I can jump in to try
this? or is the network and sharding code too
entrenched with the lucene library.