I know, I know... this project has been just released but I would
welcome some perspective on where it is heading and what are the plans
about integration with other existing (possibly related) projects or
frameworks.
Well, the roadmap is very solid in my head, and here I thought people can
read minds :). Jokes aside, I will start filling out the github issues with
features that I plan to support, and tag them with the version I hope they
will be supported on. People can vote (and open features) on what they want.
Off the top of my head, here are some of them (in no particular order):
Expose Native Java API (no HTTP, low level TCP communication with
optimized serialization). Basically, its almost there already since thats
what the Http module uses :).
Embeddability in JVM, both for testing and for starting nodes embedded in
applications (both data nodes and non data nodes).
Bulk Gateways (write behind module), including support for persistent
storage of the index on HDFS (Hadoop), Amazon S3, Voldemort, Cassandra.
Enhance search features including "all" field, highlighting, more like
this, term stats, and more. Basically, things that I did in Compass.
Enhanced facet support (bobo browse like, hopefully reusing it).
Possible another implementation of an Engine to try and get to full real
time and not near real time.
Enhance the administration API allowing to get stats (index state, ...),
JVM stats, and so on.
On top of all the JSON API, start building the coolest, web 2.0, HTML 5,
(insert web framework here) administration console.
Other cool features can be:
Reimplement Compass (OSEM, ORM integration, ...) on top of Elasticsearch.
Once the Java API is in place, it should be quite simple.
Implement automatic indexing of database based on custom SQL queries
(similar to the Compass Jdbc Gps).
Work with people on plugins to automatically index content that is stored
in other systems, like Cassandra, Voldemort, mongodb, Couchdb, ... .
Native client libraries in Ruby/Rails (ActiveSearch or something),
Python, ... (really need help from the community here).
That should keep me busy (and hopefully people would join the effort!).
Anything on your mind?
I know, I know... this project has been just released but I would
welcome some perspective on where it is heading and what are the plans
about integration with other existing (possibly related) projects or
frameworks.
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.