Just Pushed: Percolator


(Shay Banon) #1

Hi,

Just pushed a big feature to ES called Percolator. Percolator does the "reverse" of what ES does today. Instead of indexing docs and then running searches against them, one registers queries and percolates a doc among them, getting back which queries matched that doc.

Tons of more features can be built on top of this core feature, would love to hear some feedback.

Note, this feature is still experimental.

Issue: https://github.com/elasticsearch/elasticsearch/issues/issue/624

cheers,
-shay.banon


(dbenson) #2

Shay,

Loving the pace of innovation! This looks really cool, exactly the
type of idea Paul and I were thinking about when we asked about email
alerts.

Would this work for a query which spans multiple indexes?

We're set to upgrade our production instances next week from 0.13 to
0.14.2 to take advantage of the substantial reduction in disk space
needed for full text queries w/ highlighting.

Thanks,

David


(Shay Banon) #3

Would this work for a query which spans multiple indexes?

It works a bit differently then the idea of searching across indices. You register a query under an index, and then you can percolate a doc against those queries.

If you have several indices, you will need to register queries on each one.
On Thursday, January 13, 2011 at 6:00 PM, dbenson wrote:

Shay,

Loving the pace of innovation! This looks really cool, exactly the
type of idea Paul and I were thinking about when we asked about email
alerts.

Would this work for a query which spans multiple indexes?

We're set to upgrade our production instances next week from 0.13 to
0.14.2 to take advantage of the substantial reduction in disk space
needed for full text queries w/ highlighting.

Thanks,

David


(dbenson) #4

Thanks. After thinking about it for a bit, I came to the same
conclusion.

David


(Berkay Mollamustafaoglu-2) #5

Great!

I can't agree more that this feature opens up a whole new world!

Regards,
Berkay Mollamustafaoglu
mberkay on yahoo, google and skype

On Thu, Jan 13, 2011 at 9:23 AM, Shay Banon shay.banon@elasticsearch.comwrote:

Hi,

Just pushed a big feature to ES called Percolator. Percolator does the
"reverse" of what ES does today. Instead of indexing docs and then running
searches against them, one registers queries and percolates a doc among
them, getting back which queries matched that doc.

Tons of more features can be built on top of this core feature, would
love to hear some feedback.

Note, this feature is still experimental.

Issue: https://github.com/elasticsearch/elasticsearch/issues/issue/624

cheers,
-shay.banon


(harryf) #6

How would perculator play together with something like the twitter
river? Thinking to make this really useful you'd want some kind of
callback / webhook - http://wiki.webhooks.org/ - to be fired when
registered queries match. Or am I missing something?

On Jan 13, 3:23 pm, Shay Banon shay.ba...@elasticsearch.com wrote:

Hi,

Just pushed a big feature to ES called Percolator. Percolator does the "reverse" of what ES does today. Instead of indexing docs and then running searches against them, one registers queries and percolates a doc among them, getting back which queries matched that doc.

Tons of more features can be built on top of this core feature, would love to hear some feedback.

Note, this feature is still experimental.

Issue:https://github.com/elasticsearch/elasticsearch/issues/issue/624

cheers,
-shay.banon


(Shay Banon) #7

This feature is the core feature to get things going. Doing things like getting matched queries when indexing docs, and possibly publishing them is going to be built on top of it.
On Friday, January 14, 2011 at 1:29 PM, harryf wrote:

How would perculator play together with something like the twitter
river? Thinking to make this really useful you'd want some kind of
callback / webhook - http://wiki.webhooks.org/ - to be fired when
registered queries match. Or am I missing something?

On Jan 13, 3:23 pm, Shay Banon shay.ba...@elasticsearch.com wrote:

Hi,

Just pushed a big feature to ES called Percolator. Percolator does the "reverse" of what ES does today. Instead of indexing docs and then running searches against them, one registers queries and percolates a doc among them, getting back which queries matched that doc.

Tons of more features can be built on top of this core feature, would love to hear some feedback.

Note, this feature is still experimental.

Issue:https://github.com/elasticsearch/elasticsearch/issues/issue/624

cheers,
-shay.banon


(system) #8