Steal this database


(Ivan Brusic) #1

A while back, I created a simple river plugin as a fun proof of concept.
Updated some of the code and moved github repos, so I thought a blog post
was in order:

Elasticsearch is simply amazing. Even creating this plugin was not hard to
do at all. Sharing this plugin to demonstrate how easy it is to extend
elasticsearch. Is the plugin useful? Perhaps to one or two people. :slight_smile:

Have not really stress tested the plugin but the meetup example I have been
using is pretty chatty. RSVPs average around 1 per second. The river
should work on any stream that is accessible with only the URI, no
authentication besides perhaps api keys in the url is supported, which means
no Facebook APIs. Should work for sites like Digg and Datasift.

--
Ivan


(Shay Banon) #2

Nice!. Btw, if you create a zip file out of it and add it to the Downloads
section in github, elasticsearch will be able to install it automatically.

On Wed, Aug 10, 2011 at 6:20 AM, Ivan Brusic ivan@brusic.com wrote:

A while back, I created a simple river plugin as a fun proof of concept.
Updated some of the code and moved github repos, so I thought a blog post
was in order:

http://blog.brusic.com/2011/08/steal-this-database.html

Elasticsearch is simply amazing. Even creating this plugin was not hard to
do at all. Sharing this plugin to demonstrate how easy it is to extend
elasticsearch. Is the plugin useful? Perhaps to one or two people. :slight_smile:

Have not really stress tested the plugin but the meetup example I have been
using is pretty chatty. RSVPs average around 1 per second. The river
should work on any stream that is accessible with only the URI, no
authentication besides perhaps api keys in the url is supported, which means
no Facebook APIs. Should work for sites like Digg and Datasift.

--
Ivan


(Ivan Brusic) #3

I do have a zip file built for 0.17.3 in the download. Uploading a version
for 0.17.4 right now. There was that small issue with github.com downloads
with elasticsearch prior to 0.17.3, so I did not add zip files for those
versions.

There appears to be a slight mismatch between the plugin manager in regards
to installing locally or via github. Locally expects the zip file to have
the "elasticsearch-" prefix, while github should not have the prefix.

Installation instructions:

Did not spend too much documentation since I am not sure if anyone will
actually use the plugin. :slight_smile:

--
Ivan

On Wed, Aug 10, 2011 at 6:19 AM, Shay Banon kimchy@gmail.com wrote:

Nice!. Btw, if you create a zip file out of it and add it to the Downloads
section in github, elasticsearch will be able to install it automatically.

On Wed, Aug 10, 2011 at 6:20 AM, Ivan Brusic ivan@brusic.com wrote:

A while back, I created a simple river plugin as a fun proof of concept.
Updated some of the code and moved github repos, so I thought a blog post
was in order:

http://blog.brusic.com/2011/08/steal-this-database.html

Elasticsearch is simply amazing. Even creating this plugin was not hard
to do at all. Sharing this plugin to demonstrate how easy it is to extend
elasticsearch. Is the plugin useful? Perhaps to one or two people. :slight_smile:

Have not really stress tested the plugin but the meetup example I have
been using is pretty chatty. RSVPs average around 1 per second. The river
should work on any stream that is accessible with only the URI, no
authentication besides perhaps api keys in the url is supported, which means
no Facebook APIs. Should work for sites like Digg and Datasift.

--
Ivan


(Shay Banon) #4

Yea, btw, you don't have to follow each version of elasticsearch with the
plugin, you can have your own versioning (since you can provide it in the
-install command).

On Wed, Aug 10, 2011 at 6:29 PM, Ivan Brusic ivan@brusic.com wrote:

I do have a zip file built for 0.17.3 in the download. Uploading a version
for 0.17.4 right now. There was that small issue with github.comdownloads with elasticsearch prior to 0.17.3, so I did not add zip files for
those versions.

There appears to be a slight mismatch between the plugin manager in regards
to installing locally or via github. Locally expects the zip file to have
the "elasticsearch-" prefix, while github should not have the prefix.

Installation instructions:
https://github.com/brusic/streaming-river/wiki/Installation

Did not spend too much documentation since I am not sure if anyone will
actually use the plugin. :slight_smile:

--
Ivan

On Wed, Aug 10, 2011 at 6:19 AM, Shay Banon kimchy@gmail.com wrote:

Nice!. Btw, if you create a zip file out of it and add it to the Downloads
section in github, elasticsearch will be able to install it automatically.

On Wed, Aug 10, 2011 at 6:20 AM, Ivan Brusic ivan@brusic.com wrote:

A while back, I created a simple river plugin as a fun proof of concept.
Updated some of the code and moved github repos, so I thought a blog post
was in order:

http://blog.brusic.com/2011/08/steal-this-database.html

Elasticsearch is simply amazing. Even creating this plugin was not hard
to do at all. Sharing this plugin to demonstrate how easy it is to extend
elasticsearch. Is the plugin useful? Perhaps to one or two people. :slight_smile:

Have not really stress tested the plugin but the meetup example I have
been using is pretty chatty. RSVPs average around 1 per second. The river
should work on any stream that is accessible with only the URI, no
authentication besides perhaps api keys in the url is supported, which means
no Facebook APIs. Should work for sites like Digg and Datasift.

--
Ivan


(Ivan Brusic) #5

I doubt I will be releasing many versions, so I did not want to get into my
own versioning scheme. Besides "./plugin -install brusic/streaming-river"
without a number is just so clean! I think I will simply maintain my own
alias to the latest version "./plugin -install
brusic/streaming-river/latest"

On Wed, Aug 10, 2011 at 11:32 AM, Shay Banon kimchy@gmail.com wrote:

Yea, btw, you don't have to follow each version of elasticsearch with the
plugin, you can have your own versioning (since you can provide it in the
-install command).


(system) #6