[ANN] RSS River Plugin


(David Pilato) #1

Hi all,

I'm happy to share with the ES community my first Elastic Search plugin
release : RSS River 0.0.1.

As you could imagine, RSS river plugin gets RSS feed and index some few
fields such as title and description.

A short documentation is available :
https://github.com/dadoonet/rssriver/blob/master/README.textile

Project is here : https://github.com/dadoonet/rssriver

To use it :

  1.  Install plugin
    
  2.  Create index for rss feed
    
  3.  Create RSSRiver
    
  4.  Start searching.
    

$ bin\plugin -install dadoonet/rssriver/0.0.1

$ curl -XPUT 'http://localhost:9200/lemonde/' -d '{}'
$ curl -XPUT 'http://localhost:9200/_river/lemonde/_meta' -d '{
"type": "rss",
"rss": {
"url": "http://www.lemonde.fr/rss/une.xml"
}
}'
$ curl -XGET 'http://localhost:9200/lemonde/_search?q=taxe'

It's only the first release so many things to add again and many tests to
do.

Please feel free to contribute as a tester or a developer.

Hope this could help someone !

David

http://twitter.com/dadoonet


(Ivan Brusic) #2

Very nice!

Did not know about EsExecutors. Very good to know.

Ivan

On Wed, Sep 14, 2011 at 4:05 PM, David Pilato david@pilato.fr wrote:

Hi all,

I’m happy to share with the ES community my first Elastic Search plugin
release : RSS River 0.0.1.

As you could imagine, RSS river plugin gets RSS feed and index some few
fields such as title and description.

A short documentation is available :
https://github.com/dadoonet/rssriver/blob/master/README.textile

Project is here : https://github.com/dadoonet/rssriver

To use it :

  1.  Install plugin
    
  2.  Create index for rss feed
    
  3.  Create RSSRiver
    
  4.  Start searching…
    

$ bin\plugin -install dadoonet/rssriver/0.0.1

$ curl -XPUT 'http://localhost:9200/lemonde/' -d '{}'

$ curl -XPUT 'http://localhost:9200/_river/lemonde/_meta' -d '{

"type": "rss",

"rss": {

"url": "http://www.lemonde.fr/rss/une.xml"

}

}'

$ curl –XGET 'http://localhost:9200/lemonde/_search?q=taxe'

It’s only the first release so many things to add again and many tests to
do…

Please feel free to contribute as a tester or a developer…

Hope this could help someone !

David

http://twitter.com/dadoonet


(Shay Banon) #3

Hi David, looks great. Way back when I needed to do some RSS, and used Rome
which is supposed to handle all kind of formats and the like, might simplify
the code?: http://java.net/projects/rome/.

On Wed, Sep 14, 2011 at 11:05 PM, David Pilato david@pilato.fr wrote:

Hi all,****



I’m happy to share with the ES community my first Elastic Search plugin
release : RSS River 0.0.1.****


As you could imagine, RSS river plugin gets RSS feed and index some few
fields such as title and description.****


A short documentation is available :
https://github.com/dadoonet/rssriver/blob/master/README.textile****

Project is here : https://github.com/dadoonet/rssriver****


To use it :****

1) Install plugin

2) Create index for rss feed

3) Create RSSRiver

4) Start searching…

$ bin\plugin -install dadoonet/rssriver/0.0.1****

$ curl -XPUT 'http://localhost:9200/lemonde/' -d '{}'****

$ curl -XPUT 'http://localhost:9200/_river/lemonde/_meta' -d '{****

"type": "rss",****

"rss": {****

"url": "http://www.lemonde.fr/rss/une.xml"****

}****

}'****

$ curl –XGET 'http://localhost:9200/lemonde/_search?q=taxe'****

It’s only the first release so many things to add again and many tests to
do…****


Please feel free to contribute as a tester or a developer…****


Hope this could help someone !****


David****

http://twitter.com/dadoonet****



(David Pilato) #4

That was a very good advice

New version 0.0.2 is now out with Rome. It opens many new perspectives and
make the RSS River plugin stronger

Thanks Shay !

De : elasticsearch@googlegroups.com [mailto:elasticsearch@googlegroups.com]
De la part de Shay Banon
Envoyé : jeudi 15 septembre 2011 11:30
À : elasticsearch@googlegroups.com
Objet : Re: [ANN] RSS River Plugin

Hi David, looks great. Way back when I needed to do some RSS, and used Rome
which is supposed to handle all kind of formats and the like, might simplify
the code?: http://java.net/projects/rome/.


(system) #5