ElasticSearch, RSS and `_mapping` requirement?

I want to store RSS feeds in a searchable ElasticSearch store.

Using RSSRiver http://www.pilato.fr/rssriver, I am confused as to what
they want:

Do they require a /_mapping and a /_meta?

So given a nested RSS feed like this one http://venturebeat.com/feed, is
the approach to write a script to generate /_mapping or should it just work?

Here's what I tried, but the server didn't seem to download anything ::

es.put('venture_beat/_meta',
data={"type": "rss",
"rss": {"feeds": [{"name": "venturebeat",
"url" : "http://venturebeat.com/feed/"}]}})

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

Documentation is more complete here: https://github.com/dadoonet/rssriver
You need to create a _meta document in a specific index _river.

$ curl -XPUT 'localhost:9200/_river/lemonde/_meta' -d '{ "type": "rss", "rss": { "feeds" : [ { "name": "lemonde", "url": "http://www.lemonde.fr/rss/une.xml" } ] } }'
Don't forget _river index name.

HTH

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 28 juil. 2013 à 08:47, Nev Ada nevada.over9000@gmail.com a écrit :

I want to store RSS feeds in a searchable ElasticSearch store.

Using RSSRiver, I am confused as to what they want:

Do they require a /_mapping and a /_meta?

So given a nested RSS feed like this one, is the approach to write a script to generate /_mapping or should it just work?

Here's what I tried, but the server didn't seem to download anything ::

es.put('venture_beat/_meta',
data={"type": "rss",
"rss": {"feeds": [{"name": "venturebeat",
"url" : "http://venturebeat.com/feed/"}]}})

You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

Thanks

On Sunday, July 28, 2013 5:34:05 PM UTC+10, David Pilato wrote:

Documentation is more complete here: https://github.com/dadoonet/rssriver
You need to create a _meta document in a specific index _river.

$ curl -XPUT 'localhost:9200/_river/lemonde/_meta' -d '{ "type": "rss", "rss": { "feeds" : [ { "name": "lemonde", "url": "http://www.lemonde.fr/rss/une.xml" } ] }}'

Don't forget _river index name.

HTH

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 28 juil. 2013 à 08:47, Nev Ada <nevada....@gmail.com <javascript:>> a
écrit :

I want to store RSS feeds in a searchable ElasticSearch store.

Using RSSRiver http://www.pilato.fr/rssriver, I am confused as to what
they want:

Do they require a /_mapping and a /_meta?

So given a nested RSS feed like this one http://venturebeat.com/feed,
is the approach to write a script to generate /_mapping or should it just
work?

Here's what I tried, but the server didn't seem to download anything ::

es.put('venture_beat/_meta',
data={"type": "rss",
"rss": {"feeds": [{"name": "venturebeat",
"url" : "http://venturebeat.com/feed/"}]}})

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com <javascript:>.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

I have uploaded a video for RSS river mapping, indexing and searching
example; you can watch it here http://www.youtube.com/watch?v=JaX70FpEkAA
It is only visual no audio.

thanks & regards,
surya

On Sunday, July 28, 2013 12:17:15 PM UTC+5:30, Nev Ada wrote:

I want to store RSS feeds in a searchable ElasticSearch store.

Using RSSRiver http://www.pilato.fr/rssriver, I am confused as to what
they want:

Do they require a /_mapping and a /_meta?

So given a nested RSS feed like this one http://venturebeat.com/feed,
is the approach to write a script to generate /_mapping or should it just
work?

Here's what I tried, but the server didn't seem to download anything ::

es.put('venture_beat/_meta',
data={"type": "rss",
"rss": {"feeds": [{"name": "venturebeat",
"url" : "http://venturebeat.com/feed/"}]}})

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

We could add your video to RSS River page:


Or

What do you think? Open a pull request?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 29 juil. 2013 à 06:43, Kumar Surya Mani ksuryamani@gmail.com a écrit :

I have uploaded a video for RSS river mapping, indexing and searching example; you can watch it here http://www.youtube.com/watch?v=JaX70FpEkAA
It is only visual no audio.

thanks & regards,
surya

On Sunday, July 28, 2013 12:17:15 PM UTC+5:30, Nev Ada wrote:

I want to store RSS feeds in a searchable ElasticSearch store.

Using RSSRiver, I am confused as to what they want:

Do they require a /_mapping and a /_meta?

So given a nested RSS feed like this one, is the approach to write a script to generate /_mapping or should it just work?

Here's what I tried, but the server didn't seem to download anything ::

es.put('venture_beat/_meta',
data={"type": "rss",
"rss": {"feeds": [{"name": "venturebeat",
"url" : "http://venturebeat.com/feed/"}]}})
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

Hi David,

It sounds interesting; I would love it to be added to RSS River however I
don't know whether you had a chance to look into that.

thanks & regards,
surya

On Mon, Jul 29, 2013 at 11:47 AM, David Pilato david@pilato.fr wrote:

We could add your video to RSS River page:
https://github.com/dadoonet/rssriver/blob/gh-pages/index.html
Or
https://github.com/dadoonet/rssriver/blob/master/README.md

What do you think? Open a pull request?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 29 juil. 2013 à 06:43, Kumar Surya Mani ksuryamani@gmail.com a
écrit :

I have uploaded a video for RSS river mapping, indexing and searching
example; you can watch it here
http://www.youtube.com/watch?v=JaX70FpEkAA
It is only visual no audio.

thanks & regards,
surya

On Sunday, July 28, 2013 12:17:15 PM UTC+5:30, Nev Ada wrote:

I want to store RSS feeds in a searchable ElasticSearch store.

Using RSSRiver http://www.pilato.fr/rssriver, I am confused as to what
they want:

Do they require a /_mapping and a /_meta?

So given a nested RSS feed like this one http://venturebeat.com/feed,
is the approach to write a script to generate /_mapping or should it
just work?

Here's what I tried, but the server didn't seem to download anything ::

es.put('venture_beat/_meta',
data={"type": "rss",
"rss": {"feeds": [{"name": "venturebeat",
"url" : "http://venturebeat.com/feed/"**}]}})

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.

For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/iBAjQ-jvbMA/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
Warms n Regards,
Kumar Surya Mani

  **They conquer who believe they can. - John Dryden

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

I did look at the video. What do you mean?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 29 juil. 2013 à 08:32, Kumar Surya Mani ksuryamani@gmail.com a écrit :

Hi David,

It sounds interesting; I would love it to be added to RSS River however I don't know whether you had a chance to look into that.

thanks & regards,
surya

On Mon, Jul 29, 2013 at 11:47 AM, David Pilato david@pilato.fr wrote:

We could add your video to RSS River page:
https://github.com/dadoonet/rssriver/blob/gh-pages/index.html
Or
https://github.com/dadoonet/rssriver/blob/master/README.md

What do you think? Open a pull request?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 29 juil. 2013 à 06:43, Kumar Surya Mani ksuryamani@gmail.com a écrit :

I have uploaded a video for RSS river mapping, indexing and searching example; you can watch it here http://www.youtube.com/watch?v=JaX70FpEkAA
It is only visual no audio.

thanks & regards,
surya

On Sunday, July 28, 2013 12:17:15 PM UTC+5:30, Nev Ada wrote:

I want to store RSS feeds in a searchable ElasticSearch store.

Using RSSRiver, I am confused as to what they want:

Do they require a /_mapping and a /_meta?

So given a nested RSS feed like this one, is the approach to write a script to generate /_mapping or should it just work?

Here's what I tried, but the server didn't seem to download anything ::

es.put('venture_beat/_meta',
data={"type": "rss",
"rss": {"feeds": [{"name": "venturebeat",
"url" : "http://venturebeat.com/feed/"}]}})
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.

For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to a topic in the Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/elasticsearch/iBAjQ-jvbMA/unsubscribe.
To unsubscribe from this group and all its topics, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
Warms n Regards,
Kumar Surya Mani

  **They conquer who believe they can. - John Dryden

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

David,
I simply meant whether it had required information or not in the video for
somebody to start, I was just curious after seeing comments from you.
Thank you so much for your time to look in that.

On Mon, Jul 29, 2013 at 12:07 PM, David Pilato david@pilato.fr wrote:

I did look at the video. What do you mean?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 29 juil. 2013 à 08:32, Kumar Surya Mani ksuryamani@gmail.com a
écrit :

Hi David,

It sounds interesting; I would love it to be added to RSS River however I
don't know whether you had a chance to look into that.

thanks & regards,
surya

On Mon, Jul 29, 2013 at 11:47 AM, David Pilato david@pilato.fr wrote:

We could add your video to RSS River page:
https://github.com/dadoonet/rssriver/blob/gh-pages/index.html
Or
https://github.com/dadoonet/rssriver/blob/master/README.md

What do you think? Open a pull request?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 29 juil. 2013 à 06:43, Kumar Surya Mani ksuryamani@gmail.com a
écrit :

I have uploaded a video for RSS river mapping, indexing and searching
example; you can watch it here
http://www.youtube.com/watch?v=JaX70FpEkAA
It is only visual no audio.

thanks & regards,
surya

On Sunday, July 28, 2013 12:17:15 PM UTC+5:30, Nev Ada wrote:

I want to store RSS feeds in a searchable ElasticSearch store.

Using RSSRiver http://www.pilato.fr/rssriver, I am confused as to
what they want:

Do they require a /_mapping and a /_meta?

So given a nested RSS feed like this one http://venturebeat.com/feed,
is the approach to write a script to generate /_mapping or should it
just work?

Here's what I tried, but the server didn't seem to download anything ::

es.put('venture_beat/_meta',
data={"type": "rss",
"rss": {"feeds": [{"name": "venturebeat",
"url" : "http://venturebeat.com/feed/"**}]}})

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.

For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/iBAjQ-jvbMA/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
Warms n Regards,
Kumar Surya Mani

  **They conquer who believe they can. - John Dryden

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/iBAjQ-jvbMA/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
Warms n Regards,
Kumar Surya Mani

  **They conquer who believe they can. - John Dryden

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

It's a good tutorial IMHO. It could help others.

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 29 juil. 2013 à 08:47, Kumar Surya Mani ksuryamani@gmail.com a écrit :

David,
I simply meant whether it had required information or not in the video for somebody to start, I was just curious after seeing comments from you.
Thank you so much for your time to look in that.

On Mon, Jul 29, 2013 at 12:07 PM, David Pilato david@pilato.fr wrote:

I did look at the video. What do you mean?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 29 juil. 2013 à 08:32, Kumar Surya Mani ksuryamani@gmail.com a écrit :

Hi David,

It sounds interesting; I would love it to be added to RSS River however I don't know whether you had a chance to look into that.

thanks & regards,
surya

On Mon, Jul 29, 2013 at 11:47 AM, David Pilato david@pilato.fr wrote:

We could add your video to RSS River page:
https://github.com/dadoonet/rssriver/blob/gh-pages/index.html
Or
https://github.com/dadoonet/rssriver/blob/master/README.md

What do you think? Open a pull request?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 29 juil. 2013 à 06:43, Kumar Surya Mani ksuryamani@gmail.com a écrit :

I have uploaded a video for RSS river mapping, indexing and searching example; you can watch it here http://www.youtube.com/watch?v=JaX70FpEkAA
It is only visual no audio.

thanks & regards,
surya

On Sunday, July 28, 2013 12:17:15 PM UTC+5:30, Nev Ada wrote:

I want to store RSS feeds in a searchable ElasticSearch store.

Using RSSRiver, I am confused as to what they want:

Do they require a /_mapping and a /_meta?

So given a nested RSS feed like this one, is the approach to write a script to generate /_mapping or should it just work?

Here's what I tried, but the server didn't seem to download anything ::

es.put('venture_beat/_meta',
data={"type": "rss",
"rss": {"feeds": [{"name": "venturebeat",
"url" : "http://venturebeat.com/feed/"}]}})
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.

For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to a topic in the Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/elasticsearch/iBAjQ-jvbMA/unsubscribe.
To unsubscribe from this group and all its topics, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
Warms n Regards,
Kumar Surya Mani

  **They conquer who believe they can. - John Dryden

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to a topic in the Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/elasticsearch/iBAjQ-jvbMA/unsubscribe.
To unsubscribe from this group and all its topics, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
Warms n Regards,
Kumar Surya Mani

  **They conquer who believe they can. - John Dryden

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.