Indexing a CouchDB view with ElasticSearch

Elastic Stack Elasticsearch
1

Using the CouchDB river, it is possible to index CouchDB databases. Is
it also possible to index a CouchDB view with Elastic Search?

I have been informed about the existence of this feature:

Is this the way to go. Is this making it up to trunk?

Thanks,

2

Hi Daniel,

Shay is waiting for a new commit for this pull request that will make view
management a bit more efficient.
But, for this commit, I'm waiting for the feature request to be implemented
: Query DSL: Add ids_prefix query and filter to fetch docs by prefix ids · Issue #1259 · elastic/elasticsearch · GitHub

So, the pull request will not be in trunk soon.

BTW, you can clone this :
https://github.com/dadoonet/elasticsearch-river-couchdb/tree/dpi_views ,
build it, install it as a plugin and play with views.
Documentation to use it is here :
Add support for views by dadoonet · Pull Request #2 · elastic/elasticsearch-river-couchdb · GitHub

I will be pleased to have a feedback on it.

Cheers
David.

-----Message d'origine-----
De : elasticsearch@googlegroups.com
[mailto:elasticsearch@googlegroups.com] De la part de Daniel Gonzalez
Envoyé : jeudi 26 janvier 2012 10:26
À : elasticsearch
Objet : Indexing a CouchDB view with Elasticsearch

Using the CouchDB river, it is possible to index CouchDB databases. Is
it also possible to index a CouchDB view with Elastic Search?

I have been informed about the existence of this feature:

Add support for views by dadoonet · Pull Request #2 · elastic/elasticsearch-river-couchdb · GitHub

Is this the way to go. Is this making it up to trunk?

Thanks,

3

David, I will work on this issue, will try and make it into 0.19.

On Thursday, January 26, 2012 at 10:56 PM, David Pilato wrote:

Hi Daniel,

Shay is waiting for a new commit for this pull request that will make view
management a bit more efficient.
But, for this commit, I'm waiting for the feature request to be implemented
: Query DSL: Add ids_prefix query and filter to fetch docs by prefix ids · Issue #1259 · elastic/elasticsearch · GitHub

So, the pull request will not be in trunk soon.

BTW, you can clone this :
https://github.com/dadoonet/elasticsearch-river-couchdb/tree/dpi_views ,
build it, install it as a plugin and play with views.
Documentation to use it is here :
Add support for views by dadoonet · Pull Request #2 · elastic/elasticsearch-river-couchdb · GitHub

I will be pleased to have a feedback on it.

Cheers
David.

-----Message d'origine-----
De : elasticsearch@googlegroups.com (mailto:elasticsearch@googlegroups.com)
[mailto:elasticsearch@googlegroups.com] De la part de Daniel Gonzalez
Envoyé : jeudi 26 janvier 2012 10:26
À : elasticsearch
Objet : Indexing a CouchDB view with Elasticsearch

Using the CouchDB river, it is possible to index CouchDB databases. Is
it also possible to index a CouchDB view with Elastic Search?

I have been informed about the existence of this feature:

Add support for views by dadoonet · Pull Request #2 · elastic/elasticsearch-river-couchdb · GitHub

Is this the way to go. Is this making it up to trunk?

Thanks,

4

Shay,

Is there a list of what to expect in 0.19? I looked at the Github issues
but didn't see how to get a list of items being worked. Thanks,
--Mike

On Fri, Jan 27, 2012 at 3:50 PM, Shay Banon kimchy@gmail.com wrote:

David, I will work on this issue, will try and make it into 0.19.

On Thursday, January 26, 2012 at 10:56 PM, David Pilato wrote:

Hi Daniel,

Shay is waiting for a new commit for this pull request that will make view
management a bit more efficient.
But, for this commit, I'm waiting for the feature request to be implemented
: Query DSL: Add ids_prefix query and filter to fetch docs by prefix ids · Issue #1259 · elastic/elasticsearch · GitHub

So, the pull request will not be in trunk soon.

BTW, you can clone this :
https://github.com/dadoonet/elasticsearch-river-couchdb/tree/dpi_views ,
build it, install it as a plugin and play with views.
Documentation to use it is here :
Add support for views by dadoonet · Pull Request #2 · elastic/elasticsearch-river-couchdb · GitHub

I will be pleased to have a feedback on it.

Cheers
David.

-----Message d'origine-----
De : elasticsearch@googlegroups.com
[mailto:elasticsearch@googlegroups.com elasticsearch@googlegroups.com]
De la part de Daniel Gonzalez
Envoyé : jeudi 26 janvier 2012 10:26
À : elasticsearch
Objet : Indexing a CouchDB view with Elasticsearch

Using the CouchDB river, it is possible to index CouchDB databases. Is
it also possible to index a CouchDB view with Elastic Search?

I have been informed about the existence of this feature:

Add support for views by dadoonet · Pull Request #2 · elastic/elasticsearch-river-couchdb · GitHub

Is this the way to go. Is this making it up to trunk?

Thanks,

5

Basically, 0.19 main features are done, anything additional is a "nice to have".

On Friday, January 27, 2012 at 10:53 PM, Michael Sick wrote:

Shay,

Is there a list of what to expect in 0.19? I looked at the Github issues but didn't see how to get a list of items being worked. Thanks,
--Mike

On Fri, Jan 27, 2012 at 3:50 PM, Shay Banon <kimchy@gmail.com (mailto:kimchy@gmail.com)> wrote:

David, I will work on this issue, will try and make it into 0.19.

On Thursday, January 26, 2012 at 10:56 PM, David Pilato wrote:

Hi Daniel,

Shay is waiting for a new commit for this pull request that will make view
management a bit more efficient.
But, for this commit, I'm waiting for the feature request to be implemented
: Query DSL: Add ids_prefix query and filter to fetch docs by prefix ids · Issue #1259 · elastic/elasticsearch · GitHub

So, the pull request will not be in trunk soon.

BTW, you can clone this :
https://github.com/dadoonet/elasticsearch-river-couchdb/tree/dpi_views ,
build it, install it as a plugin and play with views.
Documentation to use it is here :
Add support for views by dadoonet · Pull Request #2 · elastic/elasticsearch-river-couchdb · GitHub

I will be pleased to have a feedback on it.

Cheers
David.

-----Message d'origine-----
De : elasticsearch@googlegroups.com (mailto:elasticsearch@googlegroups.com)
[mailto:elasticsearch@googlegroups.com] De la part de Daniel Gonzalez
Envoyé : jeudi 26 janvier 2012 10:26
À : elasticsearch
Objet : Indexing a CouchDB view with Elasticsearch

Using the CouchDB river, it is possible to index CouchDB databases. Is
it also possible to index a CouchDB view with Elastic Search?

I have been informed about the existence of this feature:

Add support for views by dadoonet · Pull Request #2 · elastic/elasticsearch-river-couchdb · GitHub

Is this the way to go. Is this making it up to trunk?

Thanks,

6

Thanks Shay.

David
@dadoonet

Le 27 janv. 2012 à 21:50, Shay Banon kimchy@gmail.com a écrit :

David, I will work on this issue, will try and make it into 0.19.
On Thursday, January 26, 2012 at 10:56 PM, David Pilato wrote:

Hi Daniel,

Shay is waiting for a new commit for this pull request that will make view
management a bit more efficient.
But, for this commit, I'm waiting for the feature request to be implemented
: Query DSL: Add ids_prefix query and filter to fetch docs by prefix ids · Issue #1259 · elastic/elasticsearch · GitHub

So, the pull request will not be in trunk soon.

BTW, you can clone this :
https://github.com/dadoonet/elasticsearch-river-couchdb/tree/dpi_views ,
build it, install it as a plugin and play with views.
Documentation to use it is here :
Add support for views by dadoonet · Pull Request #2 · elastic/elasticsearch-river-couchdb · GitHub

I will be pleased to have a feedback on it.

Cheers
David.

-----Message d'origine-----
De : elasticsearch@googlegroups.com
[mailto:elasticsearch@googlegroups.com] De la part de Daniel Gonzalez
Envoyé : jeudi 26 janvier 2012 10:26
À : elasticsearch
Objet : Indexing a CouchDB view with Elasticsearch

Using the CouchDB river, it is possible to index CouchDB databases. Is
it also possible to index a CouchDB view with Elastic Search?

I have been informed about the existence of this feature:

Add support for views by dadoonet · Pull Request #2 · elastic/elasticsearch-river-couchdb · GitHub

Is this the way to go. Is this making it up to trunk?

Thanks,

7

Hi there Shay,
I think there's great merit in this feature.

It's an effective way of reducing the volume of data travelling across
the wire. A CouchDb may contain a lot of data that isn't of value to
ES, but a custom view could expose just the searchable metadata -
reducing in better network and indexing efficiency.

The alternative solution of specifying a filter in the river appears
to only handle cases where the metadata fields are know in advance.

cheers,
Ian

On Jan 27, 8:50 pm, Shay Banon kim...@gmail.com wrote:

David, I will work on this issue, will try and make it into 0.19.