Filter on replication of data from couchbase to Elasticsearch

Elastic Stack Elasticsearch
1

Hi all,

I need help to understand if we can set up a filter on keys of couchbase
data to replicate into Elasticsearch while setting up a river.

Reason being is- I want only a set of keys to get replicated in
ElasticSearch not the complete bucket of couchbase.

Currently I am using couchbase 1.8.1 . I believe i have to upgrade it to
2.0 .

Appreciate your insights and help.

Thanks ,
Deepak

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

2

I assume you are talking about couch base transport plugin and not about a river, don't you?

I'm afraid that you can't have by now a way to filter it.
I think you should add an issue here: GitHub - couchbase/couchbase-elasticsearch-connector: The Official Couchbase Elasticsearch Connector

--
David Pilato | Technical Advocate | Elasticsearch.com
@dadoonet | @elasticsearchfr | @scrutmydocs

Le 8 avr. 2013 à 10:15, Deepak Diwakar deepak.diwakar@mindtickle.com a écrit :

Hi all,

I need help to understand if we can set up a filter on keys of couchbase data to replicate into Elasticsearch while setting up a river.

Reason being is- I want only a set of keys to get replicated in Elasticsearch not the complete bucket of couchbase.

Currently I am using couchbase 1.8.1 . I believe i have to upgrade it to 2.0 .

Appreciate your insights and help.

Thanks ,
Deepak

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

3

Sounds like we did not answer to the mailing list…
Posting our last exchange here.

Cheers

David Pilato | Technical Advocate | Elasticsearch.com
@dadoonet | @elasticsearchfr | @scrutmydocs

Le 8 avr. 2013 à 18:05, Deepak Diwakar deepak.diwakar@mindtickle.com a écrit :

Great! Thanks again David. This is helpful. I was exploring on the same line.

Regards,
Deepak Diwakar,

On Mon, Apr 8, 2013 at 6:18 PM, David Pilato david@pilato.fr wrote:
I think you can probably build your own ETL:
Get all documents from couchbase (based on a view for example). See Couchbase API depending on your language
For each document, add it to a bulk request: Elasticsearch Platform — Find real-time answers at scale | Elastic
Index the bulk every xxx docs
HTH
Regards

--
David Pilato | Technical Advocate | Elasticsearch.com
@dadoonet | @elasticsearchfr | @scrutmydocs

Le 8 avr. 2013 à 11:39, Deepak Diwakar deepak.diwakar@mindtickle.com a écrit :

Thanks David for the prompt response.

Yes , I was referring to the transport plugin. I see there is a river also in implementation but in experimental mode(GitHub - mschoch/elasticsearch-river-couchbase: An ElasticSearch River for Couchbase)

Is there any pull approach available to handle the case?

Thanks again.
-Deepak

On Monday, 8 April 2013 13:57:31 UTC+5:30, David Pilato wrote:
I assume you are talking about couch base transport plugin and not about a river, don't you?

I'm afraid that you can't have by now a way to filter it.
I think you should add an issue here: GitHub - couchbase/couchbase-elasticsearch-connector: The Official Couchbase Elasticsearch Connector

--
David Pilato | Technical Advocate | Elasticsearch.com
@dadoonet | @elasticsearchfr | @scrutmydocs

Le 8 avr. 2013 à 10:15, Deepak Diwakar deepak....@mindtickle.com a écrit :

Hi all,

I need help to understand if we can set up a filter on keys of couchbase data to replicate into Elasticsearch while setting up a river.

Reason being is- I want only a set of keys to get replicated in Elasticsearch not the complete bucket of couchbase.

Currently I am using couchbase 1.8.1 . I believe i have to upgrade it to 2.0 .

Appreciate your insights and help.

Thanks ,
Deepak

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearc...@googlegroups.com.

For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.