Elasticsearch as replicator of CouchDB


(Son Phan) #1

Hi all,

I'm working on one project where we need to sync up data from couchdb to elasticsearch.
I know that we already had river to do that before. But currently river has been deprecated.
I'm using logstash to resolve but I need to find out the solution which is the same CouchBase Plugin.
Could you please help me to provide me with your solution.

Thank you so much!


(David Pilato) #2

You mean couchbase or couchdb?


(Son Phan) #3

Hi,

I mean CouchDB. How can i sync up data from couchdb to my elasticsearch without logstash.

Thank you so much!


(Christian Dahlqvist) #4

As Elasticsearch can not read directly from CouchDB, I suspect you will need an external component. There may be other tools than Logstash that allow for this, but I am not familiar with CouchDB so can not point to any. You can naturally also build your own integration using one of the language clients. Why do you not want to use Logstash?


(Son Phan) #5

Thank you so much Christian Dahlqvist.

As you know, I'm trying to find the solution to resolve our problem(CouchDB) as before we did with CouchBase.


(Christian Dahlqvist) #6

I suspect the easiest way to do this would be to use Logstash as rivers are no longer available.


(David Pilato) #7

CouchBase and CouchDB have totally different approach:

  • CouchBase uses a replication system to PUSH data from couchbase to elasticsearch using XDCR.
  • CouchDB provides a _changes API which can be used by a ETL to pull changes from CouchDB.

The way to replace couchdb River is by using couchdb input for logstash.
AFAIK you don't have such a XDCR thing in couchDB.


(Son Phan) #8

Thank you so much!


(system) #9

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.