Sync with a DB


(Adam Estrada) #1

All,

I have traditionally, gone from a RDBMS to ES. Now, I am using one of the
_rivers and would like to go the other direction. I would like to create a
service that basically listens for new content to insert in to the index
and then replicate it in to Postgresql. I have my reasons why I have to do
this. Anyway, has anyone taken a stab at this before? Can you share your
experience and/or code with me?

Thanks,
Adam


(Thomas Peuss) #2

Hi Adam!

Am Mittwoch, 28. März 2012 00:16:06 UTC+2 schrieb Adam Estrada:

All,

I have traditionally, gone from a RDBMS to ES. Now, I am using one of the
_rivers and would like to go the other direction. I would like to create a
service that basically listens for new content to insert in to the index
and then replicate it in to Postgresql. I have my reasons why I have to do
this. Anyway, has anyone taken a stab at this before? Can you share your
experience and/or code with me?

I am working on a plugin
(https://github.com/derryx/elasticsearch-changes-plugin) that provides that
type of information. It is not finished yet. But you might get an idea how
to extract that type of information. We use a similar approach to feed
information into a CEP (complex event processing) system.

CU
Thomas


(Adam Estrada) #3

Brilliant! This is exactly what I had in mind! We'll take a look at it and
get back to you with any feedback we might have.

Adam

On Wed, Mar 28, 2012 at 3:04 AM, Thomas Peuss thomas.peuss@nterra.comwrote:

Hi Adam!

Am Mittwoch, 28. März 2012 00:16:06 UTC+2 schrieb Adam Estrada:

All,

I have traditionally, gone from a RDBMS to ES. Now, I am using one of the
_rivers and would like to go the other direction. I would like to create a
service that basically listens for new content to insert in to the index
and then replicate it in to Postgresql. I have my reasons why I have to do
this. Anyway, has anyone taken a stab at this before? Can you share your
experience and/or code with me?

I am working on a plugin (
https://github.com/derryx/elasticsearch-changes-plugin) that provides
that type of information. It is not finished yet. But you might get an idea
how to extract that type of information. We use a similar approach to feed
information into a CEP (complex event processing) system.

CU
Thomas


(system) #4