ActiveMQ River?


(Stephen-2) #1

Hey guys,

My company is interested in implementing ElasticSearch for a fairly
large dataset, and things would be much easier if we could publish
messages to an ActiveMQ (since we're using Enterprise Java) that ES
would listen on.

Do folks have an idea of how hard it would be to implement this
plugin? We may be willing to provide some development time, but a
rough idea of complexity would help our planning process.

Thanks a bunch!

Stephen Starkey.


(Shay Banon) #2

I would suggest having a look at the RabbitMQ river plugin, its pretty
simple, and adapting it to ActiveMQ. Once the code is there, we can help
with making it an official plugin.

On Thu, Oct 14, 2010 at 6:12 PM, Stephen scstarkey@gmail.com wrote:

Hey guys,

My company is interested in implementing ElasticSearch for a fairly
large dataset, and things would be much easier if we could publish
messages to an ActiveMQ (since we're using Enterprise Java) that ES
would listen on.

Do folks have an idea of how hard it would be to implement this
plugin? We may be willing to provide some development time, but a
rough idea of complexity would help our planning process.

Thanks a bunch!

Stephen Starkey.


(Mahendra M) #3

Hi,

My experience with JMS is very limited, so my reply may be fully wrong.

ElasticSearch has a RabbitMQ (AMQP) river plugin. JMS is pretty
similar to AMQP. So, you can write a new river plugin for JMS by using
the RabbitMQ river plugin as a reference. I believe it may not be too
tough to do, specially if you are an expert in JMS.

A slightly less attractive alternative would be to use an AMQP/JMS
bridge in between - http://github.com/imatix/openamq-jms (this works
with RabbitMQ, but with AMQP spec 0.8.x and not 0.9-1)

Regards,
Mahendra

On Thu, Oct 14, 2010 at 9:42 PM, Stephen scstarkey@gmail.com wrote:

Hey guys,

My company is interested in implementing ElasticSearch for a fairly
large dataset, and things would be much easier if we could publish
messages to an ActiveMQ (since we're using Enterprise Java) that ES
would listen on.

Do folks have an idea of how hard it would be to implement this
plugin? We may be willing to provide some development time, but a
rough idea of complexity would help our planning process.

Thanks a bunch!

Stephen Starkey.

--
Mahendra

http://twitter.com/mahendra


(Stephen-2) #4

Thanks! We'll take a look when we start planning the project.

On Oct 14, 11:40 am, Mahendra M mahendr...@gmail.com wrote:

Hi,

My experience with JMS is very limited, so my reply may be fully wrong.

ElasticSearch has a RabbitMQ (AMQP) river plugin. JMS is pretty
similar to AMQP. So, you can write a new river plugin for JMS by using
the RabbitMQ river plugin as a reference. I believe it may not be too
tough to do, specially if you are an expert in JMS.

A slightly less attractive alternative would be to use an AMQP/JMS
bridge in between -http://github.com/imatix/openamq-jms(this works
with RabbitMQ, but with AMQP spec 0.8.x and not 0.9-1)

Regards,
Mahendra

On Thu, Oct 14, 2010 at 9:42 PM, Stephen scstar...@gmail.com wrote:

Hey guys,

My company is interested in implementing ElasticSearch for a fairly
large dataset, and things would be much easier if we could publish
messages to an ActiveMQ (since we're using Enterprise Java) that ES
would listen on.

Do folks have an idea of how hard it would be to implement this
plugin? We may be willing to provide some development time, but a
rough idea of complexity would help our planning process.

Thanks a bunch!

Stephen Starkey.

--
Mahendra

http://twitter.com/mahendra


(system) #5