Indexing RabbitMQ queues


(lyes zaiko) #1

Hello all!

Is there any documentation about how to index data contained in a
RabbitMQ Queue?

thanks


(Damien Hardy) #2

2011/10/31 lyes zaiko lyesjob@gmail.com

Hello all!

Is there any documentation about how to index data contained in a
RabbitMQ Queue?

thanks

Hello,

Yes there is :
http://www.elasticsearch.org/guide/reference/river/rabbitmq.html
But ES cannot yet subscribe to active-active HA queue (instroduced in
RabbitMQ 2.6)

Best regards,

--
Damien


(lyes zaiko) #3

Thank you for the quick reply
I'll check with it

On Oct 31, 12:10 pm, Damien Hardy damienhardy....@gmail.com wrote:

2011/10/31 lyes zaiko lyes...@gmail.com

Hello all!

Is there any documentation about how to index data contained in a
RabbitMQ Queue?

thanks

Hello,

Yes there is :http://www.elasticsearch.org/guide/reference/river/rabbitmq.html
But ES cannot yet subscribe to active-active HA queue (instroduced in
RabbitMQ 2.6)

Best regards,

--
Damien


(Shay Banon) #4

Heya Demian, what needs to be done in ES to support active active
registration?

On Mon, Oct 31, 2011 at 1:10 PM, Damien Hardy damienhardy.bal@gmail.comwrote:

2011/10/31 lyes zaiko lyesjob@gmail.com

Hello all!

Is there any documentation about how to index data contained in a
RabbitMQ Queue?

thanks

Hello,

Yes there is :
http://www.elasticsearch.org/guide/reference/river/rabbitmq.html
But ES cannot yet subscribe to active-active HA queue (instroduced in
RabbitMQ 2.6)

Best regards,

--
Damien


(Damien Hardy) #5

Hi Shay,

We have done some tests pre-creating the queue withe mirror
fonctionnality on a 2 ndes RMQ clusters via the web interface and
tried to configure ES as consumer and it fails.

According to http://www.rabbitmq.com/ha.html We suppose an HashMap {"x-
ha-policy": "all"} should be added instead of null at
https://github.com/elasticsearch/elasticsearch/blob/master/plugins/river/rabbitmq/src/main/java/org/elasticsearch/river/rabbitmq/RabbitmqRiver.java#L183

ES river config should be also complexified by adding a lists of RMQ
nodes of replication.

It could be also an opportunity to upgrade the client version.

We planned to do some gitpull on this subjet when some others stuff
are over (some dead lines are coming :slight_smile:

Thank you,

--
Damien

On 31 oct, 18:35, Shay Banon kim...@gmail.com wrote:

Heya Demian, what needs to be done in ES to support active active
registration?

On Mon, Oct 31, 2011 at 1:10 PM, Damien Hardy damienhardy....@gmail.comwrote:

2011/10/31 lyes zaiko lyes...@gmail.com

Hello all!

Is there any documentation about how to index data contained in a
RabbitMQ Queue?

thanks

Hello,

Yes there is :
http://www.elasticsearch.org/guide/reference/river/rabbitmq.html
But ES cannot yet subscribe to active-active HA queue (instroduced in
RabbitMQ 2.6)

Best regards,

--
Damien


(Rohit Raghuvanshi) #6

Link is not active


(Isabel Drost-Fromm) #7

Assuming you are currently looking for a solution to the same problem: And the suggested solution isn't valid anymore as Rivers have long since been deprecated/ removed.

Instead you might want to checkout Logstash:

https://www.elastic.co/guide/en/logstash/current/plugins-inputs-rabbitmq.html

Hope this helps,
Isabel


(system) #8