River plugin just run in one node

Elastic Stack Elasticsearch
1

I have 10 ES servers

one of them is master server ,others connect to it

here is the slave configuration
discovery.zen.ping.unicast.hosts: [10.165.4.160]

for master configuration
#discovery.zen.ping.unicast.hosts: []

other configurations is all default value

I init river in every server:

curl -XPUT 'localhost:9200/_river/test/_meta' -d '{"type" : "kafka","kafka"
: {"zk.connect" : "127.0.0.1:2181","topic":"log"},"index" : {"bulk_size" :
100}}'

there is just one consumer thread running on one single server,and kafka
partition is 10,So when I create 10 rivers in each of servers, all of 10
consumer should run in server

But just master node consume messages from kafka...

Please help me

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

2

I execute this command in each od server

curl -XPUT 'localhost:9200/_river/test/_meta' -d '{"type" :
"kafka","kafka" : {"zk.connect" : "127.0.0.1:2181","topic":"log"},"index"
: {"bulk_size" : 100}}'

then I execute
curl -XGET 'localhost:9200/_river/es/_status'
the resut is :
{"_index":"_river","_type":"es","_id":"_status","_version":1,"exists":true,
"_source" :
{"ok":true,"node":{"id":"i9C1lDB9RMKdXw-6osH1Yg","name":"Frey","transport_address":"inet[/10.165.4.160:9300]"}}}

10.165.4.160 is master ip.
how can I create 10 rive(consumer) in this cluster

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

3

By design, there's only one river instance running per cluster.
There is a replica of the river in case of node failure: another node will relaunch the river. But the replica is not running.

That said, you could ask for an option in rivers to have more than one instance running in the cluster.
I did not look at the river source code and don't know yet if we can do it or not. Open an issue?

--
David Pilato | Technical Advocate | Elasticsearch.com
@dadoonet | @elasticsearchfr | @scrutmydocs

Le 22 mars 2013 à 07:06, 田晓亮 xiaoliang.tian@gmail.com a écrit :

I execute this command in each od server

curl -XPUT 'localhost:9200/_river/test/_meta' -d '{"type" : "kafka","kafka" : {"zk.connect" : "127.0.0.1:2181","topic":"log"},"index" : {"bulk_size" : 100}}'

then I execute
curl -XGET 'localhost:9200/_river/es/_status'
the resut is :
{"_index":"_river","_type":"es","_id":"_status","_version":1,"exists":true, "_source" : {"ok":true,"node":{"id":"i9C1lDB9RMKdXw-6osH1Yg","name":"Frey","transport_address":"inet[/10.165.4.160:9300]"}}}

10.165.4.160 is master ip.
how can I create 10 rive(consumer) in this cluster

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.