Elasticsearch-river-kafka can not work


(xiaomingfeng99) #1

Hi,
I installed elasticsearch-river-kafka and restart the elasticsearch.
when I create a new
river, it cat not started.
There are some error message in the elasticsearch.log:

[2014-03-31 16:11:26,613][INFO ][org.apache.zookeeper.ClientCnxn] Opening
socket connection to server /172.16.241.225:2181
[2014-03-31 16:11:31,842][INFO ][org.apache.zookeeper.ClientCnxn] Socket
connection established to 172.16.241.225/172.16.241.225:2181, initiating
session
[2014-03-31 16:11:31,854][INFO ][org.apache.zookeeper.ClientCnxn] Session
establishment complete on server 172.16.241.225/172.16.241.225:2181,
sessionid = 0x145172db3120005, negotiated timeout = 6000
[2014-03-31 16:11:32,410][ERROR][river.kafka ] [Jazz]
[kafka][my_kafka_river_0] Unexpected Error occurred
com.timgroup.statsd.StatsDClientException: Failed to start StatsD client
at com.timgroup.statsd.StatsDClient.(StatsDClient.java:109)
at com.timgroup.statsd.StatsDClient.(StatsDClient.java:76)
at org.elasticsearch.river.kafka.StatsReporter.(StatsReporter.java:37)
at
org.elasticsearch.river.kafka.KafkaRiver$KafkaRiverWorker.initStatsd(KafkaRiver.java:144)
at
org.elasticsearch.river.kafka.KafkaRiver$KafkaRiverWorker.(KafkaRiver.java:139)
at org.elasticsearch.river.kafka.KafkaRiver.start(KafkaRiver.java:68)
at org.elasticsearch.river.RiversService.createRiver(RiversService.java:146)
at
org.elasticsearch.river.RiversService$ApplyRivers$2.onResponse(RiversService.java:270)
at
org.elasticsearch.river.RiversService$ApplyRivers$2.onResponse(RiversService.java:264)
at
org.elasticsearch.action.support.TransportAction$ThreadedActionListener$1.run(TransportAction.java:87)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)
Caused by: java.net.SocketException: Unresolved address
at java.net.DatagramSocket.connect(DatagramSocket.java:477)
at com.timgroup.statsd.StatsDClient.(StatsDClient.java:107)
... 12 more
[2014-03-31 16:11:32,413][WARN ][river ] [Jazz] failed
to create river [kafka][my_kafka_river_0]
java.lang.RuntimeException: com.timgroup.statsd.StatsDClientException:
Failed to start StatsD client
at org.elasticsearch.river.kafka.KafkaRiver.start(KafkaRiver.java:74)
at org.elasticsearch.river.RiversService.createRiver(RiversService.java:146)
at
org.elasticsearch.river.RiversService$ApplyRivers$2.onResponse(RiversService.java:270)
at
org.elasticsearch.river.RiversService$ApplyRivers$2.onResponse(RiversService.java:264)
at
org.elasticsearch.action.support.TransportAction$ThreadedActionListener$1.run(TransportAction.java:87)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)
Caused by: com.timgroup.statsd.StatsDClientException: Failed to start
StatsD client
at com.timgroup.statsd.StatsDClient.(StatsDClient.java:109)
at com.timgroup.statsd.StatsDClient.(StatsDClient.java:76)
at org.elasticsearch.river.kafka.StatsReporter.(StatsReporter.java:37)
at
org.elasticsearch.river.kafka.KafkaRiver$KafkaRiverWorker.initStatsd(KafkaRiver.java:144)
at
org.elasticsearch.river.kafka.KafkaRiver$KafkaRiverWorker.(KafkaRiver.java:139)
at org.elasticsearch.river.kafka.KafkaRiver.start(KafkaRiver.java:68)
... 7 more
Caused by: java.net.SocketException: Unresolved address
at java.net.DatagramSocket.connect(DatagramSocket.java:477)
at com.timgroup.statsd.StatsDClient.(StatsDClient.java:107)
... 12 more

Creating the Kafka river Command´╝Ü
[root@CNC-JN-O-3Q2 es-kafka]# curl -XPUT
'172.16.241.225:9200/_river/my_kafka_river_0/_meta' -d '{
"type" : "kafka",
"kafka" : {
"broker_host" : "172.16.241.225",
"message_handler_factory_class" :
"org.elasticsearch.river.kafka.JsonMessageHandlerFactory",
"zookeeper" : "172.16.241.225",
"topic" : "my_topic",
"partition" : "0",
"broker_port" : 9092
},
"index" : {
"bulk_size_bytes" : 10000,
"bulk_timeout" : "1000ms"
},
"statsd":{
"prefix": "es-kafka-river",
"host": "ambassador",
"port": "8125"
}

}'
{"ok":true,"_index":"_river","_type":"my_kafka_river_0","_id":"_meta","_version":1}[root@CNC-JN-O-3Q2
es-kafka]#
[root@CNC-JN-O-3Q2 es-kafka]#

what is missing for it? how can I to do?

Thanks,
Arthur

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/2a3c2925-a052-4d0e-816b-04389b33e7c1%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


(system) #2