# How to search data when use elasticsearch-kafka-river

**URL:** <https://discuss.elastic.co/t/how-to-search-data-when-use-elasticsearch-kafka-river/17640>\
**Category:** Elasticsearch\
**Created:** [May 21, 2014, 9:01am UTC](https://discuss.elastic.co/t/how-to-search-data-when-use-elasticsearch-kafka-river/17640 "2014-05-21T09:01:38Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![xiaomingfeng99](https://avatars.discourse-cdn.com/v4/letter/x/f14d63/32.png) [@xiaomingfeng99](https://discuss.elastic.co/u/xiaomingfeng99)\
**Post date:** [May 21, 2014, 9:01am UTC](https://discuss.elastic.co/t/how-to-search-data-when-use-elasticsearch-kafka-river/17640/1 "2014-05-21T09:01:38Z")

</div>

Hello,  
I install elasticsearch-kafka-river plugin on elasticsearch-0.90.0,and it  
works,ES log show my data insert successful.  
but when I use curl to get data from ES, it only show me the last record.

How can I get all the data from ES use curl.  
Thanks!

KafkaRiverWorker is running:  
[2014-05-21 15:44:32,015][INFO][org.apache.zookeeper.ZooKeeper] Client  
environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib  
[2014-05-21 15:44:32,015][INFO][org.apache.zookeeper.ZooKeeper] Client  
environment:java.io.tmpdir=/tmp  
[2014-05-21 15:44:32,015][INFO][org.apache.zookeeper.ZooKeeper] Client  
environment:java.compiler=  
[2014-05-21 15:44:32,015][INFO][org.apache.zookeeper.ZooKeeper] Client  
environment:os.name=Linux  
[2014-05-21 15:44:32,015][INFO][org.apache.zookeeper.ZooKeeper] Client  
environment:os.arch=amd64  
[2014-05-21 15:44:32,016][INFO][org.apache.zookeeper.ZooKeeper] Client  
environment:os.version=2.6.32-358.6.1.el6.x86\_64  
[2014-05-21 15:44:32,016][INFO][org.apache.zookeeper.ZooKeeper] Client  
environment:user.name=root  
[2014-05-21 15:44:32,016][INFO][org.apache.zookeeper.ZooKeeper] Client  
environment:user.home=/root  
[2014-05-21 15:44:32,016][INFO][org.apache.zookeeper.ZooKeeper] Client  
environment:user.dir=/root/storage/es-kafka/elasticsearch-0.90.0  
[2014-05-21 15:44:32,017][INFO][org.apache.zookeeper.ZooKeeper] Initiating  
client connection, connectString=localhost sessionTimeout=1000  
watcher=com.netflix.curator.ConnectionState@2c0e6070  
[2014-05-21 15:44:32,029][INFO][org.apache.zookeeper.ClientCnxn] Opening  
socket connection to server localhost/127.0.0.1:2181  
[2014-05-21 15:44:32,031][INFO][org.apache.zookeeper.ClientCnxn] Socket  
connection established to localhost/127.0.0.1:2181, initiating session  
[2014-05-21 15:44:32,046][INFO][org.apache.zookeeper.ClientCnxn] Session  
establishment complete on server localhost/127.0.0.1:2181, sessionid =  
0x1461d9037c20001, negotiated timeout = 6000  
[2014-05-21 15:44:32,064][INFO][river.kafka] [Black Fox]  
[kafka][my\_kafka\_river\_0] Created statsd client for prefix=es-kafka-river,  
host=localhost, port=8125  
[2014-05-21 15:44:32,065][INFO][river.kafka] [Black Fox]  
[kafka][my\_kafka\_river\_0] KafkaRiverWorker is running...  
[2014-05-21 15:44:32,080][INFO][cluster.metadata] [Black Fox]  
[\_river] update\_mapping [my\_kafka\_river\_0] (dynamic)  
[2014-05-21 15:44:42,370][INFO][river.kafka] [Black Fox]  
[kafka][my\_kafka\_river\_0] localhost:9092/0521003:0 0 msg (0.00 msg/s),  
flushed 0 (0 err, 0 succ) [msg backlog 0 B]  
[2014-05-21 15:44:52,382][INFO][river.kafka] [Black Fox]  
[kafka][my\_kafka\_river\_0] localhost:9092/0521003:0 0 msg (0.00 msg/s),  
flushed 0 (0 err, 0 succ) [msg backlog 0 B]  
[2014-05-21 15:45:02,394][INFO][river.kafka] [Black Fox]  
[kafka][my\_kafka\_river\_0] localhost:9092/0521003:0 0 msg (0.00 msg/s),  
flushed 0 (0 err, 0 succ) [msg backlog 0 B]  
[2014-05-21 15:45:12,409][INFO][river.kafka] [Black Fox]  
[kafka][my\_kafka\_river\_0] localhost:9092/0521003:0 0 msg (0.00 msg/s),  
flushed 0 (0 err, 0 succ) [msg backlog 2.09 KB]  
[2014-05-21 15:45:12,521][INFO][cluster.metadata] [Black Fox]  
[\_river] update\_mapping [my\_kafka\_river\_0] (dynamic)  
[2014-05-21 15:45:22,633][INFO][river.kafka] [Black Fox]  
[kafka][my\_kafka\_river\_0] localhost:9092/0521003:0 20 msg (1.96 msg/s),  
flushed 2 (0 err, 20 succ) [msg backlog 0 B]  
[2014-05-21 15:45:32,690][INFO][river.kafka] [Black Fox]  
[kafka][my\_kafka\_river\_0] localhost:9092/0521003:0 10 msg (0.99 msg/s),  
flushed 1 (0 err, 10 succ) [msg backlog 0 B]  
[2014-05-21 15:45:42,739][INFO][river.kafka] [Black Fox]  
[kafka][my\_kafka\_river\_0] localhost:9092/0521003:0 10 msg (1.00 msg/s),  
flushed 1 (0 err, 10 succ) [msg backlog 0 B]  
[2014-05-21 15:45:52,788][INFO][river.kafka] [Black Fox]  
[kafka][my\_kafka\_river\_0] localhost:9092/0521003:0 10 msg (1.00 msg/s),  
flushed 1 (0 err, 10 succ) [msg backlog 0 B]

[root@CNC-JN-O-5A1 es-kafka]# curl -XGET  
'localhost:9200/\_river/my\_kafka\_river\_0/\_meta' -d '{"query" : {"match\_all"  
: {}}}'  
{"\_index":"\_river","\_type":"my\_kafka\_river\_0","\_id":"\_meta","\_version":1681,"exists":true,  
"\_source" : {"time":"[2014-05-21  
16:13:03]","IP":"172.16.241.208","data":"0.41 10892 9125m 487092 13541m  
0 0 0 0 567 817 0 1 99"}}[root@CNC-JN-O-5A1 es-kafka]#  
[root@CNC-JN-O-5A1 es-kafka]#  
[root@CNC-JN-O-5A1 es-kafka]# curl -XGET  
'localhost:9200/\_river/my\_kafka\_river\_0/\_meta'  
{"\_index":"\_river","\_type":"my\_kafka\_river\_0","\_id":"\_meta","\_version":1691,"exists":true,  
"\_source" : {"time":"[2014-05-21  
16:13:13]","IP":"172.16.241.208","data":"0.42 10892 9122m 487092 13541m  
0 0 0 0 580 793 0 1 98"}}[root@CNC-JN-O-5A1 es-kafka]#  
[root@CNC-JN-O-5A1 es-kafka]#  
[root@CNC-JN-O-5A1 es-kafka]# curl -XGET  
'localhost:9200/\_river/my\_kafka\_river\_0/\_meta' -d '{"query" : {"match\_all"  
: {}}}'  
{"\_index":"\_river","\_type":"my\_kafka\_river\_0","\_id":"\_meta","\_version":1691,"exists":true,  
"\_source" : {"time":"[2014-05-21  
16:13:13]","IP":"172.16.241.208","data":"0.42 10892 9122m 487092 13541m  
0 0 0 0 580 793 0 1 98"}}[root@CNC-JN-O-5A1 es-kafka]#  
[root@CNC-JN-O-5A1 es-kafka]#  
[root@CNC-JN-O-5A1 es-kafka]# curl -XGET  
'localhost:9200/\_river/my\_kafka\_river\_0/\_meta' -d '{"query" : {"match\_all"  
: {}}}'  
{"\_index":"\_river","\_type":"my\_kafka\_river\_0","\_id":"\_meta","\_version":1701,"exists":true,  
"\_source" : {"time":"[2014-05-21  
16:13:23]","IP":"172.16.241.208","data":"0.44 10892 9122m 487092 13541m  
0 0 0 0 463 770 0 0 99"}}[root@CNC-JN-O-5A1 es-kafka]#  
[root@CNC-JN-O-5A1 es-kafka]#  
[root@CNC-JN-O-5A1 es-kafka]#

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/65a64a9b-31e6-489f-8bae-064fb5c2e943%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/65a64a9b-31e6-489f-8bae-064fb5c2e943%40googlegroups.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 1:27am UTC](https://discuss.elastic.co/t/how-to-search-data-when-use-elasticsearch-kafka-river/17640/2 "2017-07-06T01:27:55Z")

</div>


