hi,
i'm trying and failing to get the elasticsearch-hadoop cascading tap to work
i've got an index "stuff" with mapping-type "foos", and some docs with
fields "name", and i'm trying to extract a list of those names with
cascalog thus :
(def fields (cascading.tuple.Fields. (into-array Comparable ["name"])))
(def t (org.elasticsearch.hadoop.cascading.ESTap. "stuff/foos" fields))
(c/??- (c/<- [?name] (t ?name)))
i.e. i'm just gathering the values from the tap into an in-memory array
this gives me an exception as below, so clearly i'm configuring my ESTap
wrongly somehow : i've played around with different resource names though :
e.g. "stuff/foos/_search" and can't seem to figure it out, while the unit
tests seem to indicate that "stuff/foos" is the correct resource name
any hints ?
thanks
:craig
Caused by: java.lang.IllegalStateException: [GET] on
[stuff/foos&search_type=scan&scroll=10m&size=50&preference=_shards:4;_only_node:MPVfqZ48SGeidNyp61dh_Q]
failed; server[http://127.0.0.1:9200] returned [No handler found for uri
[stuff/foos&search_type=scan&scroll=10m&size=50&preference=_shards:4;_only_node:MPVfqZ48SGeidNyp61dh_Q]
and method [GET]]
at org.elasticsearch.hadoop.rest.RestClient.execute(RestClient.java:131)
~[elasticsearch-hadoop-1.3.0.BUILD-SNAPSHOT.jar:1.3.0.BUILD-SNAPSHOT]
at org.elasticsearch.hadoop.rest.RestClient.get(RestClient.java:73)
~[elasticsearch-hadoop-1.3.0.BUILD-SNAPSHOT.jar:1.3.0.BUILD-SNAPSHOT]
at org.elasticsearch.hadoop.rest.RestClient.scan(RestClient.java:160)
~[elasticsearch-hadoop-1.3.0.BUILD-SNAPSHOT.jar:1.3.0.BUILD-SNAPSHOT]
at
org.elasticsearch.hadoop.rest.BufferedRestClient.scan(BufferedRestClient.java:110)
~[elasticsearch-hadoop-1.3.0.BUILD-SNAPSHOT.jar:1.3.0.BUILD-SNAPSHOT]
at org.elasticsearch.hadoop.rest.QueryBuilder.build(QueryBuilder.java:97)
~[elasticsearch-hadoop-1.3.0.BUILD-SNAPSHOT.jar:1.3.0.BUILD-SNAPSHOT]
at
org.elasticsearch.hadoop.mr.ESInputFormat$ShardRecordReader.next(ESInputFormat.java:211)
~[elasticsearch-hadoop-1.3.0.BUILD-SNAPSHOT.jar:1.3.0.BUILD-SNAPSHOT]
at
org.elasticsearch.hadoop.mr.ESInputFormat$ShardRecordReader.next(ESInputFormat.java:119)
~[elasticsearch-hadoop-1.3.0.BUILD-SNAPSHOT.jar:1.3.0.BUILD-SNAPSHOT]
at
cascading.tap.hadoop.util.MeasuredRecordReader.next(MeasuredRecordReader.java:61)
~[cascading-hadoop-2.0.8.jar:na]
at
org.elasticsearch.hadoop.cascading.ESHadoopScheme.source(ESHadoopScheme.java:145)
~[elasticsearch-hadoop-1.3.0.BUILD-SNAPSHOT.jar:1.3.0.BUILD-SNAPSHOT]
at
cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:140)
~[cascading-core-2.0.8.jar:na]
at
cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:120)
~[cascading-core-2.0.8.jar:na]
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.
answering my own (slightly dumb) question... the resource should be a
search string for a source tap, e.g. "stuff/foos/_search?q=bar"
:craig
On Thursday, 4 July 2013 15:28:14 UTC+1, mccraig mccraig wrote:
hi,
i'm trying and failing to get the elasticsearch-hadoop cascading tap to
work
i've got an index "stuff" with mapping-type "foos", and some docs with
fields "name", and i'm trying to extract a list of those names with
cascalog thus :
(def fields (cascading.tuple.Fields. (into-array Comparable ["name"])))
(def t (org.elasticsearch.hadoop.cascading.ESTap. "stuff/foos" fields))
(c/??- (c/<- [?name] (t ?name)))
i.e. i'm just gathering the values from the tap into an in-memory array
this gives me an exception as below, so clearly i'm configuring my ESTap
wrongly somehow : i've played around with different resource names though :
e.g. "stuff/foos/_search" and can't seem to figure it out, while the unit
tests seem to indicate that "stuff/foos" is the correct resource name
any hints ?
thanks
:craig
Caused by: java.lang.IllegalStateException: [GET] on
[stuff/foos&search_type=scan&scroll=10m&size=50&preference=_shards:4;_only_node:MPVfqZ48SGeidNyp61dh_Q]
failed; server[http://127.0.0.1:9200] returned [No handler found for uri
[stuff/foos&search_type=scan&scroll=10m&size=50&preference=_shards:4;_only_node:MPVfqZ48SGeidNyp61dh_Q]
and method [GET]]
at org.elasticsearch.hadoop.rest.RestClient.execute(RestClient.java:131)
~[elasticsearch-hadoop-1.3.0.BUILD-SNAPSHOT.jar:1.3.0.BUILD-SNAPSHOT]
at org.elasticsearch.hadoop.rest.RestClient.get(RestClient.java:73)
~[elasticsearch-hadoop-1.3.0.BUILD-SNAPSHOT.jar:1.3.0.BUILD-SNAPSHOT]
at org.elasticsearch.hadoop.rest.RestClient.scan(RestClient.java:160)
~[elasticsearch-hadoop-1.3.0.BUILD-SNAPSHOT.jar:1.3.0.BUILD-SNAPSHOT]
at
org.elasticsearch.hadoop.rest.BufferedRestClient.scan(BufferedRestClient.java:110)
~[elasticsearch-hadoop-1.3.0.BUILD-SNAPSHOT.jar:1.3.0.BUILD-SNAPSHOT]
at org.elasticsearch.hadoop.rest.QueryBuilder.build(QueryBuilder.java:97)
~[elasticsearch-hadoop-1.3.0.BUILD-SNAPSHOT.jar:1.3.0.BUILD-SNAPSHOT]
at
org.elasticsearch.hadoop.mr.ESInputFormat$ShardRecordReader.next(ESInputFormat.java:211)
~[elasticsearch-hadoop-1.3.0.BUILD-SNAPSHOT.jar:1.3.0.BUILD-SNAPSHOT]
at
org.elasticsearch.hadoop.mr.ESInputFormat$ShardRecordReader.next(ESInputFormat.java:119)
~[elasticsearch-hadoop-1.3.0.BUILD-SNAPSHOT.jar:1.3.0.BUILD-SNAPSHOT]
at
cascading.tap.hadoop.util.MeasuredRecordReader.next(MeasuredRecordReader.java:61)
~[cascading-hadoop-2.0.8.jar:na]
at
org.elasticsearch.hadoop.cascading.ESHadoopScheme.source(ESHadoopScheme.java:145)
~[elasticsearch-hadoop-1.3.0.BUILD-SNAPSHOT.jar:1.3.0.BUILD-SNAPSHOT]
at
cascading.tuple.TupleEntrySchemeIterator.getNext(TupleEntrySchemeIterator.java:140)
~[cascading-core-2.0.8.jar:na]
at
cascading.tuple.TupleEntrySchemeIterator.hasNext(TupleEntrySchemeIterator.java:120)
~[cascading-core-2.0.8.jar:na]
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.