[hadoop] ElasticsearchIllegalArgumentException

Elastic Stack Elasticsearch
1

Finally when reducing, it prompts me with such error:

14/12/25 00:35:45 INFO mapreduce.Job: map 100% reduce 96%

14/12/25 00:35:55 INFO mapreduce.Job: Task Id :
attempt_1417849082194_0158_r_000000_2, Status : FAILED

Error: org.elasticsearch.hadoop.rest.EsHadoopInvalidRequest: Found
unrecoverable error [Bad Request(400) - [MapperPa

rsingException[failed to parse [page.revision.comment]]; nested:
ElasticsearchIllegalArgumentException[unknown prope

rty [deleted]]; ]]; Bailing out..

    at

org.elasticsearch.hadoop.rest.RestClient.retryFailedEntries(RestClient.java:199)

    at

org.elasticsearch.hadoop.rest.RestClient.bulk(RestClient.java:165)

    at

org.elasticsearch.hadoop.rest.RestRepository.sendBatch(RestRepository.java:170)

    at

org.elasticsearch.hadoop.rest.RestRepository.doWriteToIndex(RestRepository.java:160)

    at

org.elasticsearch.hadoop.rest.RestRepository.writeToIndex(RestRepository.java:130)

    at

org.elasticsearch.hadoop.mr.EsOutputFormat$EsRecordWriter.write(EsOutputFormat.java:159)

    at

org.apache.hadoop.mapred.ReduceTask$NewTrackingRecordWriter.write(ReduceTask.java:558)

    at

org.apache.hadoop.mapreduce.task.TaskInputOutputContextImpl.write(TaskInputOutputContextImpl.java:89)

    at

org.apache.hadoop.mapreduce.lib.reduce.WrappedReducer$Context.write(WrappedReducer.java:105)

    at org.apache.hadoop.mapreduce.Reducer.reduce(Reducer.java:150)

    at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:171)

    at

org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:627)

    at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:389)

    at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)

    at java.security.AccessController.doPrivileged(Native Method)

    at javax.security.auth.Subject.doAs(Subject.java:415)

    at

org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)

    at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163)

What does that mean? Any suggestions?

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/af659de5-5274-425d-9901-8941ad7fcfb2%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

2

It looks like you have a mapping problem in Elasticsearch. Typically
this occurs when you try incompatible/multiple value types on the same
key (for example setting a string to a number field or an object to a
string field - this looks like the case, etc...).
The field in question looks to be page.revision.comment - check your
mappings (do you depend on the automatic mapping or define one
yourself?).

On 12/25/14, CAI Longqi longqicai@gmail.com wrote:

Finally when reducing, it prompts me with such error:

14/12/25 00:35:45 INFO mapreduce.Job: map 100% reduce 96%

14/12/25 00:35:55 INFO mapreduce.Job: Task Id :
attempt_1417849082194_0158_r_000000_2, Status : FAILED

Error: org.elasticsearch.hadoop.rest.EsHadoopInvalidRequest: Found
unrecoverable error [Bad Request(400) - [MapperPa

rsingException[failed to parse [page.revision.comment]]; nested:
ElasticsearchIllegalArgumentException[unknown prope

rty [deleted]]; ]]; Bailing out..

    at

org.elasticsearch.hadoop.rest.RestClient.retryFailedEntries(RestClient.java:199)

    at

org.elasticsearch.hadoop.rest.RestClient.bulk(RestClient.java:165)

    at

org.elasticsearch.hadoop.rest.RestRepository.sendBatch(RestRepository.java:170)

    at

org.elasticsearch.hadoop.rest.RestRepository.doWriteToIndex(RestRepository.java:160)

    at

org.elasticsearch.hadoop.rest.RestRepository.writeToIndex(RestRepository.java:130)

    at

org.elasticsearch.hadoop.mr.EsOutputFormat$EsRecordWriter.write(EsOutputFormat.java:159)

    at

org.apache.hadoop.mapred.ReduceTask$NewTrackingRecordWriter.write(ReduceTask.java:558)

    at

org.apache.hadoop.mapreduce.task.TaskInputOutputContextImpl.write(TaskInputOutputContextImpl.java:89)

    at

org.apache.hadoop.mapreduce.lib.reduce.WrappedReducer$Context.write(WrappedReducer.java:105)

    at org.apache.hadoop.mapreduce.Reducer.reduce(Reducer.java:150)

    at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:171)

    at

org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:627)

    at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:389)

    at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)

    at java.security.AccessController.doPrivileged(Native Method)

    at javax.security.auth.Subject.doAs(Subject.java:415)

    at

org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)

    at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163)

What does that mean? Any suggestions?

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/af659de5-5274-425d-9901-8941ad7fcfb2%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAJogdmdY5-9ZZ_H-awP1%2B_J7Xi9BeXWMm84dZD45rPrQ6EHL9g%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

3

You're right. After carefully reviewing my mapping, I find some of my
page.revision.comment have an attribute 'delete', some do not. It seems
that elasticsearch requires all the indices to be in the same structure.
Thanks :slight_smile:

在 2014年12月29日星期一UTC+8下午8时20分27秒，Costin Leau写道：

It looks like you have a mapping problem in Elasticsearch. Typically
this occurs when you try incompatible/multiple value types on the same
key (for example setting a string to a number field or an object to a
string field - this looks like the case, etc...).
The field in question looks to be page.revision.comment - check your
mappings (do you depend on the automatic mapping or define one
yourself?).

On 12/25/14, CAI Longqi <long...@gmail.com <javascript:>> wrote:

Finally when reducing, it prompts me with such error:

14/12/25 00:35:45 INFO mapreduce.Job: map 100% reduce 96%

14/12/25 00:35:55 INFO mapreduce.Job: Task Id :
attempt_1417849082194_0158_r_000000_2, Status : FAILED

Error: org.elasticsearch.hadoop.rest.EsHadoopInvalidRequest: Found
unrecoverable error [Bad Request(400) - [MapperPa

rsingException[failed to parse [page.revision.comment]]; nested:
ElasticsearchIllegalArgumentException[unknown prope

rty [deleted]]; ]]; Bailing out..

    at

org.elasticsearch.hadoop.rest.RestClient.retryFailedEntries(RestClient.java:199)

    at

org.elasticsearch.hadoop.rest.RestClient.bulk(RestClient.java:165)

    at

org.elasticsearch.hadoop.rest.RestRepository.sendBatch(RestRepository.java:170)

    at

org.elasticsearch.hadoop.rest.RestRepository.doWriteToIndex(RestRepository.java:160)

    at

org.elasticsearch.hadoop.rest.RestRepository.writeToIndex(RestRepository.java:130)

    at

org.elasticsearch.hadoop.mr.EsOutputFormat$EsRecordWriter.write(EsOutputFormat.java:159)

    at

org.apache.hadoop.mapred.ReduceTask$NewTrackingRecordWriter.write(ReduceTask.java:558)

    at

org.apache.hadoop.mapreduce.task.TaskInputOutputContextImpl.write(TaskInputOutputContextImpl.java:89)

    at

org.apache.hadoop.mapreduce.lib.reduce.WrappedReducer$Context.write(WrappedReducer.java:105)

    at org.apache.hadoop.mapreduce.Reducer.reduce(Reducer.java:150) 

    at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:171) 

    at

org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:627)

    at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:389) 

    at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168) 

    at java.security.AccessController.doPrivileged(Native Method) 

    at javax.security.auth.Subject.doAs(Subject.java:415) 

    at

org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)

    at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163)

What does that mean? Any suggestions?

--
You received this message because you are subscribed to the Google
Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an
email to elasticsearc...@googlegroups.com <javascript:>.
To view this discussion on the web visit

https://groups.google.com/d/msgid/elasticsearch/af659de5-5274-425d-9901-8941ad7fcfb2%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/51d1ac6e-4fdd-4fed-a291-170d6d890423%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.