# \[Hadoop\] : Parsing error in MR integration **URL:** \ **Category:** Elasticsearch\ **Created:** [July 14, 2014, 10:19am UTC](https://discuss.elastic.co/t/hadoop-parsing-error-in-mr-integration/18644 "2014-07-14T10:19:21Z")\ **Posts on this page:** 5\ **Page:** 1
**Author:** ![Aurelien\_3](https://avatars.discourse-cdn.com/v4/letter/a/ce7236/32.png) [@Aurelien\_3](https://discuss.elastic.co/u/Aurelien_3)\ **Post date:** [July 14, 2014, 10:19am UTC](https://discuss.elastic.co/t/hadoop-parsing-error-in-mr-integration/18644/1 "2014-07-14T10:19:21Z")
Hi, I can't sort that ! I'm using hadoop CDH3u6, and trying to get ES index my data. I tried with raw json and MapWritable, I always get the same kind of errors : java.lang.Exception: org.elasticsearch.hadoop. EsHadoopIllegalArgumentException: [org.elasticsearch.hadoop.serialization. field.MapWritableFieldExtractor@35b5f7bd] cannot extract value from object [ org.apache.hadoop.io.MapWritable@11c757a1] at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java: 349) Caused by: org.elasticsearch.hadoop.EsHadoopIllegalArgumentException: [org. elasticsearch.hadoop.serialization.field.MapWritableFieldExtractor@35b5f7bd] cannot extract value from object [org.apache.hadoop.io.MapWritable@11c757a1] at org.elasticsearch.hadoop.serialization.bulk.TemplatedBulk$FieldWriter .write(TemplatedBulk.java:49) at org.elasticsearch.hadoop.serialization.bulk.TemplatedBulk. writeTemplate(TemplatedBulk.java:101) at org.elasticsearch.hadoop.serialization.bulk.TemplatedBulk.write( TemplatedBulk.java:77) at org.elasticsearch.hadoop.rest.RestRepository.writeToIndex( RestRepository.java:130) at org.elasticsearch.hadoop.mr.EsOutputFormat$EsRecordWriter.write( EsOutputFormat.java:161) at org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.write( MapTask.java:531) at org.apache.hadoop.mapreduce.TaskInputOutputContext.write( TaskInputOutputContext.java:80) at my.jobs.index.IndexMapper.map(IndexMapper.java:27) at my.jobs.index.IndexMapper.map(IndexMapper.java:19) at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:648) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:322) at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run( LocalJobRunner.java:218) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java: 471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor. java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor .java:615) at java.lang.Thread.run(Thread.java:724) Seems to me that all is right, here the configuration of the index mapper : Job job = new Job(getConf(), "Indexing into Elastic search."); job.setJarByClass(getClass()); DomainRankDriver.loadLibrariesToDistributedCache(job); ``` Path input = new Path(args[0]); FileInputFormat.addInputPath(job, input); FileOutputFormat.setOutputPath(job, new Path(args[1])); // Used by ES-hadoop to take Text as Json job.setOutputFormatClass(EsOutputFormat.class); ``` // job.setMapOutputValueClass(Text.class); job.setMapOutputValueClass(MapWritable.class); job.setMapperClass(IndexMapper.class); ``` job.setNumReduceTasks(0); ``` And my simple mapper : @Override public void map(LongWritable key, Text value, Context context) throws IOException, InterruptedException{ MapWritable map = new MapWritable(); map.put(new Text("test"), new Text("value")); context.write(new LongWritable(), map); } Any clue to search for more ? I'm stuck. Thanks, Aurelien -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/7f6545ab-d6d9-4fdf-8923-0b60e0ea5297%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/7f6545ab-d6d9-4fdf-8923-0b60e0ea5297%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![costin](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/costin/32/44950_2.png) [@costin](https://discuss.elastic.co/u/costin)\ **Post date:** [July 14, 2014, 3:48pm UTC](https://discuss.elastic.co/t/hadoop-parsing-error-in-mr-integration/18644/2 "2014-07-14T15:48:30Z")
Hi, Nothing jumps out from your configuration. The error indicates that the values passed to es-hadoop cannot be processed for some reason. Which is more surpsing considering your Mapper writes some constants to the output. I've pushed some improvements to the 2.x branch which explain better conditions in which the error appears - you can either build the jar yourself [1] and test it out or wait for the nightly build to publish the artifact [2]. Cheers, [1] [https://github.com/elasticsearch/elasticsearch-hadoop/tree/2.x](https://github.com/elasticsearch/elasticsearch-hadoop/tree/2.x) [2] [http://build.elasticsearch.com/view/Hadoop/job/es-hadoop-nightly-2x/](http://build.elasticsearch.com/view/Hadoop/job/es-hadoop-nightly-2x/) On 7/14/14 1:19 PM, Aurélien wrote: > Hi, > > I can't sort that ! I'm using hadoop CDH3u6, and trying to get ES index my data. I tried with raw json and MapWritable, > I always get the same kind of errors : > > | > > java.lang.Exception:org.elasticsearch.hadoop.EsHadoopIllegalArgumentException:[org.elasticsearch.hadoop.serialization.field.MapWritableFieldExtractor@35b5f7bd]cannot > extract value fromobject[org.apache.hadoop.io.MapWritable@11c757a1] > at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:349) > Causedby:org.elasticsearch.hadoop.EsHadoopIllegalArgumentException:[org.elasticsearch.hadoop.serialization.field.MapWritableFieldExtractor@35b5f7bd]cannot > extract value fromobject[org.apache.hadoop.io.MapWritable@11c757a1] > at org.elasticsearch.hadoop.serialization.bulk.TemplatedBulk$FieldWriter.write(TemplatedBulk.java:49) > at org.elasticsearch.hadoop.serialization.bulk.TemplatedBulk.writeTemplate(TemplatedBulk.java:101) > at org.elasticsearch.hadoop.serialization.bulk.TemplatedBulk.write(TemplatedBulk.java:77) > at org.elasticsearch.hadoop.rest.RestRepository.writeToIndex(RestRepository.java:130) > at org.elasticsearch.hadoop.mr.EsOutputFormat$EsRecordWriter.write(EsOutputFormat.java:161) > at org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.write(MapTask.java:531) > at org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80) > at my.jobs.index.IndexMapper.map(IndexMapper.java:27) > at my.jobs.index.IndexMapper.map(IndexMapper.java:19) > at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144) > at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:648) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:322) > at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:218) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) > at java.util.concurrent.FutureTask.run(FutureTask.java:166) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:724) > > | > > Seems to me that all is right, here the configuration of the index mapper : > > | > Jobjob =newJob(getConf(),"Indexing into Elastic search."); > job.setJarByClass(getClass()); > DomainRankDriver.loadLibrariesToDistributedCache(job); > > Pathinput =newPath(args[0]); > FileInputFormat.addInputPath(job,input); > FileOutputFormat.setOutputPath(job,newPath(args[1])); > > // Used by ES-hadoop to take Text as Json > job.setOutputFormatClass(EsOutputFormat.class); > // job.setMapOutputValueClass(Text.class); > job.setMapOutputValueClass(MapWritable.class); > job.setMapperClass(IndexMapper.class); > > ``` > job.setNumReduceTasks(0); > > ``` > > | > > And my simple mapper : > | > > @Override > publicvoidmap(LongWritablekey,Textvalue,Contextcontext) > throwsIOException,InterruptedException{ > MapWritablemap =newMapWritable(); > map.put(newText("test"),newText("value")); > context.write(newLongWritable(),map); > } > | > > Any clue to search for more ? I'm stuck. > > Thanks, > Aurelien > > -- > You received this message because you are subscribed to the Google Groups "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an email to > [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com) [mailto:elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/7f6545ab-d6d9-4fdf-8923-0b60e0ea5297%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/7f6545ab-d6d9-4fdf-8923-0b60e0ea5297%40googlegroups.com) > [https://groups.google.com/d/msgid/elasticsearch/7f6545ab-d6d9-4fdf-8923-0b60e0ea5297%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/7f6545ab-d6d9-4fdf-8923-0b60e0ea5297%40googlegroups.com?utm_medium=email&utm_source=footer). > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > -- > Costin -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/53C3FBCE.9040302%40gmail.com](https://groups.google.com/d/msgid/elasticsearch/53C3FBCE.9040302%40gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![Aurelien\_3](https://avatars.discourse-cdn.com/v4/letter/a/ce7236/32.png) [@Aurelien\_3](https://discuss.elastic.co/u/Aurelien_3)\ **Post date:** [July 15, 2014, 4:19pm UTC](https://discuss.elastic.co/t/hadoop-parsing-error-in-mr-integration/18644/3 "2014-07-15T16:19:25Z")
Hi Costin, Thanks for support. Well, I'm still experiencing this issue, and for now I see no obvious reasons for it. My only guess is about environment stuff and I'm trying to clean maven dependencies, environment variables, test version compatibility. For the moment nothing had worked. About the constant, it was to test to ensure my data wasn't corrupted in some way. So I'm pretty sure the exception gives no clue about the real issue. I keep you in touch in case of I discover the reason, may interest somone after all. Aurelien 2014-07-14 18:48 GMT+03:00 Costin Leau [costin.leau@gmail.com](mailto:costin.leau@gmail.com): > Hi, > > Nothing jumps out from your configuration. The error indicates that the > values passed to es-hadoop cannot be processed for some reason. Which is > more surpsing considering your Mapper writes some constants to the output. > I've pushed some improvements to the 2.x branch which explain better > conditions in which the error appears - you can either build the jar > yourself [1] and test it out or wait for the nightly build to publish the > artifact [2]. > > Cheers, > > [1] [https://github.com/elasticsearch/elasticsearch-hadoop/tree/2.x](https://github.com/elasticsearch/elasticsearch-hadoop/tree/2.x) > [2] [http://build.elasticsearch.com/view/Hadoop/job/es-hadoop-nightly-2x/](http://build.elasticsearch.com/view/Hadoop/job/es-hadoop-nightly-2x/) > > On 7/14/14 1:19 PM, Aurélien wrote: > > > Hi, > > > > I can't sort that ! I'm using hadoop CDH3u6, and trying to get ES index > > my data. I tried with raw json and MapWritable, > > I always get the same kind of errors : > > > > | > > > > java.lang.Exception:org.elasticsearch.hadoop. > > EsHadoopIllegalArgumentException:[org.elasticsearch.hadoop. > > serialization.field.MapWritableFieldExtractor@35b5f7bd]cannot > > extract value fromobject[org.apache.hadoop.io.MapWritable@11c757a1] > > at org.apache.hadoop.mapred.LocalJobRunner$Job.run( > > LocalJobRunner.java:349) > > Causedby:org.elasticsearch.hadoop.EsHadoopIllegalArgumentExcepti > > on:[org.elasticsearch.hadoop.serialization.field. > > MapWritableFieldExtractor@35b5f7bd]cannot > > extract value fromobject[org.apache.hadoop.io.MapWritable@11c757a1] > > > > ``` > > at org.elasticsearch.hadoop.serialization.bulk. > > > > ``` > > > > TemplatedBulk$FieldWriter.write(TemplatedBulk.java:49) > > at org.elasticsearch.hadoop.serialization.bulk. > > TemplatedBulk.writeTemplate(TemplatedBulk.java:101) > > at org.elasticsearch.hadoop.serialization.bulk.TemplatedBulk.write( > > TemplatedBulk.java:77) > > at org.elasticsearch.hadoop.rest.RestRepository.writeToIndex( > > RestRepository.java:130) > > at org.elasticsearch.hadoop.mr.EsOutputFormat$EsRecordWriter. > > write(EsOutputFormat.java:161) > > at org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector. > > write(MapTask.java:531) > > at org.apache.hadoop.mapreduce.TaskInputOutputContext.write( > > TaskInputOutputContext.java:80) > > at my.jobs.index.IndexMapper.map(IndexMapper.java:27) > > at my.jobs.index.IndexMapper.map(IndexMapper.java:19) > > at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144) > > at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:648) > > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:322) > > at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run( > > LocalJobRunner.java:218) > > at java.util.concurrent.Executors$RunnableAdapter. > > call(Executors.java:471) > > at java.util.concurrent.FutureTask$Sync.innerRun( > > FutureTask.java:334) > > at java.util.concurrent.FutureTask.run(FutureTask.java:166) > > at java.util.concurrent.ThreadPoolExecutor.runWorker( > > ThreadPoolExecutor.java:1145) > > at java.util.concurrent.ThreadPoolExecutor$Worker.run( > > ThreadPoolExecutor.java:615) > > at java.lang.Thread.run(Thread.java:724) > > > > | > > > > Seems to me that all is right, here the configuration of the index mapper > > : > > > > | > > Jobjob =newJob(getConf(),"Indexing into Elastic search."); > > > > ``` > > job.setJarByClass(getClass()); > > > > ``` > > > > DomainRankDriver.loadLibrariesToDistributedCache(job); > > > > Pathinput =newPath(args[0]); > > FileInputFormat.addInputPath(job,input); > > FileOutputFormat.setOutputPath(job,newPath(args[1])); > > > > // Used by ES-hadoop to take Text as Json > > job.setOutputFormatClass(EsOutputFormat.class); > > // job.setMapOutputValueClass(Text.class); > > job.setMapOutputValueClass(MapWritable.class); > > job.setMapperClass(IndexMapper.class); > > > > ``` > > job.setNumReduceTasks(0); > > > > ``` > > > > | > > > > And my simple mapper : > > | > > > > @Override > > publicvoidmap(LongWritablekey,Textvalue,Contextcontext) > > throwsIOException,InterruptedException{ > > MapWritablemap =newMapWritable(); > > map.put(newText("test"),newText("value")); > > context.write(newLongWritable(),map); > > } > > | > > > > Any clue to search for more ? I'm stuck. > > > > Thanks, > > Aurelien > > > > -- > > You received this message because you are subscribed to the Google Groups > > "elasticsearch" group. > > To unsubscribe from this group and stop receiving emails from it, send an > > email to > > [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com) \ > [unsubscribe@googlegroups.com](mailto:unsubscribe@googlegroups.com)\>. > > > > To view this discussion on the web visit > > [https://groups.google.com/d/msgid/elasticsearch/7f6545ab-](https://groups.google.com/d/msgid/elasticsearch/7f6545ab-) > > d6d9-4fdf-8923-0b60e0ea5297%[40googlegroups.com](http://40googlegroups.com) > > \<[https://groups.google.com/d/msgid/elasticsearch/7f6545ab-](https://groups.google.com/d/msgid/elasticsearch/7f6545ab-) > > d6d9-4fdf-8923-0b60e0ea5297%[40GGGROUPS CASINO – Real Slot Casino for 10,000+ Senior Players](http://40googlegroups.com?utm_medium=) > > email&utm\_source=footer\>. > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > -- > Costin > > -- > You received this message because you are subscribed to a topic in the > Google Groups "elasticsearch" group. > To unsubscribe from this topic, visit [https://groups.google.com/d/](https://groups.google.com/d/) > topic/elasticsearch/O1sJ4UQyZNU/unsubscribe. > To unsubscribe from this group and all its topics, send an email to > [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit [https://groups.google.com/d/](https://groups.google.com/d/) > msgid/elasticsearch/53C3FBCE.9040302%[40gmail.com](http://40gmail.com). > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CA%2B4E3CZSSFWNHeRBQF1FYSBGcX2c\_BiXK\_vFxg%3D7y%2BL9wZd9nw%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CA%2B4E3CZSSFWNHeRBQF1FYSBGcX2c_BiXK_vFxg%3D7y%2BL9wZd9nw%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![costin](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/costin/32/44950_2.png) [@costin](https://discuss.elastic.co/u/costin)\ **Post date:** [July 17, 2014, 10:28am UTC](https://discuss.elastic.co/t/hadoop-parsing-error-in-mr-integration/18644/4 "2014-07-17T10:28:44Z")
Hi, Looked again at your code sample and your configuration is incorrect. For some reason you are using FileInput/OuputFormat to set the input and output; since you are using es-hadoop you need to specify only the input and not the output. Moreover in your case, you are not using the input so potentially you can remove that as well. Did you set the es.resource for es-hadoop? I don't see that set anywhere though, since no exceptions was raised you probably configured it somewhere. I've tried replicating the problem but I can't - the writable are properly converted into JSON. Can you please enable logging [1] and report back? Additionally make sure you are using the latest build since the error message is different and should give you more information (what field is being extracted and from where)... Cheers, [1] [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/guide/en/elasticsearch/hadoop/current/logging.html) On 7/15/14 7:19 PM, Aurélien V wrote: > Hi Costin, > > Thanks for support. Well, I'm still experiencing this issue, and for now I see no obvious reasons for it. My only guess > is about environment stuff and I'm trying to clean maven dependencies, environment variables, test version > compatibility. For the moment nothing had worked. > > About the constant, it was to test to ensure my data wasn't corrupted in some way. So I'm pretty sure the exception > gives no clue about the real issue. > > I keep you in touch in case of I discover the reason, may interest somone after all. > Aurelien > > 2014-07-14 18:48 GMT+03:00 Costin Leau \<[costin.leau@gmail.com](mailto:costin.leau@gmail.com) [mailto:costin.leau@gmail.com](mailto:costin.leau@gmail.com)\>: > > ``` > Hi, > > Nothing jumps out from your configuration. The error indicates that the values passed to es-hadoop cannot be > processed for some reason. Which is more surpsing considering your Mapper writes some constants to the output. > I've pushed some improvements to the 2.x branch which explain better conditions in which the error appears - you can > either build the jar yourself [1] and test it out or wait for the nightly build to publish the artifact [2]. > > Cheers, > > [1] https://github.com/ __elasticsearch/elasticsearch-__ hadoop/tree/2.x > > [2] http://build.elasticsearch. __com/view/Hadoop/job/es-hadoop-__ nightly-2x/ > > > On 7/14/14 1:19 PM, Aurélien wrote: > > Hi, > > I can't sort that ! I'm using hadoop CDH3u6, and trying to get ES index my data. I tried with raw json and > MapWritable, > I always get the same kind of errors : > > | > > java.lang.Exception:org. __elasticsearch.hadoop.__ EsHadoopIllegalArgumentExcepti__on:[org.elasticsearch.hadoop.__serialization.field. __MapWritableFieldExtractor@__ 35b5f7bd]cannot > extract value fromobject[org.apache.hadoop.__io.MapWritable@11c757a1] > at org.apache.hadoop.mapred.__LocalJobRunner$Job.run(__LocalJobRunner.java:349) > Causedby:org.elasticsearch. __hadoop.__ EsHadoopIllegalArgumentExcepti__on:[org.elasticsearch.hadoop.__serialization.field. __MapWritableFieldExtractor@__ 35b5f7bd]cannot > extract value fromobject[org.apache.hadoop.__io.MapWritable@11c757a1] > > at org.elasticsearch.hadoop. __serialization.bulk.__ TemplatedBulk$FieldWriter.__write(TemplatedBulk.java:49) > at org.elasticsearch.hadoop. __serialization.bulk.__ TemplatedBulk.writeTemplate(__TemplatedBulk.java:101) > at org.elasticsearch.hadoop. __serialization.bulk.__ TemplatedBulk.write(__TemplatedBulk.java:77) > at org.elasticsearch.hadoop.rest.__RestRepository.writeToIndex(__RestRepository.java:130) > at org.elasticsearch.hadoop.mr > . __EsOutputFormat$EsRecordWriter.__ write(EsOutputFormat.java:161) > at org.apache.hadoop.mapred. __MapTask$__ NewDirectOutputCollector.__write(MapTask.java:531) > at org.apache.hadoop.mapreduce.__TaskInputOutputContext.write(__TaskInputOutputContext.java:__80) > at my.jobs.index.IndexMapper.map(__IndexMapper.java:27) > at my.jobs.index.IndexMapper.map(__IndexMapper.java:19) > at org.apache.hadoop.mapreduce.__Mapper.run(Mapper.java:144) > at org.apache.hadoop.mapred.__MapTask.runNewMapper(MapTask.__java:648) > at org.apache.hadoop.mapred.__MapTask.run(MapTask.java:322) > at org.apache.hadoop.mapred. __LocalJobRunner$Job$__ MapTaskRunnable.run(__LocalJobRunner.java:218) > at java.util.concurrent. __Executors$RunnableAdapter.__ call(Executors.java:471) > at java.util.concurrent.__FutureTask$Sync.innerRun(__FutureTask.java:334) > at java.util.concurrent.__FutureTask.run(FutureTask.__java:166) > at java.util.concurrent.__ThreadPoolExecutor.runWorker(__ThreadPoolExecutor.java:1145) > at java.util.concurrent.__ThreadPoolExecutor$Worker.run(__ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.__java:724) > > | > > Seems to me that all is right, here the configuration of the index mapper : > > | > Jobjob =newJob(getConf(),"Indexing into Elastic search."); > > job.setJarByClass(getClass()); > DomainRankDriver. __loadLibrariesToDistributedCach__ e(job); > > Pathinput =newPath(args[0]); > FileInputFormat.addInputPath(__job,input); > FileOutputFormat.__setOutputPath(job,newPath(__args[1])); > > // Used by ES-hadoop to take Text as Json > job.setOutputFormatClass(__EsOutputFormat.class); > // job.setMapOutputValueClass(__Text.class); > job.setMapOutputValueClass(__MapWritable.class); > job.setMapperClass(__IndexMapper.class); > > job.setNumReduceTasks(0); > | > > And my simple mapper : > | > > @Override > publicvoidmap(LongWritablekey,__Textvalue,Contextcontext) > throwsIOException,__InterruptedException{ > MapWritablemap =newMapWritable(); > map.put(newText("test"),__newText("value")); > context.write(newLongWritable(__),map); > } > | > > Any clue to search for more ? I'm stuck. > > Thanks, > Aurelien > > -- > You received this message because you are subscribed to the Google Groups "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an email to > elasticsearch+unsubscribe@__googlegroups.com > >. > > To view this discussion on the web visit > https://groups.google.com/d/ __msgid/elasticsearch/7f6545ab-__ d6d9-4fdf-8923-0b60e0ea5297%__40googlegroups.com > > >. > > For more options, visit https://groups.google.com/d/__optout . > > -- > Costin > > -- > You received this message because you are subscribed to a topic in the Google Groups "elasticsearch" group. > To unsubscribe from this topic, visit https://groups.google.com/d/ __topic/elasticsearch/__ O1sJ4UQyZNU/unsubscribe > . > To unsubscribe from this group and all its topics, send an email to elasticsearch+unsubscribe@__googlegroups.com > . > To view this discussion on the web visit > https://groups.google.com/d/ __msgid/elasticsearch/53C3FBCE.__ 9040302%40gmail.com > . > > For more options, visit https://groups.google.com/d/__optout . > > ``` > > -- > You received this message because you are subscribed to the Google Groups "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an email to > [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com) [mailto:elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/CA%2B4E3CZSSFWNHeRBQF1FYSBGcX2c\_BiXK\_vFxg%3D7y%2BL9wZd9nw%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CA%2B4E3CZSSFWNHeRBQF1FYSBGcX2c_BiXK_vFxg%3D7y%2BL9wZd9nw%40mail.gmail.com) > [https://groups.google.com/d/msgid/elasticsearch/CA%2B4E3CZSSFWNHeRBQF1FYSBGcX2c\_BiXK\_vFxg%3D7y%2BL9wZd9nw%40mail.gmail.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/CA%2B4E3CZSSFWNHeRBQF1FYSBGcX2c_BiXK_vFxg%3D7y%2BL9wZd9nw%40mail.gmail.com?utm_medium=email&utm_source=footer). > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- Costin -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/53C7A55C.90106%40gmail.com](https://groups.google.com/d/msgid/elasticsearch/53C7A55C.90106%40gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 1:15am UTC](https://discuss.elastic.co/t/hadoop-parsing-error-in-mr-integration/18644/5 "2017-07-06T01:15:15Z")