# \[HADOOP\] Elasticsearch and hive

**URL:** <https://discuss.elastic.co/t/hadoop-elasticsearch-and-hive/17622>\
**Category:** Elasticsearch\
**Created:** [May 20, 2014, 12:58pm UTC](https://discuss.elastic.co/t/hadoop-elasticsearch-and-hive/17622 "2014-05-20T12:58:26Z")\
**Posts on this page:** 11\
**Page:** 1

<div class="post-metadata">

**Author:** ![hanine](https://avatars.discourse-cdn.com/v4/letter/h/b4bc9f/32.png) [@hanine](https://discuss.elastic.co/u/hanine)\
**Post date:** [May 20, 2014, 12:58pm UTC](https://discuss.elastic.co/t/hadoop-elasticsearch-and-hive/17622/1 "2014-05-20T12:58:26Z")

</div>

Hello everybody

I m trying to take data from Hive and put it in elasticsearch  
here is the script and the error

hive\> ADD JAR  
/home/hduser/hadoop/hive-0.11.0/lib/hive-serdes-1.0-SNAPSHOT.jar;  
Added /home/hduser/hadoop/hive-0.11.0/lib/hive-serdes-1.0-SNAPSHOT.jar to  
class path  
Added resource:  
/home/hduser/hadoop/hive-0.11.0/lib/hive-serdes-1.0-SNAPSHOT.jar  
hive\> CREATE EXTERNAL TABLE tweetsES (  
\> id BIGINT,  
\> created\_at STRING,  
\> source STRING,  
\> favorited BOOLEAN,  
\> retweet\_count INT,  
\> retweeted\_status STRUCT\<  
\> text:STRING,  
\> user:STRUCT\<screen\_name:STRING,name:STRING\>\>,  
\> entities STRUCT\<  
\> urls:ARRAY\<STRUCT\<expanded\_url:STRING\>\>,  
\> user\_mentions:ARRAY\<STRUCT\<screen\_name:STRING,name:STRING\>\>,  
\> hashtags:ARRAY\<STRUCTtext:STRING\>\>,  
\> text STRING,  
\> user STRUCT\<  
\> screen\_name:STRING,  
\> name:STRING,  
\> friends\_count:INT,  
\> followers\_count:INT,  
\> statuses\_count:INT,  
\> verified:BOOLEAN,  
\> utc\_offset:INT,  
\> time\_zone:STRING\>,  
\> in\_reply\_to\_screen\_name STRING  
\> )  
\> STORED BY 'org.elasticsearch.hadoop.hive.EsStorageHandler'  
\> TBLPROPERTIES('es.resource' =  
'reseaux\_sociaux/tweets','es.input.json' = 'yes');  
OK  
Time taken: 4.292 seconds  
hive\> ADD JAR /home/hduser/hadoop/elasticsearch-hadoop-1.3.0.M2.jar;  
Added /home/hduser/hadoop/elasticsearch-hadoop-1.3.0.M2.jar to class path  
Added resource: /home/hduser/hadoop/elasticsearch-hadoop-1.3.0.M2.jar  
hive\> INSERT OVERWRITE TABLE tweetsES SELECT \* FROM tweets;  
Total MapReduce jobs = 1  
Launching Job 1 out of 1  
Number of reduce tasks is set to 0 since there's no reduce operator  
java.io.FileNotFoundException: File does not exist:  
/home/hduser/hadoop/elasticsearch-hadoop-1.3.0.M2.jar  
at  
org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:558)  
at  
org.apache.hadoop.filecache.DistributedCache.getFileStatus(DistributedCache.java:185)  
at  
org.apache.hadoop.filecache.TrackerDistributedCacheManager.getFileStatus(TrackerDistributedCacheManager.java:723)  
at  
org.apache.hadoop.filecache.TrackerDistributedCacheManager.determineTimestamps(TrackerDistributedCacheManager.java:778)  
at  
org.apache.hadoop.filecache.TrackerDistributedCacheManager.determineTimestampsAndCacheVisibilities(TrackerDistributedCacheManager.java:755)  
at  
org.apache.hadoop.mapred.JobClient.copyAndConfigureFiles(JobClient.java:843)  
at  
org.apache.hadoop.mapred.JobClient.copyAndConfigureFiles(JobClient.java:734)  
at org.apache.hadoop.mapred.JobClient.access$400(JobClient.java:179)  
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:951)  
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:936)  
at java.security.AccessController.doPrivileged(Native Method)  
at javax.security.auth.Subject.doAs(Subject.java:415)  
at  
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190)  
at  
org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:936)  
at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:910)  
at  
org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:447)  
at  
org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:138)  
at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:144)  
at  
org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)  
at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1355)  
at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1139)  
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:945)  
at  
org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:259)  
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:216)  
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:413)  
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:756)  
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:614)  
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)  
at  
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)  
at  
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)  
at java.lang.reflect.Method.invoke(Method.java:606)  
at org.apache.hadoop.util.RunJar.main(RunJar.java:160)  
Job Submission failed with exception 'java.io.FileNotFoundException(File  
does not exist: /home/hduser/hadoop/elasticsearch-hadoop-1.3.0.M2.jar)'  
FAILED: Execution Error, return code 1 from  
org.apache.hadoop.hive.ql.exec.MapRedTask

That path it exist :/home/hduser/hadoop/elasticsearch-hadoop-1.3.0.M2.jar  
Any help would be so appreciable  
Thanks

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/d1613b48-e58d-4077-a579-92b46a97bcff%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/d1613b48-e58d-4077-a579-92b46a97bcff%40googlegroups.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![costin](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/costin/32/44950_2.png) [@costin](https://discuss.elastic.co/u/costin)\
**Post date:** [May 20, 2014, 1:11pm UTC](https://discuss.elastic.co/t/hadoop-elasticsearch-and-hive/17622/2 "2014-05-20T13:11:59Z")

</div>

1. You don't need to add the hive jars (hive-serdes) to your script - these are already part of the runtime
2. use es-hadoop-2.0.RC1, 1.3 M2 is fairly old
3. Make sure that the jar is actually available and that is potentially accessible by Hive. Also do note that  
when running Hive against a cluster, it's best to have the jars available on all nodes hence why most folks copy  
them to HDFS and refer to that location.  
While /home/hduser might be locally available, it might not exist on the Hive server - as indicated by the error.

Hope this helps,

On 5/20/14 3:58 PM, hanine haninne wrote:

> Hello everybody
> 
> I m trying to take data from Hive and put it in elasticsearch  
> here is the script and the error
> 
> hive\> ADD JAR /home/hduser/hadoop/hive-0.11.0/lib/hive-serdes-1.0-SNAPSHOT.jar;  
> Added /home/hduser/hadoop/hive-0.11.0/lib/hive-serdes-1.0-SNAPSHOT.jar to class path  
> Added resource: /home/hduser/hadoop/hive-0.11.0/lib/hive-serdes-1.0-SNAPSHOT.jar  
> hive\> CREATE EXTERNAL TABLE tweetsES (  
> \> id BIGINT,  
> \> created\_at STRING,  
> \> source STRING,  
> \> favorited BOOLEAN,  
> \> retweet\_count INT,  
> \> retweeted\_status STRUCT\<  
> \> text:STRING,  
> \> user:STRUCT\<screen\_name:STRING,name:STRING\>\>,  
> \> entities STRUCT\<  
> \> urls:ARRAY\<STRUCT\<expanded\_url:STRING\>\>,  
> \> user\_mentions:ARRAY\<STRUCT\<screen\_name:STRING,name:STRING\>\>,  
> \> hashtags:ARRAY\<STRUCTtext:STRING\>\>,  
> \> text STRING,  
> \> user STRUCT\<  
> \> screen\_name:STRING,  
> \> name:STRING,  
> \> friends\_count:INT,  
> \> followers\_count:INT,  
> \> statuses\_count:INT,  
> \> verified:BOOLEAN,  
> \> utc\_offset:INT,  
> \> time\_zone:STRING\>,  
> \> in\_reply\_to\_screen\_name STRING  
> \> )  
> \> STORED BY 'org.elasticsearch.hadoop.hive.EsStorageHandler'  
> \> TBLPROPERTIES('es.resource' = 'reseaux\_sociaux/tweets','es.input.json' = 'yes');  
> OK  
> Time taken: 4.292 seconds  
> hive\> ADD JAR /home/hduser/hadoop/elasticsearch-hadoop-1.3.0.M2.jar;  
> Added /home/hduser/hadoop/elasticsearch-hadoop-1.3.0.M2.jar to class path  
> Added resource: /home/hduser/hadoop/elasticsearch-hadoop-1.3.0.M2.jar  
> hive\> INSERT OVERWRITE TABLE tweetsES SELECT \* FROM tweets;  
> Total MapReduce jobs = 1  
> Launching Job 1 out of 1  
> Number of reduce tasks is set to 0 since there's no reduce operator  
> java.io.FileNotFoundException: File does not exist: /home/hduser/hadoop/elasticsearch-hadoop-1.3.0.M2.jar  
> at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:558)  
> at org.apache.hadoop.filecache.DistributedCache.getFileStatus(DistributedCache.java:185)  
> at org.apache.hadoop.filecache.TrackerDistributedCacheManager.getFileStatus(TrackerDistributedCacheManager.java:723)  
> at  
> org.apache.hadoop.filecache.TrackerDistributedCacheManager.determineTimestamps(TrackerDistributedCacheManager.java:778)  
> at  
> org.apache.hadoop.filecache.TrackerDistributedCacheManager.determineTimestampsAndCacheVisibilities(TrackerDistributedCacheManager.java:755)  
> at org.apache.hadoop.mapred.JobClient.copyAndConfigureFiles(JobClient.java:843)  
> at org.apache.hadoop.mapred.JobClient.copyAndConfigureFiles(JobClient.java:734)  
> at org.apache.hadoop.mapred.JobClient.access$400(JobClient.java:179)  
> at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:951)  
> at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:936)  
> at java.security.AccessController.doPrivileged(Native Method)  
> at javax.security.auth.Subject.doAs(Subject.java:415)  
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190)  
> at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:936)  
> at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:910)  
> at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:447)  
> at org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:138)  
> at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:144)  
> at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)  
> at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1355)  
> at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1139)  
> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:945)  
> at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:259)  
> at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:216)  
> at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:413)  
> at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:756)  
> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:614)  
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)  
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)  
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)  
> at java.lang.reflect.Method.invoke(Method.java:606)  
> at org.apache.hadoop.util.RunJar.main(RunJar.java:160)  
> Job Submission failed with exception 'java.io.FileNotFoundException(File does not exist:  
> /home/hduser/hadoop/elasticsearch-hadoop-1.3.0.M2.jar)'  
> FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MapRedTask
> 
> That path it exist :/home/hduser/hadoop/elasticsearch-hadoop-1.3.0.M2.jar  
> Any help would be so appreciable  
> Thanks
> 
> --  
> You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
> To unsubscribe from this group and stop receiving emails from it, send an email to  
> [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com) [mailto:elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> To view this discussion on the web visit  
> [https://groups.google.com/d/msgid/elasticsearch/d1613b48-e58d-4077-a579-92b46a97bcff%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/d1613b48-e58d-4077-a579-92b46a97bcff%40googlegroups.com)  
> [https://groups.google.com/d/msgid/elasticsearch/d1613b48-e58d-4077-a579-92b46a97bcff%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/d1613b48-e58d-4077-a579-92b46a97bcff%40googlegroups.com?utm_medium=email&utm_source=footer).  
> For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

--  
Costin

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/537B549F.8020501%40gmail.com](https://groups.google.com/d/msgid/elasticsearch/537B549F.8020501%40gmail.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![hanine](https://avatars.discourse-cdn.com/v4/letter/h/b4bc9f/32.png) [@hanine](https://discuss.elastic.co/u/hanine)\
**Post date:** [May 21, 2014, 9:15am UTC](https://discuss.elastic.co/t/hadoop-elasticsearch-and-hive/17622/3 "2014-05-21T09:15:30Z")

</div>

Thank you so much for ur answer  
here is what it gives me now

> INSERT OVERWRITE TABLE tweetsES SELECT \* FROM tweets;  
> Total MapReduce jobs = 1  
> Launching Job 1 out of 1  
> Number of reduce tasks is set to 0 since there's no reduce operator  
> Starting Job = job\_201405210900\_0002, Tracking URL =  
> [http://master:50030/jobdetails.jsp?jobid=job\_201405210900\_0002](http://master:50030/jobdetails.jsp?jobid=job_201405210900_0002)  
> Kill Command = /home/hduser/hadoop/libexec/../bin/hadoop job -kill  
> job\_201405210900\_0002  
> Hadoop job information for Stage-0: number of mappers: 1; number of  
> reducers: 0  
> 2014-05-21 10:12:05,285 Stage-0 map = 0%, reduce = 0%  
> 2014-05-21 10:12:23,408 Stage-0 map = 100%, reduce = 100%  
> Ended Job = job\_201405210900\_0002 with errors  
> Error during job, obtaining debugging information...  
> Job Tracking URL:  
> [http://master:50030/jobdetails.jsp?jobid=job\_201405210900\_0002](http://master:50030/jobdetails.jsp?jobid=job_201405210900_0002)  
> Examining task ID: task\_201405210900\_0002\_m\_000002 (and more) from job  
> job\_201405210900\_0002

## Task with the most failures(4):

Task ID:  
task\_201405210900\_0002\_m\_000000

URL:

## [http://master:50030/taskdetails.jsp?jobid=job\_201405210900\_0002&tipid=task\_201405210900\_0002\_m\_000000](http://master:50030/taskdetails.jsp?jobid=job_201405210900_0002&tipid=task_201405210900_0002_m_000000)

Diagnostic Messages for this Task:  
java.lang.RuntimeException: Error in configuring object  
at  
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)  
at  
org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)  
at  
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)  
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:426)  
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:366)  
at org.apache.hadoop.mapred.Child$4.run(Child.java:255)  
at java.security.AccessController.doPrivileged(Native Method)  
at javax.security.auth.Subject.doAs(Subject.java:415)  
at  
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190)  
at org.apache.hadoop.mapred.Child.main(Child.java:249)  
Caused by: java.lang.reflect.InvocationTargetException  
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)  
at  
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)  
at  
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)  
at java.lang.reflect.Method.invoke(Method.java:606)  
at  
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)  
... 9 more  
Caused by: java.lang.RuntimeException: Error in configuring object  
at  
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)  
at  
org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)  
at  
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)  
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)  
... 14 more  
Caused by: java.lang.reflect.InvocationTargetException  
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)  
at  
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)  
at  
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)  
at java.lang.reflect.Method.invoke(Method.java:606)  
at  
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)  
... 17 more  
Caused by: java.lang.RuntimeException: Map operator initialization failed  
at  
org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:121)  
... 22 more  
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException:  
java.lang.ClassNotFoundException: com.cloudera.hive.serde.JSONSerDe  
at  
org.apache.hadoop.hive.ql.exec.MapOperator.getConvertedOI(MapOperator.java:463)  
at  
org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:479)  
at  
org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:90)  
... 22 more  
Caused by: java.lang.ClassNotFoundException:  
com.cloudera.hive.serde.JSONSerDe  
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)  
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)  
at java.security.AccessController.doPrivileged(Native Method)  
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)  
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)  
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)  
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)  
at java.lang.Class.forName0(Native Method)  
at java.lang.Class.forName(Class.java:270)  
at  
org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:810)  
at  
org.apache.hadoop.hive.ql.exec.MapOperator.getConvertedOI(MapOperator.java:422)  
... 24 more

FAILED: Execution Error, return code 2 from  
org.apache.hadoop.hive.ql.exec.MapRedTask  
MapReduce Jobs Launched:  
Job 0: Map: 1 HDFS Read: 0 HDFS Write: 0 FAIL  
Total MapReduce CPU Time Spent: 0 msec

2014-05-20 14:11 GMT+01:00 Costin Leau [costin.leau@gmail.com](mailto:costin.leau@gmail.com):

> 1. You don't need to add the hive jars (hive-serdes) to your script -  
> these are already part of the runtime
> 2. use es-hadoop-2.0.RC1, 1.3 M2 is fairly old
> 3. Make sure that the jar is actually available and that is potentially  
> accessible by Hive. Also do note that  
> when running Hive against a cluster, it's best to have the jars available  
> on all nodes hence why most folks copy  
> them to HDFS and refer to that location.  
> While /home/hduser might be locally available, it might not exist on the  
> Hive server - as indicated by the error.
> 
> Hope this helps,
> 
> On 5/20/14 3:58 PM, hanine haninne wrote:
> 
> > Hello everybody
> > 
> > I m trying to take data from Hive and put it in elasticsearch  
> > here is the script and the error
> > 
> > hive\> ADD JAR /home/hduser/hadoop/hive-0.11.0/lib/hive-serdes-1.0-  
> > SNAPSHOT.jar;  
> > Added /home/hduser/hadoop/hive-0.11.0/lib/hive-serdes-1.0-SNAPSHOT.jar  
> > to class path  
> > Added resource: /home/hduser/hadoop/hive-0.11.0/lib/hive-serdes-1.0-  
> > SNAPSHOT.jar  
> > hive\> CREATE EXTERNAL TABLE tweetsES (  
> > \> id BIGINT,  
> > \> created\_at STRING,  
> > \> source STRING,  
> > \> favorited BOOLEAN,  
> > \> retweet\_count INT,  
> > \> retweeted\_status STRUCT\<  
> > \> text:STRING,  
> > \> user:STRUCT\<screen\_name:STRING,name:STRING\>\>,  
> > \> entities STRUCT\<  
> > \> urls:ARRAY\<STRUCT\<expanded\_url:STRING\>\>,  
> > \> user\_mentions:ARRAY\<STRUCT\<screen\_name:STRING,name:STRING\>\>,  
> > \> hashtags:ARRAY\<STRUCTtext:STRING\>\>,  
> > \> text STRING,  
> > \> user STRUCT\<  
> > \> screen\_name:STRING,  
> > \> name:STRING,  
> > \> friends\_count:INT,  
> > \> followers\_count:INT,  
> > \> statuses\_count:INT,  
> > \> verified:BOOLEAN,  
> > \> utc\_offset:INT,  
> > \> time\_zone:STRING\>,  
> > \> in\_reply\_to\_screen\_name STRING  
> > \> )  
> > \> STORED BY 'org.elasticsearch.hadoop.hive.EsStorageHandler'  
> > \> TBLPROPERTIES('es.resource' = 'reseaux\_sociaux/tweets','es.input.json'  
> > = 'yes');  
> > OK  
> > Time taken: 4.292 seconds  
> > hive\> ADD JAR /home/hduser/hadoop/elasticsearch-hadoop-1.3.0.M2.jar;  
> > Added /home/hduser/hadoop/elasticsearch-hadoop-1.3.0.M2.jar to class path  
> > Added resource: /home/hduser/hadoop/elasticsearch-hadoop-1.3.0.M2.jar  
> > hive\> INSERT OVERWRITE TABLE tweetsES SELECT \* FROM tweets;  
> > Total MapReduce jobs = 1  
> > Launching Job 1 out of 1  
> > Number of reduce tasks is set to 0 since there's no reduce operator  
> > java.io.FileNotFoundException: File does not exist: /home/hduser/hadoop/  
> > elasticsearch-hadoop-1.3.0.M2.jar  
> > at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(  
> > DistributedFileSystem.java:558)  
> > at org.apache.hadoop.filecache.DistributedCache.getFileStatus(  
> > DistributedCache.java:185)  
> > at org.apache.hadoop.filecache.TrackerDistributedCacheManager  
> > .getFileStatus(TrackerDistributedCacheManager.java:723)  
> > at  
> > org.apache.hadoop.filecache.TrackerDistributedCacheManager  
> > .determineTimestamps(TrackerDistributedCacheManager.java:778)  
> > at  
> > org.apache.hadoop.filecache.TrackerDistributedCacheManager.  
> > determineTimestampsAndCacheVisibilities(TrackerDistributedCacheManager  
> > .java:755)  
> > at org.apache.hadoop.mapred.JobClient.copyAndConfigureFiles(  
> > JobClient.java:843)  
> > at org.apache.hadoop.mapred.JobClient.copyAndConfigureFiles(  
> > JobClient.java:734)  
> > at org.apache.hadoop.mapred.JobClient.access$400(JobClient.java:179)  
> > at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:951)  
> > at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:936)  
> > at java.security.AccessController.doPrivileged(Native Method)  
> > at javax.security.auth.Subject.doAs(Subject.java:415)  
> > at org.apache.hadoop.security.UserGroupInformation.doAs(  
> > UserGroupInformation.java:1190)  
> > at org.apache.hadoop.mapred.JobClient.submitJobInternal(  
> > JobClient.java:936)  
> > at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:910)  
> > at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(  
> > ExecDriver.java:447)  
> > at org.apache.hadoop.hive.ql.exec.MapRedTask.execute(  
> > MapRedTask.java:138)  
> > at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:144)  
> > at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(  
> > TaskRunner.java:57)  
> > at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1355)  
> > at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1139)  
> > at org.apache.hadoop.hive.ql.Driver.run(Driver.java:945)  
> > at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(  
> > CliDriver.java:259)  
> > at org.apache.hadoop.hive.cli.CliDriver.processCmd(  
> > CliDriver.java:216)  
> > at org.apache.hadoop.hive.cli.CliDriver.processLine(  
> > CliDriver.java:413)  
> > at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:756)  
> > at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:614)  
> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)  
> > at sun.reflect.NativeMethodAccessorImpl.invoke(  
> > NativeMethodAccessorImpl.java:57)  
> > at sun.reflect.DelegatingMethodAccessorImpl.invoke(  
> > DelegatingMethodAccessorImpl.java:43)  
> > at java.lang.reflect.Method.invoke(Method.java:606)  
> > at org.apache.hadoop.util.RunJar.main(RunJar.java:160)  
> > Job Submission failed with exception 'java.io.FileNotFoundException(File  
> > does not exist:  
> > /home/hduser/hadoop/elasticsearch-hadoop-1.3.0.M2.jar)'  
> > FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.  
> > exec.MapRedTask
> > 
> > That path it exist :/home/hduser/hadoop/elasticsearch-hadoop-1.3.0.M2.jar  
> > Any help would be so appreciable  
> > Thanks
> > 
> > --  
> > You received this message because you are subscribed to the Google Groups  
> > "elasticsearch" group.  
> > To unsubscribe from this group and stop receiving emails from it, send an  
> > email to  
> > [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com) \<mailto:elasticsearch+  
> > [unsubscribe@googlegroups.com](mailto:unsubscribe@googlegroups.com)\>.
> > 
> > To view this discussion on the web visit  
> > [https://groups.google.com/d/msgid/elasticsearch/d1613b48-](https://groups.google.com/d/msgid/elasticsearch/d1613b48-)  
> > e58d-4077-a579-92b46a97bcff%[40googlegroups.com](http://40googlegroups.com)  
> > \<[https://groups.google.com/d/msgid/elasticsearch/d1613b48-](https://groups.google.com/d/msgid/elasticsearch/d1613b48-)  
> > e58d-4077-a579-92b46a97bcff%[40googlegroups.com?utm\_medium=](http://40googlegroups.com?utm_medium=)  
> > email&utm\_source=footer\>.
> > 
> > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).
> 
> --  
> Costin
> 
> --  
> You received this message because you are subscribed to the Google Groups  
> "elasticsearch" group.  
> To unsubscribe from this group and stop receiving emails from it, send an  
> email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> To view this discussion on the web visit [https://groups.google.com/d/](https://groups.google.com/d/)  
> msgid/elasticsearch/537B549F.8020501%[40gmail.com](http://40gmail.com).
> 
> For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CANXJSR9-xpGoJR4gvPW%3DKKP%3DVr\_5MxyDoUJKtbpqM6CsYs1G4Q%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CANXJSR9-xpGoJR4gvPW%3DKKP%3DVr_5MxyDoUJKtbpqM6CsYs1G4Q%40mail.gmail.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![costin](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/costin/32/44950_2.png) [@costin](https://discuss.elastic.co/u/costin)\
**Post date:** [May 21, 2014, 9:36am UTC](https://discuss.elastic.co/t/hadoop-elasticsearch-and-hive/17622/4 "2014-05-21T09:36:14Z")

</div>

The error indicates that your script refers to a JSonSerDe class (presumably from Cloudera) which cannot be found in the  
classpath:

"\> Caused by: java.lang.ClassNotFoundException: com.cloudera.hive.serde.JSONSerDe"

In fact if you read through the stacktrace, you'll notice that this comes up while the job configuration  
is being read and this class name encountered but the class definition itself cannot be resolved.

I'm not sure what causes this class to be added to the classpath of your script - it could be your script or the client  
configuration.  
Note the class is not used or added by ES-hadoop itself.

I'm not sure what distro you are using (es-hadoop works across Apache Hadoop, Cloudera, HDP, MapR, Pivotal, etc...) but  
you could try running some  
basic Hive scripts (without es-hadoop) first to make sure the environment is sane and that you can properly read and  
write from HDFS and then add  
es-hadoop into the mix.

Hope this helps,

On 5/21/14 12:15 PM, hanine haninne wrote:

> Thank you so much for ur answer  
> here is what it gives me now
> 
> > INSERT OVERWRITE TABLE tweetsES SELECT \* FROM tweets;  
> > Total MapReduce jobs = 1  
> > Launching Job 1 out of 1  
> > Number of reduce tasks is set to 0 since there's no reduce operator  
> > Starting Job = job\_201405210900\_0002, Tracking URL = [http://master:50030/jobdetails.jsp?jobid=job\_201405210900\_0002](http://master:50030/jobdetails.jsp?jobid=job_201405210900_0002)  
> > Kill Command = /home/hduser/hadoop/libexec/../bin/hadoop job -kill job\_201405210900\_0002  
> > Hadoop job information for Stage-0: number of mappers: 1; number of reducers: 0  
> > 2014-05-21 10:12:05,285 Stage-0 map = 0%, reduce = 0%  
> > 2014-05-21 10:12:23,408 Stage-0 map = 100%, reduce = 100%  
> > Ended Job = job\_201405210900\_0002 with errors  
> > Error during job, obtaining debugging information...  
> > Job Tracking URL: [http://master:50030/jobdetails.jsp?jobid=job\_201405210900\_0002](http://master:50030/jobdetails.jsp?jobid=job_201405210900_0002)  
> > Examining task ID: task\_201405210900\_0002\_m\_000002 (and more) from job job\_201405210900\_0002
> 
> ## Task with the most failures(4):
> 
> Task ID:  
> task\_201405210900\_0002\_m\_000000
> 
> ## URL: [http://master:50030/taskdetails.jsp?jobid=job\_201405210900\_0002&tipid=task\_201405210900\_0002\_m\_000000](http://master:50030/taskdetails.jsp?jobid=job_201405210900_0002&tipid=task_201405210900_0002_m_000000)
> 
> Diagnostic Messages for this Task:  
> java.lang.RuntimeException: Error in configuring object  
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)  
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)  
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)  
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:426)  
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:366)  
> at org.apache.hadoop.mapred.Child$4.run(Child.java:255)  
> at java.security.AccessController.doPrivileged(Native Method)  
> at javax.security.auth.Subject.doAs(Subject.java:415)  
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190)  
> at org.apache.hadoop.mapred.Child.main(Child.java:249)  
> Caused by: java.lang.reflect.InvocationTargetException  
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)  
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)  
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)  
> at java.lang.reflect.Method.invoke(Method.java:606)  
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)  
> ... 9 more  
> Caused by: java.lang.RuntimeException: Error in configuring object  
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)  
> at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)  
> at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)  
> at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)  
> ... 14 more  
> Caused by: java.lang.reflect.InvocationTargetException  
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)  
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)  
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)  
> at java.lang.reflect.Method.invoke(Method.java:606)  
> at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)  
> ... 17 more  
> Caused by: java.lang.RuntimeException: Map operator initialization failed  
> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:121)  
> ... 22 more  
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException:  
> com.cloudera.hive.serde.JSONSerDe  
> at org.apache.hadoop.hive.ql.exec.MapOperator.getConvertedOI(MapOperator.java:463)  
> at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:479)  
> at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:90)  
> ... 22 more  
> Caused by: java.lang.ClassNotFoundException: com.cloudera.hive.serde.JSONSerDe  
> at java.net.URLClassLoader$1.run(URLClassLoader.java:366)  
> at java.net.URLClassLoader$1.run(URLClassLoader.java:355)  
> at java.security.AccessController.doPrivileged(Native Method)  
> at java.net.URLClassLoader.findClass(URLClassLoader.java:354)  
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)  
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)  
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)  
> at java.lang.Class.forName0(Native Method)  
> at java.lang.Class.forName(Class.java:270)  
> at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:810)  
> at org.apache.hadoop.hive.ql.exec.MapOperator.getConvertedOI(MapOperator.java:422)  
> ... 24 more
> 
> FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask  
> MapReduce Jobs Launched:  
> Job 0: Map: 1 HDFS Read: 0 HDFS Write: 0 FAIL  
> Total MapReduce CPU Time Spent: 0 msec
> 
> 2014-05-20 14:11 GMT+01:00 Costin Leau \<[costin.leau@gmail.com](mailto:costin.leau@gmail.com) [mailto:costin.leau@gmail.com](mailto:costin.leau@gmail.com)\>:
> 
> ```
> 1. You don't need to add the hive jars (hive-serdes) to your script - these are already part of the runtime
> 2. use es-hadoop-2.0.RC1, 1.3 M2 is fairly old
> 3. Make sure that the jar is actually available and that is potentially accessible by Hive. Also do note that
> when running Hive against a cluster, it's best to have the jars available on all nodes hence why most folks copy
> them to HDFS and refer to that location.
> While /home/hduser might be locally available, it might not exist on the Hive server - as indicated by the error.
> 
> Hope this helps,
> 
> On 5/20/14 3:58 PM, hanine haninne wrote:
> 
> Hello everybody
> 
> I m trying to take data from Hive and put it in elasticsearch
> here is the script and the error
> 
> hive> ADD JAR /home/hduser/hadoop/hive-0.11. __0/lib/hive-serdes-1.0-__ SNAPSHOT.jar;
> Added /home/hduser/hadoop/hive-0.11. __0/lib/hive-serdes-1.0-__ SNAPSHOT.jar to class path
> Added resource: /home/hduser/hadoop/hive-0.11. __0/lib/hive-serdes-1.0-__ SNAPSHOT.jar
> hive> CREATE EXTERNAL TABLE tweetsES (
> > id BIGINT,
> > created_at STRING,
> > source STRING,
> > favorited BOOLEAN,
> > retweet_count INT,
> > retweeted_status STRUCT<
> > text:STRING,
> > user:STRUCT<screen_name:__STRING,name:STRING>>,
> > entities STRUCT<
> > urls:ARRAY<STRUCT<expanded___url:STRING>>,
> > user_mentions:ARRAY<STRUCT< __screen_name:STRING,name:__ STRING>>,
> > hashtags:ARRAY<STRUCT<text:__STRING>>>,
> > text STRING,
> > user STRUCT<
> > screen_name:STRING,
> > name:STRING,
> > friends_count:INT,
> > followers_count:INT,
> > statuses_count:INT,
> > verified:BOOLEAN,
> > utc_offset:INT,
> > time_zone:STRING>,
> > in_reply_to_screen_name STRING
> > )
> > STORED BY 'org.elasticsearch.hadoop.__hive.EsStorageHandler'
> > TBLPROPERTIES('es.resource' = 'reseaux_sociaux/tweets','es.__input.json' = 'yes');
> OK
> Time taken: 4.292 seconds
> hive> ADD JAR /home/hduser/hadoop/ __elasticsearch-hadoop-1.3.0.M2.__ jar;
> Added /home/hduser/hadoop/ __elasticsearch-hadoop-1.3.0.M2.__ jar to class path
> Added resource: /home/hduser/hadoop/ __elasticsearch-hadoop-1.3.0.M2.__ jar
> hive> INSERT OVERWRITE TABLE tweetsES SELECT * FROM tweets;
> Total MapReduce jobs = 1
> Launching Job 1 out of 1
> Number of reduce tasks is set to 0 since there's no reduce operator
> java.io.FileNotFoundException: File does not exist: /home/hduser/hadoop/ __elasticsearch-hadoop-1.3.0.M2.__ jar
> at org.apache.hadoop.hdfs. __DistributedFileSystem.__ getFileStatus( __DistributedFileSystem.java:__ 558)
> at org.apache.hadoop.filecache. __DistributedCache.__ getFileStatus(__DistributedCache.java:185)
> at
> org.apache.hadoop.filecache. __TrackerDistributedCacheManager__.getFileStatus( __TrackerDistributedCacheManager__.java:723)
> at
> org.apache.hadoop.filecache. __TrackerDistributedCacheManager__.determineTimestamps( __TrackerDistributedCacheManager__.java:778)
> at
> org.apache.hadoop.filecache. __TrackerDistributedCacheManager__. __determineTimestampsAndCacheVis__ ibilities( __TrackerDistributedCacheManager__.java:755)
> at org.apache.hadoop.mapred. __JobClient.__ copyAndConfigureFiles(__JobClient.java:843)
> at org.apache.hadoop.mapred. __JobClient.__ copyAndConfigureFiles(__JobClient.java:734)
> at org.apache.hadoop.mapred.__JobClient.access$400(__JobClient.java:179)
> at org.apache.hadoop.mapred.__JobClient$2.run(JobClient.__java:951)
> at org.apache.hadoop.mapred.__JobClient$2.run(JobClient.__java:936)
> at java.security.__AccessController.doPrivileged(__Native Method)
> at javax.security.auth.Subject.__doAs(Subject.java:415)
> at org.apache.hadoop.security.__UserGroupInformation.doAs(__UserGroupInformation.java:__1190)
> at org.apache.hadoop.mapred.__JobClient.submitJobInternal(__JobClient.java:936)
> at org.apache.hadoop.mapred.__JobClient.submitJob(JobClient.__java:910)
> at org.apache.hadoop.hive.ql.__exec.ExecDriver.execute(__ExecDriver.java:447)
> at org.apache.hadoop.hive.ql.__exec.MapRedTask.execute(__MapRedTask.java:138)
> at org.apache.hadoop.hive.ql.__exec.Task.executeTask(Task.__java:144)
> at org.apache.hadoop.hive.ql.__exec.TaskRunner.runSequential(__TaskRunner.java:57)
> at org.apache.hadoop.hive.ql.__Driver.launchTask(Driver.java:__1355)
> at org.apache.hadoop.hive.ql.__Driver.execute(Driver.java:__1139)
> at org.apache.hadoop.hive.ql.__Driver.run(Driver.java:945)
> at org.apache.hadoop.hive.cli.__CliDriver.processLocalCmd(__CliDriver.java:259)
> at org.apache.hadoop.hive.cli.__CliDriver.processCmd(__CliDriver.java:216)
> at org.apache.hadoop.hive.cli.__CliDriver.processLine(__CliDriver.java:413)
> at org.apache.hadoop.hive.cli.__CliDriver.run(CliDriver.java:__756)
> at org.apache.hadoop.hive.cli.__CliDriver.main(CliDriver.java:__614)
> at sun.reflect. __NativeMethodAccessorImpl.__ invoke0(Native Method)
> at sun.reflect. __NativeMethodAccessorImpl.__ invoke( __NativeMethodAccessorImpl.java:__ 57)
> at sun.reflect. __DelegatingMethodAccessorImpl.__ invoke( __DelegatingMethodAccessorImpl.__ java:43)
> at java.lang.reflect.Method.__invoke(Method.java:606)
> at org.apache.hadoop.util.RunJar.__main(RunJar.java:160)
> Job Submission failed with exception 'java.io <http://java.io>.__FileNotFoundException(File does not exist:
> /home/hduser/hadoop/ __elasticsearch-hadoop-1.3.0.M2.__ jar)'
> FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.__exec.MapRedTask
> 
> That path it exist :/home/hduser/hadoop/ __elasticsearch-hadoop-1.3.0.M2.__ jar
> Any help would be so appreciable
> Thanks
> 
> --
> You received this message because you are subscribed to the Google Groups "elasticsearch" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to
> elasticsearch+unsubscribe@__googlegroups.com <mailto:elasticsearch%2Bunsubscribe@googlegroups.com>
> <mailto:elasticsearch+__unsubscribe@googlegroups.com <mailto:elasticsearch%2Bunsubscribe@googlegroups.com>>.
> 
> To view this discussion on the web visit
> https://groups.google.com/d/ __msgid/elasticsearch/d1613b48-__ e58d-4077-a579-92b46a97bcff%__40googlegroups.com
> <https://groups.google.com/d/msgid/elasticsearch/d1613b48-e58d-4077-a579-92b46a97bcff%40googlegroups.com>
> <https://groups.google.com/d/ __msgid/elasticsearch/d1613b48-__ e58d-4077-a579-92b46a97bcff% __40googlegroups.com?utm_medium=__ email&utm_source=footer
> <https://groups.google.com/d/msgid/elasticsearch/d1613b48-e58d-4077-a579-92b46a97bcff%40googlegroups.com?utm_medium=email&utm_source=footer>>.
> 
> For more options, visit https://groups.google.com/d/__optout <https://groups.google.com/d/optout>.
> 
> --
> Costin
> 
> --
> You received this message because you are subscribed to the Google Groups "elasticsearch" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to
> elasticsearch+unsubscribe@__googlegroups.com <mailto:elasticsearch%2Bunsubscribe@googlegroups.com>.
> To view this discussion on the web visit
> https://groups.google.com/d/ __msgid/elasticsearch/537B549F.__ 8020501%40gmail.com
> <https://groups.google.com/d/msgid/elasticsearch/537B549F.8020501%40gmail.com>.
> 
> For more options, visit https://groups.google.com/d/__optout <https://groups.google.com/d/optout>.
> 
> ```
> 
> --  
> You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
> To unsubscribe from this group and stop receiving emails from it, send an email to  
> [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com) [mailto:elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> To view this discussion on the web visit  
> [https://groups.google.com/d/msgid/elasticsearch/CANXJSR9-xpGoJR4gvPW%3DKKP%3DVr\_5MxyDoUJKtbpqM6CsYs1G4Q%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CANXJSR9-xpGoJR4gvPW%3DKKP%3DVr_5MxyDoUJKtbpqM6CsYs1G4Q%40mail.gmail.com)  
> [https://groups.google.com/d/msgid/elasticsearch/CANXJSR9-xpGoJR4gvPW%3DKKP%3DVr\_5MxyDoUJKtbpqM6CsYs1G4Q%40mail.gmail.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/CANXJSR9-xpGoJR4gvPW%3DKKP%3DVr_5MxyDoUJKtbpqM6CsYs1G4Q%40mail.gmail.com?utm_medium=email&utm_source=footer).  
> For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

--  
Costin

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/537C738E.9030001%40gmail.com](https://groups.google.com/d/msgid/elasticsearch/537C738E.9030001%40gmail.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![hanine](https://avatars.discourse-cdn.com/v4/letter/h/b4bc9f/32.png) [@hanine](https://discuss.elastic.co/u/hanine)\
**Post date:** [May 21, 2014, 10:17am UTC](https://discuss.elastic.co/t/hadoop-elasticsearch-and-hive/17622/5 "2014-05-21T10:17:36Z")

</div>

yes, you are right.Thanks so much

well I tried hive with HDFS and it works very well,by the way I m using  
hive-0.11.0 , hadoop-1.2.1 and elasticsearch-1.0.1  
Here is the script of the tables  
CREATE EXTERNAL TABLE tweets (  
id BIGINT,  
created\_at STRING,  
source STRING,  
favorited BOOLEAN,  
retweet\_count INT,  
retweeted\_status STRUCT\<  
text:STRING,  
user:STRUCT\<screen\_name:STRING,name:STRING\>\>,  
entities STRUCT\<  
urls:ARRAY\<STRUCT\<expanded\_url:STRING\>\>,  
user\_mentions:ARRAY\<STRUCT\<screen\_name:STRING,name:STRING\>\>,  
hashtags:ARRAY\<STRUCTtext:STRING\>\>,  
text STRING,  
user STRUCT\<  
screen\_name:STRING,  
name:STRING,  
friends\_count:INT,  
followers\_count:INT,  
statuses\_count:INT,  
verified:BOOLEAN,  
utc\_offset:INT,  
time\_zone:STRING\>,  
in\_reply\_to\_screen\_name STRING  
)  
ROW FORMAT SERDE 'com.cloudera.hive.serde.JSONSerDe'  
LOCATION '/flume/Tweets\_A';

do I have to add "com.cloudera.hive.serde.JSONSerDe'" an other time to put  
data in elasticsearch ?? if yes,How !!

Thank you so very much

2014-05-21 10:36 GMT+01:00 Costin Leau [costin.leau@gmail.com](mailto:costin.leau@gmail.com):

> The error indicates that your script refers to a JSonSerDe class  
> (presumably from Cloudera) which cannot be found in the classpath:
> 
> "\> Caused by: java.lang.ClassNotFoundException: com.cloudera.hive.serde.  
> JSONSerDe"
> 
> In fact if you read through the stacktrace, you'll notice that this comes  
> up while the job configuration  
> is being read and this class name encountered but the class definition  
> itself cannot be resolved.
> 
> I'm not sure what causes this class to be added to the classpath of your  
> script - it could be your script or the client configuration.  
> Note the class is not used or added by ES-hadoop itself.
> 
> I'm not sure what distro you are using (es-hadoop works across Apache  
> Hadoop, Cloudera, HDP, MapR, Pivotal, etc...) but you could try running some  
> basic Hive scripts (without es-hadoop) first to make sure the environment  
> is sane and that you can properly read and write from HDFS and then add  
> es-hadoop into the mix.
> 
> Hope this helps,
> 
> On 5/21/14 12:15 PM, hanine haninne wrote:
> 
> > Thank you so much for ur answer  
> > here is what it gives me now
> > 
> > INSERT OVERWRITE TABLE tweetsES SELECT \* FROM tweets;
> > 
> > > 
> > 
> > Total MapReduce jobs = 1  
> > Launching Job 1 out of 1  
> > Number of reduce tasks is set to 0 since there's no reduce operator  
> > Starting Job = job\_201405210900\_0002, Tracking URL = [http://master:50030/](http://master:50030/)  
> > jobdetails.jsp?jobid=job\_201405210900\_0002  
> > Kill Command = /home/hduser/hadoop/libexec/../bin/hadoop job -kill  
> > job\_201405210900\_0002  
> > Hadoop job information for Stage-0: number of mappers: 1; number of  
> > reducers: 0  
> > 2014-05-21 10:12:05,285 Stage-0 map = 0%, reduce = 0%  
> > 2014-05-21 10:12:23,408 Stage-0 map = 100%, reduce = 100%  
> > Ended Job = job\_201405210900\_0002 with errors  
> > Error during job, obtaining debugging information...  
> > Job Tracking URL: [http://master:50030/jobdetails.jsp?jobid=job\_](http://master:50030/jobdetails.jsp?jobid=job_)  
> > 201405210900\_0002  
> > Examining task ID: task\_201405210900\_0002\_m\_000002 (and more) from job  
> > job\_201405210900\_0002
> > 
> > ## Task with the most failures(4):
> > 
> > Task ID:  
> > task\_201405210900\_0002\_m\_000000
> > 
> > ## URL: [http://master:50030/taskdetails.jsp?jobid=job\_](http://master:50030/taskdetails.jsp?jobid=job_) 201405210900\_0002&tipid=task\_201405210900\_0002\_m\_000000
> > 
> > Diagnostic Messages for this Task:  
> > java.lang.RuntimeException: Error in configuring object  
> > at org.apache.hadoop.util.ReflectionUtils.setJobConf(  
> > ReflectionUtils.java:93)  
> > at org.apache.hadoop.util.ReflectionUtils.setConf(  
> > ReflectionUtils.java:64)  
> > at org.apache.hadoop.util.ReflectionUtils.newInstance(  
> > ReflectionUtils.java:117)  
> > at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:426)  
> > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:366)  
> > at org.apache.hadoop.mapred.Child$4.run(Child.java:255)  
> > at java.security.AccessController.doPrivileged(Native Method)  
> > at javax.security.auth.Subject.doAs(Subject.java:415)  
> > at org.apache.hadoop.security.UserGroupInformation.doAs(  
> > UserGroupInformation.java:1190)  
> > at org.apache.hadoop.mapred.Child.main(Child.java:249)  
> > Caused by: java.lang.reflect.InvocationTargetException  
> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)  
> > at sun.reflect.NativeMethodAccessorImpl.invoke(  
> > NativeMethodAccessorImpl.java:57)  
> > at sun.reflect.DelegatingMethodAccessorImpl.invoke(  
> > DelegatingMethodAccessorImpl.java:43)  
> > at java.lang.reflect.Method.invoke(Method.java:606)  
> > at org.apache.hadoop.util.ReflectionUtils.setJobConf(  
> > ReflectionUtils.java:88)  
> > ... 9 more  
> > Caused by: java.lang.RuntimeException: Error in configuring object  
> > at org.apache.hadoop.util.ReflectionUtils.setJobConf(  
> > ReflectionUtils.java:93)  
> > at org.apache.hadoop.util.ReflectionUtils.setConf(  
> > ReflectionUtils.java:64)  
> > at org.apache.hadoop.util.ReflectionUtils.newInstance(  
> > ReflectionUtils.java:117)  
> > at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)  
> > ... 14 more  
> > Caused by: java.lang.reflect.InvocationTargetException  
> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)  
> > at sun.reflect.NativeMethodAccessorImpl.invoke(  
> > NativeMethodAccessorImpl.java:57)  
> > at sun.reflect.DelegatingMethodAccessorImpl.invoke(  
> > DelegatingMethodAccessorImpl.java:43)  
> > at java.lang.reflect.Method.invoke(Method.java:606)  
> > at org.apache.hadoop.util.ReflectionUtils.setJobConf(  
> > ReflectionUtils.java:88)  
> > ... 17 more  
> > Caused by: java.lang.RuntimeException: Map operator initialization failed  
> > at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(  
> > ExecMapper.java:121)  
> > ... 22 more  
> > Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.  
> > ClassNotFoundException:  
> > com.cloudera.hive.serde.JSONSerDe  
> > at org.apache.hadoop.hive.ql.exec.MapOperator.  
> > getConvertedOI(MapOperator.java:463)  
> > at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(  
> > MapOperator.java:479)  
> > at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(  
> > ExecMapper.java:90)  
> > ... 22 more  
> > Caused by: java.lang.ClassNotFoundException: com.cloudera.hive.serde.  
> > JSONSerDe  
> > at java.net.URLClassLoader$1.run(URLClassLoader.java:366)  
> > at java.net.URLClassLoader$1.run(URLClassLoader.java:355)  
> > at java.security.AccessController.doPrivileged(Native Method)  
> > at java.net.URLClassLoader.findClass(URLClassLoader.java:354)  
> > at java.lang.ClassLoader.loadClass(ClassLoader.java:424)  
> > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)  
> > at java.lang.ClassLoader.loadClass(ClassLoader.java:357)  
> > at java.lang.Class.forName0(Native Method)  
> > at java.lang.Class.forName(Class.java:270)  
> > at org.apache.hadoop.conf.Configuration.getClassByName(  
> > Configuration.java:810)  
> > at org.apache.hadoop.hive.ql.exec.MapOperator.  
> > getConvertedOI(MapOperator.java:422)  
> > ... 24 more
> > 
> > FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.  
> > exec.MapRedTask  
> > MapReduce Jobs Launched:  
> > Job 0: Map: 1 HDFS Read: 0 HDFS Write: 0 FAIL  
> > Total MapReduce CPU Time Spent: 0 msec
> > 
> > 2014-05-20 14:11 GMT+01:00 Costin Leau \<[costin.leau@gmail.com](mailto:costin.leau@gmail.com) \<mailto:  
> > [costin.leau@gmail.com](mailto:costin.leau@gmail.com)\>\>:
> > 
> > ```
> > 1. You don't need to add the hive jars (hive-serdes) to your script -
> > 
> > ```
> > 
> > these are already part of the runtime  
> > 2. use es-hadoop-2.0.RC1, 1.3 M2 is fairly old  
> > 3. Make sure that the jar is actually available and that is  
> > potentially accessible by Hive. Also do note that  
> > when running Hive against a cluster, it's best to have the jars  
> > available on all nodes hence why most folks copy  
> > them to HDFS and refer to that location.  
> > While /home/hduser might be locally available, it might not exist on  
> > the Hive server - as indicated by the error.
> > 
> > ```
> > Hope this helps,
> > 
> > On 5/20/14 3:58 PM, hanine haninne wrote:
> > 
> > Hello everybody
> > 
> > I m trying to take data from Hive and put it in elasticsearch
> > here is the script and the error
> > 
> > hive> ADD JAR /home/hduser/hadoop/hive-0.11.
> > 
> > ```
> > 
> > \_\_0/lib/hive-serdes-1.0-\_\_SNAPSHOT.jar;  
> > Added /home/hduser/hadoop/hive-0.11.\_\_0/lib/hive-serdes-1.0-\_\_SNAPSHOT.jar  
> > to class path  
> > Added resource: /home/hduser/hadoop/hive-0.11.  
> > \_\_0/lib/hive-serdes-1.0-\_\_SNAPSHOT.jar
> > 
> > ```
> > hive> CREATE EXTERNAL TABLE tweetsES (
> > > id BIGINT,
> > > created_at STRING,
> > > source STRING,
> > > favorited BOOLEAN,
> > > retweet_count INT,
> > > retweeted_status STRUCT<
> > > text:STRING,
> > > user:STRUCT<screen_name:__STRING,name:STRING>>,
> > > entities STRUCT<
> > > urls:ARRAY<STRUCT<expanded___url:STRING>>,
> > > user_mentions:ARRAY<STRUCT<__
> > 
> > ```
> > 
> > screen\_name:STRING,name:\_\_STRING\>\>,  
> > \> hashtags:ARRAY\<STRUCTtext:\_\_STRING\>\>,
> > 
> > ```
> > > text STRING,
> > > user STRUCT<
> > > screen_name:STRING,
> > > name:STRING,
> > > friends_count:INT,
> > > followers_count:INT,
> > > statuses_count:INT,
> > > verified:BOOLEAN,
> > > utc_offset:INT,
> > > time_zone:STRING>,
> > > in_reply_to_screen_name STRING
> > > )
> > > STORED BY 'org.elasticsearch.hadoop.__
> > 
> > ```
> > 
> > hive.EsStorageHandler'  
> > \> TBLPROPERTIES('es.resource' =  
> > 'reseaux\_sociaux/tweets','es.\_\_input.json' = 'yes');
> > 
> > ```
> > OK
> > Time taken: 4.292 seconds
> > hive> ADD JAR /home/hduser/hadoop/__
> > 
> > ```
> > 
> > elasticsearch-hadoop-1.3.0.M2.\_\_jar;  
> > Added /home/hduser/hadoop/\_\_elasticsearch-hadoop-1.3.0.M2.**jar  
> > to class path  
> > Added resource: /home/hduser/hadoop/**  
> > elasticsearch-hadoop-1.3.0.M2.\_\_jar
> > 
> > ```
> > hive> INSERT OVERWRITE TABLE tweetsES SELECT * FROM tweets;
> > Total MapReduce jobs = 1
> > Launching Job 1 out of 1
> > Number of reduce tasks is set to 0 since there's no reduce
> > 
> > ```
> > 
> > operator  
> > java.io.FileNotFoundException: File does not exist:  
> > /home/hduser/hadoop/\_\_elasticsearch-hadoop-1.3.0.M2.\_\_jar  
> > at org.apache.hadoop.hdfs. **DistributedFileSystem.**  
> > getFileStatus(\_\_DistributedFileSystem.java:\_\_558)  
> > at org.apache.hadoop.filecache. **DistributedCache.**  
> > getFileStatus(\_\_DistributedCache.java:185)  
> > at  
> > org.apache.hadoop.filecache.\_\_TrackerDistributedCacheManager  
> > **.getFileStatus(TrackerDistributedCacheManager.java:723)  
> > at  
> > org.apache.hadoop.filecache.TrackerDistributedCacheManager  
> > .determineTimestamps(TrackerDistributedCacheManager.java:778)  
> > at  
> > org.apache.hadoop.filecache.TrackerDistributedCacheManager.  
> > determineTimestampsAndCacheVis\_\_ibilities(  
> > TrackerDistributedCacheManager**.java:755)  
> > at org.apache.hadoop.mapred. **JobClient.**  
> > copyAndConfigureFiles(\_\_JobClient.java:843)  
> > at org.apache.hadoop.mapred. **JobClient.**  
> > copyAndConfigureFiles(\_\_JobClient.java:734)  
> > at org.apache.hadoop.mapred.**JobClient.access$400(**  
> > JobClient.java:179)  
> > at org.apache.hadoop.mapred.**JobClient$2.run(JobClient.**  
> > java:951)  
> > at org.apache.hadoop.mapred.**JobClient$2.run(JobClient.**  
> > java:936)  
> > at java.security.\_\_AccessController.doPrivileged(\_\_Native  
> > Method)  
> > at javax.security.auth.Subject.**doAs(Subject.java:415)  
> > at org.apache.hadoop.security.**  
> > UserGroupInformation.doAs(\_\_UserGroupInformation.java:**1190)  
> > at org.apache.hadoop.mapred.**  
> > JobClient.submitJobInternal(**JobClient.java:936)  
> > at org.apache.hadoop.mapred.**  
> > JobClient.submitJob(JobClient.**java:910)  
> > at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(  
> > ExecDriver.java:447)  
> > at org.apache.hadoop.hive.ql.exec.MapRedTask.execute(  
> > MapRedTask.java:138)  
> > at org.apache.hadoop.hive.ql.**  
> > exec.Task.executeTask(Task.**java:144)  
> > at org.apache.hadoop.hive.ql.**  
> > exec.TaskRunner.runSequential(**TaskRunner.java:57)  
> > at org.apache.hadoop.hive.ql.**  
> > Driver.launchTask(Driver.java:**1355)  
> > at org.apache.hadoop.hive.ql.**  
> > Driver.execute(Driver.java:\_\_1139)  
> > at org.apache.hadoop.hive.ql.**Driver.run(Driver.java:945)  
> > at org.apache.hadoop.hive.cli.**  
> > CliDriver.processLocalCmd(**CliDriver.java:259)  
> > at org.apache.hadoop.hive.cli.CliDriver.processCmd(  
> > CliDriver.java:216)  
> > at org.apache.hadoop.hive.cli.CliDriver.processLine(  
> > CliDriver.java:413)  
> > at org.apache.hadoop.hive.cli.**  
> > CliDriver.run(CliDriver.java:**756)  
> > at org.apache.hadoop.hive.cli.**  
> > CliDriver.main(CliDriver.java:\_\_614)  
> > at sun.reflect.\_\_NativeMethodAccessorImpl.\_\_invoke0(Native  
> > Method)  
> > at sun.reflect.\_\_NativeMethodAccessorImpl.**invoke(**  
> > NativeMethodAccessorImpl.java:\_\_57)  
> > at sun.reflect.\_\_DelegatingMethodAccessorImpl.**invoke(**  
> > DelegatingMethodAccessorImpl.\_\_java:43)  
> > at java.lang.reflect.Method.\_\_invoke(Method.java:606)  
> > at org.apache.hadoop.util.RunJar.\_\_main(RunJar.java:160)  
> > Job Submission failed with exception '[java.io](http://java.io) [http://java.io](http://java.io).\_\_FileNotFoundException(File  
> > does not exist:  
> > /home/hduser/hadoop/\_\_elasticsearch-hadoop-1.3.0.M2.\_\_jar)'  
> > FAILED: Execution Error, return code 1 from  
> > org.apache.hadoop.hive.ql.\_\_exec.MapRedTask
> > 
> > ```
> > That path it exist :/home/hduser/hadoop/__
> > 
> > ```
> > 
> > elasticsearch-hadoop-1.3.0.M2.\_\_jar
> > 
> > ```
> > Any help would be so appreciable
> > Thanks
> > 
> > --
> > You received this message because you are subscribed to the
> > 
> > ```
> > 
> > Google Groups "elasticsearch" group.  
> > To unsubscribe from this group and stop receiving emails from it,  
> > send an email to  
> > elasticsearch+unsubscribe@\_\_googlegroups.com \<mailto:  
> > elasticsearch%2Bunsubscribe@googlegroups.com\>  
> > \<[mailto:elasticsearch+\_\_unsubscribe@googlegroups.com](mailto:elasticsearch+__unsubscribe@googlegroups.com) \<mailto:  
> > elasticsearch%2Bunsubscribe@googlegroups.com\>\>.
> > 
> > ```
> > To view this discussion on the web visit
> > https://groups.google.com/d/__msgid/elasticsearch/d1613b48-_
> > 
> > ```
> > 
> > \_e58d-4077-a579-92b46a97bcff%\_\_40googlegroups.com  
> > \<[https://groups.google.com/d/msgid/elasticsearch/d1613b48-](https://groups.google.com/d/msgid/elasticsearch/d1613b48-)  
> > e58d-4077-a579-92b46a97bcff%[40googlegroups.com](http://40googlegroups.com)\>  
> > \<[https://groups.google.com/d/\_\_msgid/elasticsearch/d1613b48-](https://groups.google.com/d/__msgid/elasticsearch/d1613b48-)  
> > \_\_e58d-4077-a579-92b46a97bcff%\__[40GGGROUPS CASINO – Real Slot Casino for 10,000+ Senior Players](http://40googlegroups.com?utm)_  
> > medium=\_\_email&utm\_source=footer  
> > \<[https://groups.google.com/d/msgid/elasticsearch/d1613b48-](https://groups.google.com/d/msgid/elasticsearch/d1613b48-)  
> > e58d-4077-a579-92b46a97bcff%[40GGGROUPS CASINO – Real Slot Casino for 10,000+ Senior Players](http://40googlegroups.com?utm_medium=)  
> > email&utm\_source=footer\>\>.
> > 
> > ```
> > For more options, visit https://groups.google.com/d/__optout <
> > 
> > ```
> > 
> > [https://groups.google.com/d/optout](https://groups.google.com/d/optout)\>.
> > 
> > ```
> > --
> > Costin
> > 
> > --
> > You received this message because you are subscribed to the Google
> > 
> > ```
> > 
> > Groups "elasticsearch" group.  
> > To unsubscribe from this group and stop receiving emails from it,  
> > send an email to  
> > elasticsearch+unsubscribe@\_\_googlegroups.com \<mailto:elasticsearch%  
> > [2Bunsubscribe@googlegroups.com](mailto:2Bunsubscribe@googlegroups.com)\>.
> > 
> > ```
> > To view this discussion on the web visit
> > https://groups.google.com/d/__msgid/elasticsearch/537B549F._
> > 
> > ```
> > 
> > \_8020501%[40gmail.com](http://40gmail.com)  
> > \<[https://groups.google.com/d/msgid/elasticsearch/537B549F](https://groups.google.com/d/msgid/elasticsearch/537B549F).  
> > 8020501%[40gmail.com](http://40gmail.com)\>.
> > 
> > ```
> > For more options, visit https://groups.google.com/d/__optout <
> > 
> > ```
> > 
> > [https://groups.google.com/d/optout](https://groups.google.com/d/optout)\>.
> > 
> > --  
> > You received this message because you are subscribed to the Google Groups  
> > "elasticsearch" group.  
> > To unsubscribe from this group and stop receiving emails from it, send an  
> > email to  
> > [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com) \<mailto:elasticsearch+  
> > [unsubscribe@googlegroups.com](mailto:unsubscribe@googlegroups.com)\>.  
> > To view this discussion on the web visit  
> > [https://groups.google.com/d/msgid/elasticsearch/CANXJSR9-](https://groups.google.com/d/msgid/elasticsearch/CANXJSR9-)  
> > xpGoJR4gvPW%3DKKP%3DVr\_5MxyDoUJKtbpqM6CsYs1G4Q%[40mail.gmail.com](http://40mail.gmail.com)  
> > \<[https://groups.google.com/d/msgid/elasticsearch/CANXJSR9-](https://groups.google.com/d/msgid/elasticsearch/CANXJSR9-)  
> > xpGoJR4gvPW%3DKKP%3DVr\_5MxyDoUJKtbpqM6CsYs1G4Q%  
> > [40mail.gmail.com?utm\_medium=email&utm\_source=footer](http://40mail.gmail.com?utm_medium=email&utm_source=footer)\>.
> > 
> > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).
> 
> --  
> Costin
> 
> --  
> You received this message because you are subscribed to the Google Groups  
> "elasticsearch" group.  
> To unsubscribe from this group and stop receiving emails from it, send an  
> email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> To view this discussion on the web visit [https://groups.google.com/d/](https://groups.google.com/d/)  
> msgid/elasticsearch/537C738E.9030001%[40gmail.com](http://40gmail.com).
> 
> For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CANXJSR8Gy4qhM8Lzm5BHCr2-xptLKBSdm00nCrz-JtnW59jWcw%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CANXJSR8Gy4qhM8Lzm5BHCr2-xptLKBSdm00nCrz-JtnW59jWcw%40mail.gmail.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![costin](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/costin/32/44950_2.png) [@costin](https://discuss.elastic.co/u/costin)\
**Post date:** [May 21, 2014, 11:00am UTC](https://discuss.elastic.co/t/hadoop-elasticsearch-and-hive/17622/6 "2014-05-21T11:00:33Z")

</div>

If you plan to use es-hadoop, there's no need to do any JSON conversion (es-hadoop does that automatically) - see the  
documentation at [1]  
for more information.  
If not than I recommend reaching out to the providers of the package for more information on its configuration.

[1] [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://elasticsearch.org/hadoop)

On 5/21/14 1:17 PM, hanine haninne wrote:

> yes, you are right.Thanks so much
> 
> well I tried hive with HDFS and it works very well,by the way I m using hive-0.11.0 , hadoop-1.2.1 and elasticsearch-1.0.1  
> Here is the script of the tables  
> CREATE EXTERNAL TABLE tweets (  
> id BIGINT,  
> created\_at STRING,  
> source STRING,  
> favorited BOOLEAN,  
> retweet\_count INT,  
> retweeted\_status STRUCT\<  
> text:STRING,  
> user:STRUCT\<screen\_name:STRING,name:STRING\>\>,  
> entities STRUCT\<  
> urls:ARRAY\<STRUCT\<expanded\_url:STRING\>\>,  
> user\_mentions:ARRAY\<STRUCT\<screen\_name:STRING,name:STRING\>\>,  
> hashtags:ARRAY\<STRUCTtext:STRING\>\>,  
> text STRING,  
> user STRUCT\<  
> screen\_name:STRING,  
> name:STRING,  
> friends\_count:INT,  
> followers\_count:INT,  
> statuses\_count:INT,  
> verified:BOOLEAN,  
> utc\_offset:INT,  
> time\_zone:STRING\>,  
> in\_reply\_to\_screen\_name STRING  
> )  
> ROW FORMAT SERDE 'com.cloudera.hive.serde.JSONSerDe'  
> LOCATION '/flume/Tweets\_A';
> 
> do I have to add "com.cloudera.hive.serde.JSONSerDe'" an other time to put data in elasticsearch ?? if yes,How !!
> 
> Thank you so very much
> 
> 2014-05-21 10:36 GMT+01:00 Costin Leau \<[costin.leau@gmail.com](mailto:costin.leau@gmail.com) [mailto:costin.leau@gmail.com](mailto:costin.leau@gmail.com)\>:
> 
> ```
> The error indicates that your script refers to a JSonSerDe class (presumably from Cloudera) which cannot be found in
> the classpath:
> 
> "> Caused by: java.lang. __ClassNotFoundException: com.cloudera.hive.serde.__ JSONSerDe"
> 
> In fact if you read through the stacktrace, you'll notice that this comes up while the job configuration
> is being read and this class name encountered but the class definition itself cannot be resolved.
> 
> I'm not sure what causes this class to be added to the classpath of your script - it could be your script or the
> client configuration.
> Note the class is not used or added by ES-hadoop itself.
> 
> I'm not sure what distro you are using (es-hadoop works across Apache Hadoop, Cloudera, HDP, MapR, Pivotal, etc...)
> but you could try running some
> basic Hive scripts (without es-hadoop) first to make sure the environment is sane and that you can properly read and
> write from HDFS and then add
> es-hadoop into the mix.
> 
> Hope this helps,
> 
> On 5/21/14 12:15 PM, hanine haninne wrote:
> 
> Thank you so much for ur answer
> here is what it gives me now
> 
> INSERT OVERWRITE TABLE tweetsES SELECT * FROM tweets;
> 
> Total MapReduce jobs = 1
> Launching Job 1 out of 1
> Number of reduce tasks is set to 0 since there's no reduce operator
> Starting Job = job_201405210900_0002, Tracking URL =
> http://master:50030/ __jobdetails.jsp?jobid=job___ 201405210900_0002
> <http://master:50030/jobdetails.jsp?jobid=job_201405210900_0002>
> Kill Command = /home/hduser/hadoop/libexec/..__/bin/hadoop job -kill job_201405210900_0002
> Hadoop job information for Stage-0: number of mappers: 1; number of reducers: 0
> 2014-05-21 10:12:05,285 Stage-0 map = 0%, reduce = 0%
> 2014-05-21 10:12:23,408 Stage-0 map = 100%, reduce = 100%
> Ended Job = job_201405210900_0002 with errors
> Error during job, obtaining debugging information...
> Job Tracking URL: http://master:50030/ __jobdetails.jsp?jobid=job___ 201405210900_0002
> <http://master:50030/jobdetails.jsp?jobid=job_201405210900_0002>
> Examining task ID: task_201405210900_0002_m___000002 (and more) from job job_201405210900_0002
> 
> Task with the most failures(4):
> -----
> Task ID:
> task_201405210900_0002_m___000000
> 
> URL:
> http://master:50030/ __taskdetails.jsp?jobid=job___ 201405210900_0002&tipid=task___201405210900_0002_m_000000
> <http://master:50030/taskdetails.jsp?jobid=job_201405210900_0002&tipid=task_201405210900_0002_m_000000>
> -----
> Diagnostic Messages for this Task:
> java.lang.RuntimeException: Error in configuring object
> at org.apache.hadoop.util.__ReflectionUtils.setJobConf(__ReflectionUtils.java:93)
> at org.apache.hadoop.util.__ReflectionUtils.setConf(__ReflectionUtils.java:64)
> at org.apache.hadoop.util.__ReflectionUtils.newInstance(__ReflectionUtils.java:117)
> at org.apache.hadoop.mapred.__MapTask.runOldMapper(MapTask.__java:426)
> at org.apache.hadoop.mapred.__MapTask.run(MapTask.java:366)
> at org.apache.hadoop.mapred.__Child$4.run(Child.java:255)
> at java.security.__AccessController.doPrivileged(__Native Method)
> at javax.security.auth.Subject.__doAs(Subject.java:415)
> at org.apache.hadoop.security.__UserGroupInformation.doAs(__UserGroupInformation.java:__1190)
> at org.apache.hadoop.mapred.__Child.main(Child.java:249)
> Caused by: java.lang.reflect.__InvocationTargetException
> at sun.reflect. __NativeMethodAccessorImpl.__ invoke0(Native Method)
> at sun.reflect. __NativeMethodAccessorImpl.__ invoke( __NativeMethodAccessorImpl.java:__ 57)
> at sun.reflect. __DelegatingMethodAccessorImpl.__ invoke( __DelegatingMethodAccessorImpl.__ java:43)
> at java.lang.reflect.Method.__invoke(Method.java:606)
> at org.apache.hadoop.util.__ReflectionUtils.setJobConf(__ReflectionUtils.java:88)
> ... 9 more
> Caused by: java.lang.RuntimeException: Error in configuring object
> at org.apache.hadoop.util.__ReflectionUtils.setJobConf(__ReflectionUtils.java:93)
> at org.apache.hadoop.util.__ReflectionUtils.setConf(__ReflectionUtils.java:64)
> at org.apache.hadoop.util.__ReflectionUtils.newInstance(__ReflectionUtils.java:117)
> at org.apache.hadoop.mapred.__MapRunner.configure(MapRunner.__java:34)
> ... 14 more
> Caused by: java.lang.reflect.__InvocationTargetException
> at sun.reflect. __NativeMethodAccessorImpl.__ invoke0(Native Method)
> at sun.reflect. __NativeMethodAccessorImpl.__ invoke( __NativeMethodAccessorImpl.java:__ 57)
> at sun.reflect. __DelegatingMethodAccessorImpl.__ invoke( __DelegatingMethodAccessorImpl.__ java:43)
> at java.lang.reflect.Method.__invoke(Method.java:606)
> at org.apache.hadoop.util.__ReflectionUtils.setJobConf(__ReflectionUtils.java:88)
> ... 17 more
> Caused by: java.lang.RuntimeException: Map operator initialization failed
> at org.apache.hadoop.hive.ql.__exec.ExecMapper.configure(__ExecMapper.java:121)
> ... 22 more
> Caused by: org.apache.hadoop.hive.ql. __metadata.HiveException: java.lang.__ ClassNotFoundException:
> com.cloudera.hive.serde.__JSONSerDe
> at org.apache.hadoop.hive.ql. __exec.MapOperator.__ getConvertedOI(MapOperator.__java:463)
> at org.apache.hadoop.hive.ql.__exec.MapOperator.setChildren(__MapOperator.java:479)
> at org.apache.hadoop.hive.ql.__exec.ExecMapper.configure(__ExecMapper.java:90)
> ... 22 more
> Caused by: java.lang. __ClassNotFoundException: com.cloudera.hive.serde.__ JSONSerDe
> at java.net.URLClassLoader$1.run(__URLClassLoader.java:366)
> at java.net.URLClassLoader$1.run(__URLClassLoader.java:355)
> at java.security.__AccessController.doPrivileged(__Native Method)
> at java.net.URLClassLoader.__findClass(URLClassLoader.java:__354)
> at java.lang.ClassLoader.__loadClass(ClassLoader.java:__424)
> at sun.misc.Launcher$__AppClassLoader.loadClass(__Launcher.java:308)
> at java.lang.ClassLoader.__loadClass(ClassLoader.java:__357)
> at java.lang.Class.forName0(__Native Method)
> at java.lang.Class.forName(Class.__java:270)
> at org.apache.hadoop.conf.__Configuration.getClassByName(__Configuration.java:810)
> at org.apache.hadoop.hive.ql. __exec.MapOperator.__ getConvertedOI(MapOperator.__java:422)
> ... 24 more
> 
> FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.__exec.MapRedTask
> MapReduce Jobs Launched:
> Job 0: Map: 1 HDFS Read: 0 HDFS Write: 0 FAIL
> Total MapReduce CPU Time Spent: 0 msec
> 
> 2014-05-20 14:11 GMT+01:00 Costin Leau <costin.leau@gmail.com <mailto:costin.leau@gmail.com>
> <mailto:costin.leau@gmail.com <mailto:costin.leau@gmail.com>>__>:
> 
> 1. You don't need to add the hive jars (hive-serdes) to your script - these are already part of the runtime
> 2. use es-hadoop-2.0.RC1, 1.3 M2 is fairly old
> 3. Make sure that the jar is actually available and that is potentially accessible by Hive. Also do note that
> when running Hive against a cluster, it's best to have the jars available on all nodes hence why most folks
> copy
> them to HDFS and refer to that location.
> While /home/hduser might be locally available, it might not exist on the Hive server - as indicated by the
> error.
> 
> Hope this helps,
> 
> On 5/20/14 3:58 PM, hanine haninne wrote:
> 
> Hello everybody
> 
> I m trying to take data from Hive and put it in elasticsearch
> here is the script and the error
> 
> hive> ADD JAR /home/hduser/hadoop/hive-0.11. ____0/lib/hive-serdes-1.0-____ SNAPSHOT.jar;
> Added /home/hduser/hadoop/hive-0.11. ____0/lib/hive-serdes-1.0-____ SNAPSHOT.jar to class path
> Added resource: /home/hduser/hadoop/hive-0.11. ____0/lib/hive-serdes-1.0-____ SNAPSHOT.jar
> 
> hive> CREATE EXTERNAL TABLE tweetsES (
> > id BIGINT,
> > created_at STRING,
> > source STRING,
> > favorited BOOLEAN,
> > retweet_count INT,
> > retweeted_status STRUCT<
> > text:STRING,
> > user:STRUCT<screen_name: ____ STRING,name:STRING>>,
> > entities STRUCT<
> > urls:ARRAY<STRUCT<expanded _____ url:STRING>>,
> > user_mentions:ARRAY<STRUCT< ____screen_name:STRING,name:____ STRING>>,
> > hashtags:ARRAY<STRUCT<text: ____ STRING>>>,
> 
> > text STRING,
> > user STRUCT<
> > screen_name:STRING,
> > name:STRING,
> > friends_count:INT,
> > followers_count:INT,
> > statuses_count:INT,
> > verified:BOOLEAN,
> > utc_offset:INT,
> > time_zone:STRING>,
> > in_reply_to_screen_name STRING
> > )
> > STORED BY 'org.elasticsearch.hadoop. ____ hive.EsStorageHandler'
> > TBLPROPERTIES('es.resource' = 'reseaux_sociaux/tweets','es. ____ input.json' = 'yes');
> 
> OK
> Time taken: 4.292 seconds
> hive> ADD JAR /home/hduser/hadoop/ ____elasticsearch-hadoop-1.3.0.M2.____ jar;
> Added /home/hduser/hadoop/ ____elasticsearch-hadoop-1.3.0.M2.____ jar to class path
> Added resource: /home/hduser/hadoop/ ____elasticsearch-hadoop-1.3.0.M2.____ jar
> 
> hive> INSERT OVERWRITE TABLE tweetsES SELECT * FROM tweets;
> Total MapReduce jobs = 1
> Launching Job 1 out of 1
> Number of reduce tasks is set to 0 since there's no reduce operator
> java.io.FileNotFoundException: File does not exist:
> /home/hduser/hadoop/ ____elasticsearch-hadoop-1.3.0.M2.____ jar
> at
> org.apache.hadoop.hdfs. ____DistributedFileSystem.____ getFileStatus( ____DistributedFileSystem.java:____ 558)
> at org.apache.hadoop.filecache. ____DistributedCache.____ getFileStatus( ____ DistributedCache.java:185)
> at
> 
> org.apache.hadoop.filecache. ____TrackerDistributedCacheManager____.getFileStatus( ____TrackerDistributedCacheManager____.java:723)
> at
> 
> org.apache.hadoop.filecache. ____TrackerDistributedCacheManager____.determineTimestamps( ____TrackerDistributedCacheManager____.java:778)
> at
> 
> org.apache.hadoop.filecache. ____TrackerDistributedCacheManager____. ____determineTimestampsAndCacheVis____ ibilities( ____TrackerDistributedCacheManager____.java:755)
> at org.apache.hadoop.mapred. ____JobClient.____ copyAndConfigureFiles( ____ JobClient.java:843)
> at org.apache.hadoop.mapred. ____JobClient.____ copyAndConfigureFiles( ____ JobClient.java:734)
> at org.apache.hadoop.mapred.____JobClient.access$400(____JobClient.java:179)
> at org.apache.hadoop.mapred.____JobClient$2.run(JobClient.____java:951)
> at org.apache.hadoop.mapred.____JobClient$2.run(JobClient.____java:936)
> at java.security.____AccessController.doPrivileged(____Native Method)
> at javax.security.auth.Subject. ____ doAs(Subject.java:415)
> at org.apache.hadoop.security.____UserGroupInformation.doAs(____UserGroupInformation.java: ____ 1190)
> at org.apache.hadoop.mapred.____JobClient.submitJobInternal(____JobClient.java:936)
> at org.apache.hadoop.mapred.____JobClient.submitJob(JobClient.____java:910)
> at org.apache.hadoop.hive.ql.____exec.ExecDriver.execute(____ExecDriver.java:447)
> at org.apache.hadoop.hive.ql.____exec.MapRedTask.execute(____MapRedTask.java:138)
> at org.apache.hadoop.hive.ql.____exec.Task.executeTask(Task.____java:144)
> at org.apache.hadoop.hive.ql.____exec.TaskRunner.runSequential(____TaskRunner.java:57)
> at org.apache.hadoop.hive.ql.____Driver.launchTask(Driver.java:____1355)
> at org.apache.hadoop.hive.ql.____Driver.execute(Driver.java:____1139)
> at org.apache.hadoop.hive.ql. ____ Driver.run(Driver.java:945)
> at org.apache.hadoop.hive.cli.____CliDriver.processLocalCmd(____CliDriver.java:259)
> at org.apache.hadoop.hive.cli.____CliDriver.processCmd(____CliDriver.java:216)
> at org.apache.hadoop.hive.cli.____CliDriver.processLine(____CliDriver.java:413)
> at org.apache.hadoop.hive.cli.____CliDriver.run(CliDriver.java:____756)
> at org.apache.hadoop.hive.cli.____CliDriver.main(CliDriver.java:____614)
> at sun.reflect. ____NativeMethodAccessorImpl.____ invoke0(Native Method)
> at sun.reflect. ____NativeMethodAccessorImpl.____ invoke( ____NativeMethodAccessorImpl.java:____ 57)
> at
> sun.reflect. ____DelegatingMethodAccessorImpl.____ invoke( ____DelegatingMethodAccessorImpl.____ java:43)
> at java.lang.reflect.Method. ____ invoke(Method.java:606)
> at org.apache.hadoop.util.RunJar. ____ main(RunJar.java:160)
> Job Submission failed with exception 'java.io <http://java.io>
> <http://java.io>. ____ FileNotFoundException(File does not exist:
> /home/hduser/hadoop/ ____elasticsearch-hadoop-1.3.0.M2.____ jar)'
> FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql. ____ exec.MapRedTask
> 
> That path it exist :/home/hduser/hadoop/ ____elasticsearch-hadoop-1.3.0.M2.____ jar
> 
> Any help would be so appreciable
> Thanks
> 
> --
> You received this message because you are subscribed to the Google Groups "elasticsearch" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to
> elasticsearch+unsubscribe@ __go__ oglegroups.com <http://googlegroups.com>
> <mailto:elasticsearch% __2Bunsubscribe@googlegroups.com <mailto:elasticsearch%252Bunsubscribe@googlegroups.com>__ >
> <mailto:elasticsearch+ ____ unsubscribe@googlegroups.com
> <mailto:elasticsearch%2B __unsubscribe@googlegroups.com> <mailto:elasticsearch%__ 2Bunsubscribe@googlegroups.com
> <mailto:elasticsearch%252Bunsubscribe@googlegroups.com>__>>.
> 
> To view this discussion on the web visit
> https://groups.google.com/d/ ____msgid/elasticsearch/d1613b48-____ e58d-4077-a579-92b46a97bcff% ____ 40googlegroups.com
> <https://groups.google.com/d/ __msgid/elasticsearch/d1613b48-__ e58d-4077-a579-92b46a97bcff%__40googlegroups.com>
> 
> <https://groups.google.com/d/ __msgid/elasticsearch/d1613b48-__ e58d-4077-a579-92b46a97bcff%__40googlegroups.com
> <https://groups.google.com/d/msgid/elasticsearch/d1613b48-e58d-4077-a579-92b46a97bcff%40googlegroups.com>>
> 
> <https://groups.google.com/d/ ____msgid/elasticsearch/d1613b48-____ e58d-4077-a579-92b46a97bcff% ____40googlegroups.com?utm___ medium= __email&utm_source=__ footer
> <https://groups.google.com/d/ __msgid/elasticsearch/d1613b48-__ e58d-4077-a579-92b46a97bcff% __40googlegroups.com?utm_medium=__ email&utm_source=footer>
> 
> <https://groups.google.com/d/ __msgid/elasticsearch/d1613b48-__ e58d-4077-a579-92b46a97bcff% __40googlegroups.com?utm_medium=__ email&utm_source=footer
> <https://groups.google.com/d/msgid/elasticsearch/d1613b48-e58d-4077-a579-92b46a97bcff%40googlegroups.com?utm_medium=email&utm_source=footer>>>.
> 
> For more options, visit https://groups.google.com/d/ ____optout <https://groups.google.com/d/__ optout>
> <https://groups.google.com/d/__optout <https://groups.google.com/d/optout>>.
> 
> --
> Costin
> 
> --
> You received this message because you are subscribed to the Google Groups "elasticsearch" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to
> elasticsearch+unsubscribe@ __go__ oglegroups.com <http://googlegroups.com>
> <mailto:elasticsearch% __2Bunsubscribe@googlegroups.com <mailto:elasticsearch%252Bunsubscribe@googlegroups.com>__ >.
> 
> To view this discussion on the web visit
> https://groups.google.com/d/ ____msgid/elasticsearch/537B549F.____ 8020501%40gmail.com
> <https://groups.google.com/d/ __msgid/elasticsearch/537B549F.__ 8020501%40gmail.com>
> <https://groups.google.com/d/ __msgid/elasticsearch/537B549F.__ 8020501%40gmail.com
> <https://groups.google.com/d/msgid/elasticsearch/537B549F.8020501%40gmail.com>>.
> 
> For more options, visit https://groups.google.com/d/ ____optout <https://groups.google.com/d/__ optout>
> <https://groups.google.com/d/__optout <https://groups.google.com/d/optout>>.
> 
> --
> You received this message because you are subscribed to the Google Groups "elasticsearch" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to
> elasticsearch+unsubscribe@__googlegroups.com <mailto:elasticsearch%2Bunsubscribe@googlegroups.com>
> <mailto:elasticsearch+__unsubscribe@googlegroups.com <mailto:elasticsearch%2Bunsubscribe@googlegroups.com>>.
> To view this discussion on the web visit
> https://groups.google.com/d/ __msgid/elasticsearch/CANXJSR9-__ xpGoJR4gvPW%3DKKP%3DVr ___5MxyDoUJKtbpqM6CsYs1G4Q%__ 40mail.gmail.com
> <https://groups.google.com/d/msgid/elasticsearch/CANXJSR9-xpGoJR4gvPW%3DKKP%3DVr_5MxyDoUJKtbpqM6CsYs1G4Q%40mail.gmail.com>
> <https://groups.google.com/d/ __msgid/elasticsearch/CANXJSR9-__ xpGoJR4gvPW%3DKKP%3DVr ___5MxyDoUJKtbpqM6CsYs1G4Q%__ 40mail.gmail.com?utm_medium=__email&utm_source=footer
> <https://groups.google.com/d/msgid/elasticsearch/CANXJSR9-xpGoJR4gvPW%3DKKP%3DVr_5MxyDoUJKtbpqM6CsYs1G4Q%40mail.gmail.com?utm_medium=email&utm_source=footer>>.
> 
> For more options, visit https://groups.google.com/d/__optout <https://groups.google.com/d/optout>.
> 
> --
> Costin
> 
> --
> You received this message because you are subscribed to the Google Groups "elasticsearch" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to
> elasticsearch+unsubscribe@__googlegroups.com <mailto:elasticsearch%2Bunsubscribe@googlegroups.com>.
> To view this discussion on the web visit
> https://groups.google.com/d/ __msgid/elasticsearch/537C738E.__ 9030001%40gmail.com
> <https://groups.google.com/d/msgid/elasticsearch/537C738E.9030001%40gmail.com>.
> 
> For more options, visit https://groups.google.com/d/__optout <https://groups.google.com/d/optout>.
> 
> ```
> 
> --  
> You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
> To unsubscribe from this group and stop receiving emails from it, send an email to  
> [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com) [mailto:elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> To view this discussion on the web visit  
> [https://groups.google.com/d/msgid/elasticsearch/CANXJSR8Gy4qhM8Lzm5BHCr2-xptLKBSdm00nCrz-JtnW59jWcw%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CANXJSR8Gy4qhM8Lzm5BHCr2-xptLKBSdm00nCrz-JtnW59jWcw%40mail.gmail.com)  
> [https://groups.google.com/d/msgid/elasticsearch/CANXJSR8Gy4qhM8Lzm5BHCr2-xptLKBSdm00nCrz-JtnW59jWcw%40mail.gmail.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/CANXJSR8Gy4qhM8Lzm5BHCr2-xptLKBSdm00nCrz-JtnW59jWcw%40mail.gmail.com?utm_medium=email&utm_source=footer).  
> For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

--  
Costin

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/537C8751.1030908%40gmail.com](https://groups.google.com/d/msgid/elasticsearch/537C8751.1030908%40gmail.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![hanine](https://avatars.discourse-cdn.com/v4/letter/h/b4bc9f/32.png) [@hanine](https://discuss.elastic.co/u/hanine)\
**Post date:** [May 22, 2014, 9:13am UTC](https://discuss.elastic.co/t/hadoop-elasticsearch-and-hive/17622/7 "2014-05-22T09:13:02Z")

</div>

Hello again,  
I m trying to get some tweets from the HDFS and put it in  
elasticsearch(head) in order to make search on it, I did what u said and I  
m so thankful, But it start reading and does not continue. I don't know why  
?!!  
here is what I did :

hive -hiveconf  
hive.aux.jars.path=/ES\_Hadoop/dist/elasticsearch-hadoop-2.0.0.RC1.jar

Logging initialized using configuration in  
jar:file:/home/hduser/hadoop/hive-0.11.0/lib/hive-common-0.11.0.jar!/hive-log4j.properties  
Hive history  
file=/tmp/hduser/hive\_job\_log\_hduser\_8166@mouna-pc\_201405220958\_2036150447.txt

hive\> ADD JAR  
/home/hduser/hadoop/hive-0.11.0/lib/hive-serdes-1.0-SNAPSHOT.jar;  
Added /home/hduser/hadoop/hive-0.11.0/lib/hive-serdes-1.0-SNAPSHOT.jar to  
class path  
Added resource:  
/home/hduser/hadoop/hive-0.11.0/lib/hive-serdes-1.0-SNAPSHOT.jar  
hive\> INSERT OVERWRITE TABLE tweetsES SELECT \* FROM  
tweets;  
Total MapReduce jobs = 1  
Launching Job 1 out of 1  
Number of reduce tasks is set to 0 since there's no reduce operator  
Starting Job = job\_201405220937\_0005, Tracking URL =  
[http://master:50030/jobdetails.jsp?jobid=job\_201405220937\_0005](http://master:50030/jobdetails.jsp?jobid=job_201405220937_0005)  
Kill Command = /home/hduser/hadoop/libexec/../bin/hadoop job -kill  
job\_201405220937\_0005  
Hadoop job information for Stage-0: number of mappers: 1; number of  
reducers: 0  
2014-05-22 10:01:39,184 Stage-0 map = 0%, reduce = 0%  
2014-05-22 10:01:59,320 Stage-0 map = 100%, reduce = 100%  
Ended Job = job\_201405220937\_0005 with errors  
Error during job, obtaining debugging information...  
Job Tracking URL:  
[http://master:50030/jobdetails.jsp?jobid=job\_201405220937\_0005](http://master:50030/jobdetails.jsp?jobid=job_201405220937_0005)  
Examining task ID: task\_201405220937\_0005\_m\_000002 (and more) from job  
job\_201405220937\_0005

## Task with the most failures(4):

Task ID:  
task\_201405220937\_0005\_m\_000000

URL:

## [http://master:50030/taskdetails.jsp?jobid=job\_201405220937\_0005&tipid=task\_201405220937\_0005\_m\_000000](http://master:50030/taskdetails.jsp?jobid=job_201405220937_0005&tipid=task_201405220937_0005_m_000000)

Diagnostic Messages for this Task:  
java.lang.RuntimeException:  
org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while  
processing row {"id":467649114269028352,"created\_at":"Sat May 17 12:53:32  
+0000 2014","source":"\<a href="[http://www.apple.com](http://www.apple.com)"  
rel="nofollow"\>iOS","favorited":false,"retweet\_count":0,"retweeted\_status":null,"entities":{"urls":[{"expanded\_url":"  
[viera lifting fa cup for arsenal - Google Search](https://www.google.co.uk/search?q=viera+lifting+fa+cup+for+arsenal&client=safari&hl=en-gb&source=lnms&tbm=isch&sa=X&ei=alp3U4LrK82UOufRgaAK&ved=0CAYQ_AUoAQ&biw=320&bih=460#facrc=_&imgrc=-QK5IhwQT8AS8M%253A%3B2yfUWG7-cngS-M%3Bhttp%253A%252F%252Ffarm4.static.flickr.com%252F3777%252F10838930556_618b87d7cc_m.jpg%3Bhttp%253A%252F%252Fwhotalking.com%252Fflickr%252F2-0%252BChelsea%3B1024%3B669%22%7D%5D,%22user_mentions%22:%5B%7B%22screen_name%22:%22jameswilliams46%22,%22name%22:%22James)  
Williams"}],"hashtags":},"text":"@jameswilliams46  
[https://t.co/CAmxdagAym","user":{"screen\_name":"SSimpson7379","name":"Stephen](https://t.co/CAmxdagAym%22,%22user%22:%7B%22screen_name%22:%22SSimpson7379%22,%22name%22:%22Stephen)  
Simpson","friends\_count":258,"followers\_count":266,"statuses\_count":2609,"verified":false,"utc\_offset":3600,"time\_zone":"London"},"in\_reply\_to\_screen\_name":"jameswilliams46"}  
at org.apache.hadoop.hive.ql.exec.ExecMapper.map(ExecMapper.java:162)  
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)  
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:430)  
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:366)  
at org.apache.hadoop.mapred.Child$4.run(Child.java:255)  
at java.security.AccessController.doPrivileged(Native Method)  
at javax.security.auth.Subject.doAs(Subject.java:415)  
at  
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190)  
at org.apache.hadoop.mapred.Child.main(Child.java:249)  
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime  
Error while processing row {"id":467649114269028352,"created\_at":"Sat May  
17 12:53:32 +0000 2014","source":"\<a href="[http://www.apple.com](http://www.apple.com)"  
rel="nofollow"\>iOS","favorited":false,"retweet\_count":0,"retweeted\_status":null,"entities":{"urls":[{"expanded\_url":"  
[viera lifting fa cup for arsenal - Google Search](https://www.google.co.uk/search?q=viera+lifting+fa+cup+for+arsenal&client=safari&hl=en-gb&source=lnms&tbm=isch&sa=X&ei=alp3U4LrK82UOufRgaAK&ved=0CAYQ_AUoAQ&biw=320&bih=460#facrc=_&imgrc=-QK5IhwQT8AS8M%253A%3B2yfUWG7-cngS-M%3Bhttp%253A%252F%252Ffarm4.static.flickr.com%252F3777%252F10838930556_618b87d7cc_m.jpg%3Bhttp%253A%252F%252Fwhotalking.com%252Fflickr%252F2-0%252BChelsea%3B1024%3B669%22%7D%5D,%22user_mentions%22:%5B%7B%22screen_name%22:%22jameswilliams46%22,%22name%22:%22James)  
Williams"}],"hashtags":},"text":"@jameswilliams46  
[https://t.co/CAmxdagAym","user":{"screen\_name":"SSimpson7379","name":"Stephen](https://t.co/CAmxdagAym%22,%22user%22:%7B%22screen_name%22:%22SSimpson7379%22,%22name%22:%22Stephen)  
Simpson","friends\_count":258,"followers\_count":266,"statuses\_count":2609,"verified":false,"utc\_offset":3600,"time\_zone":"London"},"in\_reply\_to\_screen\_name":"jameswilliams46"}  
at  
org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:671)  
at org.apache.hadoop.hive.ql.exec.ExecMapper.map(ExecMapper.java:144)  
... 8 more  
Caused by: org.elasticsearch.hadoop.EsHadoopIllegalArgumentException: When  
using JSON input, only one field is expected  
at org.elasticsearch.hadoop.util.Assert.isTrue(Assert.java:50)  
at  
org.elasticsearch.hadoop.hive.HiveBytesConverter.convert(HiveBytesConverter.java:48)  
at  
org.elasticsearch.hadoop.serialization.bulk.JsonTemplatedBulk.preProcess(JsonTemplatedBulk.java:58)  
at  
org.elasticsearch.hadoop.serialization.bulk.TemplatedBulk.write(TemplatedBulk.java:75)  
at org.elasticsearch.hadoop.hive.EsSerDe.serialize(EsSerDe.java:128)  
at  
org.apache.hadoop.hive.ql.exec.FileSinkOperator.processOp(FileSinkOperator.java:617)  
at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:502)  
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:832)  
at  
org.apache.hadoop.hive.ql.exec.SelectOperator.processOp(SelectOperator.java:84)  
at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:502)  
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:832)  
at  
org.apache.hadoop.hive.ql.exec.TableScanOperator.processOp(TableScanOperator.java:90)  
at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:502)  
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:832)  
at  
org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:652)  
... 9 more

FAILED: Execution Error, return code 2 from  
org.apache.hadoop.hive.ql.exec.MapRedTask  
MapReduce Jobs Launched:  
Job 0: Map: 1 HDFS Read: 0 HDFS Write: 0 FAIL  
Total MapReduce CPU Time Spent: 0 msec

when I did not add that jar "ADD JAR  
/home/hduser/hadoop/hive-0.11.0/lib/hive-serdes-1.0-SNAPSHOT.jar;" it gave  
me that error "Caused by: java.lang.ClassNotFoundException:  
com.cloudera.hive.serde.JSONSerDe  
"

Thank you so very much for your helping

2014-05-21 12:00 GMT+01:00 Costin Leau [costin.leau@gmail.com](mailto:costin.leau@gmail.com):

> If you plan to use es-hadoop, there's no need to do any JSON conversion  
> (es-hadoop does that automatically) - see the documentation at [1]  
> for more information.  
> If not than I recommend reaching out to the providers of the package for  
> more information on its configuration.
> 
> [1] [Elastic — The Search AI Company | Elastic](http://elasticsearch.org/hadoop)
> 
> On 5/21/14 1:17 PM, hanine haninne wrote:
> 
> > yes, you are right.Thanks so much
> > 
> > well I tried hive with HDFS and it works very well,by the way I m using  
> > hive-0.11.0 , hadoop-1.2.1 and elasticsearch-1.0.1  
> > Here is the script of the tables  
> > CREATE EXTERNAL TABLE tweets (  
> > id BIGINT,  
> > created\_at STRING,  
> > source STRING,  
> > favorited BOOLEAN,  
> > retweet\_count INT,  
> > retweeted\_status STRUCT\<  
> > text:STRING,  
> > user:STRUCT\<screen\_name:STRING,name:STRING\>\>,  
> > entities STRUCT\<  
> > urls:ARRAY\<STRUCT\<expanded\_url:STRING\>\>,  
> > user\_mentions:ARRAY\<STRUCT\<screen\_name:STRING,name:STRING\>\>,  
> > hashtags:ARRAY\<STRUCTtext:STRING\>\>,  
> > text STRING,  
> > user STRUCT\<  
> > screen\_name:STRING,  
> > name:STRING,  
> > friends\_count:INT,  
> > followers\_count:INT,  
> > statuses\_count:INT,  
> > verified:BOOLEAN,  
> > utc\_offset:INT,  
> > time\_zone:STRING\>,  
> > in\_reply\_to\_screen\_name STRING  
> > )  
> > ROW FORMAT SERDE 'com.cloudera.hive.serde.JSONSerDe'  
> > LOCATION '/flume/Tweets\_A';
> > 
> > do I have to add "com.cloudera.hive.serde.JSONSerDe'" an other time to  
> > put data in elasticsearch ?? if yes,How !!
> > 
> > Thank you so very much
> > 
> > 2014-05-21 10:36 GMT+01:00 Costin Leau \<[costin.leau@gmail.com](mailto:costin.leau@gmail.com) \<mailto:  
> > [costin.leau@gmail.com](mailto:costin.leau@gmail.com)\>\>:
> > 
> > ```
> > The error indicates that your script refers to a JSonSerDe class
> > 
> > ```
> > 
> > (presumably from Cloudera) which cannot be found in  
> > the classpath:
> > 
> > ```
> > "> Caused by: java.lang.__ClassNotFoundException:
> > 
> > ```
> > 
> > com.cloudera.hive.serde.\_\_JSONSerDe"
> > 
> > ```
> > In fact if you read through the stacktrace, you'll notice that this
> > 
> > ```
> > 
> > comes up while the job configuration  
> > is being read and this class name encountered but the class  
> > definition itself cannot be resolved.
> > 
> > ```
> > I'm not sure what causes this class to be added to the classpath of
> > 
> > ```
> > 
> > your script - it could be your script or the  
> > client configuration.  
> > Note the class is not used or added by ES-hadoop itself.
> > 
> > ```
> > I'm not sure what distro you are using (es-hadoop works across Apache
> > 
> > ```
> > 
> > Hadoop, Cloudera, HDP, MapR, Pivotal, etc...)  
> > but you could try running some  
> > basic Hive scripts (without es-hadoop) first to make sure the  
> > environment is sane and that you can properly read and  
> > write from HDFS and then add  
> > es-hadoop into the mix.
> > 
> > ```
> > Hope this helps,
> > 
> > On 5/21/14 12:15 PM, hanine haninne wrote:
> > 
> > Thank you so much for ur answer
> > here is what it gives me now
> > 
> > INSERT OVERWRITE TABLE tweetsES SELECT * FROM tweets;
> > 
> > Total MapReduce jobs = 1
> > Launching Job 1 out of 1
> > Number of reduce tasks is set to 0 since there's no reduce
> > 
> > ```
> > 
> > operator  
> > Starting Job = job\_201405210900\_0002, Tracking URL =  
> > [http://master:50030/\_\_jobdetails.jsp?jobid=job\_\_\_](http://master:50030/ __jobdetails.jsp?jobid=job___ )  
> > 201405210900\_0002  
> > [http://master:50030/jobdetails.jsp?jobid=job\_201405210900\_0002](http://master:50030/jobdetails.jsp?jobid=job_201405210900_0002)  
> > Kill Command = /home/hduser/hadoop/libexec/..\_\_/bin/hadoop job  
> > -kill job\_201405210900\_0002
> > 
> > ```
> > Hadoop job information for Stage-0: number of mappers: 1; number
> > 
> > ```
> > 
> > of reducers: 0  
> > 2014-05-21 10:12:05,285 Stage-0 map = 0%, reduce = 0%  
> > 2014-05-21 10:12:23,408 Stage-0 map = 100%, reduce = 100%  
> > Ended Job = job\_201405210900\_0002 with errors  
> > Error during job, obtaining debugging information...  
> > Job Tracking URL: [http://master:50030/\_\_](http://master:50030/__)  
> > jobdetails.jsp?jobid=job\_\_\_201405210900\_0002  
> > [http://master:50030/jobdetails.jsp?jobid=job\_201405210900\_0002](http://master:50030/jobdetails.jsp?jobid=job_201405210900_0002)  
> > Examining task ID: task\_201405210900\_0002\_m\_\_\_000002 (and more)  
> > from job job\_201405210900\_0002
> > 
> > ```
> > Task with the most failures(4):
> > -----
> > Task ID:
> > task_201405210900_0002_m___000000
> > 
> > URL:
> > http://master:50030/ __taskdetails.jsp?jobid=job___
> > 
> > ```
> > 
> > 201405210900\_0002&tipid=task\_\_\_201405210900\_0002\_m\_000000
> > 
> > ```
> > <http://master:50030/taskdetails.jsp?jobid=job_
> > 
> > ```
> > 
> > 201405210900\_0002&tipid=task\_201405210900\_0002\_m\_000000\>  
> > -----  
> > Diagnostic Messages for this Task:  
> > java.lang.RuntimeException: Error in configuring object  
> > at org.apache.hadoop.util.**ReflectionUtils.setJobConf(**  
> > ReflectionUtils.java:93)  
> > at org.apache.hadoop.util.**ReflectionUtils.setConf(**  
> > ReflectionUtils.java:64)  
> > at org.apache.hadoop.util.**ReflectionUtils.newInstance(**  
> > ReflectionUtils.java:117)  
> > at org.apache.hadoop.mapred.\_\_  
> > MapTask.runOldMapper(MapTask.\_\_java:426)  
> > at org.apache.hadoop.mapred.\_\_MapTask.run(MapTask.java:366)  
> > at org.apache.hadoop.mapred.\_\_Child$4.run(Child.java:255)
> > 
> > ```
> > at java.security.__AccessController.doPrivileged(__Native
> > 
> > ```
> > 
> > Method)  
> > at javax.security.auth.Subject.**doAs(Subject.java:415)  
> > at org.apache.hadoop.security.**  
> > UserGroupInformation.doAs(\_\_UserGroupInformation.java:\_\_1190)  
> > at org.apache.hadoop.mapred.\_\_Child.main(Child.java:249)  
> > Caused by: java.lang.reflect.\_\_InvocationTargetException
> > 
> > ```
> > at sun.reflect. __NativeMethodAccessorImpl.__ invoke0(Native
> > 
> > ```
> > 
> > Method)  
> > at sun.reflect.\_\_NativeMethodAccessorImpl.**invoke(**  
> > NativeMethodAccessorImpl.java:\_\_57)  
> > at sun.reflect.\_\_DelegatingMethodAccessorImpl.**invoke(**  
> > DelegatingMethodAccessorImpl.\_\_java:43)  
> > at java.lang.reflect.Method.\_\_invoke(Method.java:606)  
> > at org.apache.hadoop.util.**ReflectionUtils.setJobConf(**  
> > ReflectionUtils.java:88)
> > 
> > ```
> > ... 9 more
> > Caused by: java.lang.RuntimeException: Error in configuring object
> > at org.apache.hadoop.util.__ReflectionUtils.setJobConf(__
> > 
> > ```
> > 
> > ReflectionUtils.java:93)  
> > at org.apache.hadoop.util.**ReflectionUtils.setConf(**  
> > ReflectionUtils.java:64)  
> > at org.apache.hadoop.util.**ReflectionUtils.newInstance(**  
> > ReflectionUtils.java:117)  
> > at org.apache.hadoop.mapred.\_\_  
> > MapRunner.configure(MapRunner.\_\_java:34)  
> > ... 14 more  
> > Caused by: java.lang.reflect.\_\_InvocationTargetException
> > 
> > ```
> > at sun.reflect. __NativeMethodAccessorImpl.__ invoke0(Native
> > 
> > ```
> > 
> > Method)  
> > at sun.reflect.\_\_NativeMethodAccessorImpl.**invoke(**  
> > NativeMethodAccessorImpl.java:\_\_57)  
> > at sun.reflect.\_\_DelegatingMethodAccessorImpl.**invoke(**  
> > DelegatingMethodAccessorImpl.\_\_java:43)  
> > at java.lang.reflect.Method.\_\_invoke(Method.java:606)  
> > at org.apache.hadoop.util.**ReflectionUtils.setJobConf(**  
> > ReflectionUtils.java:88)
> > 
> > ```
> > ... 17 more
> > Caused by: java.lang.RuntimeException: Map operator
> > 
> > ```
> > 
> > initialization failed  
> > at org.apache.hadoop.hive.ql.**exec.ExecMapper.configure(**  
> > ExecMapper.java:121)  
> > ... 22 more  
> > Caused by: org.apache.hadoop.hive.ql.\_\_metadata.HiveException:  
> > java.lang.\_\_ClassNotFoundException:  
> > com.cloudera.hive.serde.\_\_JSONSerDe  
> > at org.apache.hadoop.hive.ql. **exec.MapOperator.**  
> > getConvertedOI(MapOperator.**java:463)  
> > at org.apache.hadoop.hive.ql.**  
> > exec.MapOperator.setChildren(\_\_MapOperator.java:479)  
> > at org.apache.hadoop.hive.ql.**exec.ExecMapper.configure(**  
> > ExecMapper.java:90)  
> > ... 22 more  
> > Caused by: java.lang.\_\_ClassNotFoundException:  
> > com.cloudera.hive.serde.\_\_JSONSerDe  
> > at java.net.URLClassLoader$1.run(\_\_URLClassLoader.java:366)  
> > at java.net.URLClassLoader$1.run(\_\_URLClassLoader.java:355)  
> > at java.security.\_\_AccessController.doPrivileged(\_\_Native  
> > Method)  
> > at java.net.URLClassLoader.\_\_findClass(URLClassLoader.java:  
> > \_\_354)  
> > at java.lang.ClassLoader.**loadClass(ClassLoader.java:**  
> > 424)  
> > at sun.misc.Launcher$**AppClassLoader.loadClass(**  
> > Launcher.java:308)  
> > at java.lang.ClassLoader.**loadClass(ClassLoader.java:**  
> > 357)  
> > at java.lang.Class.forName0(\_\_Native Method)  
> > at java.lang.Class.forName(Class.\_\_java:270)  
> > at org.apache.hadoop.conf.\__Configuration.getClassByName(_  
> > \_Configuration.java:810)  
> > at org.apache.hadoop.hive.ql. **exec.MapOperator.**  
> > getConvertedOI(MapOperator.\_\_java:422)  
> > ... 24 more
> > 
> > ```
> > FAILED: Execution Error, return code 2 from
> > 
> > ```
> > 
> > org.apache.hadoop.hive.ql.\_\_exec.MapRedTask
> > 
> > ```
> > MapReduce Jobs Launched:
> > Job 0: Map: 1 HDFS Read: 0 HDFS Write: 0 FAIL
> > Total MapReduce CPU Time Spent: 0 msec
> > 
> > 2014-05-20 14:11 GMT+01:00 Costin Leau <costin.leau@gmail.com<mailto:
> > 
> > ```
> > 
> > [costin.leau@gmail.com](mailto:costin.leau@gmail.com)\>  
> > \<[mailto:costin.leau@gmail.com](mailto:costin.leau@gmail.com) [mailto:costin.leau@gmail.com](mailto:costin.leau@gmail.com)\>\_\_\>:
> > 
> > ```
> > 1. You don't need to add the hive jars (hive-serdes) to your
> > 
> > ```
> > 
> > script - these are already part of the runtime  
> > 2. use es-hadoop-2.0.RC1, 1.3 M2 is fairly old  
> > 3. Make sure that the jar is actually available and that is  
> > potentially accessible by Hive. Also do note that  
> > when running Hive against a cluster, it's best to have the  
> > jars available on all nodes hence why most folks  
> > copy  
> > them to HDFS and refer to that location.  
> > While /home/hduser might be locally available, it might not  
> > exist on the Hive server - as indicated by the  
> > error.
> > 
> > ```
> > Hope this helps,
> > 
> > On 5/20/14 3:58 PM, hanine haninne wrote:
> > 
> > Hello everybody
> > 
> > I m trying to take data from Hive and put it in
> > 
> > ```
> > 
> > elasticsearch  
> > here is the script and the error
> > 
> > ```
> > hive> ADD JAR /home/hduser/hadoop/hive-0.11.
> > 
> > ```
> > 
> > \_\_\_\_0/lib/hive-serdes-1.0-\_\_\_\_SNAPSHOT.jar;  
> > Added /home/hduser/hadoop/hive-0.11.  
> > \_\_\_\_0/lib/hive-serdes-1.0-\_\_\_\_SNAPSHOT.jar to class path  
> > Added resource: /home/hduser/hadoop/hive-0.11.  
> > \_\_\_\_0/lib/hive-serdes-1.0-\_\_\_\_SNAPSHOT.jar
> > 
> > ```
> > hive> CREATE EXTERNAL TABLE tweetsES (
> > > id BIGINT,
> > > created_at STRING,
> > > source STRING,
> > > favorited BOOLEAN,
> > > retweet_count INT,
> > > retweeted_status STRUCT<
> > > text:STRING,
> > > user:STRUCT<screen_name: ____
> > 
> > ```
> > 
> > STRING,name:STRING\>\>,  
> > \> entities STRUCT\<  
> > \> urls:ARRAY\<STRUCT\<expanded\_\_\_\_  
> > _url:STRING\>\>,  
> > \> user\_mentions:ARRAY\<STRUCT\<_\_\_  
> > \_screen\_name:STRING,name:\_\_\_\_STRING\>\>,  
> > \> hashtags:ARRAY\<STRUCTtext:\_\_\_\_STRING\>\>,
> > 
> > ```
> > > text STRING,
> > > user STRUCT<
> > > screen_name:STRING,
> > > name:STRING,
> > > friends_count:INT,
> > > followers_count:INT,
> > > statuses_count:INT,
> > > verified:BOOLEAN,
> > > utc_offset:INT,
> > > time_zone:STRING>,
> > > in_reply_to_screen_name STRING
> > > )
> > > STORED BY 'org.elasticsearch.hadoop. ____
> > 
> > ```
> > 
> > hive.EsStorageHandler'  
> > \> TBLPROPERTIES('es.resource' =  
> > 'reseaux\_sociaux/tweets','es.\_\_\_\_input.json' = 'yes');
> > 
> > ```
> > OK
> > Time taken: 4.292 seconds
> > hive> ADD JAR /home/hduser/hadoop/ ____
> > 
> > ```
> > 
> > elasticsearch-hadoop-1.3.0.M2.**jar;  
> > Added /home/hduser/hadoop/**  
> > elasticsearch-hadoop-1.3.0.M2.**jar to class path  
> > Added resource: /home/hduser/hadoop/**  
> > elasticsearch-hadoop-1.3.0.M2.\_\_\_\_jar
> > 
> > ```
> > hive> INSERT OVERWRITE TABLE tweetsES SELECT * FROM
> > 
> > ```
> > 
> > tweets;  
> > Total MapReduce jobs = 1  
> > Launching Job 1 out of 1  
> > Number of reduce tasks is set to 0 since there's no  
> > reduce operator  
> > java.io.FileNotFoundException: File does not exist:  
> > /home/hduser/hadoop/\_\_\_\_elasticsearch-hadoop-1.3.0.M2.\_\_\_\_jar  
> > at  
> > org.apache.hadoop.hdfs. **DistributedFileSystem.**  
> > getFileStatus(\_\_\_\_DistributedFileSystem.java:\_\_**558)  
> > at org.apache.hadoop.filecache.**  
> > \_\_DistributedCache.\_\_\_\_getFileStatus(\_\_\_\_DistributedCache.java:185)  
> > at
> > 
> > ```
> > org.apache.hadoop.filecache. ____ TrackerDistributedCacheManager
> > 
> > ```
> > 
> > \_\_\_\_.getFileStatus( **TrackerDistributedCacheManager**.java:723)  
> > at
> > 
> > ```
> > org.apache.hadoop.filecache. ____ TrackerDistributedCacheManager
> > 
> > ```
> > 
> > \_\_\_\_.determineTimestamps( **TrackerDistributedCacheManager**.java:778)  
> > at
> > 
> > ```
> > org.apache.hadoop.filecache. ____ TrackerDistributedCacheManager
> > 
> > ```
> > 
> > **.determineTimestampsAndCacheVis\_\_\_\_ibilities(  
> > TrackerDistributedCacheManager**.java:755)  
> > at org.apache.hadoop.mapred. **JobClient.**  
> > copyAndConfigureFiles(\_\_\_\_JobClient.java:843)  
> > at org.apache.hadoop.mapred. **JobClient.**  
> > copyAndConfigureFiles(**JobClient.java:734)  
> > at org.apache.hadoop.mapred.**  
> > JobClient.access$400(**JobClient.java:179)  
> > at org.apache.hadoop.mapred.**  
> > JobClient$2.run(JobClient.**java:951)  
> > at org.apache.hadoop.mapred.**  
> > JobClient$2.run(JobClient.**java:936)  
> > at java.security.**  
> > AccessController.doPrivileged(\__**Native Method)  
> > at javax.security.auth.Subject.**  
> > **doAs(Subject.java:415)  
> > at org.apache.hadoop.security.**_  
> > \_UserGroupInformation.doAs(\__**UserGroupInformation.java:1190)  
> > at org.apache.hadoop.mapred.  
> > JobClient.submitJobInternal(JobClient.java:936)  
> > at org.apache.hadoop.mapred.  
> > JobClient.submitJob(JobClient.java:910)  
> > at org.apache.hadoop.hive.ql.  
> > exec.ExecDriver.execute(ExecDriver.java:447)  
> > at org.apache.hadoop.hive.ql.  
> > exec.MapRedTask.execute(MapRedTask.java:138)  
> > at org.apache.hadoop.hive.ql.  
> > exec.Task.executeTask(Task.java:144)  
> > at org.apache.hadoop.hive.ql.  
> > exec.TaskRunner.runSequential(TaskRunner.java:57)  
> > at org.apache.hadoop.hive.ql.  
> > Driver.launchTask(Driver.java:1355)  
> > at org.apache.hadoop.hive.ql.  
> > Driver.execute(Driver.java:1139)  
> > at org.apache.hadoop.hive.ql.  
> > Driver.run(Driver.java:945)  
> > at org.apache.hadoop.hive.cli.**_  
> > \_CliDriver.processLocalCmd(\__**CliDriver.java:259)  
> > at org.apache.hadoop.hive.cli.**_  
> > \_CliDriver.processCmd(\__**CliDriver.java:216)  
> > at org.apache.hadoop.hive.cli.**_  
> > \_CliDriver.processLine(\__**CliDriver.java:413)  
> > at org.apache.hadoop.hive.cli.**_  
> > \_CliDriver.run(CliDriver.java:\__**756)  
> > at org.apache.hadoop.hive.cli.**_  
> > \_CliDriver.main(CliDriver.java:\_\_\_\_614)  
> > at sun.reflect.\_\_\_\_NativeMethodAccessorImpl.\_\_\_\_invoke0(Native  
> > Method)  
> > at sun.reflect. **NativeMethodAccessorImpl.**  
> > invoke(\_\_\_\_NativeMethodAccessorImpl.java:\_\_\_\_57)  
> > at  
> > sun.reflect.\_\_\_\_DelegatingMethodAccessorImpl.**invoke(**  
> > DelegatingMethodAccessorImpl.**java:43)  
> > at java.lang.reflect.Method.**  
> > invoke(Method.java:606)  
> > at org.apache.hadoop.util.RunJar.  
> > \_\_\_\_main(RunJar.java:160)
> > 
> > ```
> > Job Submission failed with exception 'java.io <
> > 
> > ```
> > 
> > [http://java.io](http://java.io)\>  
> > [http://java.io](http://java.io).\_\_\_\_FileNotFoundException(File does not exist:  
> > /home/hduser/hadoop/\_\_\_\_elasticsearch-hadoop-1.3.0.M2.  
> > \_\_\_\_jar)'  
> > FAILED: Execution Error, return code 1 from  
> > org.apache.hadoop.hive.ql.\_\_\_\_exec.MapRedTask
> > 
> > ```
> > That path it exist :/home/hduser/hadoop/ ____
> > 
> > ```
> > 
> > elasticsearch-hadoop-1.3.0.M2.\_\_\_\_jar
> > 
> > ```
> > Any help would be so appreciable
> > Thanks
> > 
> > --
> > You received this message because you are subscribed to
> > 
> > ```
> > 
> > the Google Groups "elasticsearch" group.  
> > To unsubscribe from this group and stop receiving emails  
> > from it, send an email to  
> > elasticsearch+unsubscribe@\_\_go\_\_oglegroups.com \<  
> > [http://googlegroups.com](http://googlegroups.com)\>  
> > \<mailto:elasticsearch%**[2Bunsubscribe@googlegroups.com](mailto:2Bunsubscribe@googlegroups.com) \<mailto:  
> > elasticsearch%252Bunsubscribe@googlegroups.com\>**\>  
> > \<[mailto:elasticsearch+\_\_\_\_unsubscribe@googlegroups.com](mailto:elasticsearch+ ____ unsubscribe@googlegroups.com)  
> > [mailto:elasticsearch%2B\_\_unsubscribe@googlegroups.com](mailto:elasticsearch%2B__unsubscribe@googlegroups.com) \<mailto:  
> > elasticsearch%**[2Bunsubscribe@googlegroups.com](mailto:2Bunsubscribe@googlegroups.com)  
> > [mailto:elasticsearch%252Bunsubscribe@googlegroups.com](mailto:elasticsearch%252Bunsubscribe@googlegroups.com)**\>\>.
> > 
> > ```
> > To view this discussion on the web visit
> > https://groups.google.com/d/ ____ msgid/elasticsearch/
> > 
> > ```
> > 
> > d1613b48-\_\_\_\_e58d-4077-a579-92b46a97bcff%\_\_\_\_40googlegroups.com  
> > \<[https://groups.google.com/d/\_\_msgid/elasticsearch/d1613b48-](https://groups.google.com/d/__msgid/elasticsearch/d1613b48-)  
> > \_\_e58d-4077-a579-92b46a97bcff%\_\_40googlegroups.com\>
> > 
> > ```
> > <https://groups.google.com/d/__msgid/elasticsearch/d1613b48-
> > 
> > ```
> > 
> > \_\_e58d-4077-a579-92b46a97bcff%\_\_40googlegroups.com  
> > \<[https://groups.google.com/d/msgid/elasticsearch/d1613b48-](https://groups.google.com/d/msgid/elasticsearch/d1613b48-)  
> > e58d-4077-a579-92b46a97bcff%[40googlegroups.com](http://40googlegroups.com)\>\>
> > 
> > ```
> > <https://groups.google.com/d/ ____ msgid/elasticsearch/
> > 
> > ```
> > 
> > d1613b48-\_\_\_\_e58d-4077-a579-92b46a97bcff%\__**[40googlegroups.com?utm](http://40googlegroups.com?utm)**_  
> > medium=\_\_email&utm\_source=\_\_footer  
> > \<[https://groups.google.com/d/\_\_msgid/elasticsearch/d1613b48-](https://groups.google.com/d/__msgid/elasticsearch/d1613b48-)  
> > \_\_e58d-4077-a579-92b46a97bcff%\__[40googlegroups.com?utm](http://40googlegroups.com?utm)_  
> > medium=\_\_email&utm\_source=footer\>
> > 
> > ```
> > <https://groups.google.com/d/__msgid/elasticsearch/d1613b48-
> > 
> > ```
> > 
> > \_\_e58d-4077-a579-92b46a97bcff%\__[40googlegroups.com?utm](http://40googlegroups.com?utm)_  
> > medium=\_\_email&utm\_source=footer  
> > \<[https://groups.google.com/d/msgid/elasticsearch/d1613b48-](https://groups.google.com/d/msgid/elasticsearch/d1613b48-)  
> > e58d-4077-a579-92b46a97bcff%[40googlegroups.com?utm\_medium=](http://40googlegroups.com?utm_medium=)  
> > email&utm\_source=footer\>\>\>.
> > 
> > ```
> > For more options, visit https://groups.google.com/d/__
> > 
> > ```
> > 
> > \_\_optout [https://groups.google.com/d/\_\_optout](https://groups.google.com/d/__optout)
> > 
> > ```
> > <https://groups.google.com/d/__optout <
> > 
> > ```
> > 
> > [https://groups.google.com/d/optout](https://groups.google.com/d/optout)\>\>.
> > 
> > ```
> > --
> > Costin
> > 
> > --
> > You received this message because you are subscribed to the
> > 
> > ```
> > 
> > Google Groups "elasticsearch" group.  
> > To unsubscribe from this group and stop receiving emails  
> > from it, send an email to  
> > elasticsearch+unsubscribe@\_\_go\_\_oglegroups.com \<  
> > [http://googlegroups.com](http://googlegroups.com)\>  
> > \<mailto:elasticsearch%**[2Bunsubscribe@googlegroups.com](mailto:2Bunsubscribe@googlegroups.com) \<mailto:  
> > elasticsearch%252Bunsubscribe@googlegroups.com\>**\>.
> > 
> > ```
> > To view this discussion on the web visit
> > https://groups.google.com/d/ ____ msgid/elasticsearch/
> > 
> > ```
> > 
> > 537B549F.\_\_\_\_8020501%[40gmail.com](http://40gmail.com)  
> > \<[https://groups.google.com/d/\_\_msgid/elasticsearch/537B549F](https://groups.google.com/d/__msgid/elasticsearch/537B549F).  
> > \_\_8020501%[40gmail.com](http://40gmail.com)\>
> > 
> > ```
> > <https://groups.google.com/d/__msgid/elasticsearch/537B549F.
> > 
> > ```
> > 
> > \_\_8020501%[40gmail.com](http://40gmail.com)  
> > \<[https://groups.google.com/d/msgid/elasticsearch/537B549F](https://groups.google.com/d/msgid/elasticsearch/537B549F).  
> > 8020501%[40gmail.com](http://40gmail.com)\>\>.
> > 
> > ```
> > For more options, visit https://groups.google.com/d/__
> > 
> > ```
> > 
> > \_\_optout [https://groups.google.com/d/\_\_optout](https://groups.google.com/d/__optout)
> > 
> > ```
> > <https://groups.google.com/d/__optout <
> > 
> > ```
> > 
> > [https://groups.google.com/d/optout](https://groups.google.com/d/optout)\>\>.
> > 
> > ```
> > --
> > You received this message because you are subscribed to the
> > 
> > ```
> > 
> > Google Groups "elasticsearch" group.  
> > To unsubscribe from this group and stop receiving emails from it,  
> > send an email to  
> > elasticsearch+unsubscribe@\_\_googlegroups.com \<mailto:  
> > elasticsearch%2Bunsubscribe@googlegroups.com\>  
> > \<[mailto:elasticsearch+\_\_unsubscribe@googlegroups.com](mailto:elasticsearch+__unsubscribe@googlegroups.com) \<mailto:  
> > elasticsearch%2Bunsubscribe@googlegroups.com\>\>.  
> > To view this discussion on the web visit  
> > [https://groups.google.com/d/\_\_msgid/elasticsearch/CANXJSR9-\_](https://groups.google.com/d/__msgid/elasticsearch/CANXJSR9-_)  
> > \_xpGoJR4gvPW%3DKKP%3DVr\_\_\_5MxyDoUJKtbpqM6CsYs1G4Q%\_\_40mail.gmail.com  
> > \<[https://groups.google.com/d/msgid/elasticsearch/CANXJSR9-](https://groups.google.com/d/msgid/elasticsearch/CANXJSR9-)  
> > xpGoJR4gvPW%3DKKP%3DVr\_5MxyDoUJKtbpqM6CsYs1G4Q%[40mail.gmail.com](http://40mail.gmail.com)\>  
> > \<[https://groups.google.com/d/\_\_msgid/elasticsearch/CANXJSR9-](https://groups.google.com/d/__msgid/elasticsearch/CANXJSR9-)  
> > **xpGoJR4gvPW%3DKKP%3DVr\_\_\_5MxyDoUJKtbpqM6CsYs1G4Q%**  
> > [40mail.gmail.com?utm\_medium=\_\_email&utm\_source=footer](http://40mail.gmail.com?utm_medium=__email&utm_source=footer)  
> > \<[https://groups.google.com/d/msgid/elasticsearch/CANXJSR9-](https://groups.google.com/d/msgid/elasticsearch/CANXJSR9-)  
> > xpGoJR4gvPW%3DKKP%3DVr\_5MxyDoUJKtbpqM6CsYs1G4Q%  
> > [40mail.gmail.com?utm\_medium=email&utm\_source=footer](http://40mail.gmail.com?utm_medium=email&utm_source=footer)\>\>.
> > 
> > ```
> > For more options, visit https://groups.google.com/d/__optout <
> > 
> > ```
> > 
> > [https://groups.google.com/d/optout](https://groups.google.com/d/optout)\>.
> > 
> > ```
> > --
> > Costin
> > 
> > --
> > You received this message because you are subscribed to the Google
> > 
> > ```
> > 
> > Groups "elasticsearch" group.  
> > To unsubscribe from this group and stop receiving emails from it,  
> > send an email to  
> > elasticsearch+unsubscribe@\_\_googlegroups.com \<mailto:elasticsearch%  
> > [2Bunsubscribe@googlegroups.com](mailto:2Bunsubscribe@googlegroups.com)\>.  
> > To view this discussion on the web visit  
> > [https://groups.google.com/d/\_\_msgid/elasticsearch/537C738E.\_](https://groups.google.com/d/__msgid/elasticsearch/537C738E._)  
> > \_9030001%[40gmail.com](http://40gmail.com)  
> > \<[https://groups.google.com/d/msgid/elasticsearch/537C738E](https://groups.google.com/d/msgid/elasticsearch/537C738E).  
> > 9030001%[40gmail.com](http://40gmail.com)\>.
> > 
> > ```
> > For more options, visit https://groups.google.com/d/__optout <
> > 
> > ```
> > 
> > [https://groups.google.com/d/optout](https://groups.google.com/d/optout)\>.
> > 
> > --  
> > You received this message because you are subscribed to the Google Groups  
> > "elasticsearch" group.  
> > To unsubscribe from this group and stop receiving emails from it, send an  
> > email to  
> > [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com) \<mailto:elasticsearch+  
> > [unsubscribe@googlegroups.com](mailto:unsubscribe@googlegroups.com)\>.  
> > To view this discussion on the web visit  
> > [https://groups.google.com/d/msgid/elasticsearch/CANXJSR8Gy4qhM8Lzm5BHCr2-](https://groups.google.com/d/msgid/elasticsearch/CANXJSR8Gy4qhM8Lzm5BHCr2-)  
> > xptLKBSdm00nCrz-JtnW59jWcw%[40mail.gmail.com](http://40mail.gmail.com)  
> > \<[https://groups.google.com/d/msgid/elasticsearch/](https://groups.google.com/d/msgid/elasticsearch/)  
> > CANXJSR8Gy4qhM8Lzm5BHCr2-xptLKBSdm00nCrz-JtnW59jWcw%  
> > [40mail.gmail.com?utm\_medium=email&utm\_source=footer](http://40mail.gmail.com?utm_medium=email&utm_source=footer)\>.
> > 
> > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).
> 
> --  
> Costin
> 
> --  
> You received this message because you are subscribed to the Google Groups  
> "elasticsearch" group.  
> To unsubscribe from this group and stop receiving emails from it, send an  
> email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> To view this discussion on the web visit [https://groups.google.com/d/](https://groups.google.com/d/)  
> msgid/elasticsearch/537C8751.1030908%[40gmail.com](http://40gmail.com).
> 
> For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CANXJSR\_pj6i55jwA3wYiGgh1d\_q86DpcNRKLZzhk-V97vWFLaQ%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CANXJSR_pj6i55jwA3wYiGgh1d_q86DpcNRKLZzhk-V97vWFLaQ%40mail.gmail.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![costin](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/costin/32/44950_2.png) [@costin](https://discuss.elastic.co/u/costin)\
**Post date:** [May 22, 2014, 2:34pm UTC](https://discuss.elastic.co/t/hadoop-elasticsearch-and-hive/17622/8 "2014-05-22T14:34:51Z")

</div>

Hi,

It looks like you have two tables - one that uses the JSONSerDe from cloudera and another one using es-hadoop.  
You configured your es-hadoop table to consider the input as json however it does not receive the proper format (as the  
exception indicates).  
See this [1] section of the documentation for more information.

Let me restate again that you do not the data to Elasticsearch and es-hadoop to be in JSON format - unless it actually  
is in JSON  
(as in JSON files are stored in HDFS) simply send whatever data you have in Hive to es-hadoop and it will do the JSON  
translation automatically  
and typically much more efficient.  
Again the docs [2] discuss this in detail. Frankly, I'm not sure why you want to use the JSONSerDe.

To conclude: if the data is in raw format in HDFS, just feed to es-hadoop with the input configured as JSON, if it's in  
a different format,  
load it in Hive as you would typically do and then insert it into the es-hadoop table.

Hope this helps,

[1] [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/guide/en/elasticsearch/hadoop/current/hive.html#writing-json-hive)  
[2] [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/guide/en/elasticsearch/hadoop/current/hive.html#hive)

On 5/22/14 12:13 PM, hanine haninne wrote:

> Hello again,  
> I m trying to get some tweets from the HDFS and put it in elasticsearch(head) in order to make search on it, I did what  
> u said and I m so thankful, But it start reading and does not continue. I don't know why ?!!  
> here is what I did :
> 
> hive -hiveconf hive.aux.jars.path=/ES\_Hadoop/dist/elasticsearch-hadoop-2.0.0.RC1.jar
> 
> Logging initialized using configuration in  
> jar:file:/home/hduser/hadoop/hive-0.11.0/lib/hive-common-0.11.0.jar!/hive-log4j.properties  
> Hive history file=/tmp/hduser/hive\_job\_log\_hduser\_8166@mouna-pc\_201405220958\_2036150447.txt
> 
> hive\> ADD JAR /home/hduser/hadoop/hive-0.11.0/lib/hive-serdes-1.0-SNAPSHOT.jar;  
> Added /home/hduser/hadoop/hive-0.11.0/lib/hive-serdes-1.0-SNAPSHOT.jar to class path  
> Added resource: /home/hduser/hadoop/hive-0.11.0/lib/hive-serdes-1.0-SNAPSHOT.jar  
> hive\> INSERT OVERWRITE TABLE tweetsES SELECT \* FROM tweets;  
> Total MapReduce jobs = 1  
> Launching Job 1 out of 1  
> Number of reduce tasks is set to 0 since there's no reduce operator  
> Starting Job = job\_201405220937\_0005, Tracking URL = [http://master:50030/jobdetails.jsp?jobid=job\_201405220937\_0005](http://master:50030/jobdetails.jsp?jobid=job_201405220937_0005)  
> Kill Command = /home/hduser/hadoop/libexec/../bin/hadoop job -kill job\_201405220937\_0005  
> Hadoop job information for Stage-0: number of mappers: 1; number of reducers: 0  
> 2014-05-22 10:01:39,184 Stage-0 map = 0%, reduce = 0%  
> 2014-05-22 10:01:59,320 Stage-0 map = 100%, reduce = 100%  
> Ended Job = job\_201405220937\_0005 with errors  
> Error during job, obtaining debugging information...  
> Job Tracking URL: [http://master:50030/jobdetails.jsp?jobid=job\_201405220937\_0005](http://master:50030/jobdetails.jsp?jobid=job_201405220937_0005)  
> Examining task ID: task\_201405220937\_0005\_m\_000002 (and more) from job job\_201405220937\_0005
> 
> ## Task with the most failures(4):
> 
> Task ID:  
> task\_201405220937\_0005\_m\_000000
> 
> ## URL: [http://master:50030/taskdetails.jsp?jobid=job\_201405220937\_0005&tipid=task\_201405220937\_0005\_m\_000000](http://master:50030/taskdetails.jsp?jobid=job_201405220937_0005&tipid=task_201405220937_0005_m_000000)
> 
> Diagnostic Messages for this Task:  
> java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row  
> {"id":467649114269028352,"created\_at":"Sat May 17 12:53:32 +0000 2014","source":"\<a href="[http://www.apple.com](http://www.apple.com)"  
> rel="nofollow"\>iOS","favorited":false,"retweet\_count":0,"retweeted\_status":null,"entities":{"urls":[{"expanded\_url":"[https://www.google.co.uk/search?q=viera+lifting+fa+cup+for+arsenal&client=safari&hl=en-gb&source=lnms&tbm=isch&sa=X&ei=alp3U4LrK82UOufRgaAK&ved=0CAYQ\_AUoAQ&biw=320&bih=460#facrc=\_&imgrc=-QK5IhwQT8AS8M%253A%3B2yfUWG7-cngS-M%3Bhttp%253A%252F%252Ffarm4.static.flickr.com%252F3777%252F10838930556\_618b87d7cc\_m.jpg%3Bhttp%253A%252F%252Fwhotalking.com%252Fflickr%252F2-0%252BChelsea%3B1024%3B669"}],"user\_mentions":[{"screen\_name":"jameswilliams46","name":"James](https://www.google.co.uk/search?q=viera+lifting+fa+cup+for+arsenal&client=safari&hl=en-gb&source=lnms&tbm=isch&sa=X&ei=alp3U4LrK82UOufRgaAK&ved=0CAYQ_AUoAQ&biw=320&bih=460#facrc=_&imgrc=-QK5IhwQT8AS8M%253A%3B2yfUWG7-cngS-M%3Bhttp%253A%252F%252Ffarm4.static.flickr.com%252F3777%252F10838930556_618b87d7cc_m.jpg%3Bhttp%253A%252F%252Fwhotalking.com%252Fflickr%252F2-0%252BChelsea%3B1024%3B669%22%7D%5D,%22user_mentions%22:%5B%7B%22screen_name%22:%22jameswilliams46%22,%22name%22:%22James)  
> Williams"}],"hashtags":},"text":"@jameswilliams46  
> [https://t.co/CAmxdagAym","user":{"screen\_name":"SSimpson7379","name":"Stephen](https://t.co/CAmxdagAym%22,%22user%22:%7B%22screen_name%22:%22SSimpson7379%22,%22name%22:%22Stephen)  
> Simpson","friends\_count":258,"followers\_count":266,"statuses\_count":2609,"verified":false,"utc\_offset":3600,"time\_zone":"London"},"in\_reply\_to\_screen\_name":"jameswilliams46"}  
> at org.apache.hadoop.hive.ql.exec.ExecMapper.map(ExecMapper.java:162)  
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)  
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:430)  
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:366)  
> at org.apache.hadoop.mapred.Child$4.run(Child.java:255)  
> at java.security.AccessController.doPrivileged(Native Method)  
> at javax.security.auth.Subject.doAs(Subject.java:415)  
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190)  
> at org.apache.hadoop.mapred.Child.main(Child.java:249)  
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row  
> {"id":467649114269028352,"created\_at":"Sat May 17 12:53:32 +0000 2014","source":"\<a href="[http://www.apple.com](http://www.apple.com)"  
> rel="nofollow"\>iOS","favorited":false,"retweet\_count":0,"retweeted\_status":null,"entities":{"urls":[{"expanded\_url":"[https://www.google.co.uk/search?q=viera+lifting+fa+cup+for+arsenal&client=safari&hl=en-gb&source=lnms&tbm=isch&sa=X&ei=alp3U4LrK82UOufRgaAK&ved=0CAYQ\_AUoAQ&biw=320&bih=460#facrc=\_&imgrc=-QK5IhwQT8AS8M%253A%3B2yfUWG7-cngS-M%3Bhttp%253A%252F%252Ffarm4.static.flickr.com%252F3777%252F10838930556\_618b87d7cc\_m.jpg%3Bhttp%253A%252F%252Fwhotalking.com%252Fflickr%252F2-0%252BChelsea%3B1024%3B669"}],"user\_mentions":[{"screen\_name":"jameswilliams46","name":"James](https://www.google.co.uk/search?q=viera+lifting+fa+cup+for+arsenal&client=safari&hl=en-gb&source=lnms&tbm=isch&sa=X&ei=alp3U4LrK82UOufRgaAK&ved=0CAYQ_AUoAQ&biw=320&bih=460#facrc=_&imgrc=-QK5IhwQT8AS8M%253A%3B2yfUWG7-cngS-M%3Bhttp%253A%252F%252Ffarm4.static.flickr.com%252F3777%252F10838930556_618b87d7cc_m.jpg%3Bhttp%253A%252F%252Fwhotalking.com%252Fflickr%252F2-0%252BChelsea%3B1024%3B669%22%7D%5D,%22user_mentions%22:%5B%7B%22screen_name%22:%22jameswilliams46%22,%22name%22:%22James)  
> Williams"}],"hashtags":},"text":"@jameswilliams46  
> [https://t.co/CAmxdagAym","user":{"screen\_name":"SSimpson7379","name":"Stephen](https://t.co/CAmxdagAym%22,%22user%22:%7B%22screen_name%22:%22SSimpson7379%22,%22name%22:%22Stephen)  
> Simpson","friends\_count":258,"followers\_count":266,"statuses\_count":2609,"verified":false,"utc\_offset":3600,"time\_zone":"London"},"in\_reply\_to\_screen\_name":"jameswilliams46"}  
> at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:671)  
> at org.apache.hadoop.hive.ql.exec.ExecMapper.map(ExecMapper.java:144)  
> ... 8 more  
> Caused by: org.elasticsearch.hadoop.EsHadoopIllegalArgumentException: When using JSON input, only one field is expected  
> at org.elasticsearch.hadoop.util.Assert.isTrue(Assert.java:50)  
> at org.elasticsearch.hadoop.hive.HiveBytesConverter.convert(HiveBytesConverter.java:48)  
> at org.elasticsearch.hadoop.serialization.bulk.JsonTemplatedBulk.preProcess(JsonTemplatedBulk.java:58)  
> at org.elasticsearch.hadoop.serialization.bulk.TemplatedBulk.write(TemplatedBulk.java:75)  
> at org.elasticsearch.hadoop.hive.EsSerDe.serialize(EsSerDe.java:128)  
> at org.apache.hadoop.hive.ql.exec.FileSinkOperator.processOp(FileSinkOperator.java:617)  
> at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:502)  
> at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:832)  
> at org.apache.hadoop.hive.ql.exec.SelectOperator.processOp(SelectOperator.java:84)  
> at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:502)  
> at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:832)  
> at org.apache.hadoop.hive.ql.exec.TableScanOperator.processOp(TableScanOperator.java:90)  
> at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:502)  
> at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:832)  
> at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:652)  
> ... 9 more
> 
> FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask  
> MapReduce Jobs Launched:  
> Job 0: Map: 1 HDFS Read: 0 HDFS Write: 0 FAIL  
> Total MapReduce CPU Time Spent: 0 msec
> 
> when I did not add that jar "ADD JAR /home/hduser/hadoop/hive-0.11.0/lib/hive-serdes-1.0-SNAPSHOT.jar;" it gave me that  
> error "Caused by: java.lang.ClassNotFoundException: com.cloudera.hive.serde.JSONSerDe  
> "
> 
> Thank you so very much for your helping
> 
> 2014-05-21 12:00 GMT+01:00 Costin Leau \<[costin.leau@gmail.com](mailto:costin.leau@gmail.com) [mailto:costin.leau@gmail.com](mailto:costin.leau@gmail.com)\>:
> 
> ```
> If you plan to use es-hadoop, there's no need to do any JSON conversion (es-hadoop does that automatically) - see
> the documentation at [1]
> for more information.
> If not than I recommend reaching out to the providers of the package for more information on its configuration.
> 
> [1] elasticsearch.org/hadoop <http://elasticsearch.org/hadoop>
> 
> On 5/21/14 1:17 PM, hanine haninne wrote:
> 
> yes, you are right.Thanks so much
> 
> well I tried hive with HDFS and it works very well,by the way I m using hive-0.11.0 , hadoop-1.2.1 and
> elasticsearch-1.0.1
> Here is the script of the tables
> CREATE EXTERNAL TABLE tweets (
> id BIGINT,
> created_at STRING,
> source STRING,
> favorited BOOLEAN,
> retweet_count INT,
> retweeted_status STRUCT<
> text:STRING,
> user:STRUCT<screen_name:__STRING,name:STRING>>,
> entities STRUCT<
> urls:ARRAY<STRUCT<expanded___url:STRING>>,
> user_mentions:ARRAY<STRUCT< __screen_name:STRING,name:__ STRING>>,
> hashtags:ARRAY<STRUCT<text:__STRING>>>,
> text STRING,
> user STRUCT<
> screen_name:STRING,
> name:STRING,
> friends_count:INT,
> followers_count:INT,
> statuses_count:INT,
> verified:BOOLEAN,
> utc_offset:INT,
> time_zone:STRING>,
> in_reply_to_screen_name STRING
> )
> ROW FORMAT SERDE 'com.cloudera.hive.serde.__JSONSerDe'
> LOCATION '/flume/Tweets_A';
> 
> do I have to add "com.cloudera.hive.serde.__JSONSerDe'" an other time to put data in elasticsearch ?? if yes,How !!
> 
> Thank you so very much
> 
> 2014-05-21 10:36 GMT+01:00 Costin Leau <costin.leau@gmail.com <mailto:costin.leau@gmail.com>
> <mailto:costin.leau@gmail.com <mailto:costin.leau@gmail.com>>__>:
> 
> The error indicates that your script refers to a JSonSerDe class (presumably from Cloudera) which cannot be
> found in
> the classpath:
> 
> "> Caused by: java.lang. ____ClassNotFoundException: com.cloudera.hive.serde.____ JSONSerDe"
> 
> In fact if you read through the stacktrace, you'll notice that this comes up while the job configuration
> is being read and this class name encountered but the class definition itself cannot be resolved.
> 
> I'm not sure what causes this class to be added to the classpath of your script - it could be your script
> or the
> client configuration.
> Note the class is not used or added by ES-hadoop itself.
> 
> I'm not sure what distro you are using (es-hadoop works across Apache Hadoop, Cloudera, HDP, MapR, Pivotal,
> etc...)
> but you could try running some
> basic Hive scripts (without es-hadoop) first to make sure the environment is sane and that you can properly
> read and
> write from HDFS and then add
> es-hadoop into the mix.
> 
> Hope this helps,
> 
> On 5/21/14 12:15 PM, hanine haninne wrote:
> 
> Thank you so much for ur answer
> here is what it gives me now
> 
> INSERT OVERWRITE TABLE tweetsES SELECT * FROM tweets;
> 
> Total MapReduce jobs = 1
> Launching Job 1 out of 1
> Number of reduce tasks is set to 0 since there's no reduce operator
> Starting Job = job_201405210900_0002, Tracking URL =
> http://master:50030/ ____jobdetails.jsp?jobid=job_____ 201405210900_0002
> <http://master:50030/ __jobdetails.jsp?jobid=job___ 201405210900_0002>
> <http://master:50030/ __jobdetails.jsp?jobid=job___ 201405210900_0002
> <http://master:50030/jobdetails.jsp?jobid=job_201405210900_0002>>
> Kill Command = /home/hduser/hadoop/libexec/.. ____ /bin/hadoop job -kill job_201405210900_0002
> 
> Hadoop job information for Stage-0: number of mappers: 1; number of reducers: 0
> 2014-05-21 10:12:05,285 Stage-0 map = 0%, reduce = 0%
> 2014-05-21 10:12:23,408 Stage-0 map = 100%, reduce = 100%
> Ended Job = job_201405210900_0002 with errors
> Error during job, obtaining debugging information...
> Job Tracking URL: http://master:50030/ ____jobdetails.jsp?jobid=job_____ 201405210900_0002
> <http://master:50030/ __jobdetails.jsp?jobid=job___ 201405210900_0002>
> <http://master:50030/ __jobdetails.jsp?jobid=job___ 201405210900_0002
> <http://master:50030/jobdetails.jsp?jobid=job_201405210900_0002>>
> Examining task ID: task_201405210900_0002_m _____ 000002 (and more) from job job_201405210900_0002
> 
> Task with the most failures(4):
> -----
> Task ID:
> task_201405210900_0002_m _____ 000000
> 
> URL:
> http://master:50030/ ____taskdetails.jsp?jobid=job_____ 201405210900_0002&tipid=task _____201405210900_0002_m_000000 <http://master:50030/__ taskdetails.jsp?jobid=job ___201405210900_0002&tipid=task___ 201405210900_0002_m_000000>
> 
> <http://master:50030/ __taskdetails.jsp?jobid=job___ 201405210900_0002&tipid=task___201405210900_0002_m_000000
> <http://master:50030/taskdetails.jsp?jobid=job_201405210900_0002&tipid=task_201405210900_0002_m_000000>>
> -----
> Diagnostic Messages for this Task:
> java.lang.RuntimeException: Error in configuring object
> at org.apache.hadoop.util.____ReflectionUtils.setJobConf(____ReflectionUtils.java:93)
> at org.apache.hadoop.util.____ReflectionUtils.setConf(____ReflectionUtils.java:64)
> at org.apache.hadoop.util.____ReflectionUtils.newInstance(____ReflectionUtils.java:117)
> at org.apache.hadoop.mapred.____MapTask.runOldMapper(MapTask.____java:426)
> at org.apache.hadoop.mapred. ____ MapTask.run(MapTask.java:366)
> at org.apache.hadoop.mapred. ____ Child$4.run(Child.java:255)
> 
> at java.security.____AccessController.doPrivileged(____Native Method)
> at javax.security.auth.Subject. ____ doAs(Subject.java:415)
> at org.apache.hadoop.security.____UserGroupInformation.doAs(____UserGroupInformation.java: ____ 1190)
> at org.apache.hadoop.mapred. ____ Child.main(Child.java:249)
> Caused by: java.lang.reflect. ____ InvocationTargetException
> 
> at sun.reflect. ____NativeMethodAccessorImpl.____ invoke0(Native Method)
> at sun.reflect. ____NativeMethodAccessorImpl.____ invoke( ____NativeMethodAccessorImpl.java:____ 57)
> at
> sun.reflect. ____DelegatingMethodAccessorImpl.____ invoke( ____DelegatingMethodAccessorImpl.____ java:43)
> at java.lang.reflect.Method. ____ invoke(Method.java:606)
> at org.apache.hadoop.util.____ReflectionUtils.setJobConf(____ReflectionUtils.java:88)
> 
> ... 9 more
> Caused by: java.lang.RuntimeException: Error in configuring object
> at org.apache.hadoop.util.____ReflectionUtils.setJobConf(____ReflectionUtils.java:93)
> at org.apache.hadoop.util.____ReflectionUtils.setConf(____ReflectionUtils.java:64)
> at org.apache.hadoop.util.____ReflectionUtils.newInstance(____ReflectionUtils.java:117)
> at org.apache.hadoop.mapred.____MapRunner.configure(MapRunner.____java:34)
> ... 14 more
> Caused by: java.lang.reflect. ____ InvocationTargetException
> 
> at sun.reflect. ____NativeMethodAccessorImpl.____ invoke0(Native Method)
> at sun.reflect. ____NativeMethodAccessorImpl.____ invoke( ____NativeMethodAccessorImpl.java:____ 57)
> at
> sun.reflect. ____DelegatingMethodAccessorImpl.____ invoke( ____DelegatingMethodAccessorImpl.____ java:43)
> at java.lang.reflect.Method. ____ invoke(Method.java:606)
> at org.apache.hadoop.util.____ReflectionUtils.setJobConf(____ReflectionUtils.java:88)
> 
> ... 17 more
> Caused by: java.lang.RuntimeException: Map operator initialization failed
> at org.apache.hadoop.hive.ql.____exec.ExecMapper.configure(____ExecMapper.java:121)
> ... 22 more
> Caused by: org.apache.hadoop.hive.ql. ____metadata.HiveException: java.lang.____ ClassNotFoundException:
> com.cloudera.hive.serde. ____ JSONSerDe
> at org.apache.hadoop.hive.ql. ____exec.MapOperator.____ getConvertedOI(MapOperator. ____ java:463)
> at org.apache.hadoop.hive.ql.____exec.MapOperator.setChildren(____MapOperator.java:479)
> at org.apache.hadoop.hive.ql.____exec.ExecMapper.configure(____ExecMapper.java:90)
> ... 22 more
> Caused by: java.lang. ____ClassNotFoundException: com.cloudera.hive.serde.____ JSONSerDe
> at java.net.URLClassLoader$1.run( ____ URLClassLoader.java:366)
> at java.net.URLClassLoader$1.run( ____ URLClassLoader.java:355)
> at java.security.____AccessController.doPrivileged(____Native Method)
> at java.net.URLClassLoader.____findClass(URLClassLoader.java:____354)
> at java.lang.ClassLoader.____loadClass(ClassLoader.java:____424)
> at sun.misc.Launcher$____AppClassLoader.loadClass(____Launcher.java:308)
> at java.lang.ClassLoader.____loadClass(ClassLoader.java:____357)
> at java.lang.Class.forName0( ____ Native Method)
> at java.lang.Class.forName(Class. ____ java:270)
> at org.apache.hadoop.conf.____Configuration.getClassByName(____Configuration.java:810)
> at org.apache.hadoop.hive.ql. ____exec.MapOperator.____ getConvertedOI(MapOperator. ____ java:422)
> ... 24 more
> 
> FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql. ____ exec.MapRedTask
> 
> MapReduce Jobs Launched:
> Job 0: Map: 1 HDFS Read: 0 HDFS Write: 0 FAIL
> Total MapReduce CPU Time Spent: 0 msec
> 
> 2014-05-20 14:11 GMT+01:00 Costin Leau <costin.leau@gmail.com <mailto:costin.leau@gmail.com>
> <mailto:costin.leau@gmail.com <mailto:costin.leau@gmail.com>>
> <mailto:costin.leau@gmail.com <mailto:costin.leau@gmail.com> <mailto:costin.leau@gmail.com
> <mailto:costin.leau@gmail.com>> __>__ >:
> 
> 1. You don't need to add the hive jars (hive-serdes) to your script - these are already part of
> the runtime
> 2. use es-hadoop-2.0.RC1, 1.3 M2 is fairly old
> 3. Make sure that the jar is actually available and that is potentially accessible by Hive. Also
> do note that
> when running Hive against a cluster, it's best to have the jars available on all nodes hence why
> most folks
> copy
> them to HDFS and refer to that location.
> While /home/hduser might be locally available, it might not exist on the Hive server - as
> indicated by the
> error.
> 
> Hope this helps,
> 
> On 5/20/14 3:58 PM, hanine haninne wrote:
> 
> Hello everybody
> 
> I m trying to take data from Hive and put it in elasticsearch
> here is the script and the error
> 
> hive> ADD JAR /home/hduser/hadoop/hive-0.11. ______0/lib/hive-serdes-1.0-______ SNAPSHOT.jar;
> Added /home/hduser/hadoop/hive-0.11. ______0/lib/hive-serdes-1.0-______ SNAPSHOT.jar to class path
> Added resource: /home/hduser/hadoop/hive-0.11. ______0/lib/hive-serdes-1.0-______ SNAPSHOT.jar
> 
> hive> CREATE EXTERNAL TABLE tweetsES (
> > id BIGINT,
> > created_at STRING,
> > source STRING,
> > favorited BOOLEAN,
> > retweet_count INT,
> > retweeted_status STRUCT<
> > text:STRING,
> > user:STRUCT<screen_name: ______ STRING,name:STRING>>,
> > entities STRUCT<
> > urls:ARRAY<STRUCT<expanded _______ url:STRING>>,
> > user_mentions:ARRAY<STRUCT< ______screen_name:STRING,name:______ STRING>>,
> > hashtags:ARRAY<STRUCT<text: ______ STRING>>>,
> 
> > text STRING,
> > user STRUCT<
> > screen_name:STRING,
> > name:STRING,
> > friends_count:INT,
> > followers_count:INT,
> > statuses_count:INT,
> > verified:BOOLEAN,
> > utc_offset:INT,
> > time_zone:STRING>,
> > in_reply_to_screen_name STRING
> > )
> > STORED BY 'org.elasticsearch.hadoop. ______ hive.EsStorageHandler'
> > TBLPROPERTIES('es.resource' = 'reseaux_sociaux/tweets','es. ______ input.json' = 'yes');
> 
> OK
> Time taken: 4.292 seconds
> hive> ADD JAR /home/hduser/hadoop/ ______elasticsearch-hadoop-1.3.0.M2.______ jar;
> Added /home/hduser/hadoop/ ______elasticsearch-hadoop-1.3.0.M2.______ jar to class path
> Added resource: /home/hduser/hadoop/ ______elasticsearch-hadoop-1.3.0.M2.______ jar
> 
> hive> INSERT OVERWRITE TABLE tweetsES SELECT * FROM tweets;
> Total MapReduce jobs = 1
> Launching Job 1 out of 1
> Number of reduce tasks is set to 0 since there's no reduce operator
> java.io.FileNotFoundException: File does not exist:
> /home/hduser/hadoop/ ______elasticsearch-hadoop-1.3.0.M2.______ jar
> at
> 
> org.apache.hadoop.hdfs. ______DistributedFileSystem.______ getFileStatus( ______DistributedFileSystem.java:______ 558)
> at
> org.apache.hadoop.filecache. ______DistributedCache.______ getFileStatus( ______ DistributedCache.java:185)
> at
> 
> org.apache.hadoop.filecache. ________TrackerDistributedCacheManager______.getFileStatus( ______TrackerDistributedCacheManager______.java:723)
> at
> 
> org.apache.hadoop.filecache. ________TrackerDistributedCacheManager______.determineTimestamps( ______TrackerDistributedCacheManager______.java:778)
> at
> 
> org.apache.hadoop.filecache. ________TrackerDistributedCacheManager______. ______determineTimestampsAndCacheVis______ ibilities( ______TrackerDistributedCacheManager______.java:755)
> at
> org.apache.hadoop.mapred. ______JobClient.______ copyAndConfigureFiles( ______ JobClient.java:843)
> at
> org.apache.hadoop.mapred. ______JobClient.______ copyAndConfigureFiles( ______ JobClient.java:734)
> at org.apache.hadoop.mapred.______JobClient.access$400(______JobClient.java:179)
> at org.apache.hadoop.mapred.______JobClient$2.run(JobClient.______java:951)
> at org.apache.hadoop.mapred.______JobClient$2.run(JobClient.______java:936)
> at java.security.______AccessController.doPrivileged(______Native Method)
> at javax.security.auth.Subject. ______ doAs(Subject.java:415)
> at
> org.apache.hadoop.security.______UserGroupInformation.doAs(______UserGroupInformation.java: ______ 1190)
> at org.apache.hadoop.mapred.______JobClient.submitJobInternal(______JobClient.java:936)
> at org.apache.hadoop.mapred.______JobClient.submitJob(JobClient.______java:910)
> at org.apache.hadoop.hive.ql.______exec.ExecDriver.execute(______ExecDriver.java:447)
> at org.apache.hadoop.hive.ql.______exec.MapRedTask.execute(______MapRedTask.java:138)
> at org.apache.hadoop.hive.ql.______exec.Task.executeTask(Task.______java:144)
> at org.apache.hadoop.hive.ql.______exec.TaskRunner.runSequential(______TaskRunner.java:57)
> at org.apache.hadoop.hive.ql.______Driver.launchTask(Driver.java:______1355)
> at org.apache.hadoop.hive.ql.______Driver.execute(Driver.java:______1139)
> at org.apache.hadoop.hive.ql. ______ Driver.run(Driver.java:945)
> at org.apache.hadoop.hive.cli.______CliDriver.processLocalCmd(______CliDriver.java:259)
> at org.apache.hadoop.hive.cli.______CliDriver.processCmd(______CliDriver.java:216)
> at org.apache.hadoop.hive.cli.______CliDriver.processLine(______CliDriver.java:413)
> at org.apache.hadoop.hive.cli.______CliDriver.run(CliDriver.java:______756)
> at org.apache.hadoop.hive.cli.______CliDriver.main(CliDriver.__java: ____ 614)
> at sun.reflect. ______NativeMethodAccessorImpl.______ invoke0(Native Method)
> at
> sun.reflect. ______NativeMethodAccessorImpl.______ invoke( ______NativeMethodAccessorImpl.java:______ 57)
> at
> 
> sun.reflect. ______DelegatingMethodAccessorImpl.______ invoke( ______DelegatingMethodAccessorImpl.______ java:43)
> at java.lang.reflect.Method. ______ invoke(Method.java:606)
> at org.apache.hadoop.util.RunJar. ______ main(RunJar.java:160)
> 
> Job Submission failed with exception 'java.io <http://java.io> <http://java.io>
> <http://java.io>. ______ FileNotFoundException(File does not exist:
> /home/hduser/hadoop/ ______elasticsearch-hadoop-1.3.0.M2.______ jar)'
> FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql. ______ exec.MapRedTask
> 
> That path it exist :/home/hduser/hadoop/ ______elasticsearch-hadoop-1.3.0.M2.______ jar
> 
> Any help would be so appreciable
> Thanks
> 
> --
> You received this message because you are subscribed to the Google Groups "elasticsearch" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to
> elasticsearch+unsubscribe@ __go____ oglegroups.com <http://go__oglegroups.com>
> <http://googlegroups.com>
> <mailto:elasticsearch% ____ 2Bunsubscribe@googlegroups.com
> <mailto:elasticsearch%25__2Bunsubscribe@googlegroups.com>
> <mailto:elasticsearch% __252Bunsubscribe@googlegroups.__ com
> <mailto:elasticsearch%25252Bunsubscribe@googlegroups.com>>__>
> <mailto:elasticsearch+ ______ unsubscribe@googlegroups.com
> <mailto:elasticsearch%2B ____ unsubscribe@googlegroups.com>
> <mailto:elasticsearch%2B ____ unsubscribe@googlegroups.com
> <mailto:elasticsearch%252B__unsubscribe@googlegroups.com>>
> <mailto:elasticsearch% ____2Bunsubscribe@googlegroups.com <mailto:elasticsearch%25__ 2Bunsubscribe@googlegroups.com>
> <mailto:elasticsearch% __252Bunsubscribe@googlegroups.__ com
> <mailto:elasticsearch%25252Bunsubscribe@googlegroups.com>>__>>.
> 
> To view this discussion on the web visit
> https://groups.google.com/d/ ______msgid/elasticsearch/__ d1613b48- ____e58d-4077-a579-__ 92b46a97bcff% ______ 40googlegroups.com
> <https://groups.google.com/d/ ____msgid/elasticsearch/d1613b48-____ e58d-4077-a579-92b46a97bcff% ____ 40googlegroups.com>
> 
> <https://groups.google.com/d/ ____msgid/elasticsearch/d1613b48-____ e58d-4077-a579-92b46a97bcff% ____ 40googlegroups.com
> <https://groups.google.com/d/ __msgid/elasticsearch/d1613b48-__ e58d-4077-a579-92b46a97bcff%__40googlegroups.com>>
> 
> <https://groups.google.com/d/ ____msgid/elasticsearch/d1613b48-____ e58d-4077-a579-92b46a97bcff% ____ 40googlegroups.com
> <https://groups.google.com/d/ __msgid/elasticsearch/d1613b48-__ e58d-4077-a579-92b46a97bcff%__40googlegroups.com>
> 
> <https://groups.google.com/d/ __msgid/elasticsearch/d1613b48-__ e58d-4077-a579-92b46a97bcff%__40googlegroups.com
> <https://groups.google.com/d/msgid/elasticsearch/d1613b48-e58d-4077-a579-92b46a97bcff%40googlegroups.com>>>
> 
> <https://groups.google.com/d/ ______msgid/elasticsearch/__ d1613b48- ____e58d-4077-a579-__ 92b46a97bcff% ______40googlegroups.com?utm_____ medium= __email&utm_source=____ footer
> <https://groups.google.com/d/ ____msgid/elasticsearch/d1613b48-____ e58d-4077-a579-92b46a97bcff% ____40googlegroups.com?utm___ medium= __email&utm_source=__ footer>
> 
> <https://groups.google.com/d/ ____msgid/elasticsearch/d1613b48-____ e58d-4077-a579-92b46a97bcff% ____40googlegroups.com?utm___ medium= __email&utm_source=__ footer
> <https://groups.google.com/d/ __msgid/elasticsearch/d1613b48-__ e58d-4077-a579-92b46a97bcff% __40googlegroups.com?utm_medium=__ email&utm_source=footer>>
> 
> <https://groups.google.com/d/ ____msgid/elasticsearch/d1613b48-____ e58d-4077-a579-92b46a97bcff% ____40googlegroups.com?utm___ medium= __email&utm_source=__ footer
> <https://groups.google.com/d/ __msgid/elasticsearch/d1613b48-__ e58d-4077-a579-92b46a97bcff% __40googlegroups.com?utm_medium=__ email&utm_source=footer>
> 
> <https://groups.google.com/d/ __msgid/elasticsearch/d1613b48-__ e58d-4077-a579-92b46a97bcff% __40googlegroups.com?utm_medium=__ email&utm_source=footer
> <https://groups.google.com/d/msgid/elasticsearch/d1613b48-e58d-4077-a579-92b46a97bcff%40googlegroups.com?utm_medium=email&utm_source=footer>>>>.
> 
> For more options, visit https://groups.google.com/d/ ______ optout
> <https://groups.google.com/d/ ____optout> <https://groups.google.com/d/____ optout
> <https://groups.google.com/d/__optout>>
> 
> <https://groups.google.com/d/ ____optout <https://groups.google.com/d/__ optout>
> <https://groups.google.com/d/__optout <https://groups.google.com/d/optout>>>.
> 
> --
> Costin
> 
> --
> You received this message because you are subscribed to the Google Groups "elasticsearch" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to
> elasticsearch+unsubscribe@ __go____ oglegroups.com <http://go__oglegroups.com> <http://googlegroups.com>
> <mailto:elasticsearch% ____ 2Bunsubscribe@googlegroups.com
> <mailto:elasticsearch%25__2Bunsubscribe@googlegroups.com>
> <mailto:elasticsearch% __252Bunsubscribe@googlegroups.__ com
> <mailto:elasticsearch%25252Bunsubscribe@googlegroups.com>>__>.
> 
> To view this discussion on the web visit
> https://groups.google.com/d/ ______msgid/elasticsearch/__ 537B549F. ____8020501%40gmail.__ com
> <https://groups.google.com/d/ ____msgid/elasticsearch/537B549F.____ 8020501%40gmail.com>
> <https://groups.google.com/d/ ____msgid/elasticsearch/537B549F.____ 8020501%40gmail.com
> <https://groups.google.com/d/ __msgid/elasticsearch/537B549F.__ 8020501%40gmail.com>>
> 
> <https://groups.google.com/d/ ____msgid/elasticsearch/537B549F.____ 8020501%40gmail.com
> <https://groups.google.com/d/ __msgid/elasticsearch/537B549F.__ 8020501%40gmail.com>
> <https://groups.google.com/d/ __msgid/elasticsearch/537B549F.__ 8020501%40gmail.com
> <https://groups.google.com/d/msgid/elasticsearch/537B549F.8020501%40gmail.com>>>.
> 
> For more options, visit https://groups.google.com/d/ ______ optout
> <https://groups.google.com/d/ ____optout> <https://groups.google.com/d/____ optout
> <https://groups.google.com/d/__optout>>
> 
> <https://groups.google.com/d/ ____optout <https://groups.google.com/d/__ optout>
> <https://groups.google.com/d/__optout <https://groups.google.com/d/optout>>>.
> 
> --
> You received this message because you are subscribed to the Google Groups "elasticsearch" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to
> elasticsearch+unsubscribe@ __go__ oglegroups.com <http://googlegroups.com>
> <mailto:elasticsearch% __2Bunsubscribe@googlegroups.com <mailto:elasticsearch%252Bunsubscribe@googlegroups.com>__ >
> <mailto:elasticsearch+ ____ unsubscribe@googlegroups.com
> <mailto:elasticsearch%2B __unsubscribe@googlegroups.com> <mailto:elasticsearch%__ 2Bunsubscribe@googlegroups.com
> <mailto:elasticsearch%252Bunsubscribe@googlegroups.com>__>>.
> To view this discussion on the web visit
> https://groups.google.com/d/ ____msgid/elasticsearch/CANXJSR9-____ xpGoJR4gvPW%3DKKP%3DVr _____5MxyDoUJKtbpqM6CsYs1G4Q%____ 40mail.gmail.com
> <https://groups.google.com/d/ __msgid/elasticsearch/CANXJSR9-__ xpGoJR4gvPW%3DKKP%3DVr ___5MxyDoUJKtbpqM6CsYs1G4Q%__ 40mail.gmail.com>
> 
> <https://groups.google.com/d/ __msgid/elasticsearch/CANXJSR9-__ xpGoJR4gvPW%3DKKP%3DVr ___5MxyDoUJKtbpqM6CsYs1G4Q%__ 40mail.gmail.com
> <https://groups.google.com/d/msgid/elasticsearch/CANXJSR9-xpGoJR4gvPW%3DKKP%3DVr_5MxyDoUJKtbpqM6CsYs1G4Q%40mail.gmail.com>>
> 
> <https://groups.google.com/d/ ____msgid/elasticsearch/CANXJSR9-____ xpGoJR4gvPW%3DKKP%3DVr _____5MxyDoUJKtbpqM6CsYs1G4Q%____ 40mail.gmail.com?utm_medium= ____ email&utm_source=footer
> <https://groups.google.com/d/ __msgid/elasticsearch/CANXJSR9-__ xpGoJR4gvPW%3DKKP%3DVr ___5MxyDoUJKtbpqM6CsYs1G4Q%__ 40mail.gmail.com?utm_medium=__email&utm_source=footer>
> 
> <https://groups.google.com/d/ __msgid/elasticsearch/CANXJSR9-__ xpGoJR4gvPW%3DKKP%3DVr ___5MxyDoUJKtbpqM6CsYs1G4Q%__ 40mail.gmail.com?utm_medium=__email&utm_source=footer
> <https://groups.google.com/d/msgid/elasticsearch/CANXJSR9-xpGoJR4gvPW%3DKKP%3DVr_5MxyDoUJKtbpqM6CsYs1G4Q%40mail.gmail.com?utm_medium=email&utm_source=footer>>>.
> 
> For more options, visit https://groups.google.com/d/ ____optout <https://groups.google.com/d/__ optout>
> <https://groups.google.com/d/__optout <https://groups.google.com/d/optout>>.
> 
> --
> Costin
> 
> --
> You received this message because you are subscribed to the Google Groups "elasticsearch" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to
> elasticsearch+unsubscribe@ __go__ oglegroups.com <http://googlegroups.com>
> <mailto:elasticsearch% __2Bunsubscribe@googlegroups.com <mailto:elasticsearch%252Bunsubscribe@googlegroups.com>__ >.
> To view this discussion on the web visit
> https://groups.google.com/d/ ____msgid/elasticsearch/537C738E.____ 9030001%40gmail.com
> <https://groups.google.com/d/ __msgid/elasticsearch/537C738E.__ 9030001%40gmail.com>
> <https://groups.google.com/d/ __msgid/elasticsearch/537C738E.__ 9030001%40gmail.com
> <https://groups.google.com/d/msgid/elasticsearch/537C738E.9030001%40gmail.com>>.
> 
> For more options, visit https://groups.google.com/d/ ____optout <https://groups.google.com/d/__ optout>
> <https://groups.google.com/d/__optout <https://groups.google.com/d/optout>>.
> 
> --
> You received this message because you are subscribed to the Google Groups "elasticsearch" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to
> elasticsearch+unsubscribe@__googlegroups.com <mailto:elasticsearch%2Bunsubscribe@googlegroups.com>
> <mailto:elasticsearch+__unsubscribe@googlegroups.com <mailto:elasticsearch%2Bunsubscribe@googlegroups.com>>.
> To view this discussion on the web visit
> https://groups.google.com/d/ __msgid/elasticsearch/__ CANXJSR8Gy4qhM8Lzm5BHCr2- __xptLKBSdm00nCrz-JtnW59jWcw%__ 40mail.gmail.com
> <https://groups.google.com/d/msgid/elasticsearch/CANXJSR8Gy4qhM8Lzm5BHCr2-xptLKBSdm00nCrz-JtnW59jWcw%40mail.gmail.com>
> <https://groups.google.com/d/ __msgid/elasticsearch/__ CANXJSR8Gy4qhM8Lzm5BHCr2- __xptLKBSdm00nCrz-JtnW59jWcw%__ 40mail.gmail.com?utm_medium=__email&utm_source=footer
> <https://groups.google.com/d/msgid/elasticsearch/CANXJSR8Gy4qhM8Lzm5BHCr2-xptLKBSdm00nCrz-JtnW59jWcw%40mail.gmail.com?utm_medium=email&utm_source=footer>>.
> 
> For more options, visit https://groups.google.com/d/__optout <https://groups.google.com/d/optout>.
> 
> --
> Costin
> 
> --
> You received this message because you are subscribed to the Google Groups "elasticsearch" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to
> elasticsearch+unsubscribe@__googlegroups.com <mailto:elasticsearch%2Bunsubscribe@googlegroups.com>.
> To view this discussion on the web visit
> https://groups.google.com/d/ __msgid/elasticsearch/537C8751.__ 1030908%40gmail.com
> <https://groups.google.com/d/msgid/elasticsearch/537C8751.1030908%40gmail.com>.
> 
> For more options, visit https://groups.google.com/d/__optout <https://groups.google.com/d/optout>.
> 
> ```
> 
> --  
> You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
> To unsubscribe from this group and stop receiving emails from it, send an email to  
> [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com) [mailto:elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> To view this discussion on the web visit  
> [https://groups.google.com/d/msgid/elasticsearch/CANXJSR\_pj6i55jwA3wYiGgh1d\_q86DpcNRKLZzhk-V97vWFLaQ%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CANXJSR_pj6i55jwA3wYiGgh1d_q86DpcNRKLZzhk-V97vWFLaQ%40mail.gmail.com)  
> [https://groups.google.com/d/msgid/elasticsearch/CANXJSR\_pj6i55jwA3wYiGgh1d\_q86DpcNRKLZzhk-V97vWFLaQ%40mail.gmail.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/CANXJSR_pj6i55jwA3wYiGgh1d_q86DpcNRKLZzhk-V97vWFLaQ%40mail.gmail.com?utm_medium=email&utm_source=footer).  
> For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

--  
Costin

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/537E0B0B.3070307%40gmail.com](https://groups.google.com/d/msgid/elasticsearch/537E0B0B.3070307%40gmail.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![hanine](https://avatars.discourse-cdn.com/v4/letter/h/b4bc9f/32.png) [@hanine](https://discuss.elastic.co/u/hanine)\
**Post date:** [May 27, 2014, 8:53pm UTC](https://discuss.elastic.co/t/hadoop-elasticsearch-and-hive/17622/9 "2014-05-27T20:53:08Z")

</div>

Hello,  
I m sorry,but it did not work yet. I thinking I m missing something,Here is  
what I did from the beginning ( from getting tweets with flume )

1-script flume (Tweets.conf)  
2-store data in HDFS as indicated in the script  
3-then I create a table with hive and get data there (in order to have the  
possibility to communicate with elasticsearch after) the scripte hive is in  
hive\_tweets  
now I wanna put that data in elasticsearch(head) in order to show it in an  
ergonomic interface (like image1 )  
so that I tried this script (hiveES)  
when I execute it, it gives me :

```
> STORED BY 'org.elasticsearch.hadoop.hive.EsStorageHandler'
> TBLPROPERTIES('es.resource' =

```

'reseaux\_sociaux/tweets','es.input.json' = 'yes');  
OK  
Time taken: 0.133 seconds  
hive\> INSERT OVERWRITE TABLE tweetsES SELECT \* FROM tweets;  
Total MapReduce jobs = 1  
Launching Job 1 out of 1  
Number of reduce tasks is set to 0 since there's no reduce operator  
Starting Job = job\_201405272117\_0002, Tracking URL =  
[http://master:50030/jobdetails.jsp?jobid=job\_201405272117\_0002](http://master:50030/jobdetails.jsp?jobid=job_201405272117_0002)  
Kill Command = /home/hduser/hadoop/libexec/../bin/hadoop job -kill  
job\_201405272117\_0002  
Hadoop job information for Stage-0: number of mappers: 1; number of  
reducers: 0  
2014-05-27 21:51:14,893 Stage-0 map = 0%, reduce = 0%  
2014-05-27 21:51:35,019 Stage-0 map = 100%, reduce = 100%  
Ended Job = job\_201405272117\_0002 with errors  
Error during job, obtaining debugging information...  
Job Tracking URL:  
[http://master:50030/jobdetails.jsp?jobid=job\_201405272117\_0002](http://master:50030/jobdetails.jsp?jobid=job_201405272117_0002)  
Examining task ID: task\_201405272117\_0002\_m\_000002 (and more) from job  
job\_201405272117\_0002

## Task with the most failures(4):

Task ID:  
task\_201405272117\_0002\_m\_000000

URL:

## [http://master:50030/taskdetails.jsp?jobid=job\_201405272117\_0002&tipid=task\_201405272117\_0002\_m\_000000](http://master:50030/taskdetails.jsp?jobid=job_201405272117_0002&tipid=task_201405272117_0002_m_000000)

Diagnostic Messages for this Task:  
java.lang.RuntimeException:  
org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while  
processing row {"id":467649114269028352,"created\_at":"Sat May 17 12:53:32  
+0000 2014","source":"\<a href="[http://www.apple.com](http://www.apple.com)"  
rel="nofollow"\>iOS","favorited":false,"retweet\_count":0,"retweeted\_status":null,"entities":{"urls":[{"expanded\_url":"  
[viera lifting fa cup for arsenal - Google Search](https://www.google.co.uk/search?q=viera+lifting+fa+cup+for+arsenal&client=safari&hl=en-gb&source=lnms&tbm=isch&sa=X&ei=alp3U4LrK82UOufRgaAK&ved=0CAYQ_AUoAQ&biw=320&bih=460#facrc=_&imgrc=-QK5IhwQT8AS8M%253A%3B2yfUWG7-cngS-M%3Bhttp%253A%252F%252Ffarm4.static.flickr.com%252F3777%252F10838930556_618b87d7cc_m.jpg%3Bhttp%253A%252F%252Fwhotalking.com%252Fflickr%252F2-0%252BChelsea%3B1024%3B669%22%7D%5D,%22user_mentions%22:%5B%7B%22screen_name%22:%22jameswilliams46%22,%22name%22:%22James)  
Williams"}],"hashtags":},"text":"@jameswilliams46  
[https://t.co/CAmxdagAym","user":{"screen\_name":"SSimpson7379","name":"Stephen](https://t.co/CAmxdagAym%22,%22user%22:%7B%22screen_name%22:%22SSimpson7379%22,%22name%22:%22Stephen)  
Simpson","friends\_count":258,"followers\_count":266,"statuses\_count":2609,"verified":false,"utc\_offset":3600,"time\_zone":"London"},"in\_reply\_to\_screen\_name":"jameswilliams46"}  
at org.apache.hadoop.hive.ql.exec.ExecMapper.map(ExecMapper.java:162)  
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)  
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:430)  
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:366)  
at org.apache.hadoop.mapred.Child$4.run(Child.java:255)  
at java.security.AccessController.doPrivileged(Native Method)  
at javax.security.auth.Subject.doAs(Subject.java:415)  
at  
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190)  
at org.apache.hadoop.mapred.Child.main(Child.java:249)  
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime  
Error while processing row {"id":467649114269028352,"created\_at":"Sat May  
17 12:53:32 +0000 2014","source":"\<a href="[http://www.apple.com](http://www.apple.com)"  
rel="nofollow"\>iOS","favorited":false,"retweet\_count":0,"retweeted\_status":null,"entities":{"urls":[{"expanded\_url":"  
[viera lifting fa cup for arsenal - Google Search](https://www.google.co.uk/search?q=viera+lifting+fa+cup+for+arsenal&client=safari&hl=en-gb&source=lnms&tbm=isch&sa=X&ei=alp3U4LrK82UOufRgaAK&ved=0CAYQ_AUoAQ&biw=320&bih=460#facrc=_&imgrc=-QK5IhwQT8AS8M%253A%3B2yfUWG7-cngS-M%3Bhttp%253A%252F%252Ffarm4.static.flickr.com%252F3777%252F10838930556_618b87d7cc_m.jpg%3Bhttp%253A%252F%252Fwhotalking.com%252Fflickr%252F2-0%252BChelsea%3B1024%3B669%22%7D%5D,%22user_mentions%22:%5B%7B%22screen_name%22:%22jameswilliams46%22,%22name%22:%22James)  
Williams"}],"hashtags":},"text":"@jameswilliams46  
[https://t.co/CAmxdagAym","user":{"screen\_name":"SSimpson7379","name":"Stephen](https://t.co/CAmxdagAym%22,%22user%22:%7B%22screen_name%22:%22SSimpson7379%22,%22name%22:%22Stephen)  
Simpson","friends\_count":258,"followers\_count":266,"statuses\_count":2609,"verified":false,"utc\_offset":3600,"time\_zone":"London"},"in\_reply\_to\_screen\_name":"jameswilliams46"}  
at  
org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:671)  
at org.apache.hadoop.hive.ql.exec.ExecMapper.map(ExecMapper.java:144)  
... 8 more  
Caused by: java.lang.IllegalArgumentException: When using JSON input, only  
one field is expected  
at org.elasticsearch.hadoop.util.Assert.isTrue(Assert.java:48)  
at  
org.elasticsearch.hadoop.hive.HiveBytesConverter.convert(HiveBytesConverter.java:48)  
at  
org.elasticsearch.hadoop.serialization.command.JsonTemplatedCommand.preProcess(JsonTemplatedCommand.java:56)  
at  
org.elasticsearch.hadoop.serialization.command.TemplatedCommand.write(TemplatedCommand.java:73)  
at org.elasticsearch.hadoop.hive.EsSerDe.serialize(EsSerDe.java:135)  
at  
org.apache.hadoop.hive.ql.exec.FileSinkOperator.processOp(FileSinkOperator.java:617)  
at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:502)  
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:832)  
at  
org.apache.hadoop.hive.ql.exec.SelectOperator.processOp(SelectOperator.java:84)  
at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:502)  
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:832)  
at  
org.apache.hadoop.hive.ql.exec.TableScanOperator.processOp(TableScanOperator.java:90)  
at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:502)  
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:832)  
at  
org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:652)  
... 9 more

FAILED: Execution Error, return code 2 from  
org.apache.hadoop.hive.ql.exec.MapRedTask  
MapReduce Jobs Launched:  
Job 0: Map: 1 HDFS Read: 0 HDFS Write: 0 FAIL  
Total MapReduce CPU Time Spent: 0 msec

Any help would be so appreciable  
Thank you so much

2014-05-22 15:34 GMT+01:00 Costin Leau [costin.leau@gmail.com](mailto:costin.leau@gmail.com):

> Hi,
> 
> It looks like you have two tables - one that uses the JSONSerDe from  
> cloudera and another one using es-hadoop.  
> You configured your es-hadoop table to consider the input as json however  
> it does not receive the proper format (as the exception indicates).  
> See this [1] section of the documentation for more information.
> 
> Let me restate again that you do not the data to Elasticsearch and  
> es-hadoop to be in JSON format - unless it actually is in JSON  
> (as in JSON files are stored in HDFS) simply send whatever data you have  
> in Hive to es-hadoop and it will do the JSON translation automatically  
> and typically much more efficient.  
> Again the docs [2] discuss this in detail. Frankly, I'm not sure why you  
> want to use the JSONSerDe.
> 
> To conclude: if the data is in raw format in HDFS, just feed to es-hadoop  
> with the input configured as JSON, if it's in a different format,  
> load it in Hive as you would typically do and then insert it into the  
> es-hadoop table.
> 
> Hope this helps,
> 
> [1] [Elastic — The Search AI Company | Elastic](http://www.elasticsearch.org/guide/en/elasticsearch/hadoop/)  
> current/hive.html#writing-json-hive  
> [2] [Elastic — The Search AI Company | Elastic](http://www.elasticsearch.org/guide/en/elasticsearch/hadoop/)  
> current/hive.html#hive
> 
> On 5/22/14 12:13 PM, hanine haninne wrote:
> 
> > Hello again,  
> > I m trying to get some tweets from the HDFS and put it in  
> > elasticsearch(head) in order to make search on it, I did what  
> > u said and I m so thankful, But it start reading and does not continue. I  
> > don't know why ?!!  
> > here is what I did :
> > 
> > hive -hiveconf hive.aux.jars.path=/ES\_Hadoop/  
> > dist/elasticsearch-hadoop-2.0.0.RC1.jar
> > 
> > Logging initialized using configuration in  
> > jar:file:/home/hduser/hadoop/hive-0.11.0/lib/hive-common-0.  
> > 11.0.jar!/hive-log4j.properties  
> > Hive history file=/tmp/hduser/hive\_job\_log\_hduser\_8166@mouna-pc\_  
> > 201405220958\_2036150447.txt
> > 
> > hive\> ADD JAR /home/hduser/hadoop/hive-0.11.0/lib/hive-serdes-1.0-  
> > SNAPSHOT.jar;  
> > Added /home/hduser/hadoop/hive-0.11.0/lib/hive-serdes-1.0-SNAPSHOT.jar  
> > to class path  
> > Added resource: /home/hduser/hadoop/hive-0.11.0/lib/hive-serdes-1.0-  
> > SNAPSHOT.jar  
> > hive\> INSERT OVERWRITE TABLE tweetsES SELECT \* FROM tweets;  
> > Total MapReduce jobs = 1  
> > Launching Job 1 out of 1  
> > Number of reduce tasks is set to 0 since there's no reduce operator  
> > Starting Job = job\_201405220937\_0005, Tracking URL = [http://master:50030/](http://master:50030/)  
> > jobdetails.jsp?jobid=job\_201405220937\_0005  
> > Kill Command = /home/hduser/hadoop/libexec/../bin/hadoop job -kill  
> > job\_201405220937\_0005  
> > Hadoop job information for Stage-0: number of mappers: 1; number of  
> > reducers: 0  
> > 2014-05-22 10:01:39,184 Stage-0 map = 0%, reduce = 0%  
> > 2014-05-22 10:01:59,320 Stage-0 map = 100%, reduce = 100%  
> > Ended Job = job\_201405220937\_0005 with errors  
> > Error during job, obtaining debugging information...  
> > Job Tracking URL: [http://master:50030/jobdetails.jsp?jobid=job\_](http://master:50030/jobdetails.jsp?jobid=job_)  
> > 201405220937\_0005  
> > Examining task ID: task\_201405220937\_0005\_m\_000002 (and more) from job  
> > job\_201405220937\_0005
> > 
> > ## Task with the most failures(4):
> > 
> > Task ID:  
> > task\_201405220937\_0005\_m\_000000
> > 
> > ## URL: [http://master:50030/taskdetails.jsp?jobid=job\_](http://master:50030/taskdetails.jsp?jobid=job_) 201405220937\_0005&tipid=task\_201405220937\_0005\_m\_000000
> > 
> > Diagnostic Messages for this Task:  
> > java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException:  
> > Hive Runtime Error while processing row  
> > {"id":467649114269028352,"created\_at":"Sat May 17 12:53:32 +0000  
> > 2014","source":"\<a href="[http://www.apple.com](http://www.apple.com)"  
> > rel="nofollow"\>iOS","favorited":false,"retweet\_  
> > count":0,"retweeted\_status":null,"entities":{"urls":[{"expanded\_url":"  
> > [Google Search](https://www.google.co.uk/search?q=viera+lifting+fa+cup+for+arsenal&)  
> > client=safari&hl=en-gb&source=lnms&tbm=isch&sa=X&ei=  
> > alp3U4LrK82UOufRgaAK&ved=0CAYQ\_AUoAQ&biw=320&bih=460#  
> > facrc=_&imgrc=-QK5IhwQT8AS8M%253A%3B2yfUWG7-cngS-M%3Bhttp%  
> > 253A%252F%252Ffarm4.static.flickr.com%252F3777%  
> > 252F10838930556\_618b87d7cc\_m.jpg%3Bhttp%253A%252F%  
> > 252Fwhotalking.com%252Fflickr%252F2-0%252BChelsea%3B1024%3B669  
> > "}],"user\_mentions":[{"screen\_name":"jameswilliams46","name":"James  
> > Williams"}],"hashtags":[]},"text":"@jameswilliams46  
> > [https://t.co/CAmxdagAym","user":{"screen\_name":"](https://t.co/CAmxdagAym%22,%22user%22:%7B%22screen_name%22:%22)  
> > SSimpson7379","name":"Stephen  
> > Simpson","friends\_count":258,"followers\_count":266,"  
> > statuses\_count":2609,"verified":false,"utc\_offset":  
> > 3600,"time\_zone":"London"},"in\_reply\_to\_screen\_name":"jameswilliams46"}  
> > at org.apache.hadoop.hive.ql.exec.ExecMapper.map(  
> > ExecMapper.java:162)  
> > at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)  
> > at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:430)  
> > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:366)  
> > at org.apache.hadoop.mapred.Child$4.run(Child.java:255)  
> > at java.security.AccessController.doPrivileged(Native Method)  
> > at javax.security.auth.Subject.doAs(Subject.java:415)  
> > at org.apache.hadoop.security.UserGroupInformation.doAs(  
> > UserGroupInformation.java:1190)  
> > at org.apache.hadoop.mapred.Child.main(Child.java:249)  
> > Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive  
> > Runtime Error while processing row  
> > {"id":467649114269028352,"created\_at":"Sat May 17 12:53:32 +0000  
> > 2014","source":"\<a href="[http://www.apple.com](http://www.apple.com)"  
> > rel="nofollow"\>iOS","favorited":false,"retweet_  
> > count":0,"retweeted\_status":null,"entities":{"urls":[{"expanded\_url":"  
> > [Google Search](https://www.google.co.uk/search?q=viera+lifting+fa+cup+for+arsenal&)  
> > client=safari&hl=en-gb&source=lnms&tbm=isch&sa=X&ei=  
> > alp3U4LrK82UOufRgaAK&ved=0CAYQ\_AUoAQ&biw=320&bih=460#  
> > facrc=\_&imgrc=-QK5IhwQT8AS8M%253A%3B2yfUWG7-cngS-M%3Bhttp%  
> > 253A%252F%[252Ffarm4.static.flickr.com](http://252Ffarm4.static.flickr.com)%252F3777%  
> > 252F10838930556\_618b87d7cc\_m.jpg%3Bhttp%253A%252F%  
> > [252Fwhotalking.com](http://252Fwhotalking.com)%252Fflickr%252F2-0%252BChelsea%3B1024%3B669  
> > "}],"user\_mentions":[{"screen\_name":"jameswilliams46","name":"James  
> > Williams"}],"hashtags":},"text":"@jameswilliams46  
> > [https://t.co/CAmxdagAym","user":{"screen\_name":"](https://t.co/CAmxdagAym%22,%22user%22:%7B%22screen_name%22:%22)  
> > SSimpson7379","name":"Stephen  
> > Simpson","friends\_count":258,"followers\_count":266,"  
> > statuses\_count":2609,"verified":false,"utc\_offset":  
> > 3600,"time\_zone":"London"},"in\_reply\_to\_screen\_name":"jameswilliams46"}  
> > at org.apache.hadoop.hive.ql.exec.MapOperator.process(  
> > MapOperator.java:671)  
> > at org.apache.hadoop.hive.ql.exec.ExecMapper.map(  
> > ExecMapper.java:144)  
> > ... 8 more  
> > Caused by: org.elasticsearch.hadoop.EsHadoopIllegalArgumentException:  
> > When using JSON input, only one field is expected  
> > at org.elasticsearch.hadoop.util.Assert.isTrue(Assert.java:50)  
> > at org.elasticsearch.hadoop.hive.HiveBytesConverter.convert(  
> > HiveBytesConverter.java:48)  
> > at org.elasticsearch.hadoop.serialization.bulk.  
> > JsonTemplatedBulk.preProcess(JsonTemplatedBulk.java:58)  
> > at org.elasticsearch.hadoop.serialization.bulk.TemplatedBulk.write(  
> > TemplatedBulk.java:75)  
> > at org.elasticsearch.hadoop.hive.EsSerDe.serialize(EsSerDe.java:128)  
> > at org.apache.hadoop.hive.ql.exec.FileSinkOperator.  
> > processOp(FileSinkOperator.java:617)  
> > at org.apache.hadoop.hive.ql.exec.Operator.process(  
> > Operator.java:502)  
> > at org.apache.hadoop.hive.ql.exec.Operator.forward(  
> > Operator.java:832)  
> > at org.apache.hadoop.hive.ql.exec.SelectOperator.processOp(  
> > SelectOperator.java:84)  
> > at org.apache.hadoop.hive.ql.exec.Operator.process(  
> > Operator.java:502)  
> > at org.apache.hadoop.hive.ql.exec.Operator.forward(  
> > Operator.java:832)  
> > at org.apache.hadoop.hive.ql.exec.TableScanOperator.  
> > processOp(TableScanOperator.java:90)  
> > at org.apache.hadoop.hive.ql.exec.Operator.process(  
> > Operator.java:502)  
> > at org.apache.hadoop.hive.ql.exec.Operator.forward(  
> > Operator.java:832)  
> > at org.apache.hadoop.hive.ql.exec.MapOperator.process(  
> > MapOperator.java:652)  
> > ... 9 more
> > 
> > FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.  
> > exec.MapRedTask  
> > MapReduce Jobs Launched:  
> > Job 0: Map: 1 HDFS Read: 0 HDFS Write: 0 FAIL  
> > Total MapReduce CPU Time Spent: 0 msec
> > 
> > when I did not add that jar "ADD JAR /home/hduser/hadoop/hive-0.11.  
> > 0/lib/hive-serdes-1.0-SNAPSHOT.jar;" it gave me that  
> > error "Caused by: java.lang.ClassNotFoundException:  
> > com.cloudera.hive.serde.JSONSerDe  
> > "
> > 
> > Thank you so very much for your helping
> > 
> > 2014-05-21 12:00 GMT+01:00 Costin Leau \<[costin.leau@gmail.com](mailto:costin.leau@gmail.com) \<mailto:  
> > [costin.leau@gmail.com](mailto:costin.leau@gmail.com)\>\>:
> > 
> > ```
> > If you plan to use es-hadoop, there's no need to do any JSON
> > 
> > ```
> > 
> > conversion (es-hadoop does that automatically) - see  
> > the documentation at [1]  
> > for more information.  
> > If not than I recommend reaching out to the providers of the package  
> > for more information on its configuration.
> > 
> > ```
> > [1] elasticsearch.org/hadoop <http://elasticsearch.org/hadoop>
> > 
> > On 5/21/14 1:17 PM, hanine haninne wrote:
> > 
> > yes, you are right.Thanks so much
> > 
> > well I tried hive with HDFS and it works very well,by the way I m
> > 
> > ```
> > 
> > using hive-0.11.0 , hadoop-1.2.1 and  
> > elasticsearch-1.0.1  
> > Here is the script of the tables  
> > CREATE EXTERNAL TABLE tweets (  
> > id BIGINT,  
> > created\_at STRING,  
> > source STRING,  
> > favorited BOOLEAN,  
> > retweet\_count INT,  
> > retweeted\_status STRUCT\<  
> > text:STRING,  
> > user:STRUCT\<screen\_name:\_\_STRING,name:STRING\>\>,  
> > entities STRUCT\<  
> > urls:ARRAY\<STRUCT\<expanded\_\_\_url:STRING\>\>,  
> > user\_mentions:ARRAY\<STRUCT\< **screen\_name:STRING,name:**  
> > STRING\>\>,  
> > hashtags:ARRAY\<STRUCTtext:\_\_STRING\>\>,
> > 
> > ```
> > text STRING,
> > user STRUCT<
> > screen_name:STRING,
> > name:STRING,
> > friends_count:INT,
> > followers_count:INT,
> > statuses_count:INT,
> > verified:BOOLEAN,
> > utc_offset:INT,
> > time_zone:STRING>,
> > in_reply_to_screen_name STRING
> > )
> > ROW FORMAT SERDE 'com.cloudera.hive.serde.__JSONSerDe'
> > LOCATION '/flume/Tweets_A';
> > 
> > do I have to add "com.cloudera.hive.serde.__JSONSerDe'" an other
> > 
> > ```
> > 
> > time to put data in elasticsearch ?? if yes,How !!
> > 
> > ```
> > Thank you so very much
> > 
> > 2014-05-21 10:36 GMT+01:00 Costin Leau <costin.leau@gmail.com<mailto:
> > 
> > ```
> > 
> > [costin.leau@gmail.com](mailto:costin.leau@gmail.com)\>  
> > \<[mailto:costin.leau@gmail.com](mailto:costin.leau@gmail.com) [mailto:costin.leau@gmail.com](mailto:costin.leau@gmail.com)\>\_\_\>:
> > 
> > ```
> > The error indicates that your script refers to a JSonSerDe
> > 
> > ```
> > 
> > class (presumably from Cloudera) which cannot be  
> > found in  
> > the classpath:
> > 
> > ```
> > "> Caused by: java.lang. ____ ClassNotFoundException:
> > 
> > ```
> > 
> > com.cloudera.hive.serde.\_\_\_\_JSONSerDe"
> > 
> > ```
> > In fact if you read through the stacktrace, you'll notice
> > 
> > ```
> > 
> > that this comes up while the job configuration  
> > is being read and this class name encountered but the class  
> > definition itself cannot be resolved.
> > 
> > ```
> > I'm not sure what causes this class to be added to the
> > 
> > ```
> > 
> > classpath of your script - it could be your script  
> > or the  
> > client configuration.  
> > Note the class is not used or added by ES-hadoop itself.
> > 
> > ```
> > I'm not sure what distro you are using (es-hadoop works
> > 
> > ```
> > 
> > across Apache Hadoop, Cloudera, HDP, MapR, Pivotal,  
> > etc...)  
> > but you could try running some  
> > basic Hive scripts (without es-hadoop) first to make sure  
> > the environment is sane and that you can properly  
> > read and  
> > write from HDFS and then add  
> > es-hadoop into the mix.
> > 
> > ```
> > Hope this helps,
> > 
> > On 5/21/14 12:15 PM, hanine haninne wrote:
> > 
> > Thank you so much for ur answer
> > here is what it gives me now
> > 
> > INSERT OVERWRITE TABLE tweetsES SELECT * FROM tweets;
> > 
> > Total MapReduce jobs = 1
> > Launching Job 1 out of 1
> > Number of reduce tasks is set to 0 since there's no
> > 
> > ```
> > 
> > reduce operator  
> > Starting Job = job\_201405210900\_0002, Tracking URL =  
> > [http://master:50030/\_\_\_\_jobdetails.jsp?jobid=job\_\_\_\_\_](http://master:50030/ ____jobdetails.jsp?jobid=job_____ )  
> > 201405210900\_0002
> > 
> > ```
> > <http://master:50030/ __jobdetails.jsp?jobid=job___
> > 
> > ```
> > 
> > 201405210900\_0002\>  
> > \<[http://master:50030/\_\_jobdetails.jsp?jobid=job\_\_\_](http://master:50030/ __jobdetails.jsp?jobid=job___ )  
> > 201405210900\_0002  
> > [http://master:50030/jobdetails.jsp?jobid=job\_201405210900\_0002](http://master:50030/jobdetails.jsp?jobid=job_201405210900_0002)\>  
> > Kill Command = /home/hduser/hadoop/libexec/..\_\_\_\_/bin/hadoop  
> > job -kill job\_201405210900\_0002
> > 
> > ```
> > Hadoop job information for Stage-0: number of mappers:
> > 
> > ```
> > 
> > 1; number of reducers: 0  
> > 2014-05-21 10:12:05,285 Stage-0 map = 0%, reduce = 0%  
> > 2014-05-21 10:12:23,408 Stage-0 map = 100%, reduce =  
> > 100%  
> > Ended Job = job\_201405210900\_0002 with errors  
> > Error during job, obtaining debugging information...  
> > Job Tracking URL: [http://master:50030/\_\_\_\_](http://master:50030/ ____ )  
> > jobdetails.jsp?jobid=job\_\_\_\_\_201405210900\_0002  
> > \<[http://master:50030/\_\_jobdetails.jsp?jobid=job\_\_\_](http://master:50030/ __jobdetails.jsp?jobid=job___ )  
> > 201405210900\_0002\>
> > 
> > ```
> > <http://master:50030/ __jobdetails.jsp?jobid=job___
> > 
> > ```
> > 
> > 201405210900\_0002  
> > [http://master:50030/jobdetails.jsp?jobid=job\_201405210900\_0002](http://master:50030/jobdetails.jsp?jobid=job_201405210900_0002)\>  
> > Examining task ID: task\_201405210900\_0002\_m\_\_\_\_\_000002  
> > (and more) from job job\_201405210900\_0002
> > 
> > ```
> > Task with the most failures(4):
> > -----
> > Task ID:
> > task_201405210900_0002_m _____ 000000
> > 
> > URL:
> > http://master:50030/ ____taskdetails.jsp?jobid=job_____
> > 
> > ```
> > 
> > 201405210900\_0002&tipid=task\_\_\_\_\_201405210900\_0002\_m\_000000 \<  
> > [http://master:50030/\_\_taskdetails.jsp?jobid=job\_\_\_](http://master:50030/ __taskdetails.jsp?jobid=job___ )  
> > 201405210900\_0002&tipid=task\_\_\_201405210900\_0002\_m\_000000\>
> > 
> > ```
> > <http://master:50030/ __taskdetails.jsp?jobid=job___
> > 
> > ```
> > 
> > 201405210900\_0002&tipid=task\_\_\_201405210900\_0002\_m\_000000  
> > \<[http://master:50030/taskdetails.jsp?jobid=job\_](http://master:50030/taskdetails.jsp?jobid=job_)  
> > 201405210900\_0002&tipid=task\_201405210900\_0002\_m\_000000\>\>  
> > -----  
> > Diagnostic Messages for this Task:  
> > java.lang.RuntimeException: Error in configuring object  
> > at org.apache.hadoop.util.\_\_\_\_  
> > ReflectionUtils.setJobConf(**ReflectionUtils.java:93)  
> > at org.apache.hadoop.util.**  
> > ReflectionUtils.setConf(**ReflectionUtils.java:64)  
> > at org.apache.hadoop.util.**  
> > ReflectionUtils.newInstance(**ReflectionUtils.java:117)  
> > at org.apache.hadoop.mapred.**  
> > MapTask.runOldMapper(MapTask.**java:426)  
> > at org.apache.hadoop.mapred.**  
> > MapTask.run(MapTask.java:366)  
> > at org.apache.hadoop.mapred.\_\_\_\_  
> > Child$4.run(Child.java:255)
> > 
> > ```
> > at java.security. ____
> > 
> > ```
> > 
> > AccessController.doPrivileged(\__**Native Method)  
> > at javax.security.auth.Subject.**  
> > **doAs(Subject.java:415)  
> > at org.apache.hadoop.security.**_  
> > \_UserGroupInformation.doAs(**UserGroupInformation.java:1190)  
> > at org.apache.hadoop.mapred.  
> > Child.main(Child.java:249)  
> > Caused by: java.lang.reflect.**  
> > InvocationTargetException
> > 
> > ```
> > at sun.reflect. ____NativeMethodAccessorImpl.____ invoke0(Native
> > 
> > ```
> > 
> > Method)  
> > at sun.reflect. **NativeMethodAccessorImpl.**  
> > invoke(\_\_\_\_NativeMethodAccessorImpl.java:\_\_\_\_57)  
> > at  
> > sun.reflect.**DelegatingMethodAccessorImpl.invoke(  
> > DelegatingMethodAccessorImpl.java:43)  
> > at java.lang.reflect.Method.  
> > invoke(Method.java:606)  
> > at org.apache.hadoop.util.**  
> > ReflectionUtils.setJobConf(\_\_\_\_ReflectionUtils.java:88)
> > 
> > ```
> > ... 9 more
> > Caused by: java.lang.RuntimeException: Error in
> > 
> > ```
> > 
> > configuring object  
> > at org.apache.hadoop.util.\_\_\_\_  
> > ReflectionUtils.setJobConf(**ReflectionUtils.java:93)  
> > at org.apache.hadoop.util.**  
> > ReflectionUtils.setConf(**ReflectionUtils.java:64)  
> > at org.apache.hadoop.util.**  
> > ReflectionUtils.newInstance(**ReflectionUtils.java:117)  
> > at org.apache.hadoop.mapred.**  
> > MapRunner.configure(MapRunner.**java:34)  
> > ... 14 more  
> > Caused by: java.lang.reflect.**  
> > InvocationTargetException
> > 
> > ```
> > at sun.reflect. ____NativeMethodAccessorImpl.____ invoke0(Native
> > 
> > ```
> > 
> > Method)  
> > at sun.reflect. **NativeMethodAccessorImpl.**  
> > invoke(\_\_\_\_NativeMethodAccessorImpl.java:\_\_\_\_57)  
> > at  
> > sun.reflect.**DelegatingMethodAccessorImpl.invoke(  
> > DelegatingMethodAccessorImpl.java:43)  
> > at java.lang.reflect.Method.  
> > invoke(Method.java:606)  
> > at org.apache.hadoop.util.**  
> > ReflectionUtils.setJobConf(\_\_\_\_ReflectionUtils.java:88)
> > 
> > ```
> > ... 17 more
> > Caused by: java.lang.RuntimeException: Map operator
> > 
> > ```
> > 
> > initialization failed  
> > at org.apache.hadoop.hive.ql.\_\_\_\_  
> > exec.ExecMapper.configure(\_\_\_\_ExecMapper.java:121)  
> > ... 22 more  
> > Caused by: org.apache.hadoop.hive.ql.\_\_\_\_metadata.HiveException:  
> > java.lang.\_\_\_\_ClassNotFoundException:  
> > com.cloudera.hive.serde.**JSONSerDe  
> > at org.apache.hadoop.hive.ql.**  
> > exec.MapOperator.\_\_\_\_getConvertedOI(MapOperator.**java:463)  
> > at org.apache.hadoop.hive.ql.**  
> > exec.MapOperator.setChildren(**MapOperator.java:479)  
> > at org.apache.hadoop.hive.ql.**  
> > exec.ExecMapper.configure(\_\_\_\_ExecMapper.java:90)  
> > ... 22 more  
> > Caused by: java.lang.\_\_\_\_ClassNotFoundException:  
> > com.cloudera.hive.serde.\_\_\_\_JSONSerDe  
> > at java.net.URLClassLoader$1.run(  
> > \_\_\_\_URLClassLoader.java:366)  
> > at java.net.URLClassLoader$1.run(  
> > **URLClassLoader.java:355)  
> > at java.security.**  
> > AccessController.doPrivileged(**Native Method)  
> > at java.net.URLClassLoader.**  
> > findClass(URLClassLoader.java:**354)  
> > at java.lang.ClassLoader.**  
> > loadClass(ClassLoader.java:**424)  
> > at sun.misc.Launcher$**  
> > AppClassLoader.loadClass(**Launcher.java:308)  
> > at java.lang.ClassLoader.**  
> > loadClass(ClassLoader.java:\_\_\_\_357)  
> > at java.lang.Class.forName0(\_\_\_\_Native Method)  
> > at java.lang.Class.forName(Class.**java:270)  
> > at org.apache.hadoop.conf.**  
> > Configuration.getClassByName(**Configuration.java:810)  
> > at org.apache.hadoop.hive.ql.**  
> > exec.MapOperator.\_\_\_\_getConvertedOI(MapOperator.\_\_\_\_java:422)  
> > ... 24 more
> > 
> > ```
> > FAILED: Execution Error, return code 2 from
> > 
> > ```
> > 
> > org.apache.hadoop.hive.ql.\_\_\_\_exec.MapRedTask
> > 
> > ```
> > MapReduce Jobs Launched:
> > Job 0: Map: 1 HDFS Read: 0 HDFS Write: 0 FAIL
> > Total MapReduce CPU Time Spent: 0 msec
> > 
> > 2014-05-20 14:11 GMT+01:00 Costin Leau <
> > 
> > ```
> > 
> > [costin.leau@gmail.com](mailto:costin.leau@gmail.com) [mailto:costin.leau@gmail.com](mailto:costin.leau@gmail.com)  
> > \<[mailto:costin.leau@gmail.com](mailto:costin.leau@gmail.com) [mailto:costin.leau@gmail.com](mailto:costin.leau@gmail.com)\>  
> > \<[mailto:costin.leau@gmail.com](mailto:costin.leau@gmail.com) \<mailto:  
> > [costin.leau@gmail.com](mailto:costin.leau@gmail.com)\> \<[mailto:costin.leau@gmail.com](mailto:costin.leau@gmail.com)  
> > [mailto:costin.leau@gmail.com](mailto:costin.leau@gmail.com)\> **\>** \>:
> > 
> > ```
> > 1. You don't need to add the hive jars
> > 
> > ```
> > 
> > (hive-serdes) to your script - these are already part of  
> > the runtime  
> > 2. use es-hadoop-2.0.RC1, 1.3 M2 is fairly old  
> > 3. Make sure that the jar is actually available and  
> > that is potentially accessible by Hive. Also  
> > do note that  
> > when running Hive against a cluster, it's best to  
> > have the jars available on all nodes hence why  
> > most folks  
> > copy  
> > them to HDFS and refer to that location.  
> > While /home/hduser might be locally available, it  
> > might not exist on the Hive server - as  
> > indicated by the  
> > error.
> > 
> > ```
> > Hope this helps,
> > 
> > On 5/20/14 3:58 PM, hanine haninne wrote:
> > 
> > Hello everybody
> > 
> > I m trying to take data from Hive and put it in
> > 
> > ```
> > 
> > elasticsearch  
> > here is the script and the error
> > 
> > ```
> > hive> ADD JAR /home/hduser/hadoop/hive-0.11.
> > 
> > ```
> > 
> > \_\_\_\_\_\_0/lib/hive-serdes-1.0-\_\_\_\_\_\_SNAPSHOT.jar;  
> > Added /home/hduser/hadoop/hive-0.11.  
> > \_\_\_\_\_\_0/lib/hive-serdes-1.0-\_\_\_\_\_\_SNAPSHOT.jar to class path  
> > Added resource: /home/hduser/hadoop/hive-0.11.  
> > \_\_\_\_\_\_0/lib/hive-serdes-1.0-\_\_\_\_\_\_SNAPSHOT.jar
> > 
> > ```
> > hive> CREATE EXTERNAL TABLE tweetsES (
> > > id BIGINT,
> > > created_at STRING,
> > > source STRING,
> > > favorited BOOLEAN,
> > > retweet_count INT,
> > > retweeted_status STRUCT<
> > > text:STRING,
> > > user:STRUCT<screen_name: ______
> > 
> > ```
> > 
> > STRING,name:STRING\>\>,  
> > \> entities STRUCT\<  
> > \> urls:ARRAY\<STRUCT\<expanded\_\_\_\_  
> > _**url:STRING\>\>,  
> > \> user\_mentions:ARRAY\<STRUCT\<**_  
> > \_\_\_screen\_name:STRING,name:\_\_\__**STRING\>\>,  
> > \> hashtags:ARRAY\<STRUCT\<text:**_  
> > \_\_\_STRING\>\>\>,
> > 
> > ```
> > > text STRING,
> > > user STRUCT<
> > > screen_name:STRING,
> > > name:STRING,
> > > friends_count:INT,
> > > followers_count:INT,
> > > statuses_count:INT,
> > > verified:BOOLEAN,
> > > utc_offset:INT,
> > > time_zone:STRING>,
> > > in_reply_to_screen_name STRING
> > > )
> > > STORED BY 'org.elasticsearch.hadoop. ____
> > 
> > ```
> > 
> > \_\_hive.EsStorageHandler'  
> > \> TBLPROPERTIES('es.resource' =  
> > 'reseaux\_sociaux/tweets','es.\_\_\_\_\_\_input.json' = 'yes');
> > 
> > ```
> > OK
> > Time taken: 4.292 seconds
> > hive> ADD JAR /home/hduser/hadoop/ ______
> > 
> > ```
> > 
> > elasticsearch-hadoop-1.3.0.M2.**jar;  
> > Added /home/hduser/hadoop/**  
> > elasticsearch-hadoop-1.3.0.M2.**jar to class path  
> > Added resource: /home/hduser/hadoop/**  
> > elasticsearch-hadoop-1.3.0.M2.\_\_\_\_\_\_jar
> > 
> > ```
> > hive> INSERT OVERWRITE TABLE tweetsES SELECT *
> > 
> > ```
> > 
> > FROM tweets;  
> > Total MapReduce jobs = 1  
> > Launching Job 1 out of 1  
> > Number of reduce tasks is set to 0 since  
> > there's no reduce operator  
> > java.io.FileNotFoundException: File does not  
> > exist:  
> > /home/hduser/hadoop/\_\_\_\_\_\_elasticsearch-hadoop-1.3.0.M2.  
> > \_\_\_\_\_\_jar  
> > at
> > 
> > ```
> > org.apache.hadoop.hdfs. ______DistributedFileSystem.______
> > 
> > ```
> > 
> > getFileStatus(\_\_\_\_\_\_DistributedFileSystem.java:\_\_\_\_\_\_558)  
> > at  
> > org.apache.hadoop.filecache. **DistributedCache.**  
> > getFileStatus(\_\_\_\_\_\_DistributedCache.java:185)  
> > at
> > 
> > ```
> > org.apache.hadoop.filecache. ________
> > 
> > ```
> > 
> > TrackerDistributedCacheManager\_\_\_\_\_\_.getFileStatus(\_\_\_\_\_\_  
> > TrackerDistributedCacheManager\_\_\_\_\_\_.java:723)  
> > at
> > 
> > ```
> > org.apache.hadoop.filecache. ________
> > 
> > ```
> > 
> > TrackerDistributedCacheManager\_\_\_\_\_\_.determineTimestamps(\_\_\_\_\_\_  
> > TrackerDistributedCacheManager\_\_\_\_\_\_.java:778)  
> > at
> > 
> > ```
> > org.apache.hadoop.filecache. ________
> > 
> > ```
> > 
> > TrackerDistributedCacheManager\_\_\_\_\_\_.\_\_\_\_\_\_determineTimestampsAndCacheVis  
> > \_\_\_\_\_\_ibilities( **TrackerDistributedCacheManager**.java:755)  
> > at  
> > org.apache.hadoop.mapred. **JobClient.**  
> > copyAndConfigureFiles(\_\_\_\_\_\_JobClient.java:843)  
> > at  
> > org.apache.hadoop.mapred. **JobClient.**  
> > copyAndConfigureFiles(\__**JobClient.java:734)  
> > at org.apache.hadoop.mapred.**_  
> > \_JobClient.access$400(\__**JobClient.java:179)  
> > at org.apache.hadoop.mapred.**_  
> > \_JobClient$2.run(JobClient.\__**java:951)  
> > at org.apache.hadoop.mapred.**_  
> > \_JobClient$2.run(JobClient.**java:936)  
> > at java.security.**  
> > AccessController.doPrivileged(\_\_\_\_**Native Method)  
> > at javax.security.auth.Subject.**  
> > \_\_\_\_doAs(Subject.java:415)  
> > at  
> > org.apache.hadoop.security.\_\_\_\_\__UserGroupInformation.doAs(_  
> > \_\_\_\_\_UserGroupInformation.java:\__**1190)  
> > at org.apache.hadoop.mapred.**_  
> > \_JobClient.submitJobInternal(\__**JobClient.java:936)  
> > at org.apache.hadoop.mapred.**_  
> > \_JobClient.submitJob(JobClient.\_\_**java:910)  
> > at org.apache.hadoop.hive.ql.**  
> > \_\_exec.ExecDriver.execute(\_\_**ExecDriver.java:447)  
> > at org.apache.hadoop.hive.ql.**  
> > \_\_exec.MapRedTask.execute(\_\_**MapRedTask.java:138)  
> > at org.apache.hadoop.hive.ql.**  
> > \_\_exec.Task.executeTask(Task.\_\_**java:144)  
> > at org.apache.hadoop.hive.ql.**  
> > \_\_exec.TaskRunner.runSequential(\_\_**TaskRunner.java:57)  
> > at org.apache.hadoop.hive.ql.**  
> > \_\_Driver.launchTask(Driver.java:\_\_**1355)  
> > at org.apache.hadoop.hive.ql.**  
> > \_\_Driver.execute(Driver.java:\__**1139)  
> > at org.apache.hadoop.hive.ql.**  
> > **Driver.run(Driver.java:945)  
> > at org.apache.hadoop.hive.cli.**_  
> > \_\_\_CliDriver.processLocalCmd(\_\_\__**CliDriver.java:259)  
> > at org.apache.hadoop.hive.cli.**_  
> > \_\_\_CliDriver.processCmd(\_\_\__**CliDriver.java:216)  
> > at org.apache.hadoop.hive.cli.**_  
> > \_\_\_CliDriver.processLine(\_\_\__**CliDriver.java:413)  
> > at org.apache.hadoop.hive.cli.**_  
> > \_\_\_CliDriver.run(CliDriver.java:\_\_\__**756)  
> > at org.apache.hadoop.hive.cli.**_  
> > \_\_\_CliDriver.main(CliDriver.**java:614)  
> > at sun.reflect.**  
> > NativeMethodAccessorImpl.\_\_\_\_\_\_invoke0(Native Method)  
> > at  
> > sun.reflect.\_\_\_\_\_\_NativeMethodAccessorImpl.**invoke(**  
> > NativeMethodAccessorImpl.java:\_\_\_\_\_\_57)  
> > at
> > 
> > ```
> > sun.reflect. ______ DelegatingMethodAccessorImpl._
> > 
> > ```
> > 
> > \_\_\_\_\_invoke(\_\_\_\_\_\_DelegatingMethodAccessorImpl.\__**java:43)  
> > at java.lang.reflect.Method.**_  
> > \_invoke(Method.java:606)  
> > at org.apache.hadoop.util.RunJar.  
> > \_\_\_\_\_\_main(RunJar.java:160)
> > 
> > ```
> > Job Submission failed with exception 'java.io <
> > 
> > ```
> > 
> > [http://java.io](http://java.io)\> [http://java.io](http://java.io)  
> > [http://java.io](http://java.io).**FileNotFoundException(File does  
> > not exist:  
> > /home/hduser/hadoop/**  
> > elasticsearch-hadoop-1.3.0.M2.\_\_\_\_\_\_jar)'  
> > FAILED: Execution Error, return code 1 from  
> > org.apache.hadoop.hive.ql.\_\_\_\_\_\_exec.MapRedTask
> > 
> > ```
> > That path it exist :/home/hduser/hadoop/ ______
> > 
> > ```
> > 
> > elasticsearch-hadoop-1.3.0.M2.\_\_\_\_\_\_jar
> > 
> > ```
> > Any help would be so appreciable
> > Thanks
> > 
> > --
> > You received this message because you are
> > 
> > ```
> > 
> > subscribed to the Google Groups "elasticsearch" group.  
> > To unsubscribe from this group and stop  
> > receiving emails from it, send an email to  
> > elasticsearch+unsubscribe@\__go  
> > \_\_\_\_oglegroups.com [http://go\_\_oglegroups.com](http://go__oglegroups.com)  
> > [http://googlegroups.com](http://googlegroups.com)  
> > \<mailto:elasticsearch%**[2Bunsubscribe@googlegroups.com](mailto:2Bunsubscribe@googlegroups.com)  
> > [mailto:elasticsearch%25\_\_2Bunsubscribe@googlegroups.com](mailto:elasticsearch%25__2Bunsubscribe@googlegroups.com)  
> > \<mailto:elasticsearch%252Bunsubscribe@googlegroups.com  
> > [mailto:elasticsearch%25252Bunsubscribe@googlegroups.com](mailto:elasticsearch%25252Bunsubscribe@googlegroups.com)\>\>  
> > \<mailto:elasticsearch+**  
> > [unsubscribe@googlegroups.com](mailto:unsubscribe@googlegroups.com)  
> > [mailto:elasticsearch%2B\_\_\_\_unsubscribe@googlegroups.com](mailto:elasticsearch%2B ____ unsubscribe@googlegroups.com)  
> > \<mailto:elasticsearch%2B\_\_\_\_unsubscribe@googlegroups.com  
> > [mailto:elasticsearch%252B\_\_unsubscribe@googlegroups.com](mailto:elasticsearch%252B__unsubscribe@googlegroups.com)\>  
> > \<mailto:elasticsearch%\_\_\_\_2Bunsubscribe@googlegroups.com \<mailto:  
> > elasticsearch%25\_\_2Bunsubscribe@googlegroups.com\>  
> > \<mailto:elasticsearch%252Bunsubscribe@googlegroups.  
> > \_com  
> > [mailto:elasticsearch%25252Bunsubscribe@googlegroups.com](mailto:elasticsearch%25252Bunsubscribe@googlegroups.com)\>_\>\>.
> > 
> > ```
> > To view this discussion on the web visit
> > https://groups.google.com/d/ ______msgid/elasticsearch/__
> > 
> > ```
> > 
> > d1613b48-\_\_\_\_e58d-4077-a579-\_\_92b46a97bcff%\_\_\_\_\_\_40googlegroups.com  
> > \<[https://groups.google.com/d/\_\_\_\_msgid/elasticsearch/](https://groups.google.com/d/ ____ msgid/elasticsearch/)  
> > d1613b48-\_\_\_\_e58d-4077-a579-92b46a97bcff%\_\_\_\_40googlegroups.com\>
> > 
> > ```
> > <https://groups.google.com/d/ ____ msgid/elasticsearch/
> > 
> > ```
> > 
> > d1613b48-\_\_\_\_e58d-4077-a579-92b46a97bcff%\_\_\_\_40googlegroups.com  
> > \<[https://groups.google.com/d/\_\_msgid/elasticsearch/d1613b48-](https://groups.google.com/d/__msgid/elasticsearch/d1613b48-)  
> > \_\_e58d-4077-a579-92b46a97bcff%\_\_40googlegroups.com\>\>
> > 
> > ```
> > <https://groups.google.com/d/ ____ msgid/elasticsearch/
> > 
> > ```
> > 
> > d1613b48-\_\_\_\_e58d-4077-a579-92b46a97bcff%\_\_\_\_40googlegroups.com  
> > \<[https://groups.google.com/d/\_\_msgid/elasticsearch/d1613b48-](https://groups.google.com/d/__msgid/elasticsearch/d1613b48-)  
> > \_\_e58d-4077-a579-92b46a97bcff%\_\_40googlegroups.com\>
> > 
> > ```
> > <https://groups.google.com/d/__msgid/elasticsearch/d1613b48-
> > 
> > ```
> > 
> > \_\_e58d-4077-a579-92b46a97bcff%\_\_40googlegroups.com  
> > \<[https://groups.google.com/d/msgid/elasticsearch/d1613b48-](https://groups.google.com/d/msgid/elasticsearch/d1613b48-)  
> > e58d-4077-a579-92b46a97bcff%[40googlegroups.com](http://40googlegroups.com)\>\>\>
> > 
> > ```
> > <https://groups.google.com/d/ ______msgid/elasticsearch/__
> > 
> > ```
> > 
> > d1613b48- **e58d-4077-a579-92b46a97bcff%**  
> > [40googlegroups.com?utm\_\_\_\_\_medium=\_\_email&utm\_source=\_\_\_\_footer](http://40googlegroups.com?utm _____medium=__ email&utm_source= ____ footer)  
> > \<[https://groups.google.com/d/\_\_\_\_msgid/elasticsearch/](https://groups.google.com/d/ ____ msgid/elasticsearch/)  
> > d1613b48-\_\_\_\_e58d-4077-a579-92b46a97bcff%\__**[40googlegroups.com?utm](http://40googlegroups.com?utm)**_  
> > medium=\_\_email&utm\_source=\_\_footer\>
> > 
> > ```
> > <https://groups.google.com/d/ ____ msgid/elasticsearch/
> > 
> > ```
> > 
> > d1613b48-\_\_\_\_e58d-4077-a579-92b46a97bcff%\__**[40googlegroups.com?utm](http://40googlegroups.com?utm)**_  
> > medium=\_\_email&utm\_source=\_\_footer  
> > \<[https://groups.google.com/d/\_\_msgid/elasticsearch/d1613b48-](https://groups.google.com/d/__msgid/elasticsearch/d1613b48-)  
> > \_\_e58d-4077-a579-92b46a97bcff%\__[40googlegroups.com?utm](http://40googlegroups.com?utm)_  
> > medium=\_\_email&utm\_source=footer\>\>
> > 
> > ```
> > <https://groups.google.com/d/ ____ msgid/elasticsearch/
> > 
> > ```
> > 
> > d1613b48-\_\_\_\_e58d-4077-a579-92b46a97bcff%\__**[40googlegroups.com?utm](http://40googlegroups.com?utm)**_  
> > medium=\_\_email&utm\_source=\_\_footer  
> > \<[https://groups.google.com/d/\_\_msgid/elasticsearch/d1613b48-](https://groups.google.com/d/__msgid/elasticsearch/d1613b48-)  
> > \_\_e58d-4077-a579-92b46a97bcff%\__[40googlegroups.com?utm](http://40googlegroups.com?utm)_  
> > medium=\_\_email&utm\_source=footer\>
> > 
> > ```
> > <https://groups.google.com/d/__msgid/elasticsearch/d1613b48-
> > 
> > ```
> > 
> > \_\_e58d-4077-a579-92b46a97bcff%\__[40googlegroups.com?utm](http://40googlegroups.com?utm)_  
> > medium=\_\_email&utm\_source=footer  
> > \<[https://groups.google.com/d/msgid/elasticsearch/d1613b48-](https://groups.google.com/d/msgid/elasticsearch/d1613b48-)  
> > e58d-4077-a579-92b46a97bcff%[40googlegroups.com?utm\_medium=](http://40googlegroups.com?utm_medium=)  
> > email&utm\_source=footer\>\>\>\>.
> > 
> > ```
> > For more options, visit
> > 
> > ```
> > 
> > [https://groups.google.com/d/\_\_\_\_\_\_optout](https://groups.google.com/d/ ______ optout)  
> > [https://groups.google.com/d/\_\_\_\_optout](https://groups.google.com/d/ ____ optout) \<  
> > [https://groups.google.com/d/\_\_\_\_optout](https://groups.google.com/d/ ____ optout)
> > 
> > ```
> > <https://groups.google.com/d/__optout>>
> > 
> > <https://groups.google.com/d/ ____ optout <
> > 
> > ```
> > 
> > [https://groups.google.com/d/\_\_optout](https://groups.google.com/d/__optout)\>  
> > \<[https://groups.google.com/d/\_\_optout](https://groups.google.com/d/__optout) \<  
> > [https://groups.google.com/d/optout](https://groups.google.com/d/optout)\>\>\>.
> > 
> > ```
> > --
> > Costin
> > 
> > --
> > You received this message because you are
> > 
> > ```
> > 
> > subscribed to the Google Groups "elasticsearch" group.  
> > To unsubscribe from this group and stop receiving  
> > emails from it, send an email to  
> > elasticsearch+unsubscribe@\_\_go\_\_\_\_oglegroups.com \<  
> > http://go\_\_oglegroups.com\> [http://googlegroups.com](http://googlegroups.com)  
> > \<mailto:elasticsearch%\_\_\_\_2Bunsubscribe@googlegroups.com  
> > [mailto:elasticsearch%25\_\_2Bunsubscribe@googlegroups.com](mailto:elasticsearch%25__2Bunsubscribe@googlegroups.com)  
> > \<mailto:elasticsearch%\_\_252Bunsubscribe@googlegroups.**com  
> > [mailto:elasticsearch%25252Bunsubscribe@googlegroups.com](mailto:elasticsearch%25252Bunsubscribe@googlegroups.com)\>**\>.
> > 
> > ```
> > To view this discussion on the web visit
> > https://groups.google.com/d/ ______msgid/elasticsearch/__
> > 
> > ```
> > 
> > 537B549F.\_\_\_\_8020501%40gmail.\_\_com  
> > \<[https://groups.google.com/d/\_\_\_\_msgid/elasticsearch/](https://groups.google.com/d/ ____ msgid/elasticsearch/)  
> > 537B549F.\_\_\_\_8020501%[40gmail.com](http://40gmail.com)\>
> > 
> > ```
> > <https://groups.google.com/d/ ____ msgid/elasticsearch/
> > 
> > ```
> > 
> > 537B549F.\_\_\_\_8020501%[40gmail.com](http://40gmail.com)  
> > \<[https://groups.google.com/d/\_\_msgid/elasticsearch/537B549F](https://groups.google.com/d/__msgid/elasticsearch/537B549F).  
> > \_\_8020501%[40gmail.com](http://40gmail.com)\>\>
> > 
> > ```
> > <https://groups.google.com/d/_
> > 
> > ```
> > 
> > \_\_\_msgid/elasticsearch/537B549F.\_\_\_\_8020501%[40gmail.com](http://40gmail.com)  
> > \<[https://groups.google.com/d/\_\_msgid/elasticsearch/537B549F](https://groups.google.com/d/__msgid/elasticsearch/537B549F).  
> > \_\_8020501%[40gmail.com](http://40gmail.com)\>  
> > \<[https://groups.google.com/d/\_](https://groups.google.com/d/_)  
> > \_msgid/elasticsearch/537B549F.\_\_8020501%[40gmail.com](http://40gmail.com)  
> > \<[https://groups.google.com/d/msgid/elasticsearch/537B549F](https://groups.google.com/d/msgid/elasticsearch/537B549F).  
> > 8020501%[40gmail.com](http://40gmail.com)\>\>\>.
> > 
> > ```
> > For more options, visit
> > 
> > ```
> > 
> > [https://groups.google.com/d/\_\_\_\_\_\_optout](https://groups.google.com/d/ ______ optout)  
> > [https://groups.google.com/d/\_\_\_\_optout](https://groups.google.com/d/ ____ optout) \<  
> > [https://groups.google.com/d/\_\_\_\_optout](https://groups.google.com/d/ ____ optout)  
> > [https://groups.google.com/d/\_\_optout](https://groups.google.com/d/__optout)\>
> > 
> > ```
> > <https://groups.google.com/d/ ____ optout <
> > 
> > ```
> > 
> > [https://groups.google.com/d/\_\_optout](https://groups.google.com/d/__optout)\>  
> > \<[https://groups.google.com/d/\_\_optout](https://groups.google.com/d/__optout) \<  
> > [https://groups.google.com/d/optout](https://groups.google.com/d/optout)\>\>\>.
> > 
> > ```
> > --
> > You received this message because you are subscribed to
> > 
> > ```
> > 
> > the Google Groups "elasticsearch" group.  
> > To unsubscribe from this group and stop receiving emails  
> > from it, send an email to  
> > elasticsearch+unsubscribe@\_\_go\_\_oglegroups.com \<  
> > [http://googlegroups.com](http://googlegroups.com)\>  
> > \<mailto:elasticsearch%**[2Bunsubscribe@googlegroups.com](mailto:2Bunsubscribe@googlegroups.com) \<mailto:  
> > elasticsearch%252Bunsubscribe@googlegroups.com\>**\>  
> > \<[mailto:elasticsearch+\_\_\_\_unsubscribe@googlegroups.com](mailto:elasticsearch+ ____ unsubscribe@googlegroups.com)  
> > [mailto:elasticsearch%2B\_\_unsubscribe@googlegroups.com](mailto:elasticsearch%2B__unsubscribe@googlegroups.com) \<mailto:  
> > elasticsearch%**[2Bunsubscribe@googlegroups.com](mailto:2Bunsubscribe@googlegroups.com)  
> > [mailto:elasticsearch%252Bunsubscribe@googlegroups.com](mailto:elasticsearch%252Bunsubscribe@googlegroups.com)**\>\>.  
> > To view this discussion on the web visit  
> > [https://groups.google.com/d/\_\_\_\_msgid/elasticsearch/](https://groups.google.com/d/ ____ msgid/elasticsearch/)  
> > CANXJSR9- **xpGoJR4gvPW%3DKKP%3DVr\_\_\_\_\_5MxyDoUJKtbpqM6CsYs1G4Q%**  
> > [40mail.gmail.com](http://40mail.gmail.com)  
> > \<[https://groups.google.com/d/\_\_msgid/elasticsearch/CANXJSR9-](https://groups.google.com/d/__msgid/elasticsearch/CANXJSR9-)  
> > \_\_xpGoJR4gvPW%3DKKP%3DVr\_\_\_5MxyDoUJKtbpqM6CsYs1G4Q%\_\_40mail.gmail.com\>
> > 
> > ```
> > <https://groups.google.com/d/__msgid/elasticsearch/CANXJSR9-
> > 
> > ```
> > 
> > \_\_xpGoJR4gvPW%3DKKP%3DVr\_\_\_5MxyDoUJKtbpqM6CsYs1G4Q%\_\_40mail.gmail.com  
> > \<[https://groups.google.com/d/msgid/elasticsearch/CANXJSR9-](https://groups.google.com/d/msgid/elasticsearch/CANXJSR9-)  
> > xpGoJR4gvPW%3DKKP%3DVr\_5MxyDoUJKtbpqM6CsYs1G4Q%[40mail.gmail.com](http://40mail.gmail.com)\>\>
> > 
> > ```
> > <https://groups.google.com/d/ ____ msgid/elasticsearch/
> > 
> > ```
> > 
> > CANXJSR9- **xpGoJR4gvPW%3DKKP%3DVr\_\_\_\_\_5MxyDoUJKtbpqM6CsYs1G4Q%**  
> > [40mail.gmail.com?utm\_medium=\_\_\_\_email&utm\_source=footer](http://40mail.gmail.com?utm_medium= ____ email&utm_source=footer)  
> > \<[https://groups.google.com/d/\_\_msgid/elasticsearch/CANXJSR9-](https://groups.google.com/d/__msgid/elasticsearch/CANXJSR9-)  
> > **xpGoJR4gvPW%3DKKP%3DVr\_\_\_5MxyDoUJKtbpqM6CsYs1G4Q%**  
> > [40mail.gmail.com?utm\_medium=\_\_email&utm\_source=footer](http://40mail.gmail.com?utm_medium=__email&utm_source=footer)\>
> > 
> > ```
> > <https://groups.google.com/d/__msgid/elasticsearch/CANXJSR9-
> > 
> > ```
> > 
> > **xpGoJR4gvPW%3DKKP%3DVr\_\_\_5MxyDoUJKtbpqM6CsYs1G4Q%**  
> > [40mail.gmail.com?utm\_medium=\_\_email&utm\_source=footer](http://40mail.gmail.com?utm_medium=__email&utm_source=footer)  
> > \<[https://groups.google.com/d/msgid/elasticsearch/CANXJSR9-](https://groups.google.com/d/msgid/elasticsearch/CANXJSR9-)  
> > xpGoJR4gvPW%3DKKP%3DVr\_5MxyDoUJKtbpqM6CsYs1G4Q%  
> > [40mail.gmail.com?utm\_medium=email&utm\_source=footer](http://40mail.gmail.com?utm_medium=email&utm_source=footer)\>\>\>.
> > 
> > ```
> > For more options, visit https://groups.google.com/d/__
> > 
> > ```
> > 
> > \_\_optout [https://groups.google.com/d/\_\_optout](https://groups.google.com/d/__optout)  
> > \<[https://groups.google.com/d/\_\_optout](https://groups.google.com/d/__optout) \<  
> > [https://groups.google.com/d/optout](https://groups.google.com/d/optout)\>\>.
> > 
> > ```
> > --
> > Costin
> > 
> > --
> > You received this message because you are subscribed to the
> > 
> > ```
> > 
> > Google Groups "elasticsearch" group.  
> > To unsubscribe from this group and stop receiving emails  
> > from it, send an email to  
> > elasticsearch+unsubscribe@\_\_go\_\_oglegroups.com \<  
> > [http://googlegroups.com](http://googlegroups.com)\>  
> > \<mailto:elasticsearch%**[2Bunsubscribe@googlegroups.com](mailto:2Bunsubscribe@googlegroups.com) \<mailto:  
> > elasticsearch%252Bunsubscribe@googlegroups.com\>**\>.  
> > To view this discussion on the web visit  
> > [https://groups.google.com/d/\_\_\_\_msgid/elasticsearch/](https://groups.google.com/d/ ____ msgid/elasticsearch/)  
> > 537C738E.\_\_\_\_9030001%[40gmail.com](http://40gmail.com)  
> > \<[https://groups.google.com/d/\_\_msgid/elasticsearch/537C738E](https://groups.google.com/d/__msgid/elasticsearch/537C738E).  
> > \_\_9030001%[40gmail.com](http://40gmail.com)\>
> > 
> > ```
> > <https://groups.google.com/d/__msgid/elasticsearch/537C738E.
> > 
> > ```
> > 
> > \_\_9030001%[40gmail.com](http://40gmail.com)  
> > \<[https://groups.google.com/d/msgid/elasticsearch/537C738E](https://groups.google.com/d/msgid/elasticsearch/537C738E).  
> > 9030001%[40gmail.com](http://40gmail.com)\>\>.
> > 
> > ```
> > For more options, visit https://groups.google.com/d/__
> > 
> > ```
> > 
> > \_\_optout [https://groups.google.com/d/\_\_optout](https://groups.google.com/d/__optout)  
> > \<[https://groups.google.com/d/\_\_optout](https://groups.google.com/d/__optout) \<  
> > [https://groups.google.com/d/optout](https://groups.google.com/d/optout)\>\>.
> > 
> > ```
> > --
> > You received this message because you are subscribed to the
> > 
> > ```
> > 
> > Google Groups "elasticsearch" group.  
> > To unsubscribe from this group and stop receiving emails from it,  
> > send an email to  
> > elasticsearch+unsubscribe@\_\_googlegroups.com \<mailto:  
> > elasticsearch%2Bunsubscribe@googlegroups.com\>  
> > \<[mailto:elasticsearch+\_\_unsubscribe@googlegroups.com](mailto:elasticsearch+__unsubscribe@googlegroups.com) \<mailto:  
> > elasticsearch%2Bunsubscribe@googlegroups.com\>\>.  
> > To view this discussion on the web visit  
> > [https://groups.google.com/d/\_\_msgid/elasticsearch/\_\_](https://groups.google.com/d/ __msgid/elasticsearch/__ )  
> > CANXJSR8Gy4qhM8Lzm5BHCr2-\_\_xptLKBSdm00nCrz-JtnW59jWcw%\_\_40mail.gmail.com  
> > \<[https://groups.google.com/d/msgid/elasticsearch/](https://groups.google.com/d/msgid/elasticsearch/)  
> > CANXJSR8Gy4qhM8Lzm5BHCr2-xptLKBSdm00nCrz-JtnW59jWcw%[40mail.gmail.com](http://40mail.gmail.com)\>  
> > \<[https://groups.google.com/d/\_\_msgid/elasticsearch/\_\_](https://groups.google.com/d/ __msgid/elasticsearch/__ )  
> > CANXJSR8Gy4qhM8Lzm5BHCr2- **xptLKBSdm00nCrz-JtnW59jWcw%**  
> > [40mail.gmail.com?utm\_medium=\_\_email&utm\_source=footer](http://40mail.gmail.com?utm_medium=__email&utm_source=footer)  
> > \<[https://groups.google.com/d/msgid/elasticsearch/](https://groups.google.com/d/msgid/elasticsearch/)  
> > CANXJSR8Gy4qhM8Lzm5BHCr2-xptLKBSdm00nCrz-JtnW59jWcw%  
> > [40mail.gmail.com?utm\_medium=email&utm\_source=footer](http://40mail.gmail.com?utm_medium=email&utm_source=footer)\>\>.
> > 
> > ```
> > For more options, visit https://groups.google.com/d/__optout <
> > 
> > ```
> > 
> > [https://groups.google.com/d/optout](https://groups.google.com/d/optout)\>.
> > 
> > ```
> > --
> > Costin
> > 
> > --
> > You received this message because you are subscribed to the Google
> > 
> > ```
> > 
> > Groups "elasticsearch" group.  
> > To unsubscribe from this group and stop receiving emails from it,  
> > send an email to  
> > elasticsearch+unsubscribe@\_\_googlegroups.com \<mailto:elasticsearch%  
> > [2Bunsubscribe@googlegroups.com](mailto:2Bunsubscribe@googlegroups.com)\>.  
> > To view this discussion on the web visit  
> > [https://groups.google.com/d/\_\_msgid/elasticsearch/537C8751.\_](https://groups.google.com/d/__msgid/elasticsearch/537C8751._)  
> > \_1030908%[40gmail.com](http://40gmail.com)  
> > \<[https://groups.google.com/d/msgid/elasticsearch/537C8751](https://groups.google.com/d/msgid/elasticsearch/537C8751).  
> > 1030908%[40gmail.com](http://40gmail.com)\>.
> > 
> > ```
> > For more options, visit https://groups.google.com/d/__optout <
> > 
> > ```
> > 
> > [https://groups.google.com/d/optout](https://groups.google.com/d/optout)\>.
> > 
> > --  
> > You received this message because you are subscribed to the Google Groups  
> > "elasticsearch" group.  
> > To unsubscribe from this group and stop receiving emails from it, send an  
> > email to  
> > [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com) \<mailto:elasticsearch+  
> > [unsubscribe@googlegroups.com](mailto:unsubscribe@googlegroups.com)\>.  
> > To view this discussion on the web visit  
> > [https://groups.google.com/d/msgid/elasticsearch/CANXJSR\_](https://groups.google.com/d/msgid/elasticsearch/CANXJSR_)  
> > pj6i55jwA3wYiGgh1d\_q86DpcNRKLZzhk-V97vWFLaQ%[40mail.gmail.com](http://40mail.gmail.com)  
> > \<[https://groups.google.com/d/msgid/elasticsearch/CANXJSR\_](https://groups.google.com/d/msgid/elasticsearch/CANXJSR_)  
> > pj6i55jwA3wYiGgh1d\_q86DpcNRKLZzhk-V97vWFLaQ%[40mail.gmail.com?utm\_medium=](http://40mail.gmail.com?utm_medium=)  
> > email&utm\_source=footer\>.
> > 
> > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).
> 
> --  
> Costin
> 
> --  
> You received this message because you are subscribed to the Google Groups  
> "elasticsearch" group.  
> To unsubscribe from this group and stop receiving emails from it, send an  
> email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> To view this discussion on the web visit [https://groups.google.com/d/](https://groups.google.com/d/)  
> msgid/elasticsearch/537E0B0B.3070307%[40gmail.com](http://40gmail.com).
> 
> For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CANXJSR9VEYNegZ%3D7AHdz%2Bhm6wBSPe7D5yZPQRd6XwB%3DqWZwqxg%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CANXJSR9VEYNegZ%3D7AHdz%2Bhm6wBSPe7D5yZPQRd6XwB%3DqWZwqxg%40mail.gmail.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![hanine](https://avatars.discourse-cdn.com/v4/letter/h/b4bc9f/32.png) [@hanine](https://discuss.elastic.co/u/hanine)\
**Post date:** [May 27, 2014, 9:04pm UTC](https://discuss.elastic.co/t/hadoop-elasticsearch-and-hive/17622/10 "2014-05-27T21:04:35Z")

</div>

by the way I wanna put data here "es.resource' = 'reseaux\_sociaux/tweets'"  
and I did not create it,shoud I create it first or what ?!!

2014-05-27 21:53 GMT+01:00 hanine haninne [haninne.5@gmail.com](mailto:haninne.5@gmail.com):

> Hello,  
> I m sorry,but it did not work yet. I thinking I m missing something,Here  
> is what I did from the beginning ( from getting tweets with flume )
> 
> 1-script flume (Tweets.conf)  
> 2-store data in HDFS as indicated in the script  
> 3-then I create a table with hive and get data there (in order to have the  
> possibility to communicate with elasticsearch after) the scripte hive is in  
> hive\_tweets  
> now I wanna put that data in elasticsearch(head) in order to show it in an  
> ergonomic interface (like image1 )  
> so that I tried this script (hiveES)  
> when I execute it, it gives me :
> 
> ```
> > STORED BY 'org.elasticsearch.hadoop.hive.EsStorageHandler'
> > TBLPROPERTIES('es.resource' =
> 
> ```
> 
> 'reseaux\_sociaux/tweets','es.input.json' = 'yes');  
> OK  
> Time taken: 0.133 seconds
> 
> hive\> INSERT OVERWRITE TABLE tweetsES SELECT \* FROM tweets;  
> Total MapReduce jobs = 1  
> Launching Job 1 out of 1  
> Number of reduce tasks is set to 0 since there's no reduce operator  
> Starting Job = job\_201405272117\_0002, Tracking URL =  
> [http://master:50030/jobdetails.jsp?jobid=job\_201405272117\_0002](http://master:50030/jobdetails.jsp?jobid=job_201405272117_0002)  
> Kill Command = /home/hduser/hadoop/libexec/../bin/hadoop job -kill  
> job\_201405272117\_0002
> 
> Hadoop job information for Stage-0: number of mappers: 1; number of  
> reducers: 0  
> 2014-05-27 21:51:14,893 Stage-0 map = 0%, reduce = 0%  
> 2014-05-27 21:51:35,019 Stage-0 map = 100%, reduce = 100%  
> Ended Job = job\_201405272117\_0002 with errors
> 
> Error during job, obtaining debugging information...  
> Job Tracking URL:  
> [http://master:50030/jobdetails.jsp?jobid=job\_201405272117\_0002](http://master:50030/jobdetails.jsp?jobid=job_201405272117_0002)  
> Examining task ID: task\_201405272117\_0002\_m\_000002 (and more) from job  
> job\_201405272117\_0002
> 
> ## Task with the most failures(4):
> 
> Task ID:  
> task\_201405272117\_0002\_m\_000000
> 
> URL:
> 
> [http://master:50030/taskdetails.jsp?jobid=job\_201405272117\_0002&tipid=task\_201405272117\_0002\_m\_000000](http://master:50030/taskdetails.jsp?jobid=job_201405272117_0002&tipid=task_201405272117_0002_m_000000)
> 
> * * *
> 
> Diagnostic Messages for this Task:  
> java.lang.RuntimeException:  
> org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while  
> processing row {"id":467649114269028352,"created\_at":"Sat May 17 12:53:32  
> +0000 2014","source":"\<a href="[http://www.apple.com](http://www.apple.com)"  
> rel="nofollow"\>iOS","favorited":false,"retweet\_count":0,"retweeted\_status":null,"entities":{"urls":[{"expanded\_url":"  
> [https://www.google.co.uk/search?q=viera+lifting+fa+cup+for+arsenal&client=safari&hl=en-gb&source=lnms&tbm=isch&sa=X&ei=alp3U4LrK82UOufRgaAK&ved=0CAYQ\_AUoAQ&biw=320&bih=460#facrc=\_&imgrc=-QK5IhwQT8AS8M%253A%3B2yfUWG7-cngS-M%3Bhttp%253A%252F%252Ffarm4.static.flickr.com%252F3777%252F10838930556\_618b87d7cc\_m.jpg%3Bhttp%253A%252F%252Fwhotalking.com%252Fflickr%252F2-0%252BChelsea%3B1024%3B669"}],"user\_mentions":[{"screen\_name":"jameswilliams46","name":"James](https://www.google.co.uk/search?q=viera+lifting+fa+cup+for+arsenal&client=safari&hl=en-gb&source=lnms&tbm=isch&sa=X&ei=alp3U4LrK82UOufRgaAK&ved=0CAYQ_AUoAQ&biw=320&bih=460#facrc=_&imgrc=-QK5IhwQT8AS8M%253A%3B2yfUWG7-cngS-M%3Bhttp%253A%252F%252Ffarm4.static.flickr.com%252F3777%252F10838930556_618b87d7cc_m.jpg%3Bhttp%253A%252F%252Fwhotalking.com%252Fflickr%252F2-0%252BChelsea%3B1024%3B669%22%7D%5D,%22user_mentions%22:%5B%7B%22screen_name%22:%22jameswilliams46%22,%22name%22:%22James)  
> Williams"}],"hashtags":},"text":"@jameswilliams46  
> [https://t.co/CAmxdagAym","user":{"screen\_name":"SSimpson7379","name":"Stephen](https://t.co/CAmxdagAym%22,%22user%22:%7B%22screen_name%22:%22SSimpson7379%22,%22name%22:%22Stephen)  
> Simpson","friends\_count":258,"followers\_count":266,"statuses\_count":2609,"verified":false,"utc\_offset":3600,"time\_zone":"London"},"in\_reply\_to\_screen\_name":"jameswilliams46"}  
> at org.apache.hadoop.hive.ql.exec.ExecMapper.map(ExecMapper.java:162)  
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)  
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:430)  
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:366)  
> at org.apache.hadoop.mapred.Child$4.run(Child.java:255)  
> at java.security.AccessController.doPrivileged(Native Method)  
> at javax.security.auth.Subject.doAs(Subject.java:415)  
> at  
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190)  
> at org.apache.hadoop.mapred.Child.main(Child.java:249)  
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime  
> Error while processing row {"id":467649114269028352,"created\_at":"Sat May  
> 17 12:53:32 +0000 2014","source":"\<a href="[http://www.apple.com](http://www.apple.com)"  
> rel="nofollow"\>iOS","favorited":false,"retweet\_count":0,"retweeted\_status":null,"entities":{"urls":[{"expanded\_url":"  
> [https://www.google.co.uk/search?q=viera+lifting+fa+cup+for+arsenal&client=safari&hl=en-gb&source=lnms&tbm=isch&sa=X&ei=alp3U4LrK82UOufRgaAK&ved=0CAYQ\_AUoAQ&biw=320&bih=460#facrc=\_&imgrc=-QK5IhwQT8AS8M%253A%3B2yfUWG7-cngS-M%3Bhttp%253A%252F%252Ffarm4.static.flickr.com%252F3777%252F10838930556\_618b87d7cc\_m.jpg%3Bhttp%253A%252F%252Fwhotalking.com%252Fflickr%252F2-0%252BChelsea%3B1024%3B669"}],"user\_mentions":[{"screen\_name":"jameswilliams46","name":"James](https://www.google.co.uk/search?q=viera+lifting+fa+cup+for+arsenal&client=safari&hl=en-gb&source=lnms&tbm=isch&sa=X&ei=alp3U4LrK82UOufRgaAK&ved=0CAYQ_AUoAQ&biw=320&bih=460#facrc=_&imgrc=-QK5IhwQT8AS8M%253A%3B2yfUWG7-cngS-M%3Bhttp%253A%252F%252Ffarm4.static.flickr.com%252F3777%252F10838930556_618b87d7cc_m.jpg%3Bhttp%253A%252F%252Fwhotalking.com%252Fflickr%252F2-0%252BChelsea%3B1024%3B669%22%7D%5D,%22user_mentions%22:%5B%7B%22screen_name%22:%22jameswilliams46%22,%22name%22:%22James)  
> Williams"}],"hashtags":},"text":"@jameswilliams46  
> [https://t.co/CAmxdagAym","user":{"screen\_name":"SSimpson7379","name":"Stephen](https://t.co/CAmxdagAym%22,%22user%22:%7B%22screen_name%22:%22SSimpson7379%22,%22name%22:%22Stephen)  
> Simpson","friends\_count":258,"followers\_count":266,"statuses\_count":2609,"verified":false,"utc\_offset":3600,"time\_zone":"London"},"in\_reply\_to\_screen\_name":"jameswilliams46"}  
> at  
> org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:671)  
> at org.apache.hadoop.hive.ql.exec.ExecMapper.map(ExecMapper.java:144)  
> ... 8 more  
> Caused by: java.lang.IllegalArgumentException: When using JSON input, only  
> one field is expected  
> at org.elasticsearch.hadoop.util.Assert.isTrue(Assert.java:48)  
> at  
> org.elasticsearch.hadoop.hive.HiveBytesConverter.convert(HiveBytesConverter.java:48)  
> at  
> org.elasticsearch.hadoop.serialization.command.JsonTemplatedCommand.preProcess(JsonTemplatedCommand.java:56)  
> at  
> org.elasticsearch.hadoop.serialization.command.TemplatedCommand.write(TemplatedCommand.java:73)  
> at org.elasticsearch.hadoop.hive.EsSerDe.serialize(EsSerDe.java:135)
> 
> ```
> at
> 
> ```
> 
> org.apache.hadoop.hive.ql.exec.FileSinkOperator.processOp(FileSinkOperator.java:617)  
> at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:502)  
> at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:832)  
> at  
> org.apache.hadoop.hive.ql.exec.SelectOperator.processOp(SelectOperator.java:84)  
> at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:502)  
> at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:832)  
> at  
> org.apache.hadoop.hive.ql.exec.TableScanOperator.processOp(TableScanOperator.java:90)  
> at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:502)  
> at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:832)  
> at  
> org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:652)  
> ... 9 more
> 
> FAILED: Execution Error, return code 2 from  
> org.apache.hadoop.hive.ql.exec.MapRedTask  
> MapReduce Jobs Launched:  
> Job 0: Map: 1 HDFS Read: 0 HDFS Write: 0 FAIL  
> Total MapReduce CPU Time Spent: 0 msec
> 
> Any help would be so appreciable  
> Thank you so much
> 
> 2014-05-22 15:34 GMT+01:00 Costin Leau [costin.leau@gmail.com](mailto:costin.leau@gmail.com):
> 
> Hi,
> 
> > It looks like you have two tables - one that uses the JSONSerDe from  
> > cloudera and another one using es-hadoop.  
> > You configured your es-hadoop table to consider the input as json however  
> > it does not receive the proper format (as the exception indicates).  
> > See this [1] section of the documentation for more information.
> > 
> > Let me restate again that you do not the data to Elasticsearch and  
> > es-hadoop to be in JSON format - unless it actually is in JSON  
> > (as in JSON files are stored in HDFS) simply send whatever data you have  
> > in Hive to es-hadoop and it will do the JSON translation automatically  
> > and typically much more efficient.  
> > Again the docs [2] discuss this in detail. Frankly, I'm not sure why you  
> > want to use the JSONSerDe.
> > 
> > To conclude: if the data is in raw format in HDFS, just feed to es-hadoop  
> > with the input configured as JSON, if it's in a different format,  
> > load it in Hive as you would typically do and then insert it into the  
> > es-hadoop table.
> > 
> > Hope this helps,
> > 
> > [1] [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/guide/en/elasticsearch/hadoop/)  
> > current/hive.html#writing-json-hive  
> > [2] [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/guide/en/elasticsearch/hadoop/)  
> > current/hive.html#hive
> > 
> > On 5/22/14 12:13 PM, hanine haninne wrote:
> > 
> > > Hello again,  
> > > I m trying to get some tweets from the HDFS and put it in  
> > > elasticsearch(head) in order to make search on it, I did what  
> > > u said and I m so thankful, But it start reading and does not continue.  
> > > I don't know why ?!!  
> > > here is what I did :
> > > 
> > > hive -hiveconf hive.aux.jars.path=/ES\_Hadoop/  
> > > dist/elasticsearch-hadoop-2.0.0.RC1.jar
> > > 
> > > Logging initialized using configuration in  
> > > jar:file:/home/hduser/hadoop/hive-0.11.0/lib/hive-common-0.  
> > > 11.0.jar!/hive-log4j.properties  
> > > Hive history file=/tmp/hduser/hive\_job\_log\_hduser\_8166@mouna-pc\_  
> > > 201405220958\_2036150447.txt
> > > 
> > > hive\> ADD JAR /home/hduser/hadoop/hive-0.11.0/lib/hive-serdes-1.0-  
> > > SNAPSHOT.jar;  
> > > Added /home/hduser/hadoop/hive-0.11.0/lib/hive-serdes-1.0-SNAPSHOT.jar  
> > > to class path  
> > > Added resource: /home/hduser/hadoop/hive-0.11.0/lib/hive-serdes-1.0-  
> > > SNAPSHOT.jar  
> > > hive\> INSERT OVERWRITE TABLE tweetsES SELECT \* FROM tweets;  
> > > Total MapReduce jobs = 1  
> > > Launching Job 1 out of 1  
> > > Number of reduce tasks is set to 0 since there's no reduce operator  
> > > Starting Job = job\_201405220937\_0005, Tracking URL =  
> > > [http://master:50030/jobdetails.jsp?jobid=job\_201405220937\_0005](http://master:50030/jobdetails.jsp?jobid=job_201405220937_0005)  
> > > Kill Command = /home/hduser/hadoop/libexec/../bin/hadoop job -kill  
> > > job\_201405220937\_0005  
> > > Hadoop job information for Stage-0: number of mappers: 1; number of  
> > > reducers: 0  
> > > 2014-05-22 10:01:39,184 Stage-0 map = 0%, reduce = 0%  
> > > 2014-05-22 10:01:59,320 Stage-0 map = 100%, reduce = 100%  
> > > Ended Job = job\_201405220937\_0005 with errors  
> > > Error during job, obtaining debugging information...  
> > > Job Tracking URL: [http://master:50030/jobdetails.jsp?jobid=job\_](http://master:50030/jobdetails.jsp?jobid=job_)  
> > > 201405220937\_0005  
> > > Examining task ID: task\_201405220937\_0005\_m\_000002 (and more) from job  
> > > job\_201405220937\_0005
> > > 
> > > ## Task with the most failures(4):
> > > 
> > > Task ID:  
> > > task\_201405220937\_0005\_m\_000000
> > > 
> > > ## URL: [http://master:50030/taskdetails.jsp?jobid=job\_](http://master:50030/taskdetails.jsp?jobid=job_) 201405220937\_0005&tipid=task\_201405220937\_0005\_m\_000000
> > > 
> > > Diagnostic Messages for this Task:  
> > > java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException:  
> > > Hive Runtime Error while processing row  
> > > {"id":467649114269028352,"created\_at":"Sat May 17 12:53:32 +0000  
> > > 2014","source":"\<a href="[http://www.apple.com](http://www.apple.com)"  
> > > rel="nofollow"\>iOS","favorited":false,"retweet\_  
> > > count":0,"retweeted\_status":null,"entities":{"urls":[{"expanded\_url":"  
> > > [viera lifting fa cup for arsenal - Google Search](https://www.google.co.uk/search?q=viera+lifting+fa+cup+for+arsenal&)  
> > > client=safari&hl=en-gb&source=lnms&tbm=isch&sa=X&ei=  
> > > alp3U4LrK82UOufRgaAK&ved=0CAYQ\_AUoAQ&biw=320&bih=460#  
> > > facrc=_&imgrc=-QK5IhwQT8AS8M%253A%3B2yfUWG7-cngS-M%3Bhttp%  
> > > 253A%252F%252Ffarm4.static.flickr.com%252F3777%  
> > > 252F10838930556\_618b87d7cc\_m.jpg%3Bhttp%253A%252F%  
> > > 252Fwhotalking.com%252Fflickr%252F2-0%252BChelsea%3B1024%3B669  
> > > "}],"user\_mentions":[{"screen\_name":"jameswilliams46","name":"James  
> > > Williams"}],"hashtags":[]},"text":"@jameswilliams46  
> > > [https://t.co/CAmxdagAym","user":{"screen\_name":"](https://t.co/CAmxdagAym%22,%22user%22:%7B%22screen_name%22:%22)  
> > > SSimpson7379","name":"Stephen  
> > > Simpson","friends\_count":258,"followers\_count":266,"  
> > > statuses\_count":2609,"verified":false,"utc\_offset":  
> > > 3600,"time\_zone":"London"},"in\_reply\_to\_screen\_name":"jameswilliams46"}  
> > > at org.apache.hadoop.hive.ql.exec.ExecMapper.map(  
> > > ExecMapper.java:162)  
> > > at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)  
> > > at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:430)  
> > > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:366)  
> > > at org.apache.hadoop.mapred.Child$4.run(Child.java:255)  
> > > at java.security.AccessController.doPrivileged(Native Method)  
> > > at javax.security.auth.Subject.doAs(Subject.java:415)  
> > > at org.apache.hadoop.security.UserGroupInformation.doAs(  
> > > UserGroupInformation.java:1190)  
> > > at org.apache.hadoop.mapred.Child.main(Child.java:249)  
> > > Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive  
> > > Runtime Error while processing row  
> > > {"id":467649114269028352,"created\_at":"Sat May 17 12:53:32 +0000  
> > > 2014","source":"\<a href="[http://www.apple.com](http://www.apple.com)"  
> > > rel="nofollow"\>iOS","favorited":false,"retweet_  
> > > count":0,"retweeted\_status":null,"entities":{"urls":[{"expanded\_url":"  
> > > [viera lifting fa cup for arsenal - Google Search](https://www.google.co.uk/search?q=viera+lifting+fa+cup+for+arsenal&)  
> > > client=safari&hl=en-gb&source=lnms&tbm=isch&sa=X&ei=  
> > > alp3U4LrK82UOufRgaAK&ved=0CAYQ\_AUoAQ&biw=320&bih=460#  
> > > facrc=\_&imgrc=-QK5IhwQT8AS8M%253A%3B2yfUWG7-cngS-M%3Bhttp%  
> > > 253A%252F%[252Ffarm4.static.flickr.com](http://252Ffarm4.static.flickr.com)%252F3777%  
> > > 252F10838930556\_618b87d7cc\_m.jpg%3Bhttp%253A%252F%  
> > > [252Fwhotalking.com](http://252Fwhotalking.com)%252Fflickr%252F2-0%252BChelsea%3B1024%3B669  
> > > "}],"user\_mentions":[{"screen\_name":"jameswilliams46","name":"James  
> > > Williams"}],"hashtags":},"text":"@jameswilliams46  
> > > [https://t.co/CAmxdagAym","user":{"screen\_name":"](https://t.co/CAmxdagAym%22,%22user%22:%7B%22screen_name%22:%22)  
> > > SSimpson7379","name":"Stephen  
> > > Simpson","friends\_count":258,"followers\_count":266,"  
> > > statuses\_count":2609,"verified":false,"utc\_offset":  
> > > 3600,"time\_zone":"London"},"in\_reply\_to\_screen\_name":"jameswilliams46"}  
> > > at org.apache.hadoop.hive.ql.exec.MapOperator.process(  
> > > MapOperator.java:671)  
> > > at org.apache.hadoop.hive.ql.exec.ExecMapper.map(  
> > > ExecMapper.java:144)  
> > > ... 8 more  
> > > Caused by: org.elasticsearch.hadoop.EsHadoopIllegalArgumentException:  
> > > When using JSON input, only one field is expected  
> > > at org.elasticsearch.hadoop.util.Assert.isTrue(Assert.java:50)  
> > > at org.elasticsearch.hadoop.hive.HiveBytesConverter.convert(  
> > > HiveBytesConverter.java:48)  
> > > at org.elasticsearch.hadoop.serialization.bulk.  
> > > JsonTemplatedBulk.preProcess(JsonTemplatedBulk.java:58)  
> > > at org.elasticsearch.hadoop.serialization.bulk.TemplatedBulk.write(  
> > > TemplatedBulk.java:75)  
> > > at org.elasticsearch.hadoop.hive.EsSerDe.serialize(EsSerDe.  
> > > java:128)  
> > > at org.apache.hadoop.hive.ql.exec.FileSinkOperator.  
> > > processOp(FileSinkOperator.java:617)  
> > > at org.apache.hadoop.hive.ql.exec.Operator.process(  
> > > Operator.java:502)  
> > > at org.apache.hadoop.hive.ql.exec.Operator.forward(  
> > > Operator.java:832)  
> > > at org.apache.hadoop.hive.ql.exec.SelectOperator.processOp(  
> > > SelectOperator.java:84)  
> > > at org.apache.hadoop.hive.ql.exec.Operator.process(  
> > > Operator.java:502)  
> > > at org.apache.hadoop.hive.ql.exec.Operator.forward(  
> > > Operator.java:832)  
> > > at org.apache.hadoop.hive.ql.exec.TableScanOperator.  
> > > processOp(TableScanOperator.java:90)  
> > > at org.apache.hadoop.hive.ql.exec.Operator.process(  
> > > Operator.java:502)  
> > > at org.apache.hadoop.hive.ql.exec.Operator.forward(  
> > > Operator.java:832)  
> > > at org.apache.hadoop.hive.ql.exec.MapOperator.process(  
> > > MapOperator.java:652)  
> > > ... 9 more
> > > 
> > > FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.  
> > > exec.MapRedTask  
> > > MapReduce Jobs Launched:  
> > > Job 0: Map: 1 HDFS Read: 0 HDFS Write: 0 FAIL  
> > > Total MapReduce CPU Time Spent: 0 msec
> > > 
> > > when I did not add that jar "ADD JAR /home/hduser/hadoop/hive-0.11.  
> > > 0/lib/hive-serdes-1.0-SNAPSHOT.jar;" it gave me that  
> > > error "Caused by: java.lang.ClassNotFoundException:  
> > > com.cloudera.hive.serde.JSONSerDe  
> > > "
> > > 
> > > Thank you so very much for your helping
> > > 
> > > 2014-05-21 12:00 GMT+01:00 Costin Leau \<[costin.leau@gmail.com](mailto:costin.leau@gmail.com) \<mailto:  
> > > [costin.leau@gmail.com](mailto:costin.leau@gmail.com)\>\>:
> > > 
> > > ```
> > > If you plan to use es-hadoop, there's no need to do any JSON
> > > 
> > > ```
> > > 
> > > conversion (es-hadoop does that automatically) - see  
> > > the documentation at [1]  
> > > for more information.  
> > > If not than I recommend reaching out to the providers of the package  
> > > for more information on its configuration.
> > > 
> > > ```
> > > [1] elasticsearch.org/hadoop <http://elasticsearch.org/hadoop>
> > > 
> > > On 5/21/14 1:17 PM, hanine haninne wrote:
> > > 
> > > yes, you are right.Thanks so much
> > > 
> > > well I tried hive with HDFS and it works very well,by the way I
> > > 
> > > ```
> > > 
> > > m using hive-0.11.0 , hadoop-1.2.1 and  
> > > elasticsearch-1.0.1  
> > > Here is the script of the tables  
> > > CREATE EXTERNAL TABLE tweets (  
> > > id BIGINT,  
> > > created\_at STRING,  
> > > source STRING,  
> > > favorited BOOLEAN,  
> > > retweet\_count INT,  
> > > retweeted\_status STRUCT\<  
> > > text:STRING,  
> > > user:STRUCT\<screen\_name:\_\_STRING,name:STRING\>\>,  
> > > entities STRUCT\<  
> > > urls:ARRAY\<STRUCT\<expanded\_\_\_url:STRING\>\>,  
> > > user\_mentions:ARRAY\<STRUCT\< **screen\_name:STRING,name:**  
> > > STRING\>\>,  
> > > hashtags:ARRAY\<STRUCTtext:\_\_STRING\>\>,
> > > 
> > > ```
> > > text STRING,
> > > user STRUCT<
> > > screen_name:STRING,
> > > name:STRING,
> > > friends_count:INT,
> > > followers_count:INT,
> > > statuses_count:INT,
> > > verified:BOOLEAN,
> > > utc_offset:INT,
> > > time_zone:STRING>,
> > > in_reply_to_screen_name STRING
> > > )
> > > ROW FORMAT SERDE 'com.cloudera.hive.serde.__JSONSerDe'
> > > LOCATION '/flume/Tweets_A';
> > > 
> > > do I have to add "com.cloudera.hive.serde.__JSONSerDe'" an
> > > 
> > > ```
> > > 
> > > other time to put data in elasticsearch ?? if yes,How !!
> > > 
> > > ```
> > > Thank you so very much
> > > 
> > > 2014-05-21 10:36 GMT+01:00 Costin Leau <costin.leau@gmail.com<mailto:
> > > 
> > > ```
> > > 
> > > [costin.leau@gmail.com](mailto:costin.leau@gmail.com)\>  
> > > \<[mailto:costin.leau@gmail.com](mailto:costin.leau@gmail.com) [mailto:costin.leau@gmail.com](mailto:costin.leau@gmail.com)
> > > 
> > > > \_\_\>:
> > > 
> > > ```
> > > The error indicates that your script refers to a JSonSerDe
> > > 
> > > ```
> > > 
> > > class (presumably from Cloudera) which cannot be  
> > > found in  
> > > the classpath:
> > > 
> > > ```
> > > "> Caused by: java.lang. ____ ClassNotFoundException:
> > > 
> > > ```
> > > 
> > > com.cloudera.hive.serde.\_\_\_\_JSONSerDe"
> > > 
> > > ```
> > > In fact if you read through the stacktrace, you'll notice
> > > 
> > > ```
> > > 
> > > that this comes up while the job configuration  
> > > is being read and this class name encountered but the class  
> > > definition itself cannot be resolved.
> > > 
> > > ```
> > > I'm not sure what causes this class to be added to the
> > > 
> > > ```
> > > 
> > > classpath of your script - it could be your script  
> > > or the  
> > > client configuration.  
> > > Note the class is not used or added by ES-hadoop itself.
> > > 
> > > ```
> > > I'm not sure what distro you are using (es-hadoop works
> > > 
> > > ```
> > > 
> > > across Apache Hadoop, Cloudera, HDP, MapR, Pivotal,  
> > > etc...)  
> > > but you could try running some  
> > > basic Hive scripts (without es-hadoop) first to make sure  
> > > the environment is sane and that you can properly  
> > > read and  
> > > write from HDFS and then add  
> > > es-hadoop into the mix.
> > > 
> > > ```
> > > Hope this helps,
> > > 
> > > On 5/21/14 12:15 PM, hanine haninne wrote:
> > > 
> > > Thank you so much for ur answer
> > > here is what it gives me now
> > > 
> > > INSERT OVERWRITE TABLE tweetsES SELECT * FROM
> > > 
> > > ```
> > > 
> > > tweets;
> > > 
> > > ```
> > > Total MapReduce jobs = 1
> > > Launching Job 1 out of 1
> > > Number of reduce tasks is set to 0 since there's no
> > > 
> > > ```
> > > 
> > > reduce operator  
> > > Starting Job = job\_201405210900\_0002, Tracking URL =  
> > > [http://master:50030/\_\_\_\_jobdetails.jsp?jobid=job\_\_\_\_\_](http://master:50030/ ____jobdetails.jsp?jobid=job_____ )  
> > > 201405210900\_0002
> > > 
> > > ```
> > > <http://master:50030/ __jobdetails.jsp?jobid=job___
> > > 
> > > ```
> > > 
> > > 201405210900\_0002\>  
> > > \<[http://master:50030/\_\_jobdetails.jsp?jobid=job\_\_\_](http://master:50030/ __jobdetails.jsp?jobid=job___ )  
> > > 201405210900\_0002  
> > > \<[http://master:50030/jobdetails.jsp?jobid=job\_201405210900\_0002](http://master:50030/jobdetails.jsp?jobid=job_201405210900_0002)
> > > 
> > > > >
> > > 
> > > ```
> > > Kill Command = /home/hduser/hadoop/libexec/.. ____ /bin/hadoop
> > > 
> > > ```
> > > 
> > > job -kill job\_201405210900\_0002
> > > 
> > > ```
> > > Hadoop job information for Stage-0: number of mappers:
> > > 
> > > ```
> > > 
> > > 1; number of reducers: 0  
> > > 2014-05-21 10:12:05,285 Stage-0 map = 0%, reduce = 0%  
> > > 2014-05-21 10:12:23,408 Stage-0 map = 100%, reduce =  
> > > 100%  
> > > Ended Job = job\_201405210900\_0002 with errors  
> > > Error during job, obtaining debugging information...  
> > > Job Tracking URL: [http://master:50030/\_\_\_\_](http://master:50030/ ____ )  
> > > jobdetails.jsp?jobid=job\_\_\_\_\_201405210900\_0002  
> > > \<[http://master:50030/\_\_jobdetails.jsp?jobid=job\_\_\_](http://master:50030/ __jobdetails.jsp?jobid=job___ )  
> > > 201405210900\_0002\>
> > > 
> > > ```
> > > <http://master:50030/ __jobdetails.jsp?jobid=job___
> > > 
> > > ```
> > > 
> > > 201405210900\_0002  
> > > \<[http://master:50030/jobdetails.jsp?jobid=job\_201405210900\_0002](http://master:50030/jobdetails.jsp?jobid=job_201405210900_0002)
> > > 
> > > > >
> > > 
> > > ```
> > > Examining task ID: task_201405210900_0002_m _____ 000002
> > > 
> > > ```
> > > 
> > > (and more) from job job\_201405210900\_0002
> > > 
> > > ```
> > > Task with the most failures(4):
> > > -----
> > > Task ID:
> > > task_201405210900_0002_m _____ 000000
> > > 
> > > URL:
> > > http://master:50030/ ____taskdetails.jsp?jobid=job_____
> > > 
> > > ```
> > > 
> > > 201405210900\_0002&tipid=task\_\_\_\_\_201405210900\_0002\_m\_000000 \<  
> > > [http://master:50030/\_\_taskdetails.jsp?jobid=job\_\_\_](http://master:50030/ __taskdetails.jsp?jobid=job___ )  
> > > 201405210900\_0002&tipid=task\_\_\_201405210900\_0002\_m\_000000\>
> > > 
> > > ```
> > > <http://master:50030/ __taskdetails.jsp?jobid=job___
> > > 
> > > ```
> > > 
> > > 201405210900\_0002&tipid=task\_\_\_201405210900\_0002\_m\_000000  
> > > \<[http://master:50030/taskdetails.jsp?jobid=job\_](http://master:50030/taskdetails.jsp?jobid=job_)  
> > > 201405210900\_0002&tipid=task\_201405210900\_0002\_m\_000000\>\>  
> > > -----  
> > > Diagnostic Messages for this Task:  
> > > java.lang.RuntimeException: Error in configuring object  
> > > at org.apache.hadoop.util.\_\_\_\_  
> > > ReflectionUtils.setJobConf(**ReflectionUtils.java:93)  
> > > at org.apache.hadoop.util.**  
> > > ReflectionUtils.setConf(**ReflectionUtils.java:64)  
> > > at org.apache.hadoop.util.**  
> > > ReflectionUtils.newInstance(**ReflectionUtils.java:117)  
> > > at org.apache.hadoop.mapred.**  
> > > MapTask.runOldMapper(MapTask.**java:426)  
> > > at org.apache.hadoop.mapred.**  
> > > MapTask.run(MapTask.java:366)  
> > > at org.apache.hadoop.mapred.\_\_\_\_  
> > > Child$4.run(Child.java:255)
> > > 
> > > ```
> > > at java.security. ____
> > > 
> > > ```
> > > 
> > > AccessController.doPrivileged(\__**Native Method)  
> > > at javax.security.auth.Subject.**  
> > > **doAs(Subject.java:415)  
> > > at org.apache.hadoop.security.**_  
> > > \_UserGroupInformation.doAs(**UserGroupInformation.java:1190)  
> > > at org.apache.hadoop.mapred.  
> > > Child.main(Child.java:249)  
> > > Caused by: java.lang.reflect.**  
> > > InvocationTargetException
> > > 
> > > ```
> > > at sun.reflect. ____NativeMethodAccessorImpl.____ invoke0(Native
> > > 
> > > ```
> > > 
> > > Method)  
> > > at sun.reflect. **NativeMethodAccessorImpl.**  
> > > invoke(\_\_\_\_NativeMethodAccessorImpl.java:\_\_\_\_57)  
> > > at  
> > > sun.reflect.**DelegatingMethodAccessorImpl.invoke(  
> > > DelegatingMethodAccessorImpl.java:43)  
> > > at java.lang.reflect.Method.  
> > > invoke(Method.java:606)  
> > > at org.apache.hadoop.util.**  
> > > ReflectionUtils.setJobConf(\_\_\_\_ReflectionUtils.java:88)
> > > 
> > > ```
> > > ... 9 more
> > > Caused by: java.lang.RuntimeException: Error in
> > > 
> > > ```
> > > 
> > > configuring object  
> > > at org.apache.hadoop.util.\_\_\_\_  
> > > ReflectionUtils.setJobConf(**ReflectionUtils.java:93)  
> > > at org.apache.hadoop.util.**  
> > > ReflectionUtils.setConf(**ReflectionUtils.java:64)  
> > > at org.apache.hadoop.util.**  
> > > ReflectionUtils.newInstance(**ReflectionUtils.java:117)  
> > > at org.apache.hadoop.mapred.**  
> > > MapRunner.configure(MapRunner.**java:34)  
> > > ... 14 more  
> > > Caused by: java.lang.reflect.**  
> > > InvocationTargetException
> > > 
> > > ```
> > > at sun.reflect. ____NativeMethodAccessorImpl.____ invoke0(Native
> > > 
> > > ```
> > > 
> > > Method)  
> > > at sun.reflect. **NativeMethodAccessorImpl.**  
> > > invoke(\_\_\_\_NativeMethodAccessorImpl.java:\_\_\_\_57)  
> > > at  
> > > sun.reflect.**DelegatingMethodAccessorImpl.invoke(  
> > > DelegatingMethodAccessorImpl.java:43)  
> > > at java.lang.reflect.Method.  
> > > invoke(Method.java:606)  
> > > at org.apache.hadoop.util.**  
> > > ReflectionUtils.setJobConf(\_\_\_\_ReflectionUtils.java:88)
> > > 
> > > ```
> > > ... 17 more
> > > Caused by: java.lang.RuntimeException: Map operator
> > > 
> > > ```
> > > 
> > > initialization failed  
> > > at org.apache.hadoop.hive.ql.\_\_\_\_  
> > > exec.ExecMapper.configure(\_\_\_\_ExecMapper.java:121)  
> > > ... 22 more  
> > > Caused by: org.apache.hadoop.hive.ql.\_\_\_\_metadata.HiveException:  
> > > java.lang.\_\_\_\_ClassNotFoundException:  
> > > com.cloudera.hive.serde.**JSONSerDe  
> > > at org.apache.hadoop.hive.ql.**  
> > > exec.MapOperator.\_\_\_\_getConvertedOI(MapOperator.**java:463)  
> > > at org.apache.hadoop.hive.ql.**  
> > > exec.MapOperator.setChildren(**MapOperator.java:479)  
> > > at org.apache.hadoop.hive.ql.**  
> > > exec.ExecMapper.configure(\_\_\_\_ExecMapper.java:90)  
> > > ... 22 more  
> > > Caused by: java.lang.\_\_\_\_ClassNotFoundException:  
> > > com.cloudera.hive.serde.\_\_\_\_JSONSerDe  
> > > at java.net.URLClassLoader$1.run(  
> > > \_\_\_\_URLClassLoader.java:366)  
> > > at java.net.URLClassLoader$1.run(  
> > > **URLClassLoader.java:355)  
> > > at java.security.**  
> > > AccessController.doPrivileged(**Native Method)  
> > > at java.net.URLClassLoader.**  
> > > findClass(URLClassLoader.java:**354)  
> > > at java.lang.ClassLoader.**  
> > > loadClass(ClassLoader.java:**424)  
> > > at sun.misc.Launcher$**  
> > > AppClassLoader.loadClass(**Launcher.java:308)  
> > > at java.lang.ClassLoader.**  
> > > loadClass(ClassLoader.java:\_\_\_\_357)  
> > > at java.lang.Class.forName0(\_\_\_\_Native Method)  
> > > at java.lang.Class.forName(Class.**java:270)  
> > > at org.apache.hadoop.conf.**  
> > > Configuration.getClassByName(**Configuration.java:810)  
> > > at org.apache.hadoop.hive.ql.**  
> > > exec.MapOperator.\_\_\_\_getConvertedOI(MapOperator.\_\_\_\_java:422)  
> > > ... 24 more
> > > 
> > > ```
> > > FAILED: Execution Error, return code 2 from
> > > 
> > > ```
> > > 
> > > org.apache.hadoop.hive.ql.\_\_\_\_exec.MapRedTask
> > > 
> > > ```
> > > MapReduce Jobs Launched:
> > > Job 0: Map: 1 HDFS Read: 0 HDFS Write: 0 FAIL
> > > Total MapReduce CPU Time Spent: 0 msec
> > > 
> > > 2014-05-20 14:11 GMT+01:00 Costin Leau <
> > > 
> > > ```
> > > 
> > > [costin.leau@gmail.com](mailto:costin.leau@gmail.com) [mailto:costin.leau@gmail.com](mailto:costin.leau@gmail.com)  
> > > \<[mailto:costin.leau@gmail.com](mailto:costin.leau@gmail.com) [mailto:costin.leau@gmail.com](mailto:costin.leau@gmail.com)\>  
> > > \<[mailto:costin.leau@gmail.com](mailto:costin.leau@gmail.com) \<mailto:  
> > > [costin.leau@gmail.com](mailto:costin.leau@gmail.com)\> \<[mailto:costin.leau@gmail.com](mailto:costin.leau@gmail.com)  
> > > [mailto:costin.leau@gmail.com](mailto:costin.leau@gmail.com)\> **\>** \>:
> > > 
> > > ```
> > > 1. You don't need to add the hive jars
> > > 
> > > ```
> > > 
> > > (hive-serdes) to your script - these are already part of  
> > > the runtime  
> > > 2. use es-hadoop-2.0.RC1, 1.3 M2 is fairly old  
> > > 3. Make sure that the jar is actually available  
> > > and that is potentially accessible by Hive. Also  
> > > do note that  
> > > when running Hive against a cluster, it's best to  
> > > have the jars available on all nodes hence why  
> > > most folks  
> > > copy  
> > > them to HDFS and refer to that location.  
> > > While /home/hduser might be locally available, it  
> > > might not exist on the Hive server - as  
> > > indicated by the  
> > > error.
> > > 
> > > ```
> > > Hope this helps,
> > > 
> > > On 5/20/14 3:58 PM, hanine haninne wrote:
> > > 
> > > Hello everybody
> > > 
> > > I m trying to take data from Hive and put it
> > > 
> > > ```
> > > 
> > > in elasticsearch  
> > > here is the script and the error
> > > 
> > > ```
> > > hive> ADD JAR /home/hduser/hadoop/hive-0.11.
> > > 
> > > ```
> > > 
> > > \_\_\_\_\_\_0/lib/hive-serdes-1.0-\_\_\_\_\_\_SNAPSHOT.jar;  
> > > Added /home/hduser/hadoop/hive-0.11.  
> > > \_\_\_\_\_\_0/lib/hive-serdes-1.0-\_\_\_\_\_\_SNAPSHOT.jar to class path  
> > > Added resource: /home/hduser/hadoop/hive-0.11.  
> > > \_\_\_\_\_\_0/lib/hive-serdes-1.0-\_\_\_\_\_\_SNAPSHOT.jar
> > > 
> > > ```
> > > hive> CREATE EXTERNAL TABLE tweetsES (
> > > > id BIGINT,
> > > > created_at STRING,
> > > > source STRING,
> > > > favorited BOOLEAN,
> > > > retweet_count INT,
> > > > retweeted_status STRUCT<
> > > > text:STRING,
> > > > user:STRUCT<screen_name: ______
> > > 
> > > ```
> > > 
> > > STRING,name:STRING\>\>,  
> > > \> entities STRUCT\<  
> > > \> urls:ARRAY\<STRUCT\<expanded\_\_\_\_  
> > > _**url:STRING\>\>,  
> > > \> user\_mentions:ARRAY\<STRUCT\<**_  
> > > \_\_\_screen\_name:STRING,name:\_\_\__**STRING\>\>,  
> > > \> hashtags:ARRAY\<STRUCT\<text:**_  
> > > \_\_\_STRING\>\>\>,
> > > 
> > > ```
> > > > text STRING,
> > > > user STRUCT<
> > > > screen_name:STRING,
> > > > name:STRING,
> > > > friends_count:INT,
> > > > followers_count:INT,
> > > > statuses_count:INT,
> > > > verified:BOOLEAN,
> > > > utc_offset:INT,
> > > > time_zone:STRING>,
> > > > in_reply_to_screen_name STRING
> > > > )
> > > > STORED BY
> > > 
> > > ```
> > > 
> > > 'org.elasticsearch.hadoop.\_\_\_\_\_\_hive.EsStorageHandler'  
> > > \> TBLPROPERTIES('es.resource' =  
> > > 'reseaux\_sociaux/tweets','es.\_\_\_\_\_\_input.json' = 'yes');
> > > 
> > > ```
> > > OK
> > > Time taken: 4.292 seconds
> > > hive> ADD JAR /home/hduser/hadoop/ ______
> > > 
> > > ```
> > > 
> > > elasticsearch-hadoop-1.3.0.M2.**jar;  
> > > Added /home/hduser/hadoop/**  
> > > elasticsearch-hadoop-1.3.0.M2.**jar to class path  
> > > Added resource: /home/hduser/hadoop/**  
> > > elasticsearch-hadoop-1.3.0.M2.\_\_\_\_\_\_jar
> > > 
> > > ```
> > > hive> INSERT OVERWRITE TABLE tweetsES SELECT *
> > > 
> > > ```
> > > 
> > > FROM tweets;  
> > > Total MapReduce jobs = 1  
> > > Launching Job 1 out of 1  
> > > Number of reduce tasks is set to 0 since  
> > > there's no reduce operator  
> > > java.io.FileNotFoundException: File does not  
> > > exist:  
> > > /home/hduser/hadoop/\_\_\_\_\_\_  
> > > elasticsearch-hadoop-1.3.0.M2.\_\_\_\_\_\_jar  
> > > at
> > > 
> > > ```
> > > org.apache.hadoop.hdfs. ______DistributedFileSystem.______
> > > 
> > > ```
> > > 
> > > getFileStatus(\_\_\_\_\_\_DistributedFileSystem.java:\_\_\_\_\_\_558)  
> > > at  
> > > org.apache.hadoop.filecache. **DistributedCache.**  
> > > getFileStatus(\_\_\_\_\_\_DistributedCache.java:185)  
> > > at
> > > 
> > > ```
> > > org.apache.hadoop.filecache. ________
> > > 
> > > ```
> > > 
> > > TrackerDistributedCacheManager\_\_\_\_\_\_.getFileStatus(\_\_\_\_\_\_  
> > > TrackerDistributedCacheManager\_\_\_\_\_\_.java:723)  
> > > at
> > > 
> > > ```
> > > org.apache.hadoop.filecache. ________
> > > 
> > > ```
> > > 
> > > TrackerDistributedCacheManager\_\_\_\_\_\_.determineTimestamps(\_\_\_\_\_\_  
> > > TrackerDistributedCacheManager\_\_\_\_\_\_.java:778)  
> > > at
> > > 
> > > ```
> > > org.apache.hadoop.filecache. ________
> > > 
> > > ```
> > > 
> > > TrackerDistributedCacheManager\_\_\_\_\_\_.\_\_\_\_\_\_  
> > > determineTimestampsAndCacheVis\_\_\_\_\_\_ibilities(\_\_\_\_\_\_  
> > > TrackerDistributedCacheManager\_\_\_\_\_\_.java:755)  
> > > at  
> > > org.apache.hadoop.mapred. **JobClient.**  
> > > copyAndConfigureFiles(\_\_\_\_\_\_JobClient.java:843)  
> > > at  
> > > org.apache.hadoop.mapred. **JobClient.**  
> > > copyAndConfigureFiles(\__**JobClient.java:734)  
> > > at org.apache.hadoop.mapred.**_  
> > > \_JobClient.access$400(\__**JobClient.java:179)  
> > > at org.apache.hadoop.mapred.**_  
> > > \_JobClient$2.run(JobClient.\__**java:951)  
> > > at org.apache.hadoop.mapred.**_  
> > > \_JobClient$2.run(JobClient.**java:936)  
> > > at java.security.**  
> > > AccessController.doPrivileged(\_\_\_\_**Native Method)  
> > > at javax.security.auth.Subject.**  
> > > \_\_\_\_doAs(Subject.java:415)  
> > > at  
> > > org.apache.hadoop.security.\_\_\_\_\__UserGroupInformation.doAs(_  
> > > \_\_\_\_\_UserGroupInformation.java:\__**1190)  
> > > at org.apache.hadoop.mapred.**_  
> > > \_JobClient.submitJobInternal(\__**JobClient.java:936)  
> > > at org.apache.hadoop.mapred.**_  
> > > \_JobClient.submitJob(JobClient.\_\_**java:910)  
> > > at org.apache.hadoop.hive.ql.**  
> > > \_\_exec.ExecDriver.execute(\_\_**ExecDriver.java:447)  
> > > at org.apache.hadoop.hive.ql.**  
> > > \_\_exec.MapRedTask.execute(\_\_**MapRedTask.java:138)  
> > > at org.apache.hadoop.hive.ql.**  
> > > \_\_exec.Task.executeTask(Task.\_\_**java:144)  
> > > at org.apache.hadoop.hive.ql.**  
> > > \_\_exec.TaskRunner.runSequential(\_\_**TaskRunner.java:57)  
> > > at org.apache.hadoop.hive.ql.**  
> > > \_\_Driver.launchTask(Driver.java:\_\_**1355)  
> > > at org.apache.hadoop.hive.ql.**  
> > > \_\_Driver.execute(Driver.java:\__**1139)  
> > > at org.apache.hadoop.hive.ql.**  
> > > **Driver.run(Driver.java:945)  
> > > at org.apache.hadoop.hive.cli.**_  
> > > \_\_\_CliDriver.processLocalCmd(\_\_\__**CliDriver.java:259)  
> > > at org.apache.hadoop.hive.cli.**_  
> > > \_\_\_CliDriver.processCmd(\_\_\__**CliDriver.java:216)  
> > > at org.apache.hadoop.hive.cli.**_  
> > > \_\_\_CliDriver.processLine(\_\_\__**CliDriver.java:413)  
> > > at org.apache.hadoop.hive.cli.**_  
> > > \_\_\_CliDriver.run(CliDriver.java:\_\_\__**756)  
> > > at org.apache.hadoop.hive.cli.**_  
> > > \_\_\_CliDriver.main(CliDriver.**java:614)  
> > > at sun.reflect.**  
> > > NativeMethodAccessorImpl.\_\_\_\_\_\_invoke0(Native Method)  
> > > at  
> > > sun.reflect.\_\_\_\_\_\_NativeMethodAccessorImpl.**invoke(**  
> > > NativeMethodAccessorImpl.java:\_\_\_\_\_\_57)  
> > > at
> > > 
> > > ```
> > > sun.reflect. ______ DelegatingMethodAccessorImpl._
> > > 
> > > ```
> > > 
> > > \_\_\_\_\_invoke(\_\_\_\_\_\_DelegatingMethodAccessorImpl.\__**java:43)  
> > > at java.lang.reflect.Method.**_  
> > > \_invoke(Method.java:606)  
> > > at org.apache.hadoop.util.RunJar.  
> > > \_\_\_\_\_\_main(RunJar.java:160)
> > > 
> > > ```
> > > Job Submission failed with exception 'java.io<
> > > 
> > > ```
> > > 
> > > [http://java.io](http://java.io)\> [http://java.io](http://java.io)  
> > > [http://java.io](http://java.io).**FileNotFoundException(File  
> > > does not exist:  
> > > /home/hduser/hadoop/**  
> > > elasticsearch-hadoop-1.3.0.M2.\_\_\_\_\_\_jar)'  
> > > FAILED: Execution Error, return code 1 from  
> > > org.apache.hadoop.hive.ql.\_\_\_\_\_\_exec.MapRedTask
> > > 
> > > ```
> > > That path it exist :/home/hduser/hadoop/ ______
> > > 
> > > ```
> > > 
> > > elasticsearch-hadoop-1.3.0.M2.\_\_\_\_\_\_jar
> > > 
> > > ```
> > > Any help would be so appreciable
> > > Thanks
> > > 
> > > --
> > > You received this message because you are
> > > 
> > > ```
> > > 
> > > subscribed to the Google Groups "elasticsearch" group.  
> > > To unsubscribe from this group and stop  
> > > receiving emails from it, send an email to  
> > > elasticsearch+unsubscribe@**go  
> > > [oglegroups.com](http://oglegroups.com) [http://go\_\_oglegroups.com](http://go__oglegroups.com)  
> > > [http://googlegroups.com](http://googlegroups.com)  
> > > \<mailto:elasticsearch%  
> > > [2Bunsubscribe@googlegroups.com](mailto:2Bunsubscribe@googlegroups.com)  
> > > [mailto:elasticsearch%25\_\_2Bunsubscribe@googlegroups.com](mailto:elasticsearch%25__2Bunsubscribe@googlegroups.com)  
> > > \<mailto:elasticsearch%252Bunsubscribe@googlegroups.com  
> > > [mailto:elasticsearch%25252Bunsubscribe@googlegroups.com](mailto:elasticsearch%25252Bunsubscribe@googlegroups.com)\>\>  
> > > \<mailto:elasticsearch+**\_\_  
> > > [unsubscribe@googlegroups.com](mailto:unsubscribe@googlegroups.com)  
> > > [mailto:elasticsearch%2B\_\_\_\_unsubscribe@googlegroups.com](mailto:elasticsearch%2B ____ unsubscribe@googlegroups.com)  
> > > \<mailto:elasticsearch%2B\_\_\_\_  
> > > [unsubscribe@googlegroups.com](mailto:unsubscribe@googlegroups.com)  
> > > [mailto:elasticsearch%252B\_\_unsubscribe@googlegroups.com](mailto:elasticsearch%252B__unsubscribe@googlegroups.com)\>  
> > > \<mailto:elasticsearch%\_\_\_\_2Bunsubscribe@googlegroups.com\<mailto:  
> > > elasticsearch%25\_\_2Bunsubscribe@googlegroups.com\>  
> > > \<mailto:elasticsearch%_252Bunsubscribe@googlegroups.  
> > > \_com  
> > > [mailto:elasticsearch%25252Bunsubscribe@googlegroups.com](mailto:elasticsearch%25252Bunsubscribe@googlegroups.com)\>_\_\>\>.
> > > 
> > > ```
> > > To view this discussion on the web visit
> > > https://groups.google.com/d/ ______msgid/elasticsearch/__
> > > 
> > > ```
> > > 
> > > d1613b48-\_\_\_\_e58d-4077-a579-\_\_92b46a97bcff%\_\_\_\_\_\_40googlegroups.com  
> > > \<[https://groups.google.com/d/\_\_\_\_msgid/elasticsearch/](https://groups.google.com/d/ ____ msgid/elasticsearch/)  
> > > d1613b48-\_\_\_\_e58d-4077-a579-92b46a97bcff%\_\_\_\_40googlegroups.com\>
> > > 
> > > ```
> > > <https://groups.google.com/d/ ____ msgid/elasticsearch/
> > > 
> > > ```
> > > 
> > > d1613b48-\_\_\_\_e58d-4077-a579-92b46a97bcff%\_\_\_\_40googlegroups.com  
> > > \<[https://groups.google.com/d/\_\_msgid/elasticsearch/d1613b48-](https://groups.google.com/d/__msgid/elasticsearch/d1613b48-)  
> > > \_\_e58d-4077-a579-92b46a97bcff%\_\_40googlegroups.com\>\>
> > > 
> > > ```
> > > <https://groups.google.com/d/ ____ msgid/elasticsearch/
> > > 
> > > ```
> > > 
> > > d1613b48-\_\_\_\_e58d-4077-a579-92b46a97bcff%\_\_\_\_40googlegroups.com  
> > > \<[https://groups.google.com/d/\_\_msgid/elasticsearch/d1613b48-](https://groups.google.com/d/__msgid/elasticsearch/d1613b48-)  
> > > \_\_e58d-4077-a579-92b46a97bcff%\_\_40googlegroups.com\>
> > > 
> > > ```
> > > <https://groups.google.com/d/__msgid/elasticsearch/d1613b48-
> > > 
> > > ```
> > > 
> > > \_\_e58d-4077-a579-92b46a97bcff%\_\_40googlegroups.com  
> > > \<[https://groups.google.com/d/msgid/elasticsearch/d1613b48-](https://groups.google.com/d/msgid/elasticsearch/d1613b48-)  
> > > e58d-4077-a579-92b46a97bcff%[40googlegroups.com](http://40googlegroups.com)\>\>\>
> > > 
> > > ```
> > > <https://groups.google.com/d/ ______msgid/elasticsearch/__
> > > 
> > > ```
> > > 
> > > d1613b48- **e58d-4077-a579-92b46a97bcff%**  
> > > [40GGGROUPS CASINO – Real Slot Casino for 10,000+ Senior Players](http://40googlegroups.com?utm _____medium=__ email&utm_source= ____ footer)  
> > > \<[https://groups.google.com/d/\_\_\_\_msgid/elasticsearch/](https://groups.google.com/d/ ____ msgid/elasticsearch/)  
> > > d1613b48-\_\_\_\_e58d-4077-a579-92b46a97bcff%\__**[40GGGROUPS CASINO – Real Slot Casino for 10,000+ Senior Players](http://40googlegroups.com?utm)**_  
> > > medium=\_\_email&utm\_source=\_\_footer\>
> > > 
> > > ```
> > > <https://groups.google.com/d/ ____ msgid/elasticsearch/
> > > 
> > > ```
> > > 
> > > d1613b48-\_\_\_\_e58d-4077-a579-92b46a97bcff%\__**[40GGGROUPS CASINO – Real Slot Casino for 10,000+ Senior Players](http://40googlegroups.com?utm)**_  
> > > medium=\_\_email&utm\_source=\_\_footer  
> > > \<[https://groups.google.com/d/\_\_msgid/elasticsearch/d1613b48-](https://groups.google.com/d/__msgid/elasticsearch/d1613b48-)  
> > > \_\_e58d-4077-a579-92b46a97bcff%\__[40GGGROUPS CASINO – Real Slot Casino for 10,000+ Senior Players](http://40googlegroups.com?utm)_  
> > > medium=\_\_email&utm\_source=footer\>\>
> > > 
> > > ```
> > > <https://groups.google.com/d/ ____ msgid/elasticsearch/
> > > 
> > > ```
> > > 
> > > d1613b48-\_\_\_\_e58d-4077-a579-92b46a97bcff%\__**[40GGGROUPS CASINO – Real Slot Casino for 10,000+ Senior Players](http://40googlegroups.com?utm)**_  
> > > medium=\_\_email&utm\_source=\_\_footer  
> > > \<[https://groups.google.com/d/\_\_msgid/elasticsearch/d1613b48-](https://groups.google.com/d/__msgid/elasticsearch/d1613b48-)  
> > > \_\_e58d-4077-a579-92b46a97bcff%\__[40GGGROUPS CASINO – Real Slot Casino for 10,000+ Senior Players](http://40googlegroups.com?utm)_  
> > > medium=\_\_email&utm\_source=footer\>
> > > 
> > > ```
> > > <https://groups.google.com/d/__msgid/elasticsearch/d1613b48-
> > > 
> > > ```
> > > 
> > > \_\_e58d-4077-a579-92b46a97bcff%\__[40GGGROUPS CASINO – Real Slot Casino for 10,000+ Senior Players](http://40googlegroups.com?utm)_  
> > > medium=\_\_email&utm\_source=footer  
> > > \<[https://groups.google.com/d/msgid/elasticsearch/d1613b48-](https://groups.google.com/d/msgid/elasticsearch/d1613b48-)  
> > > e58d-4077-a579-92b46a97bcff%[40GGGROUPS CASINO – Real Slot Casino for 10,000+ Senior Players](http://40googlegroups.com?utm_medium=)  
> > > email&utm\_source=footer\>\>\>\>.
> > > 
> > > ```
> > > For more options, visit
> > > 
> > > ```
> > > 
> > > [https://groups.google.com/d/\_\_\_\_\_\_optout](https://groups.google.com/d/ ______ optout)  
> > > [https://groups.google.com/d/\_\_\_\_optout](https://groups.google.com/d/ ____ optout) \<  
> > > [https://groups.google.com/d/\_\_\_\_optout](https://groups.google.com/d/ ____ optout)
> > > 
> > > ```
> > > <https://groups.google.com/d/__optout>>
> > > 
> > > <https://groups.google.com/d/ ____ optout <
> > > 
> > > ```
> > > 
> > > [https://groups.google.com/d/\_\_optout](https://groups.google.com/d/__optout)\>  
> > > \<[https://groups.google.com/d/\_\_optout](https://groups.google.com/d/__optout) \<  
> > > [https://groups.google.com/d/optout](https://groups.google.com/d/optout)\>\>\>.
> > > 
> > > ```
> > > --
> > > Costin
> > > 
> > > --
> > > You received this message because you are
> > > 
> > > ```
> > > 
> > > subscribed to the Google Groups "elasticsearch" group.  
> > > To unsubscribe from this group and stop receiving  
> > > emails from it, send an email to  
> > > elasticsearch+unsubscribe@**go\_\_\_\_oglegroups.com \<  
> > > http://go\_\_oglegroups.com\> [http://googlegroups.com](http://googlegroups.com)  
> > > \<mailto:elasticsearch%**\_\_  
> > > [2Bunsubscribe@googlegroups.com](mailto:2Bunsubscribe@googlegroups.com)  
> > > [mailto:elasticsearch%25\_\_2Bunsubscribe@googlegroups.com](mailto:elasticsearch%25__2Bunsubscribe@googlegroups.com)  
> > > \<mailto:elasticsearch%\_\_252Bunsubscribe@googlegroups.**com  
> > > [mailto:elasticsearch%25252Bunsubscribe@googlegroups.com](mailto:elasticsearch%25252Bunsubscribe@googlegroups.com)\>**\>.
> > > 
> > > ```
> > > To view this discussion on the web visit
> > > https://groups.google.com/d/ ______msgid/elasticsearch/__
> > > 
> > > ```
> > > 
> > > 537B549F.\_\_\_\_8020501%40gmail.\_\_com  
> > > \<[https://groups.google.com/d/\_\_\_\_msgid/elasticsearch/](https://groups.google.com/d/ ____ msgid/elasticsearch/)  
> > > 537B549F.\_\_\_\_8020501%[40gmail.com](http://40gmail.com)\>
> > > 
> > > ```
> > > <https://groups.google.com/d/ ____ msgid/elasticsearch/
> > > 
> > > ```
> > > 
> > > 537B549F.\_\_\_\_8020501%[40gmail.com](http://40gmail.com)  
> > > \<[https://groups.google.com/d/\_\_msgid/elasticsearch/537B549F](https://groups.google.com/d/__msgid/elasticsearch/537B549F).  
> > > \_\_8020501%[40gmail.com](http://40gmail.com)\>\>
> > > 
> > > ```
> > > <https://groups.google.com/d/_
> > > 
> > > ```
> > > 
> > > \_\_\_msgid/elasticsearch/537B549F.\_\_\_\_8020501%[40gmail.com](http://40gmail.com)  
> > > \<[https://groups.google.com/d/\_\_msgid/elasticsearch/537B549F](https://groups.google.com/d/__msgid/elasticsearch/537B549F).  
> > > \_\_8020501%[40gmail.com](http://40gmail.com)\>  
> > > \<[https://groups.google.com/d/\_](https://groups.google.com/d/_)  
> > > \_msgid/elasticsearch/537B549F.\_\_8020501%[40gmail.com](http://40gmail.com)  
> > > \<[https://groups.google.com/d/msgid/elasticsearch/537B549F](https://groups.google.com/d/msgid/elasticsearch/537B549F).  
> > > 8020501%[40gmail.com](http://40gmail.com)\>\>\>.
> > > 
> > > ```
> > > For more options, visit
> > > 
> > > ```
> > > 
> > > [https://groups.google.com/d/\_\_\_\_\_\_optout](https://groups.google.com/d/ ______ optout)  
> > > [https://groups.google.com/d/\_\_\_\_optout](https://groups.google.com/d/ ____ optout) \<  
> > > [https://groups.google.com/d/\_\_\_\_optout](https://groups.google.com/d/ ____ optout)  
> > > [https://groups.google.com/d/\_\_optout](https://groups.google.com/d/__optout)\>
> > > 
> > > ```
> > > <https://groups.google.com/d/ ____ optout <
> > > 
> > > ```
> > > 
> > > [https://groups.google.com/d/\_\_optout](https://groups.google.com/d/__optout)\>  
> > > \<[https://groups.google.com/d/\_\_optout](https://groups.google.com/d/__optout) \<  
> > > [https://groups.google.com/d/optout](https://groups.google.com/d/optout)\>\>\>.
> > > 
> > > ```
> > > --
> > > You received this message because you are subscribed to
> > > 
> > > ```
> > > 
> > > the Google Groups "elasticsearch" group.  
> > > To unsubscribe from this group and stop receiving  
> > > emails from it, send an email to  
> > > elasticsearch+unsubscribe@\_\_go\_\_oglegroups.com \<  
> > > [http://googlegroups.com](http://googlegroups.com)\>  
> > > \<mailto:elasticsearch%**[2Bunsubscribe@googlegroups.com](mailto:2Bunsubscribe@googlegroups.com) \<mailto:  
> > > elasticsearch%252Bunsubscribe@googlegroups.com\>**\>  
> > > \<[mailto:elasticsearch+\_\_\_\_unsubscribe@googlegroups.com](mailto:elasticsearch+ ____ unsubscribe@googlegroups.com)  
> > > [mailto:elasticsearch%2B\_\_unsubscribe@googlegroups.com](mailto:elasticsearch%2B__unsubscribe@googlegroups.com) \<mailto:  
> > > elasticsearch%**[2Bunsubscribe@googlegroups.com](mailto:2Bunsubscribe@googlegroups.com)  
> > > [mailto:elasticsearch%252Bunsubscribe@googlegroups.com](mailto:elasticsearch%252Bunsubscribe@googlegroups.com)**\>\>.  
> > > To view this discussion on the web visit  
> > > [https://groups.google.com/d/\_\_\_\_msgid/elasticsearch/](https://groups.google.com/d/ ____ msgid/elasticsearch/)  
> > > CANXJSR9- **xpGoJR4gvPW%3DKKP%3DVr\_\_\_\_\_5MxyDoUJKtbpqM6CsYs1G4Q%**  
> > > [40mail.gmail.com](http://40mail.gmail.com)  
> > > \<[https://groups.google.com/d/\_\_msgid/elasticsearch/CANXJSR9-](https://groups.google.com/d/__msgid/elasticsearch/CANXJSR9-)  
> > > \_\_xpGoJR4gvPW%3DKKP%3DVr\_\_\_5MxyDoUJKtbpqM6CsYs1G4Q%\_\_40mail.gmail.com\>
> > > 
> > > ```
> > > <https://groups.google.com/d/__msgid/elasticsearch/CANXJSR9-
> > > 
> > > ```
> > > 
> > > \_\_xpGoJR4gvPW%3DKKP%3DVr\_\_\_5MxyDoUJKtbpqM6CsYs1G4Q%\_\_40mail.gmail.com  
> > > \<[https://groups.google.com/d/msgid/elasticsearch/CANXJSR9-](https://groups.google.com/d/msgid/elasticsearch/CANXJSR9-)  
> > > xpGoJR4gvPW%3DKKP%3DVr\_5MxyDoUJKtbpqM6CsYs1G4Q%[40mail.gmail.com](http://40mail.gmail.com)\>\>
> > > 
> > > ```
> > > <https://groups.google.com/d/ ____ msgid/elasticsearch/
> > > 
> > > ```
> > > 
> > > CANXJSR9- **xpGoJR4gvPW%3DKKP%3DVr\_\_\_\_\_5MxyDoUJKtbpqM6CsYs1G4Q%**  
> > > [40mail.gmail.com?utm\_medium=\_\_\_\_email&utm\_source=footer](http://40mail.gmail.com?utm_medium= ____ email&utm_source=footer)  
> > > \<[https://groups.google.com/d/\_\_msgid/elasticsearch/CANXJSR9-](https://groups.google.com/d/__msgid/elasticsearch/CANXJSR9-)  
> > > **xpGoJR4gvPW%3DKKP%3DVr\_\_\_5MxyDoUJKtbpqM6CsYs1G4Q%**  
> > > [40mail.gmail.com?utm\_medium=\_\_email&utm\_source=footer](http://40mail.gmail.com?utm_medium=__email&utm_source=footer)\>
> > > 
> > > ```
> > > <https://groups.google.com/d/__msgid/elasticsearch/CANXJSR9-
> > > 
> > > ```
> > > 
> > > **xpGoJR4gvPW%3DKKP%3DVr\_\_\_5MxyDoUJKtbpqM6CsYs1G4Q%**  
> > > [40mail.gmail.com?utm\_medium=\_\_email&utm\_source=footer](http://40mail.gmail.com?utm_medium=__email&utm_source=footer)  
> > > \<[https://groups.google.com/d/msgid/elasticsearch/CANXJSR9-](https://groups.google.com/d/msgid/elasticsearch/CANXJSR9-)  
> > > xpGoJR4gvPW%3DKKP%3DVr\_5MxyDoUJKtbpqM6CsYs1G4Q%  
> > > [40mail.gmail.com?utm\_medium=email&utm\_source=footer](http://40mail.gmail.com?utm_medium=email&utm_source=footer)\>\>\>.
> > > 
> > > ```
> > > For more options, visit https://groups.google.com/d/__
> > > 
> > > ```
> > > 
> > > \_\_optout [https://groups.google.com/d/\_\_optout](https://groups.google.com/d/__optout)  
> > > \<[https://groups.google.com/d/\_\_optout](https://groups.google.com/d/__optout) \<  
> > > [https://groups.google.com/d/optout](https://groups.google.com/d/optout)\>\>.
> > > 
> > > ```
> > > --
> > > Costin
> > > 
> > > --
> > > You received this message because you are subscribed to the
> > > 
> > > ```
> > > 
> > > Google Groups "elasticsearch" group.  
> > > To unsubscribe from this group and stop receiving emails  
> > > from it, send an email to  
> > > elasticsearch+unsubscribe@\_\_go\_\_oglegroups.com \<  
> > > [http://googlegroups.com](http://googlegroups.com)\>  
> > > \<mailto:elasticsearch%**[2Bunsubscribe@googlegroups.com](mailto:2Bunsubscribe@googlegroups.com) \<mailto:  
> > > elasticsearch%252Bunsubscribe@googlegroups.com\>**\>.  
> > > To view this discussion on the web visit  
> > > [https://groups.google.com/d/\_\_\_\_msgid/elasticsearch/](https://groups.google.com/d/ ____ msgid/elasticsearch/)  
> > > 537C738E.\_\_\_\_9030001%[40gmail.com](http://40gmail.com)  
> > > \<[https://groups.google.com/d/\_\_msgid/elasticsearch/537C738E](https://groups.google.com/d/__msgid/elasticsearch/537C738E).  
> > > \_\_9030001%[40gmail.com](http://40gmail.com)\>
> > > 
> > > ```
> > > <https://groups.google.com/d/_
> > > 
> > > ```
> > > 
> > > \_msgid/elasticsearch/537C738E.\_\_9030001%[40gmail.com](http://40gmail.com)  
> > > \<[https://groups.google.com/d/msgid/elasticsearch/537C738E](https://groups.google.com/d/msgid/elasticsearch/537C738E).  
> > > 9030001%[40gmail.com](http://40gmail.com)\>\>.
> > > 
> > > ```
> > > For more options, visit https://groups.google.com/d/__
> > > 
> > > ```
> > > 
> > > \_\_optout [https://groups.google.com/d/\_\_optout](https://groups.google.com/d/__optout)  
> > > \<[https://groups.google.com/d/\_\_optout](https://groups.google.com/d/__optout) \<  
> > > [https://groups.google.com/d/optout](https://groups.google.com/d/optout)\>\>.
> > > 
> > > ```
> > > --
> > > You received this message because you are subscribed to the
> > > 
> > > ```
> > > 
> > > Google Groups "elasticsearch" group.  
> > > To unsubscribe from this group and stop receiving emails from  
> > > it, send an email to  
> > > elasticsearch+unsubscribe@\_\_googlegroups.com \<mailto:  
> > > elasticsearch%2Bunsubscribe@googlegroups.com\>  
> > > \<[mailto:elasticsearch+\_\_unsubscribe@googlegroups.com](mailto:elasticsearch+__unsubscribe@googlegroups.com) \<mailto:  
> > > elasticsearch%2Bunsubscribe@googlegroups.com\>\>.  
> > > To view this discussion on the web visit  
> > > [https://groups.google.com/d/\_\_msgid/elasticsearch/\_\_](https://groups.google.com/d/ __msgid/elasticsearch/__ )  
> > > CANXJSR8Gy4qhM8Lzm5BHCr2-\_\_xptLKBSdm00nCrz-JtnW59jWcw%\_\_40mail.gmail.com  
> > > \<[https://groups.google.com/d/msgid/elasticsearch/](https://groups.google.com/d/msgid/elasticsearch/)  
> > > CANXJSR8Gy4qhM8Lzm5BHCr2-xptLKBSdm00nCrz-JtnW59jWcw%[40mail.gmail.com](http://40mail.gmail.com)\>  
> > > \<[https://groups.google.com/d/\_\_msgid/elasticsearch/\_\_](https://groups.google.com/d/ __msgid/elasticsearch/__ )  
> > > CANXJSR8Gy4qhM8Lzm5BHCr2- **xptLKBSdm00nCrz-JtnW59jWcw%**  
> > > [40mail.gmail.com?utm\_medium=\_\_email&utm\_source=footer](http://40mail.gmail.com?utm_medium=__email&utm_source=footer)  
> > > \<[https://groups.google.com/d/msgid/elasticsearch/](https://groups.google.com/d/msgid/elasticsearch/)  
> > > CANXJSR8Gy4qhM8Lzm5BHCr2-xptLKBSdm00nCrz-JtnW59jWcw%  
> > > [40mail.gmail.com?utm\_medium=email&utm\_source=footer](http://40mail.gmail.com?utm_medium=email&utm_source=footer)\>\>.
> > > 
> > > ```
> > > For more options, visit https://groups.google.com/d/__optout <
> > > 
> > > ```
> > > 
> > > [https://groups.google.com/d/optout](https://groups.google.com/d/optout)\>.
> > > 
> > > ```
> > > --
> > > Costin
> > > 
> > > --
> > > You received this message because you are subscribed to the Google
> > > 
> > > ```
> > > 
> > > Groups "elasticsearch" group.  
> > > To unsubscribe from this group and stop receiving emails from it,  
> > > send an email to  
> > > elasticsearch+unsubscribe@\_\_googlegroups.com \<mailto:elasticsearch%  
> > > [2Bunsubscribe@googlegroups.com](mailto:2Bunsubscribe@googlegroups.com)\>.  
> > > To view this discussion on the web visit  
> > > [https://groups.google.com/d/\_\_msgid/elasticsearch/537C8751.\_](https://groups.google.com/d/__msgid/elasticsearch/537C8751._)  
> > > \_1030908%[40gmail.com](http://40gmail.com)  
> > > \<[https://groups.google.com/d/msgid/elasticsearch/537C8751](https://groups.google.com/d/msgid/elasticsearch/537C8751).  
> > > 1030908%[40gmail.com](http://40gmail.com)\>.
> > > 
> > > ```
> > > For more options, visit https://groups.google.com/d/__optout <
> > > 
> > > ```
> > > 
> > > [https://groups.google.com/d/optout](https://groups.google.com/d/optout)\>.
> > > 
> > > --  
> > > You received this message because you are subscribed to the Google  
> > > Groups "elasticsearch" group.  
> > > To unsubscribe from this group and stop receiving emails from it, send  
> > > an email to  
> > > [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com) \<mailto:elasticsearch+  
> > > [unsubscribe@googlegroups.com](mailto:unsubscribe@googlegroups.com)\>.  
> > > To view this discussion on the web visit  
> > > [https://groups.google.com/d/msgid/elasticsearch/CANXJSR\_](https://groups.google.com/d/msgid/elasticsearch/CANXJSR_)  
> > > pj6i55jwA3wYiGgh1d\_q86DpcNRKLZzhk-V97vWFLaQ%[40mail.gmail.com](http://40mail.gmail.com)  
> > > \<[https://groups.google.com/d/msgid/elasticsearch/CANXJSR\_](https://groups.google.com/d/msgid/elasticsearch/CANXJSR_)  
> > > pj6i55jwA3wYiGgh1d\_q86DpcNRKLZzhk-V97vWFLaQ%[40mail.gmail.com?utm\_medium=](http://40mail.gmail.com?utm_medium=)  
> > > email&utm\_source=footer\>.
> > > 
> > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).
> > 
> > --  
> > Costin
> > 
> > --  
> > You received this message because you are subscribed to the Google Groups  
> > "elasticsearch" group.  
> > To unsubscribe from this group and stop receiving emails from it, send an  
> > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> > To view this discussion on the web visit [https://groups.google.com/d/](https://groups.google.com/d/)  
> > msgid/elasticsearch/537E0B0B.3070307%[40gmail.com](http://40gmail.com).
> > 
> > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CANXJSR-yASyzyEDUokfstUm%3Dco64JepijaMm8ti05w7tw7qk2Q%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CANXJSR-yASyzyEDUokfstUm%3Dco64JepijaMm8ti05w7tw7qk2Q%40mail.gmail.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 1:26am UTC](https://discuss.elastic.co/t/hadoop-elasticsearch-and-hive/17622/11 "2017-07-06T01:26:33Z")

</div>