# I can't start elasticsearch in yarn,please help!20151106

**URL:** <https://discuss.elastic.co/t/i-cant-start-elasticsearch-in-yarn-please-help-20151106/33947>\
**Category:** Elasticsearch\
**Tags:** es-hadoop\
**Created:** [November 6, 2015, 5:27am UTC](https://discuss.elastic.co/t/i-cant-start-elasticsearch-in-yarn-please-help-20151106/33947 "2015-11-06T05:27:50Z")\
**Posts on this page:** 10\
**Page:** 1

<div class="post-metadata">

**Author:** ![wang](https://avatars.discourse-cdn.com/v4/letter/w/edb3f5/32.png) [@wang](https://discuss.elastic.co/u/wang)\
**Post date:** [November 6, 2015, 5:27am UTC](https://discuss.elastic.co/t/i-cant-start-elasticsearch-in-yarn-please-help-20151106/33947/1 "2015-11-06T05:27:51Z")

</div>

hello,when I use  
hadoop jar elasticsearch-yarn-2.1.1.jar -start hdfs.upload.dir=private/wcw/elasticsearchrtf

to start the elasticsearch on the CDH 5.0.0, encounter the problem as follows:

Application application\_1440481474920\_527812 failed 2 times due to AM Container for appattempt\_1440481474920\_527812\_000002 exited with exitCode: -1000 due to: java.io.IOException: Resource hdfs://ns1/user/elasticsearch-yarn-2.1.1.jar is not publicly accessable and as such cannot be part of the public cache.

.Failing this attempt.. Failing the application.

note:

in previously, I add user=yarn to supergroup in order to make solve the problem as follows

perssion denied: user=yarn

---

<div class="post-metadata">

**Author:** ![eliasah](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/eliasah/32/34741_2.png) [@eliasah](https://discuss.elastic.co/u/eliasah)\
**Post date:** [November 6, 2015, 7:59am UTC](https://discuss.elastic.co/t/i-cant-start-elasticsearch-in-yarn-please-help-20151106/33947/2 "2015-11-06T07:59:55Z")

</div>

Can you explain what's the purpose of what you are doing? You want to install elasticsearch?

---

<div class="post-metadata">

**Author:** ![costin](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/costin/32/44950_2.png) [@costin](https://discuss.elastic.co/u/costin)\
**Post date:** [November 7, 2015, 9:06pm UTC](https://discuss.elastic.co/t/i-cant-start-elasticsearch-in-yarn-please-help-20151106/33947/3 "2015-11-07T21:06:29Z")

</div>

Looks like there's a permission problem with the new jar. Can you double check the permissions for the mentioned file and, since you mentioned it worked before (or that's what I understood), can you please compare the working version with this one.

---

<div class="post-metadata">

**Author:** ![wang](https://avatars.discourse-cdn.com/v4/letter/w/edb3f5/32.png) [@wang](https://discuss.elastic.co/u/wang)\
**Post date:** [November 8, 2015, 11:40am UTC](https://discuss.elastic.co/t/i-cant-start-elasticsearch-in-yarn-please-help-20151106/33947/4 "2015-11-08T11:40:18Z")

</div>

Thank you very much indeed, I want to install elasticsearch, cuz we have a cluster of hadoop yarn , we have a lot of data sources in the hdfs , I want to try to use elasticsearch to integrate many kinds of data info (because use hive to build tables have many limits,expecially info is affluent). At least now , I face a problem to install elasticsearch. Can you help me, Thank you

---

<div class="post-metadata">

**Author:** ![wang](https://avatars.discourse-cdn.com/v4/letter/w/edb3f5/32.png) [@wang](https://discuss.elastic.co/u/wang)\
**Post date:** [November 8, 2015, 11:50am UTC](https://discuss.elastic.co/t/i-cant-start-elasticsearch-in-yarn-please-help-20151106/33947/5 "2015-11-08T11:50:53Z")

</div>

Thank you very much, May be I can explains it very clearly, my step is  
first

1. I use hadoop fs -put to upload jar files and elasticsearch-rtf(Chinese integration version) to hdfs
2. I use command hadoop jar elasticsearch-yarn-2.1.1.jar -start hdfs.upload.dir=private/elasticsearchrtf to start it  
firstly, I face a problem of org.apache.hadoop.security.AccessControlException: Permission denied: user=yarn,access=EXECUTE, indoe ="/user"..........group: drwxr-x--  
then I change user=yarn to our supergroup  
after that I try hadoop jar elasticsearch-yarn-2.1.1.jar -start hdfs.upload.dir=private/elasticsearchrtf secondly I face the error Application application\_1440481474920\_527812 failed 2 times due to AM Container for appattempt\_1440481474920\_527812\_000002 exited with exitCode: -1000 due to: java.io.IOException: Resource hdfs://ns1/user/elasticsearch-yarn-2.1.1.jar is not publicly accessable and as such cannot be part of the public cache.

that is my problem,thank you

---

<div class="post-metadata">

**Author:** ![wang](https://avatars.discourse-cdn.com/v4/letter/w/edb3f5/32.png) [@wang](https://discuss.elastic.co/u/wang)\
**Post date:** [November 9, 2015, 2:58am UTC](https://discuss.elastic.co/t/i-cant-start-elasticsearch-in-yarn-please-help-20151106/33947/6 "2015-11-09T02:58:05Z")

</div>

I have chmod the hdfs postion ,but still have the problem

-rwxrwxrwx 3 u\_xywb\_analysis u\_xywb\_analysis 74809314 2015-11-05 17:20 private/es/elasticsearch/elasticsearch-rtf-master.zip  
-rwxrwxrwx 3 u\_xywb\_analysis u\_xywb\_analysis 53821 2015-11-05 17:19 private/es/elasticsearch/elasticsearch-yarn-2.1.1.jar

---

<div class="post-metadata">

**Author:** ![costin](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/costin/32/44950_2.png) [@costin](https://discuss.elastic.co/u/costin)\
**Post date:** [November 9, 2015, 9:24am UTC](https://discuss.elastic.co/t/i-cant-start-elasticsearch-in-yarn-please-help-20151106/33947/7 "2015-11-09T09:24:00Z")

</div>

Try to see under what credentials and on what cluster is the yarn command executed.  
Do note that one can use ES with Hadoop without the use of YARN - this option (in beta) is offered as a convenience. However it is not mandatory to use it and it is not recommended for production.  
Considering the issues that you are facing, consider installing ES manually as with any environment outside YARN (puppet, chef, etc... also work).

---

<div class="post-metadata">

**Author:** ![wang](https://avatars.discourse-cdn.com/v4/letter/w/edb3f5/32.png) [@wang](https://discuss.elastic.co/u/wang)\
**Post date:** [November 17, 2015, 6:27am UTC](https://discuss.elastic.co/t/i-cant-start-elasticsearch-in-yarn-please-help-20151106/33947/8 "2015-11-17T06:27:02Z")

</div>

I use Marvel , but Marvel is very slowly ,not like solr UI fruently. Maybe it due to from cloud not local computer, Can you recommend the UI Plugin like Marvel That I Can finish job in the it,Thank you

---

<div class="post-metadata">

**Author:** ![eliasah](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/eliasah/32/34741_2.png) [@eliasah](https://discuss.elastic.co/u/eliasah)\
**Post date:** [November 17, 2015, 9:09am UTC](https://discuss.elastic.co/t/i-cant-start-elasticsearch-in-yarn-please-help-20151106/33947/9 "2015-11-17T09:09:32Z")

</div>

If you have another question wrang, you should open an new topic! Nevertheless, your question isn't clear. Marvel is for monitoring purposes.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 1:27pm UTC](https://discuss.elastic.co/t/i-cant-start-elasticsearch-in-yarn-please-help-20151106/33947/10 "2017-07-06T13:27:12Z")

</div>


