Specify yarn queue for elasticsearch-hadoop


#1

How do you specify a yarn pool when launching an instance of es-hadoop?

I've tried every possible combination of adding sys.prop and -D parameters and nothing seems to be working.

Here's what I've tried.

hadoop jar dist/elasticsearch-yarn-2.4.0.jar -start -Dmapred.job.queue.name=mypool
hadoop jar dist/elasticsearch-yarn-2.4.0.jar -start -Dmapreduce.job.queuename=mypool
hadoop jar dist/elasticsearch-yarn-2.4.0.jar -start sys.prop.mapreduce.job.queuename=mypool
hadoop jar dist/elasticsearch-yarn-2.4.0.jar -start sys.prop.mapred.job.queue.name=mypool


#2

Had to read https://github.com/elastic/elasticsearch-hadoop/blob/master/yarn/src/main/java/org/elasticsearch/hadoop/yarn/cfg/Config.java to figure it out.

hadoop jar dist/elasticsearch-yarn-2.4.0.jar -start app.queue=mypool


(system) #3