# Hadoop hdfs newScalingExecutorService **URL:** \ **Category:** Elasticsearch\ **Created:** [March 4, 2012, 2:54am UTC](https://discuss.elastic.co/t/hadoop-hdfs-newscalingexecutorservice/6875 "2012-03-04T02:54:33Z")\ **Posts on this page:** 5\ **Page:** 1
**Author:** ![duze](https://avatars.discourse-cdn.com/v4/letter/d/65b543/32.png) [@duze](https://discuss.elastic.co/u/duze)\ **Post date:** [March 4, 2012, 2:54am UTC](https://discuss.elastic.co/t/hadoop-hdfs-newscalingexecutorservice/6875/1 "2012-03-04T02:54:33Z")
Hi, I am trying to run ES on hadoop and its hdfs. I am running hadoop locally for testing in pseudo-distributed operation. What I get after starting ES with hadoop plugin is an error, which I cant fix. Hadoop itself works fine. Versions are matching (both hadoop and plugin are 0.20.204). My configuration of the gateway is standard: gateway: type: hdfs hdfs: uri: hdfs://localhost:8020 path: elastic What I get is: [INFO][node] [Gateway] {0.19.0}[28484]: initializing ... [INFO][plugins] [Gateway] loaded [hadoop], sites [] [DEBUG][discovery.zen.ping.multicast] [Gateway] using group [224.2.2.4], with port [54328], ttl [3], and address [null] [DEBUG][discovery.zen.ping.unicast] [Gateway] using initial hosts [], with concurrent\_connects [10] ][DEBUG][discovery.zen] [Gateway] using ping.timeout [3s] [DEBUG][discovery.zen.elect] [Gateway] using minimum\_master\_nodes [-1] [DEBUG][discovery.zen.fd] [Gateway] [master] uses ping\_interval [1s], ping\_timeout [30s], ping\_retries [3] [DEBUG][discovery.zen.fd] [Gateway] [node] uses ping\_interval [1s], ping\_timeout [30s], ping\_retries [3] [DEBUG][indices.recovery] [Gateway] using max\_size\_per\_sec[0b], concurrent\_streams [5], file\_chunk\_size [100kb], translog\_size [100kb], translog\_ops [1000], and compress [true] [ERROR][bootstrap] {0.19.0}: Initialization Failed ... 1) NoSuchMethodError[org.elasticsearch.common.util.concurrent.EsExecutors.newScalingExecutorService(IIJLjava/ util/concurrent/TimeUnit;Ljava/util/concurrent/ThreadFactory;)Ljava/ util/concurrent/ThreadPoolExecutor;] Any ideas how to fix it? ---
**Author:** ![kimchy](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kimchy/32/44952_2.png) [@kimchy](https://discuss.elastic.co/u/kimchy)\ **Post date:** [March 4, 2012, 9:32am UTC](https://discuss.elastic.co/t/hadoop-hdfs-newscalingexecutorservice/6875/2 "2012-03-04T09:32:34Z")
Which version of the plugin are you using? Make sure to use one that works with 0.19: [GitHub - elastic/elasticsearch-hadoop: Elasticsearch real-time search and analytics natively integrated with Hadoop](https://github.com/elasticsearch/elasticsearch-hadoop). On Sunday, March 4, 2012 at 4:54 AM, duze wrote: > Hi, > > I am trying to run ES on hadoop and its hdfs. > I am running hadoop locally for testing in pseudo-distributed > operation. What I get after starting ES with hadoop plugin is an > error, which I cant fix. Hadoop itself works fine. Versions are > matching (both hadoop and plugin are 0.20.204). > > My configuration of the gateway is standard: > gateway: > type: hdfs > hdfs: > uri: hdfs://localhost:8020 > path: elastic > > What I get is: > > [INFO][node] [Gateway] {0.19.0}[28484]: initializing ... > [INFO][plugins] [Gateway] loaded [hadoop], sites > [DEBUG][discovery.zen.ping.multicast] [Gateway] using group > [224.2.2.4], with port [54328], ttl [3], and address [null] > [DEBUG][discovery.zen.ping.unicast] [Gateway] using initial hosts , > with concurrent\_connects [10] > ][DEBUG][discovery.zen] [Gateway] using ping.timeout [3s] > [DEBUG][discovery.zen.elect] [Gateway] using minimum\_master\_nodes [-1] > [DEBUG][discovery.zen.fd] [Gateway] [master] uses ping\_interval [1s], > ping\_timeout [30s], ping\_retries [3] > [DEBUG][discovery.zen.fd] [Gateway] [node] uses ping\_interval [1s], > ping\_timeout [30s], ping\_retries [3] > [DEBUG][indices.recovery] [Gateway] using max\_size\_per\_sec[0b], > concurrent\_streams [5], file\_chunk\_size [100kb], translog\_size > [100kb], translog\_ops [1000], and compress [true] > [ERROR][bootstrap] {0.19.0}: Initialization Failed ... > 1) > NoSuchMethodError[org.elasticsearch.common.util.concurrent.EsExecutors.newScalingExecutorService(IIJLjava/ > util/concurrent/TimeUnit;Ljava/util/concurrent/ThreadFactory;)Ljava/ > util/concurrent/ThreadPoolExecutor;] > > Any ideas how to fix it? ---
**Author:** ![duze](https://avatars.discourse-cdn.com/v4/letter/d/65b543/32.png) [@duze](https://discuss.elastic.co/u/duze)\ **Post date:** [March 4, 2012, 1:04pm UTC](https://discuss.elastic.co/t/hadoop-hdfs-newscalingexecutorservice/6875/3 "2012-03-04T13:04:59Z")
Thanks for response, I checked versions, everything should be correct. hadoop plugin 1.1.0, Elasticsearch 0.19.0 and embedded hadoop plugin 0.20.204.0, hadoop 0.20.204.0 I tried to reinstall the plugin.. (you never know), but it is the same. bin/plugin -install elasticsearch/elasticsearch-hadoop/1.1.0 On Sunday, March 4, 2012 10:32:34 AM UTC+1, kimchy wrote: > Which version of the plugin are you using? Make sure to use one that > works with 0.19: [GitHub - elastic/elasticsearch-hadoop: Elasticsearch real-time search and analytics natively integrated with Hadoop](https://github.com/elasticsearch/elasticsearch-hadoop). > > On Sunday, March 4, 2012 at 4:54 AM, duze wrote: > > Hi, > > I am trying to run ES on hadoop and its hdfs. > I am running hadoop locally for testing in pseudo-distributed > operation. What I get after starting ES with hadoop plugin is an > error, which I cant fix. Hadoop itself works fine. Versions are > matching (both hadoop and plugin are 0.20.204). > > My configuration of the gateway is standard: > gateway: > type: hdfs > hdfs: > uri: hdfs://localhost:8020 > path: elastic > > What I get is: > > [INFO][node] [Gateway] {0.19.0}[28484]: initializing ... > [INFO][plugins] [Gateway] loaded [hadoop], sites > [DEBUG][discovery.zen.ping.multicast] [Gateway] using group > [224.2.2.4], with port [54328], ttl [3], and address [null] > [DEBUG][discovery.zen.ping.unicast] [Gateway] using initial hosts , > with concurrent\_connects [10] > ][DEBUG][discovery.zen] [Gateway] using ping.timeout [3s] > [DEBUG][discovery.zen.elect] [Gateway] using minimum\_master\_nodes [-1] > [DEBUG][discovery.zen.fd] [Gateway] [master] uses ping\_interval [1s], > ping\_timeout [30s], ping\_retries [3] > [DEBUG][discovery.zen.fd] [Gateway] [node] uses ping\_interval [1s], > ping\_timeout [30s], ping\_retries [3] > [DEBUG][indices.recovery] [Gateway] using max\_size\_per\_sec[0b], > concurrent\_streams [5], file\_chunk\_size [100kb], translog\_size > [100kb], translog\_ops [1000], and compress [true] > [ERROR][bootstrap] {0.19.0}: Initialization Failed ... > 1) > > NoSuchMethodError[org.elasticsearch.common.util.concurrent.EsExecutors.newScalingExecutorService(IIJLjava/ > util/concurrent/TimeUnit;Ljava/util/concurrent/ThreadFactory;)Ljava/ > util/concurrent/ThreadPoolExecutor;] > > Any ideas how to fix it? ---
**Author:** ![kimchy](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kimchy/32/44952_2.png) [@kimchy](https://discuss.elastic.co/u/kimchy)\ **Post date:** [March 4, 2012, 2:50pm UTC](https://discuss.elastic.co/t/hadoop-hdfs-newscalingexecutorservice/6875/4 "2012-03-04T14:50:02Z")
Strange… . I rebuilt against 0.19.0 and published a new version of the plugin (1.2.0), which should work now. On Sunday, March 4, 2012 at 3:04 PM, duze wrote: > Thanks for response, > > I checked versions, everything should be correct. > hadoop plugin 1.1.0, Elasticsearch 0.19.0 and embedded hadoop plugin 0.20.204.0, hadoop 0.20.204.0 > I tried to reinstall the plugin.. (you never know), but it is the same. > bin/plugin -install elasticsearch/elasticsearch-hadoop/1.1.0 > > On Sunday, March 4, 2012 10:32:34 AM UTC+1, kimchy wrote: > > > Which version of the plugin are you using? Make sure to use one that works with 0.19: [GitHub - elastic/elasticsearch-hadoop: Elasticsearch real-time search and analytics natively integrated with Hadoop](https://github.com/elasticsearch/elasticsearch-hadoop). > > > > On Sunday, March 4, 2012 at 4:54 AM, duze wrote: > > > > > Hi, > > > > > > I am trying to run ES on hadoop and its hdfs. > > > I am running hadoop locally for testing in pseudo-distributed > > > operation. What I get after starting ES with hadoop plugin is an > > > error, which I cant fix. Hadoop itself works fine. Versions are > > > matching (both hadoop and plugin are 0.20.204). > > > > > > My configuration of the gateway is standard: > > > gateway: > > > type: hdfs > > > hdfs: > > > uri: hdfs://localhost:8020 > > > path: elastic > > > > > > What I get is: > > > > > > [INFO][node] [Gateway] {0.19.0}[28484]: initializing ... > > > [INFO][plugins] [Gateway] loaded [hadoop], sites > > > [DEBUG][discovery.zen.ping.multicast] [Gateway] using group > > > [224.2.2.4], with port [54328], ttl [3], and address [null] > > > [DEBUG][discovery.zen.ping.unicast] [Gateway] using initial hosts , > > > with concurrent\_connects [10] > > > ][DEBUG][discovery.zen] [Gateway] using ping.timeout [3s] > > > [DEBUG][discovery.zen.elect] [Gateway] using minimum\_master\_nodes [-1] > > > [DEBUG][discovery.zen.fd] [Gateway] [master] uses ping\_interval [1s], > > > ping\_timeout [30s], ping\_retries [3] > > > [DEBUG][discovery.zen.fd] [Gateway] [node] uses ping\_interval [1s], > > > ping\_timeout [30s], ping\_retries [3] > > > [DEBUG][indices.recovery] [Gateway] using max\_size\_per\_sec[0b], > > > concurrent\_streams [5], file\_chunk\_size [100kb], translog\_size > > > [100kb], translog\_ops [1000], and compress [true] > > > [ERROR][bootstrap] {0.19.0}: Initialization Failed ... > > > 1) > > > NoSuchMethodError[org.elasticsearch.common.util.concurrent.EsExecutors.newScalingExecutorService(IIJLjava/ > > > util/concurrent/TimeUnit;Ljava/util/concurrent/ThreadFactory;)Ljava/ > > > util/concurrent/ThreadPoolExecutor;] > > > > > > Any ideas how to fix it? ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 3:37am UTC](https://discuss.elastic.co/t/hadoop-hdfs-newscalingexecutorservice/6875/5 "2017-07-06T03:37:26Z")