# ECK- Discovery GCE plugin not working in GKE cluster

**URL:** <https://discuss.elastic.co/t/eck-discovery-gce-plugin-not-working-in-gke-cluster/240209>\
**Category:** Elastic Cloud on Kubernetes (ECK)\
**Created:** [July 7, 2020, 7:08pm UTC](https://discuss.elastic.co/t/eck-discovery-gce-plugin-not-working-in-gke-cluster/240209 "2020-07-07T19:08:48Z")\
**Posts on this page:** 9\
**Page:** 1

<div class="post-metadata">

**Author:** ![aman26ps](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/aman26ps/32/82604_2.png) [@aman26ps](https://discuss.elastic.co/u/aman26ps)\
**Post date:** [July 7, 2020, 7:08pm UTC](https://discuss.elastic.co/t/eck-discovery-gce-plugin-not-working-in-gke-cluster/240209/1 "2020-07-07T19:08:48Z")

</div>

Hi All,

I am trying to install gce discovery plugin in elasticsearch but unable to set the following parameters

```auto
# get the IP address from network interface 1
network.host: _gce:privateIp:1_
# Using GCE internal hostname
network.host: _gce:hostname_
# shortcut for _gce:privateIp:0_ (recommended)
network.host: _gce_

```

I am getting following error when i am giving any of the above config in elastic search.yml

```auto
ig", "node.name": "elasticsearch-config-es-master-0", "message": "uncaught exception in thread [main]",
"stacktrace": ["org.elasticsearch.bootstrap.StartupException: BindTransportException[Failed to resolve host [_gce_]]; nested: IOException[IOException caught when fetching I
netAddress from [network-interfaces/0/ip]]; nested: IOException[failed to fetch metadata from [http://metadata.google.internal/computeMetadata/v1/instance/network-interface
s/0/ip]]; nested: HttpResponseException[404 Not Found",
"Not Found",
"];",
"at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:163) ~[elasticsearch-7.4.0.jar:7.4.0]",
"at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:150) ~[elasticsearch-7.4.0.jar:7.4.0]",
"at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:86) ~[elasticsearch-7.4.0.jar:7.4.0]",
"at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:125) ~[elasticsearch-cli-7.4.0.jar:7.4.0]",
"at org.elasticsearch.cli.Command.main(Command.java:90) ~[elasticsearch-cli-7.4.0.jar:7.4.0]",
"at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:115) ~[elasticsearch-7.4.0.jar:7.4.0]",
"at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:92) ~[elasticsearch-7.4.0.jar:7.4.0]",
"Caused by: org.elasticsearch.transport.BindTransportException: Failed to resolve host [_gce_]",
"at org.elasticsearch.transport.TcpTransport.bindServer(TcpTransport.java:341) ~[elasticsearch-7.4.0.jar:7.4.0]",
"at org.elasticsearch.transport.netty4.Netty4Transport.doStart(Netty4Transport.java:139) ~[?:?]",
"at org.elasticsearch.xpack.core.security.transport.netty4.SecurityNetty4Transport.doStart(SecurityNetty4Transport.java:81) ~[?:?]",
"at org.elasticsearch.xpack.security.transport.netty4.SecurityNetty4ServerTransport.doStart(SecurityNetty4ServerTransport.java:43) ~[?:?]",
"at org.elasticsearch.common.component.AbstractLifecycleComponent.start(AbstractLifecycleComponent.java:59) ~[elasticsearch-7.4.0.jar:7.4.0]",
"at org.elasticsearch.transport.TransportService.doStart(TransportService.java:230) ~[elasticsearch-7.4.0.jar:7.4.0]",
"at org.elasticsearch.common.component.AbstractLifecycleComponent.start(AbstractLifecycleComponent.java:59) ~[elasticsearch-7.4.0.jar:7.4.0]",
"at org.elasticsearch.node.Node.start(Node.java:695) ~[elasticsearch-7.4.0.jar:7.4.0]",
"at org.elasticsearch.bootstrap.Bootstrap.start(Bootstrap.java:273) ~[elasticsearch-7.4.0.jar:7.4.0]",
"at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:358) ~[elasticsearch-7.4.0.jar:7.4.0]",
"at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:159) ~[elasticsearch-7.4.0.jar:7.4.0]",
"... 6 more",

```

My elasticsearch.yaml seems to be picking up discoverygce setting for my projects and zone, but unable to pickup any of the network.host properties

```auto
cloud:
  gce:
    project_id: <PROJECT-ID>
    zone:
    - us-east4-a
    - us-east4-b
    - us-east4-c
cluster:
  name: elasticsearch-config
discovery:
  seed_providers: gce
http:
  compression: true
  compression_level: 9
network:
  host: 0.0.0.0
  publish_host: ${POD_IP}

```

Am i missing something, this cluster is on GKE.

---

<div class="post-metadata">

**Author:** ![sebgl](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/sebgl/32/48702_2.png) [@sebgl](https://discuss.elastic.co/u/sebgl)\
**Post date:** [July 8, 2020, 7:53am UTC](https://discuss.elastic.co/t/eck-discovery-gce-plugin-not-working-in-gke-cluster/240209/2 "2020-07-08T07:53:54Z")

</div>

Hey @aman26ps, is there a particular reason why you want to setup the gce discovery plugin? Everything should just work out of the box on GKE, you shouldn't have to setup any discovery plugin.

---

<div class="post-metadata">

**Author:** ![aman26ps](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/aman26ps/32/82604_2.png) [@aman26ps](https://discuss.elastic.co/u/aman26ps)\
**Post date:** [July 8, 2020, 8:31am UTC](https://discuss.elastic.co/t/eck-discovery-gce-plugin-not-working-in-gke-cluster/240209/3 "2020-07-08T08:31:36Z")

</div>

Hey sebgl, i want to use the host network for my es pods, by default my pod will be spunned up using pod network, i would like to use host interface of whichever node it chooses to spun up on.

---

<div class="post-metadata">

**Author:** ![sebgl](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/sebgl/32/48702_2.png) [@sebgl](https://discuss.elastic.co/u/sebgl)\
**Post date:** [July 8, 2020, 9:26am UTC](https://discuss.elastic.co/t/eck-discovery-gce-plugin-not-working-in-gke-cluster/240209/4 "2020-07-08T09:26:15Z")

</div>

Can you share your entire elasticsearch yaml spec, and the entire resulting elasticsearch.yaml configuration file?

---

<div class="post-metadata">

**Author:** ![aman26ps](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/aman26ps/32/82604_2.png) [@aman26ps](https://discuss.elastic.co/u/aman26ps)\
**Post date:** [July 8, 2020, 9:45am UTC](https://discuss.elastic.co/t/eck-discovery-gce-plugin-not-working-in-gke-cluster/240209/5 "2020-07-08T09:45:50Z")

</div>

Sure @sebgl

Please find my elastic-cr spec:

```auto
 #spec:
      #minAvailable: 2
      #selector:
        #matchLabels:
          #elasticsearch.k8s.elastic.co/cluster-name: elasticsearch-config
      config:
        # most Elasticsearch configuration parameters are possible to set, e.g: node.attr.attr_name: attr_value
        node.master: true
        node.data: false
        node.ingest: false
        node.ml: true
        # Uncomment this parameter you can specify which topology you will like to choose , hot-warm
        #node.attr.data: hot
        # this allows ES to run on nodes even if their vm.max_map_count has not been increased, at a performance cost
        node.store.allow_mmap: false
        # Uncomment these two parameters if you wish to specify which zone es node should run in
        #node.attr.zone: europe-west3-a
        #cluster.routing.allocation.awareness.attributes: zone
        # for release 7.4.0 and 7.6.0 uncomment following line for filerealm config
        xpack.security.authc.realms.file.file1.order: 0
        # for release 6.8.8 uncomment following line for filerealm config
        #xpack.security.authc.realms.file1.type: file
        #xpack.security.authc.realms.file1.order: 0
        http.compression: true
        http.compression_level: 9
        cloud:
          gce:
              project_id: <project-id>
              zone: ["us-east4-a", "us-east4-b", "us-east4-c"]
        discovery:
              seed_providers: gce
        # get the IP address from network interface 1
        #network.host: _gce:privateIp:1_
        # # Using GCE internal hostname
        network.host: _gce:hostname_
        # # shortcut for _gce:privateIp:0_ (recommended)
        #network.host: _gce_

```

the elasticsearch.yml inside pod:

```auto
cloud:
  gce:
    project_id: <project-id>
    zone:
    - us-east4-a
    - us-east4-b
    - us-east4-c
cluster:
  name: elasticsearch-config
discovery:
  seed_providers: gce
http:
  compression: true
  compression_level: 9
network:
  host: 0.0.0.0
  publish_host: ${POD_IP}
node:
  data: true
  ingest: true
  master: false
  name: ${POD_NAME}
  store:
    allow_mmap: false
path:
  data: /usr/share/elasticsearch/data
  logs: /usr/share/elasticsearch/logs
xpack:
  security:
    authc:
      realms:
        file:
          file1:
            order: 0
        native:
          native1:
            order: -99
      reserved_realm:
        enabled: "false"
    enabled: "true"

```

---

<div class="post-metadata">

**Author:** ![aman26ps](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/aman26ps/32/82604_2.png) [@aman26ps](https://discuss.elastic.co/u/aman26ps)\
**Post date:** [July 9, 2020, 5:39am UTC](https://discuss.elastic.co/t/eck-discovery-gce-plugin-not-working-in-gke-cluster/240209/6 "2020-07-09T05:39:41Z")

</div>

Use case to use discovery-gce plugin on gke = We are looking for running some of ES data nodes on host network (Pod needs to have host IP )so that we can join them to a running ES cluster to migrate ES VM to VM on GKE.

---

<div class="post-metadata">

**Author:** ![sebgl](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/sebgl/32/48702_2.png) [@sebgl](https://discuss.elastic.co/u/sebgl)\
**Post date:** [July 15, 2020, 10:06am UTC](https://discuss.elastic.co/t/eck-discovery-gce-plugin-not-working-in-gke-cluster/240209/7 "2020-07-15T10:06:09Z")

</div>

Looks like another issue has been created for this: [ECK - can we run ECK operator in privileged mode](https://discuss.elastic.co/t/eck-can-we-run-eck-operator-in-privileged-mode/240474/2).

---

<div class="post-metadata">

**Author:** ![aman26ps](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/aman26ps/32/82604_2.png) [@aman26ps](https://discuss.elastic.co/u/aman26ps)\
**Post date:** [July 15, 2020, 10:48am UTC](https://discuss.elastic.co/t/eck-discovery-gce-plugin-not-working-in-gke-cluster/240209/8 "2020-07-15T10:48:45Z")

</div>

yes @sebgl for time being we have decided to drop this requirement because as we do more research on this topic we find that the discovery-gce is not really meant for GKE where networking is managed by google, thanks for your help

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [November 4, 2022, 8:05am UTC](https://discuss.elastic.co/t/eck-discovery-gce-plugin-not-working-in-gke-cluster/240209/9 "2022-11-04T08:05:22Z")

</div>