# Unable to retrieve version information from Elasticsearch nodes

**URL:** https://discuss.elastic.co/t/unable-to-retrieve-version-information-from-elasticsearch-nodes/319776
**Category:** Kibana
**Created:** [November 24, 2022, 11:05pm UTC](https://discuss.elastic.co/t/unable-to-retrieve-version-information-from-elasticsearch-nodes/319776 "2022-11-24T23:05:09Z")
**Posts on this page:** 11
**Page:** 1

<div class="post-metadata">

### Author: ![Dmitriy\_Esin](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dmitriy_esin/32/95725_2.png) [@Dmitriy\_Esin](https://discuss.elastic.co/u/Dmitriy_Esin)
#### Post date: [November 24, 2022, 11:05pm UTC](https://discuss.elastic.co/t/unable-to-retrieve-version-information-from-elasticsearch-nodes/319776/1 "2022-11-24T23:05:09Z")

</div>

Hi!  
I trying to install EFK stack into my k8s GCP cluster.  
I use official helm charts from _[https://helm.elastic.co](https://helm.elastic.co)_: **elasticsearch and kibana**  
I use automatically generated certificates and credentials on deployment startup.  
I tried to use custom certs generated by Issuer, the manual is [here](https://www.elastic.co/guide/en/cloud-on-k8s/master/k8s-custom-http-certificate.html)  
Here is my Issuer and Certificate config (I don't use it now):

```auto
---
apiVersion: cert-manager.io/v1
kind: Issuer
metadata:
  name: selfsigned-issuer
  namespace: elasticsearch
spec:
  selfSigned: {}
---
apiVersion: cert-manager.io/v1
kind: Certificate
metadata:
  name: elasticsearch-master-certs
  namespace: elasticsearch
spec:
  isCA: true
  dnsNames:
    - elasticsearch-master
    - elasticsearch-master:9200
    - elasticsearch-master.elasticsearch
    - elasticsearch-master.elasticsearch:9200
    - elasticsearch-master.elasticsearch.svc
    - elasticsearch-master.elasticsearch.svc:9200
    - elasticsearch-master.elasticsearch.svc.cluster.local
    - elasticsearch-master.elasticsearch.svc.cluster.local:9200
  issuerRef:
    kind: Issuer
    name: selfsigned-issuer
  secretName: elasticsearch-master-certs
  subject:
    organizations:
      - org

```

Here is my values files:

```auto
elasticsearch:
  
  # createCert: false

  esConfig:
    elasticsearch.yml: |
      xpack.security.enabled: true
      xpack.security.transport.ssl.enabled: true
      xpack.security.http.ssl.enabled: true
      xpack.security.transport.ssl.verification_mode: "certificate"
      xpack.security.transport.ssl.key: "/usr/share/elasticsearch/config/certs/tls.key"
      xpack.security.transport.ssl.certificate: "/usr/share/elasticsearch/config/certs/tls.crt"
      xpack.security.transport.ssl.certificate_authorities: "/usr/share/elasticsearch/config/certs/ca.crt"
      xpack.security.http.ssl.key: "/usr/share/elasticsearch/config/certs/tls.key"
      xpack.security.http.ssl.certificate: "/usr/share/elasticsearch/config/certs/tls.crt"
      xpack.security.http.ssl.certificate_authorities: "/usr/share/elasticsearch/config/certs/ca.crt"
  
  # secretMounts:
  # - name: elasticsearch-master-certs
  # secretName: elasticsearch-master-certs
  # path: /usr/share/elasticsearch/config/certs
  # defaultMode: 0755

  volumeClaimTemplate:
    accessModes: ["ReadWriteOnce"]
    resources:
      requests:
        storage: 2Ti

  resources:
    requests:
      cpu: "1000m"
      memory: "8Gi"
    limits:
      cpu: "1000m"
      memory: "16Gi"
  
  service:
    enabled: true
    annotations:
      cloud.google.com/load-balancer-type: "Internal"
    type: LoadBalancer
    loadBalancerIP: ***

  affinity:
    nodeAntiAffinity:
      requiredDuringSchedulingIgnoredDuringExecution:
        nodeSelectorTerms:
        - matchExpressions:
            - key: cloud.google.com/gke-nodepool
              operator: In
              values:
              - elasticsearch-master
  tolerations:
    - key: app
      operator: Equal
      value: elasticsearch
      effect: NoSchedule

```

```auto
kibana:
  elasticsearchHosts: https://elasticsearch-master.elasticsearch.svc:9200
  
  kibanaConfig:
    kibana.yml: |
      server.publicBaseUrl: https://kibana. ***.**

  secretMounts:
   - name: elasticsearch-master-certs
     secretName: elasticsearch-master-certs
     path: /usr/share/elasticsearch/config/certs
     defaultMode: 0755
  
  tolerations:
    - key: app
      operator: Equal
      value: elasticsearch
      effect: NoSchedule

  ingress:
    enabled: true
    className: "nginx"
    pathtype: ImplementationSpecific
    annotations:
      cert-manager.io/cluster-issuer: cf-issuer
    hosts:
      - host: kibana. ***.**
        paths:
          - path: /
    tls:
     - secretName: kibana-tls
       hosts:
         - kibana. ***.**

```

when I open URLs I get:

 ![Screenshot 2022-11-25 at 01.38.29](https://us1.discourse-cdn.com/elastic/original/3X/c/d/cdfc989e28da28b9c7b5f6a4f29ddaf633fa3c07.png)  
 ![Screenshot 2022-11-25 at 01.38.13](https://us1.discourse-cdn.com/elastic/original/3X/7/d/7d68c95703e8f4d6622583412d63153f9bf46e4b.png)

Seems like all stuff works well but Kibana says in log this:  
_Unable to retrieve version information from Elasticsearch nodes. unable to verify the first certificate_  
And shows that it is not ready.

Also I noticed, that elastic generates new certificates every couple minutes (may be every 5-10-15 mins). It is problem for me because I installed elastic and kibana to different namespaces. I don't know is it expected and normal behavior?

I believe I mentioned all. Appreciate your help.

---

<div class="post-metadata">

### Author: ![Dmitriy\_Esin](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dmitriy_esin/32/95725_2.png) [@Dmitriy\_Esin](https://discuss.elastic.co/u/Dmitriy_Esin)
#### Post date: [November 24, 2022, 11:06pm UTC](https://discuss.elastic.co/t/unable-to-retrieve-version-information-from-elasticsearch-nodes/319776/2 "2022-11-24T23:06:43Z")

</div>

it is damn magic  
all fixed itself while I was writing this message.  
my configs the same, don't know what it was.

---

<div class="post-metadata">

### Author: ![Dmitriy\_Esin](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dmitriy_esin/32/95725_2.png) [@Dmitriy\_Esin](https://discuss.elastic.co/u/Dmitriy_Esin)
#### Post date: [November 24, 2022, 11:44pm UTC](https://discuss.elastic.co/t/unable-to-retrieve-version-information-from-elasticsearch-nodes/319776/3 "2022-11-24T23:44:21Z")

</div>

now I get this:

 ![Screenshot 2022-11-25 at 02.44.09](https://us1.discourse-cdn.com/elastic/original/3X/7/9/79d7fdcf51ff459dd52d300be9bdf8766aa7af7e.png)

---

<div class="post-metadata">

### Author: ![Dmitriy\_Esin](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dmitriy_esin/32/95725_2.png) [@Dmitriy\_Esin](https://discuss.elastic.co/u/Dmitriy_Esin)
#### Post date: [November 25, 2022, 12:02am UTC](https://discuss.elastic.co/t/unable-to-retrieve-version-information-from-elasticsearch-nodes/319776/4 "2022-11-25T00:02:43Z")

</div>

Kibana says this

 ![Screenshot 2022-11-25 at 03.02.17](https://us1.discourse-cdn.com/elastic/original/3X/4/6/4636b0747a96cf0e5add31571f43de3967af2b91.png)

---

<div class="post-metadata">

### Author: ![Dzmitry](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dzmitry/32/65026_2.png) [@Dzmitry](https://discuss.elastic.co/u/Dzmitry)
#### Post date: [November 25, 2022, 1:40pm UTC](https://discuss.elastic.co/t/unable-to-retrieve-version-information-from-elasticsearch-nodes/319776/5 "2022-11-25T13:40:53Z")

</div>

Hey @Dmitriy_Esin ,

Probably something wrong with certificates configuration, I suggest checking [docs](https://www.elastic.co/guide/en/elasticsearch/reference/7.15/security-basic-setup-https.html#encrypt-kibana-elasticsearch) and this post has a similar issue [Kibana not connecting to Elasticsearch when providing external Certificate](https://discuss.elastic.co/t/kibana-not-connecting-to-elasticsearch-when-providing-external-certificate/290511)

Regards, Dima

---

<div class="post-metadata">

### Author: ![Dmitriy\_Esin](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dmitriy_esin/32/95725_2.png) [@Dmitriy\_Esin](https://discuss.elastic.co/u/Dmitriy_Esin)
#### Post date: [November 25, 2022, 4:06pm UTC](https://discuss.elastic.co/t/unable-to-retrieve-version-information-from-elasticsearch-nodes/319776/6 "2022-11-25T16:06:21Z")

</div>

Hi!  
Thank you for your answer!  
I fixed it tonight 😅 and forgot to close the topic  
I changed back configuration to self signed certs and tuned xpack.security configs  
Now all works well!  
thank you!

---

<div class="post-metadata">

### Author: ![Dmitriy\_Esin](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dmitriy_esin/32/95725_2.png) [@Dmitriy\_Esin](https://discuss.elastic.co/u/Dmitriy_Esin)
#### Post date: [November 25, 2022, 4:08pm UTC](https://discuss.elastic.co/t/unable-to-retrieve-version-information-from-elasticsearch-nodes/319776/7 "2022-11-25T16:08:47Z")

</div>

If someone need manifests:

```auto
elasticsearch:

  roles:
    - master
    - data
    - ingest
    - transform

  createCert: false

  esConfig:
    elasticsearch.yml: |
      xpack.security.enabled: true
      path.data: /usr/share/elasticsearch/data
      xpack.security.transport.ssl.enabled: true
      xpack.security.transport.ssl.verification_mode: "certificate"
      xpack.security.transport.ssl.client_authentication: required
      xpack.security.http.ssl.enabled: true
      xpack.security.transport.ssl.key: "/usr/share/elasticsearch/config/certs/tls.key"
      xpack.security.transport.ssl.certificate: "/usr/share/elasticsearch/config/certs/tls.crt"
      xpack.security.transport.ssl.certificate_authorities: "/usr/share/elasticsearch/config/certs/ca.crt"
      xpack.security.http.ssl.key: "/usr/share/elasticsearch/config/certs/tls.key"
      xpack.security.http.ssl.certificate: "/usr/share/elasticsearch/config/certs/tls.crt"
      xpack.security.http.ssl.certificate_authorities: "/usr/share/elasticsearch/config/certs/ca.crt"
  
  secretMounts:
   - name: elasticsearch-master-certs
     secretName: elasticsearch-master-certs
     path: /usr/share/elasticsearch/config/certs
     defaultMode: 0755

  volumeClaimTemplate:
    accessModes: ["ReadWriteOnce"]
    resources:
      requests:
        storage: 2Ti

  resources:
    requests:
      cpu: "1000m"
      memory: "8Gi"
    limits:
      cpu: "1000m"
      memory: "16Gi"
  
  service:
    enabled: true
    annotations:
      cloud.google.com/load-balancer-type: "Internal"
    type: LoadBalancer
    loadBalancerIP: ***

  affinity:
    nodeAntiAffinity:
      requiredDuringSchedulingIgnoredDuringExecution:
        nodeSelectorTerms:
        - matchExpressions:
            - key: cloud.google.com/gke-nodepool
              operator: In
              values:
              - elasticsearch-master
  tolerations:
    - key: app
      operator: Equal
      value: elasticsearch
      effect: NoSchedule

kibana:
  elasticsearchHosts: https://elasticsearch-master.elasticsearch.svc:9200
  elasticsearch.ssl.certificateAuthorities: ["/usr/share/elasticsearch/config/certs/ca.crt"]
  server.ssl.certificate: "/usr/share/elasticsearch/config/certs/tls.crt"
  server.ssl.key: "/usr/share/elasticsearch/config/certs/tls.key"
  server.ssl.enabled: true

  kibanaConfig:
    kibana.yml: |
      server.publicBaseUrl: https://kibana. ***.**

  secretMounts:
   - name: elasticsearch-master-certs
     secretName: elasticsearch-master-certs
     path: /usr/share/elasticsearch/config/certs
     defaultMode: 0755
  
  tolerations:
    - key: app
      operator: Equal
      value: elasticsearch
      effect: NoSchedule

  ingress:
    enabled: true
    className: "nginx"
    pathtype: ImplementationSpecific
    annotations:
      cert-manager.io/cluster-issuer: cf-issuer
    hosts:
      - host: kibana. ***.**
        paths:
          - path: /
    tls:
     - secretName: kibana-tls
       hosts:
         - kibana. ***.**

```

---

<div class="post-metadata">

### Author: ![Dmitriy\_Esin](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dmitriy_esin/32/95725_2.png) [@Dmitriy\_Esin](https://discuss.elastic.co/u/Dmitriy_Esin)
#### Post date: [November 25, 2022, 4:11pm UTC](https://discuss.elastic.co/t/unable-to-retrieve-version-information-from-elasticsearch-nodes/319776/8 "2022-11-25T16:11:18Z")

</div>

Maybe you have any thoughts about this  
I try to configure snapshots to google-storage  
I use secret as keystore with json creds:

```auto
  keystore:
    - secretName: elasticsearch-keystore

```

But elastic says:  
`Cannot mount elasticsearch keystore in pod, device busy`

---

<div class="post-metadata">

### Author: ![Dzmitry](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dzmitry/32/65026_2.png) [@Dzmitry](https://discuss.elastic.co/u/Dzmitry)
#### Post date: [November 25, 2022, 4:19pm UTC](https://discuss.elastic.co/t/unable-to-retrieve-version-information-from-elasticsearch-nodes/319776/9 "2022-11-25T16:19:16Z")

</div>

ok, one problem less 🙂

> [@Dmitriy\_Esin](#):
>
> `Cannot mount elasticsearch keystore in pod, device busy`

I can only point to the helm charts [issue](https://github.com/elastic/helm-charts/issues/90), that might give you some ideas to check.

Maybe change the topic headline to better describe the issue, it might help to get more folks from community.

Regards, Dima

---

<div class="post-metadata">

### Author: ![Dmitriy\_Esin](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dmitriy_esin/32/95725_2.png) [@Dmitriy\_Esin](https://discuss.elastic.co/u/Dmitriy_Esin)
#### Post date: [November 25, 2022, 4:21pm UTC](https://discuss.elastic.co/t/unable-to-retrieve-version-information-from-elasticsearch-nodes/319776/10 "2022-11-25T16:21:01Z")

</div>

thanks!  
will try to fix 🙂

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [December 23, 2022, 4:21pm UTC](https://discuss.elastic.co/t/unable-to-retrieve-version-information-from-elasticsearch-nodes/319776/11 "2022-12-23T16:21:42Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
