# High Availability of Kibana running on k8s

**URL:** https://discuss.elastic.co/t/high-availability-of-kibana-running-on-k8s/317147
**Category:** Elastic Cloud on Kubernetes (ECK)
**Created:** [October 20, 2022, 5:43pm UTC](https://discuss.elastic.co/t/high-availability-of-kibana-running-on-k8s/317147 "2022-10-20T17:43:54Z")
**Posts on this page:** 5
**Page:** 1

<div class="post-metadata">

### Author: ![Nikita\_Ivankov](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/nikita_ivankov/32/112345_2.png) [@Nikita\_Ivankov](https://discuss.elastic.co/u/Nikita_Ivankov)
#### Post date: [October 20, 2022, 5:43pm UTC](https://discuss.elastic.co/t/high-availability-of-kibana-running-on-k8s/317147/1 "2022-10-20T17:43:54Z")

</div>

Hi,

we are running an EFK stack on top of k8s clusters in AWS. To deploy both elastic and kibana we use Kubernetes operator

> **[cloud-on-k8s/deploy/eck-operator at main · elastic/cloud-on-k8s](https://github.com/elastic/cloud-on-k8s/tree/main/deploy/eck-operator)**
>
> main/deploy/eck-operator

The installation contains several elasticsearch pods, but one kibana pod. The kibana is exposed to the outside via k8s ingress. The ingress is exposed over AWS NLB which does the TLS termination.

Since we are using the EC2 spot instance type, the node running kibana comes back to the market from time to time, and sometimes a new kibana is not created while the old one is already terminated, so the kibana becomes unavailable for a while.

That's not critical but creates some bad user experience working with kibana and we want to fix that. A possible solution would be to increase the number of kibana pods from 1 to 2...

I was looking into documentation and found the documentation on how to run kibana in production

> **[Use Kibana in a production environment | Kibana Guide \[7.17\] | Elastic](https://www.elastic.co/guide/en/kibana/7.17/production.html)**
>
> Consider the production components that are used to generate reports.

It indicates that to spread the load across multiple kibana instances we need to modify the configuration and make some settings unique and some similar. I think we will figure out how to update that configuration over the kibana operator, but for me, some settings do not make any sense, for example, what is the reason to use uniq `server.port` parameter? So it seems to be the documentation unrelated to k8s and intended more for another installation...

Does anyone has any experience setting up multiple Kibana pods for such HA? Have you had any issue with that approach?

k8s version is 1.21  
elastic/kibana - 7.16.1

Many thanks in adavance

---

<div class="post-metadata">

### Author: ![michael.morello](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/michael.morello/32/47448_2.png) [@michael.morello](https://discuss.elastic.co/u/michael.morello)
#### Post date: [October 26, 2022, 11:19am UTC](https://discuss.elastic.co/t/high-availability-of-kibana-running-on-k8s/317147/2 "2022-10-26T11:19:23Z")

</div>

Hi,

The Kibana Guide may not always be relevant in the context of ECK. When scaling out Kibana using ECK you don't need to care about the "unique settings" mentioned in this guide.

The following settings will be automatically set by the operator:

- xpack.security.encryptionKey
- xpack.reporting.encryptionKey
- xpack.encryptedSavedObjects.encryptionKey

You can still override them using [secure settings](https://www.elastic.co/guide/en/cloud-on-k8s/current/k8s-kibana-secure-settings.html). They will be automatically shared by the Kibana instances.

Hope it helps.

---

<div class="post-metadata">

### Author: ![michael.morello](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/michael.morello/32/47448_2.png) [@michael.morello](https://discuss.elastic.co/u/michael.morello)
#### Post date: [October 26, 2022, 11:31am UTC](https://discuss.elastic.co/t/high-availability-of-kibana-running-on-k8s/317147/3 "2022-10-26T11:31:20Z")

</div>

I created [Update the list of Kibana keys managed by the operator by barkbay · Pull Request #6119 · elastic/cloud-on-k8s · GitHub](https://github.com/elastic/cloud-on-k8s/pull/6119) to update the ECK documentation as only `xpack.security.encryptionKey` was mentioned.

---

<div class="post-metadata">

### Author: ![Nikita\_Ivankov](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/nikita_ivankov/32/112345_2.png) [@Nikita\_Ivankov](https://discuss.elastic.co/u/Nikita_Ivankov)
#### Post date: [November 8, 2022, 6:40am UTC](https://discuss.elastic.co/t/high-availability-of-kibana-running-on-k8s/317147/4 "2022-11-08T06:40:10Z")

</div>

Thanks a lot Michael

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [December 6, 2022, 6:40am UTC](https://discuss.elastic.co/t/high-availability-of-kibana-running-on-k8s/317147/5 "2022-12-06T06:40:19Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
