Update elasticsearch.yml in elastic cloud through API

[idelix]

Hello,

I deployed Elastic Cloud in Azure using terraform provider hovewer I cannot use terraform to update elasticsearch.yml (below) since OpenID configuration (Secure your clusters with OpenID Connect | Elasticsearch Service Documentation | Elastic) requires keystore secret to be added first otherwise setting change fails.

 config {
   user_settings_yaml = data.template_file.elasticsearch_settings.rendered
 }

So I need to update elasticsearch.yml after cluster is created and currently I couldn't find way to do it.

I know I can see API version of my deployment and I saw how you can for example add Kibana through API Create a first deployment: Just an Elasticsearch cluster | Elastic Cloud Enterprise Reference [2.10] | Elastic but I cannot find any example of adding settings.

Guess I could obtain deployment as json then parse it and try to add user settings but thought there must be easier way

[Alex_Piggott]

This is indeed a rough area of our Terraform implementation

Currently Terraform cannot support Keystore insertion (and our API does not support Keystore insertion on creation, only on update)

Therefore the steps are:

• Create the cluster with a terraform config with no OIDC YAML settings
• Add the OIDC keystore entries via the UI or API (or ecctl command line) ... eg Add or remove settings from the cluster keystore | Elastic Cloud Enterprise Reference [2.10] | Elastic for raw API, or ecctl deployment elasticsearch keystore | Elastic Cloud Control Documentation [1.4] | Elastic for CLI
• Update the terraform config with the OIDC YAML settings

We are aware this isn't an ideal experience for a fairly common operation, and are actively discussing how future versions can improve on this

Alex

[idelix]

Thanks for information the problem is it is not possible to change configuration inside terraform without code change and pushing this change to repository.

Ideally I would just update config through API after terraform finished deploying cluster and also after I already added secret using API.

I found this instruction of how to upgrade deployment Applying a new deployment configuration: Upgrade | Elastic Cloud Enterprise Reference [2.10] | Elastic but I only need to update config so wonder if you have some example of how this can be acomplished.

[idelix]

Actually I think it will be fine I can add settings using dynamic block in terraform and just run terraform twice with diff parameters second after I added keystore secret

    dynamic "config" {
      for_each = var.enable_elasticsearch_config ? [1] : []
      content {
        user_settings_yaml = data.template_file.elasticsearch_settings.rendered
      }
    }
  }