# Elastic Orchestration **URL:** https://discuss.elastic.co/c/orchestration/85.md?page=21 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 22 --- ## [Elasticsearch failing. Missing Shard. .kibana\_task\_manager\_7.15.0\_001](https://discuss.elastic.co/t/elasticsearch-failing-missing-shard-kibana-task-manager-7-15-0-001/286106)
**Author:** [@WookWook](https://discuss.elastic.co/u/WookWook)\ **Replies:** 3\ **Last updated:** [October 20, 2021, 12:00pm UTC](https://discuss.elastic.co/t/elasticsearch-failing-missing-shard-kibana-task-manager-7-15-0-001/286106 "2021-10-20T12:00:37Z")
Hi, currently I have a lot of trouble to keep the ELK alive. First it failed after 11 days. Then I redeployed everything because of no important production data. Now it failed with the same errors after 2 days. I am us… --- ## [Cannot disable TLS and security in EKS](https://discuss.elastic.co/t/cannot-disable-tls-and-security-in-eks/222335)
**Author:** [@yannalbou](https://discuss.elastic.co/u/yannalbou)\ **Replies:** 11\ **Last updated:** [October 20, 2021, 8:16am UTC](https://discuss.elastic.co/t/cannot-disable-tls-and-security-in-eks/222335 "2021-10-20T08:16:16Z")
Hello, I Installed ECK open source 1.0.1 in k8s 1.15.5 I tried to disable the security and TLS using: apiVersion: elasticsearch.k8s.elastic.co/v1 kind: Elasticsearch metadata: name: elasticsearch spec: … --- ## [ECK cluster always on MigratingData status](https://discuss.elastic.co/t/eck-cluster-always-on-migratingdata-status/286941)
**Author:** [@chenyg0911](https://discuss.elastic.co/u/chenyg0911)\ **Replies:** 1\ **Last updated:** [October 19, 2021, 7:59pm UTC](https://discuss.elastic.co/t/eck-cluster-always-on-migratingdata-status/286941 "2021-10-19T19:59:36Z")
eck: v1.8. kubernetes: v1.20.7 kubectl get es: NAME HEALTH NODES VERSION PHASE AGE es-v7132 yellow 4 7.13.2 MigratingData 83d GET \_cat/health?v epoch timestamp cluster st… --- ## [Beats can't reach Elastic Service](https://discuss.elastic.co/t/beats-cant-reach-elastic-service/286851)
**Author:** [@\_bugc4t](https://discuss.elastic.co/u/_bugc4t)\ **Replies:** 2\ **Last updated:** [October 18, 2021, 12:54pm UTC](https://discuss.elastic.co/t/beats-cant-reach-elastic-service/286851 "2021-10-18T12:54:02Z")
I've been running my ECK (elastic cloud on kubernetes) cluster for a couple of weeks with no issues. However, 3 days ago filebeat stopped being able to connect to my ES service. All pods are up and running (Elastic, Beat… --- ## [Filebeat installed as Daemon Set in IBM Private Cloud Kubernetes Cluster don't send logs to Elastic Cloud instance](https://discuss.elastic.co/t/filebeat-installed-as-daemon-set-in-ibm-private-cloud-kubernetes-cluster-dont-send-logs-to-elastic-cloud-instance/184406)
**Author:** [@l.rava](https://discuss.elastic.co/u/l.rava)\ **Replies:** 4\ **Last updated:** [October 15, 2021, 1:31pm UTC](https://discuss.elastic.co/t/filebeat-installed-as-daemon-set-in-ibm-private-cloud-kubernetes-cluster-dont-send-logs-to-elastic-cloud-instance/184406 "2021-10-15T13:31:20Z")
Hi I installed as Daemon Set metricBeat and fileBeat into my infrastracture: IBM Private Cloud kubernetes cluster - 2 nodes - v.1.13 following this guide. MetricBeat send data without problem. Filebeat don't send da… --- ## [Kibana: Readiness probe failed: HTTP probe failed with statuscode: 503](https://discuss.elastic.co/t/kibana-readiness-probe-failed-http-probe-failed-with-statuscode-503/286493)
**Author:** [@purushothamkdr143](https://discuss.elastic.co/u/purushothamkdr143)\ **Replies:** 1\ **Last updated:** [October 13, 2021, 5:19am UTC](https://discuss.elastic.co/t/kibana-readiness-probe-failed-http-probe-failed-with-statuscode-503/286493 "2021-10-13T05:19:29Z")
Hi All, I have created Elasticsearch/kibana using eck operator. Although kibana pod is running, I see that readiness probe is failed i.e Readiness probe failed: HTTP probe failed with statuscode: 503. What could be reas… --- ## [Possible values for "Phase" field for elasticSearch resource](https://discuss.elastic.co/t/possible-values-for-phase-field-for-elasticsearch-resource/286455)
**Author:** [@x00m](https://discuss.elastic.co/u/x00m)\ **Replies:** 1\ **Last updated:** [October 13, 2021, 5:01am UTC](https://discuss.elastic.co/t/possible-values-for-phase-field-for-elasticsearch-resource/286455 "2021-10-13T05:01:21Z")
After an Elasticsearch instance is created, I do a kubectl get Elasticsearch to get the status and I get the following output: NAME HEALTH NODES VERSION PHASE AGE quickstart green 3 7.11.2 Ready… --- ## [ECK Expose Kibana Service](https://discuss.elastic.co/t/eck-expose-kibana-service/286215)
**Author:** [@Adriann](https://discuss.elastic.co/u/Adriann)\ **Replies:** 2\ **Last updated:** [October 12, 2021, 1:32pm UTC](https://discuss.elastic.co/t/eck-expose-kibana-service/286215 "2021-10-12T13:32:24Z")
Hello, I am building ELK Stack solutions using ECK and minikube. The working solution will be uploaded to GCK. I am able to connect to kibana after I do this command from documentation kubectl port-forward service/quic… --- ## [ECK follows CIS benchmark? If so can you please point me to those resource](https://discuss.elastic.co/t/eck-follows-cis-benchmark-if-so-can-you-please-point-me-to-those-resource/285965)
**Author:** [@vinodhreddyg](https://discuss.elastic.co/u/vinodhreddyg)\ **Replies:** 1\ **Last updated:** [October 6, 2021, 7:45am UTC](https://discuss.elastic.co/t/eck-follows-cis-benchmark-if-so-can-you-please-point-me-to-those-resource/285965 "2021-10-06T07:45:14Z")
Hi Team, Can you please point to the ECK CIS benchmark resources? --- ## [ECK Snapshot option outside Kubernetes cluster](https://discuss.elastic.co/t/eck-snapshot-option-outside-kubernetes-cluster/285867)
**Author:** [@surajbisht](https://discuss.elastic.co/u/surajbisht)\ **Replies:** 1\ **Last updated:** [October 5, 2021, 8:06am UTC](https://discuss.elastic.co/t/eck-snapshot-option-outside-kubernetes-cluster/285867 "2021-10-05T08:06:12Z")
Hi, What are the snapshots backup options for ECK/ELK deployed on hosted kubernetes cluster? Is it possible for use external ftp or http server to store snapshots oustide kubernetes cluster? Thanks, Suraj --- ## [Cross Cluster Search feature on free/Basic ECK](https://discuss.elastic.co/t/cross-cluster-search-feature-on-free-basic-eck/285865)
**Author:** [@surajbisht](https://discuss.elastic.co/u/surajbisht)\ **Replies:** 1\ **Last updated:** [October 5, 2021, 3:28am UTC](https://discuss.elastic.co/t/cross-cluster-search-feature-on-free-basic-eck/285865 "2021-10-05T03:28:17Z")
Is Cross Cluster Search feature supported on free/basic ECK version Thanks, Suraj --- ## [Customize Kibana URL and DNS](https://discuss.elastic.co/t/customize-kibana-url-and-dns/284744)
**Author:** [@netjammr](https://discuss.elastic.co/u/netjammr)\ **Replies:** 5\ **Last updated:** [October 4, 2021, 2:47pm UTC](https://discuss.elastic.co/t/customize-kibana-url-and-dns/284744 "2021-10-04T14:47:18Z")
I am looking at options for customizing the Kibana URL for an ECE deployment. As an example, if under Platform \> Settings the "Deployments domain name" is "myece.mydomain.com", I understand that the Kibana URL would be s… --- ## [External provisioner is not creating volume](https://discuss.elastic.co/t/external-provisioner-is-not-creating-volume/285762)
**Author:** [@HoseinGhanbari](https://discuss.elastic.co/u/HoseinGhanbari)\ **Replies:** 4\ **Last updated:** [October 4, 2021, 11:44am UTC](https://discuss.elastic.co/t/external-provisioner-is-not-creating-volume/285762 "2021-10-04T11:44:58Z")
Recently deployed a brand new ECK and Elasticsearch Cluster using the official quickstart guide. but my external provisioner which is a NFS server through custom StorageClass is not creating the volume for Elasticsearch … --- ## [ECK - How to set context path for elasticsearch?](https://discuss.elastic.co/t/eck-how-to-set-context-path-for-elasticsearch/285442)
**Author:** [@x00m](https://discuss.elastic.co/u/x00m)\ **Replies:** 1\ **Last updated:** [October 4, 2021, 8:41am UTC](https://discuss.elastic.co/t/eck-how-to-set-context-path-for-elasticsearch/285442 "2021-10-04T08:41:11Z")
After eck is setup, i can reach an index via http://quickstart-es-http/ How to set a custom context path so that the Elasticsearch is reachable via http://quickstart-es-http/customcontextpath/ ? --- ## [Automatic provisioning (index/pipelin/transform)](https://discuss.elastic.co/t/automatic-provisioning-index-pipelin-transform/285475)
**Author:** [@roll](https://discuss.elastic.co/u/roll)\ **Replies:** 6\ **Last updated:** [September 30, 2021, 3:44pm UTC](https://discuss.elastic.co/t/automatic-provisioning-index-pipelin-transform/285475 "2021-09-30T15:44:53Z")
Hi all, I'm fairly new to Elasticsearch and need help automanizing the deployment. I'm using kafka sink connector to feed the data to Elasticsearch and transform API to prepare data for the client for querying. Elasti… --- ## [Single node consuming more disk space](https://discuss.elastic.co/t/single-node-consuming-more-disk-space/285250)
**Author:** [@purushothamkdr143](https://discuss.elastic.co/u/purushothamkdr143)\ **Replies:** 6\ **Last updated:** [September 29, 2021, 11:24am UTC](https://discuss.elastic.co/t/single-node-consuming-more-disk-space/285250 "2021-09-29T11:24:59Z")
Hi All, I have setup Elasticsearch cluster using eck operator. details as follows. master nodes: 3 data nodes: 9 only single data node is consuming more disk space although it has less number of shards than the other… --- ## [Deploying ECK on AWS EKS with i3 and d2 instances and local volumes](https://discuss.elastic.co/t/deploying-eck-on-aws-eks-with-i3-and-d2-instances-and-local-volumes/235223)
**Author:** [@Chris\_Austin](https://discuss.elastic.co/u/Chris_Austin)\ **Replies:** 6\ **Last updated:** [September 28, 2021, 2:51pm UTC](https://discuss.elastic.co/t/deploying-eck-on-aws-eks-with-i3-and-d2-instances-and-local-volumes/235223 "2021-09-28T14:51:27Z")
I'm attempting to deploy Elasticsearch w/ ECK on EKS with i3 hot nodes and d2 warm nodes, with the EC2 instances created through Terraform as part of an autoscaling group so I can have failover across availability zones.… --- ## [Deploying ECK with Network-attached PersistentVolumes (e.g. AWSElasticBlockStore)](https://discuss.elastic.co/t/deploying-eck-with-network-attached-persistentvolumes-e-g-awselasticblockstore/285353)
**Author:** [@brsolomon](https://discuss.elastic.co/u/brsolomon)\ **Replies:** 3\ **Last updated:** [September 28, 2021, 12:53pm UTC](https://discuss.elastic.co/t/deploying-eck-with-network-attached-persistentvolumes-e-g-awselasticblockstore/285353 "2021-09-28T12:53:39Z")
The ECK docs would greatly benefit from an MCVE on how to deploy ECK with Network-attached PersistentVolumes and a provisioner such as kubernetes.io/aws-ebs. The Best Practices in AWS section suggests using one of Instan… --- ## [ECK Update Secret for Kibana.yml fails](https://discuss.elastic.co/t/eck-update-secret-for-kibana-yml-fails/285082)
**Author:** [@bwheatley](https://discuss.elastic.co/u/bwheatley)\ **Replies:** 2\ **Last updated:** [September 27, 2021, 2:19pm UTC](https://discuss.elastic.co/t/eck-update-secret-for-kibana-yml-fails/285082 "2021-09-27T14:19:35Z")
Good Morning, This is hopefully me being stupid and missing something easy. If someone can point me in the right direction I would appreciate it. I'm trying to update the secret quickstart-kb-config so i can update my … --- ## [Create index template with K8S CRD](https://discuss.elastic.co/t/create-index-template-with-k8s-crd/285143)
**Author:** [@ebuildy](https://discuss.elastic.co/u/ebuildy)\ **Replies:** 4\ **Last updated:** [September 26, 2021, 6:01pm UTC](https://discuss.elastic.co/t/create-index-template-with-k8s-crd/285143 "2021-09-26T18:01:50Z")
Is there a CRD to create an index template? I know rabbitMQ operator allow to declare queue like this: apiVersion: rabbitmq.com/v1beta1 kind: Queue metadata: name: test namespace: rabbitmq-system spec: name: test… --- ## [\[Fleet Agent\] Cannot get kubernetes autodiscovery to work](https://discuss.elastic.co/t/fleet-agent-cannot-get-kubernetes-autodiscovery-to-work/284388)
**Author:** [@ZikPhil](https://discuss.elastic.co/u/ZikPhil)\ **Replies:** 1\ **Last updated:** [September 24, 2021, 6:39am UTC](https://discuss.elastic.co/t/fleet-agent-cannot-get-kubernetes-autodiscovery-to-work/284388 "2021-09-24T06:39:09Z")
Hello, So previously I was running metricbeat, filebeat & heartbeat separately using a different manifest for each. I want to migrate to a single agent instance that would do it all. Here is my config: apiVersion: agen… --- ## [ECK - Fleet Server agent startup failure](https://discuss.elastic.co/t/eck-fleet-server-agent-startup-failure/280573)
**Author:** [@sc75651](https://discuss.elastic.co/u/sc75651)\ **Replies:** 11\ **Last updated:** [September 23, 2021, 6:53pm UTC](https://discuss.elastic.co/t/eck-fleet-server-agent-startup-failure/280573 "2021-09-23T18:53:16Z")
Followed these steps - but I am getting below error during startup Note\* - I am using custom TLS certificates generated using cert-manager - k logs -f fleet-server-agent-6f976f656c-l5vtd cp: cannot stat '/mnt/elastic-i… --- ## [ECK - Alternative secrets storage using CSI Driver for KeyVault in Azure](https://discuss.elastic.co/t/eck-alternative-secrets-storage-using-csi-driver-for-keyvault-in-azure/284294)
**Author:** [@x00m](https://discuss.elastic.co/u/x00m)\ **Replies:** 2\ **Last updated:** [September 23, 2021, 6:18am UTC](https://discuss.elastic.co/t/eck-alternative-secrets-storage-using-csi-driver-for-keyvault-in-azure/284294 "2021-09-23T06:18:01Z")
I have integrated my AKS cluster with Azure Keyvault CSI Driver for secrets storage. Link: GitHub - Azure/secrets-store-csi-driver-provider-azure: Azure Key Vault provider for Secret Store CSI driver allows you to get … --- ## [Index pattern for all ccs deployments](https://discuss.elastic.co/t/index-pattern-for-all-ccs-deployments/284810)
**Author:** [@pbroek](https://discuss.elastic.co/u/pbroek)\ **Replies:** 0\ **Last updated:** [September 22, 2021, 7:14am UTC](https://discuss.elastic.co/t/index-pattern-for-all-ccs-deployments/284810 "2021-09-22T07:14:13Z")
Hi, Within ECE we have multiple deployments. Most of them acting as backend deployments without kibana instances. And one deployment acts as frontend where we use all kibana features. On ECE I setup CCS to all the back… --- ## [ECK operator on OpenShift does not take the created self-signed certificate after updating Elasticsearch instance yaml file](https://discuss.elastic.co/t/eck-operator-on-openshift-does-not-take-the-created-self-signed-certificate-after-updating-elasticsearch-instance-yaml-file/284619)
**Author:** [@Inad.mammdov](https://discuss.elastic.co/u/Inad.mammdov)\ **Replies:** 1\ **Last updated:** [September 22, 2021, 6:33am UTC](https://discuss.elastic.co/t/eck-operator-on-openshift-does-not-take-the-created-self-signed-certificate-after-updating-elasticsearch-instance-yaml-file/284619 "2021-09-22T06:33:17Z")
I have created a self-signed cert on our side, created the secret form the certs and added under spec: http: tls: certificate, but operator does not update the pod, so that elastic pod runs its own cert. Could you please… --- ## [Load Balancing and ECE](https://discuss.elastic.co/t/load-balancing-and-ece/283691)
**Author:** [@netjammr](https://discuss.elastic.co/u/netjammr)\ **Replies:** 4\ **Last updated:** [September 21, 2021, 3:50am UTC](https://discuss.elastic.co/t/load-balancing-and-ece/283691 "2021-09-21T03:50:32Z")
Hello, I've reviewed the ECE installation documentation and while it is clear that load balancing is recommended/required for traffic to the deployment endpoints (via the proxies) is load balancing required or recommend… --- ## [CloudUI vs ECE API URL](https://discuss.elastic.co/t/cloudui-vs-ece-api-url/283690)
**Author:** [@netjammr](https://discuss.elastic.co/u/netjammr)\ **Replies:** 2\ **Last updated:** [September 20, 2021, 3:04pm UTC](https://discuss.elastic.co/t/cloudui-vs-ece-api-url/283690 "2021-09-20T15:04:20Z")
Hello, Can someone please explain the difference between the CloudUI and ECE API URL. Does a change to the ECE API URL also change the URL used to connect the CloudUI? Thank you. --- ## [ECE Control planes node all containers down](https://discuss.elastic.co/t/ece-control-planes-node-all-containers-down/284179)
**Author:** [@Icaka](https://discuss.elastic.co/u/Icaka)\ **Replies:** 2\ **Last updated:** [September 20, 2021, 5:00am UTC](https://discuss.elastic.co/t/ece-control-planes-node-all-containers-down/284179 "2021-09-20T05:00:28Z")
I've been playing around and testing ECE (2.11.0) for one of our customers, so I have to use minimal footprint: 1 x node (node-1) for osting ECE COntrol plane (Coordinator, Director, Cloud UI) and 1 x node (node-2) for a… --- ## [Kibana dashboards and index patterns lost after delete kibana pod](https://discuss.elastic.co/t/kibana-dashboards-and-index-patterns-lost-after-delete-kibana-pod/284422)
**Author:** [@humartinez](https://discuss.elastic.co/u/humartinez)\ **Replies:** 1\ **Last updated:** [September 18, 2021, 1:27pm UTC](https://discuss.elastic.co/t/kibana-dashboards-and-index-patterns-lost-after-delete-kibana-pod/284422 "2021-09-18T13:27:33Z")
Hi, I just delete the kibana pod that I build with eck and I lost all the dashboards and index patterns that I've created. I thought that that info was loaded in the .kibana index. Its theres a way that I can recover th… --- ## [How to deploy beats in the same pod with ElasticSearch Kubernetes Orchestration API](https://discuss.elastic.co/t/how-to-deploy-beats-in-the-same-pod-with-elasticsearch-kubernetes-orchestration-api/284293)
**Author:** [@Adriann](https://discuss.elastic.co/u/Adriann)\ **Replies:** 3\ **Last updated:** [September 17, 2021, 9:20am UTC](https://discuss.elastic.co/t/how-to-deploy-beats-in-the-same-pod-with-elasticsearch-kubernetes-orchestration-api/284293 "2021-09-17T09:20:38Z")
Hello, I want to be able to set up for example all the beats in the same pod. Is it possible to achieve using Elasticserach Orchestration Kubernetes API? [Previous page](https://discuss.elastic.co/c/orchestration/85.md?page=20) [Next page](https://discuss.elastic.co/c/orchestration/85.md?page=22)