Unable to associate to elasticsearch on kibana

basically just following this code sample:

# Install OLM (Operator Lifecycle Management)
kubectl apply -f https://github.com/operator-framework/operator-lifecycle-manager/releases/download/0.16.1/crds.yaml
kubectl apply -f https://github.com/operator-framework/operator-lifecycle-manager/releases/download/0.16.1/olm.yaml
kubectl get olm -A

# Install ECK/Elasticsearch Operator
kubectl apply -f https://download.elastic.co/downloads/eck/1.2.1/all-in-one.yaml

# Create a namespace for logging
kubectl create ns logging

# Install Elasticsearch cluster
cat <<EOF | kubectl apply -n logging -f -
apiVersion: elasticsearch.k8s.elastic.co/v1beta1
kind: Elasticsearch
metadata:
  name: quickstart
spec:
  version: 7.5.0
  nodeSets:
  - name: default
    count: 1
    config:
      node.master: true
      node.data: true
      node.ingest: true
      node.store.allow_mmap: false
EOF

# Install Kibana 
cat <<EOF | kubectl apply -n logging -f -
apiVersion: kibana.k8s.elastic.co/v1beta1
kind: Kibana
metadata:
  name: quickstart
spec:
  version: 7.5.0
  count: 1
  elasticsearchRef:
    name: quickstart
EOF

# Install Logging/Fluentd & Fluent Bit Operator inside logging namespace
helm repo add banzaicloud-stable https://kubernetes-charts.banzaicloud.com
helm install --namespace logging logging banzaicloud-stable/logging-operator --set createCustomResource=false

# Install demo app
helm install --namespace logging logging-demo banzaicloud-stable/logging-demo --set "elasticsearch.enabled=True"

# Get the password for Kibana (default user is 'elastic')'
kubectl get secret quickstart-es-elastic-user -n logging -o=jsonpath='{.data.elastic}' | base64 --decode; echo

# Access Kibana dashboard
kubectl port-forward -n logging svc/quickstart-kb-http 5601

What did you expect to see?
a live kibana dashboard

What did you see instead? Under which circumstances?
kibana failing to start

Environment

  • ECK version:

1.2.1

  • Kubernetes information:

AKS v1.18.19

$ kubectl version

v1.21.3

  • Logs:
kubectl describe kibana quickstart -n logging
  Warning  AssociationError         28m (x4 over 28m)  kibana-controller             Association backend for elasticsearch is not configured

from inside of the cluster, es is working properly

root@doks-debug:~# curl -u "elastic:XXXXXXX" -k "https://quickstart-es-http.logging:9200"
{
   ...,
  "tagline" : "You Know, for Search"
}

There are a couple of things I'm noting:

  1. You seem to be installing the operator lifecycle manager, but not using it to install ECK. I'd likely recommend when just trying out the operator to just ignore OLM for now, and Install via this guide: Deploy ECK in your Kubernetes cluster | Elastic Cloud on Kubernetes [master] | Elastic
  2. You're installing an old version of ECK. Version 1.2.1 Release 1.2.1 · elastic/cloud-on-k8s · GitHub was released August of last year, and 1.8.0 is the current version: Release Elastic Cloud On Kubernetes 1.8.0 · elastic/cloud-on-k8s · GitHub. The above install guide I referenced will install 1.8.0 by default.

Would you mind starting over, and installing from the referenced install guide, and see if you encounter the same issue?

Thanks.