Kibana UI stuck in loading in kubernetes and ingress setup

versions:

Kibana: 4.6.1
ES: 2.4.1
kubernetes: 1.6.4

$ kubectl cluster-info
Kubernetes master is running at http://localhost:8080
Elasticsearch is running at http://localhost:8080/api/v1/proxy/namespaces/kube-system/services/elasticsearch-logging
Kibana is running at
http://localhost:8080/api/v1/proxy/namespaces/kube-system/services/kibana-logging
kubedns is running at http://localhost:8080/api/v1/proxy/namespaces/kube-system/services/kubedns

When I access UI http://kibana.mycompany.local/app/kibana, kibana backend sends out the following logs and UI is at "Kibana is loading" state forever:

{"type":"response","@timestamp":"2017-06-21T15:23:51Z","tags":[],"pid":7,"method":"get","statusCode":200,"req":{"url":"/app/kibana","method":"get","headers":{"host":"kibana.mycompany.local","connection":"close","x-real-ip":"172.27.31.228","x-forwarded-for":"172.27.31.228","x-forwarded-host":"kibana.mycompany.local","x-forwarded-port":"80","x-forwarded-proto":"http","x-original-uri":"/app/kibana","x-scheme":"http","cache-control":"max-age=0","upgrade-insecure-requests":"1","user-agent":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.133 Safari/537.36","accept":"text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,/;q=0.8","accept-encoding":"gzip, deflate, sdch","accept-language":"en-US,en;q=0.8,zh-CN;q=0.6"},"remoteAddress":"10.0.0.12","userAgent":"10.0.0.12"},"res":{"statusCode":200,"responseTime":7,"contentLength":9},"message":"GET /app/kibana 200 7ms - 9.0B"}
{"type":"response","@timestamp":"2017-06-21T15:23:51Z","tags":[],"pid":7,"method":"get","statusCode":404,"req":{"url":"/api/v1/proxy/namespaces/kube-system/services/kibana-logging/bundles/commons.bundle.js?v=10146","method":"get","headers":{"host":"kibana.mycompany.local","connection":"close","x-real-ip":"172.27.31.228","x-forwarded-for":"172.27.31.228","x-forwarded-host":"kibana.mycompany.local","x-forwarded-port":"80","x-forwarded-proto":"http","x-original-uri":"/api/v1/proxy/namespaces/kube-system/services/kibana-logging/bundles/commons.bundle.js?v=10146","x-scheme":"http","user-agent":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.133 Safari/537.36","accept":"/","referer":"http://kibana.mycompany.local/app/kibana","accept-encoding":"gzip, deflate, sdch","accept-language":"en-US,en;q=0.8,zh-CN;q=0.6"},"remoteAddress":"10.0.0.12","userAgent":"10.0.0.12","referer":"http://kibana.mycompany.local/app/kibana"},"res":{"statusCode":404,"responseTime":92,"contentLength":9},"message":"GET /api/v1/proxy/namespaces/kube-system/services/kibana-logging/bundles/commons.bundle.js?v=10146 404 92ms - 9.0B"}
{"type":"response","@timestamp":"2017-06-21T15:23:51Z","tags":[],"pid":7,"method":"get","statusCode":404,"req":{"url":"/api/v1/proxy/namespaces/kube-system/services/kibana-logging/bundles/commons.style.css?v=10146","method":"get","headers":{"host":"kibana.mycompany.local","connection":"close","x-real-ip":"172.27.31.228","x-forwarded-for":"172.27.31.228","x-forwarded-host":"kibana.mycompany.local","x-forwarded-port":"80","x-forwarded-proto":"http","x-original-uri":"/api/v1/proxy/namespaces/kube-system/services/kibana-logging/bundles/commons.style.css?v=10146","x-scheme":"http","user-agent":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.133 Safari/537.36","accept":"text/css,/;q=0.1","referer":"http://kibana.mycompany.local/app/kibana","accept-encoding":"gzip, deflate, sdch","accept-language":"en-US,en;q=0.8,zh-CN;q=0.6"},"remoteAddress":"10.0.0.12","userAgent":"10.0.0.12","referer":"http://kibana.mycompany.local/app/kibana"},"res":{"statusCode":404,"responseTime":189,"contentLength":9},"message":"GET /api/v1/proxy/namespaces/kube-system/services/kibana-logging/bundles/commons.style.css?v=10146 404 189ms - 9.0B"}
{"type":"response","@timestamp":"2017-06-21T15:23:51Z","tags":[],"pid":7,"method":"get","statusCode":404,"req":{"url":"/api/v1/proxy/namespaces/kube-system/services/kibana-logging/bundles/kibana.style.css?v=10146","method":"get","headers":{"host":"kibana.mycompany.local","connection":"close","x-real-ip":"172.27.31.228","x-forwarded-for":"172.27.31.228","x-forwarded-host":"kibana.mycompany.local","x-forwarded-port":"80","x-forwarded-proto":"http","x-original-uri":"/api/v1/proxy/namespaces/kube-system/services/kibana-logging/bundles/kibana.style.css?v=10146","x-scheme":"http","user-agent":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.133 Safari/537.36","accept":"text/css,/;q=0.1","referer":"http://kibana.mycompany.local/app/kibana","accept-encoding":"gzip, deflate, sdch","accept-language":"en-US,en;q=0.8,zh-CN;q=0.6"},"remoteAddress":"10.0.0.12","userAgent":"10.0.0.12","referer":"http://kibana.mycompany.local/app/kibana"},"res":{"statusCode":404,"responseTime":189,"contentLength":9},"message":"GET /api/v1/proxy/namespaces/kube-system/services/kibana-logging/bundles/kibana.style.css?v=10146 404 189ms - 9.0B"}

I figured this out as it is kargo issue in which it has KIBANA_BASE_URL configured. Remove it works.

env:
  - name: "ELASTICSEARCH_URL"
    value: "http://elasticsearch-logging:9200"

Nice! Hopefully this post would be useful for someone else in the future.

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.