Hello,
Using this repo -- https://github.com/deviantony/docker-elk -- i recently setup ELK on an EC2 instance running Docker (version 17.05.0-ce, build 89658be) and docker-compose (docker-compose version 1.6.2, build 4d72027). I also used https://github.com/tugrulcan/docker-elk-filebeat to install filebeat.
After configuring everything, I'm able to see basic log file entries flowing thru such that I can view them in Kibana: I have to access the GUI, though, via an ssh tunnel into my Docker host.
I would like, though, to be able to access the Kibana GUI via an haproxy container that's also running on my Docker host. That way I'd be able to just hit "http://<EC2 instance's IP>/logs" and have this redirect to Kibana, without having to open port 5601 on the host and modify the current security group.
When I try, though, the UI loads partially, then just stops. Clicking on the different options (Discover, Visualize, etc) changes the URL listed (http://myapp-demo/app/kibana#/home to http://myapp-demo/app/kibana#/discover to http://myapp-demo/app/kibana#/visualize and so on), but that's it. Oh, and I have a simple entry in my local /etc/hosts file mapping myapp-demo to the AWS instance's IP.
Security groups are setup, temporarily, on the EC2 instance such that ports 22, 5601, 9200, 9100 are all open to my admin workstation's IP. iptables has only the entries that were put in place by the installation of Docker (iptables wasn't even there on the Docker host, before I installed Docker).
Here's an excerpt from my haproxy.cfg file (I've created a pastebin at https://pastebin.com/yavnXyEw, just in case my posting proves difficult to read):
frontend web
bind *:80
reqadd X-Forwarded-Proto:\ http if !{ ssl_fc }
reqadd X-Forwarded-Proto:\ https if { ssl_fc }
default_backend myapp_ui
...
acl is_kibana path_sub logs
acl is_kibana path_sub kibana
acl is_kibana path_sub bundles
acl is_kibana path_sub app/kibana
acl is_kibana path_sub plugins/kibana/assets
use_backend kibana if is_kibana
use_backend es_head if is_es_head
...
backend myapp_ui
server ui1 myapp:8080 check
backend kibana
mode http
reqrep ^([^\ ]\ /)logs[/]?(.) \1\2
reqrep ^([^\ ]\ /)kibana[/]?(.) \1\2
server kibana kibana:5601 check
And here's an excerpt from my docker-compose.yml file:
haproxy:
image: < personal repo >
restart: always
links:
- myapp
- kibana
- es_head
volumes:
- ./docker/haproxy/haproxy.cfg:/usr/local/etc/haproxy/haproxy.cfg:ro
ports:
- "80:80"
kibana:
image: < personal repo >
ports:
- "5601:5601"
Now, since I'm able to get the GUI to load partially, I know that the setup is mostly functional. The issue seems to be, perhaps, with my haproxy acls. I'm not sure what else I need to add in that area.
'Anyone out there have experience with this kind of setup and any ideas on what I can do to get around the issue that I'm seeing?