Rsyslog server => Haproxy => ES cluster

Elastic Stack Elasticsearch
1

Hi all
I use haproxy with keepalive for ES
but I have some concerns

HAproxy config

global
log 127.0.0.1 local0 notice
chroot /var/lib/haproxy
user haproxy
group haproxy
daemon
maxconn 4000

defaults
log global
mode http
option httplog
option dontlognull
option redispatch
retries 3
timeout client 35s
timeout server 60s
timeout connect 5s
timeout http-keep-alive 10s

listen stats :9090
mode http
stats enable
stats hide-version
stats realm Haproxy\ Statistics
stats uri /
stats auth admin:XXXX

listen elasticsearch 10.XXX.XXX.121:9300
mode tcp
option tcpka
option tcplog
# balance leastconn - The server with the lowest number of connections receives the connection
# balance roundrobin - Each server is used in turns, according to their weights.
# balance source - Source IP hashed and divided by total weight of servers designates which server will receive the request
balance roundrobin
server es-1 10.XXX.XXX.104:9200 check
server es-2 10.XXX.XXX.105:9200 check

keepalived config

vrrp_script chk_haproxy {
script "killall -0 haproxy"
interval 2
weight 2
}

vrrp_instance VI_1 {
interface eth0
state MASTER
virtual_router_id 51
priority 101
virtual_ipaddress {
10.XXX.XXX.144
}
track_script {
chk_haproxy
}
}

HAproxy work but
one ES server appear in haproxy stats

2

Can you elaborate please, what you are asking is not clear.

3

HI,
im using rsyslog server to send logs to ES
that work fine but in the rsyslog parameter there are one output
so im trying to use Haproxy and keepalived to set an VIP to my node master
so im look'in for a solution to do this in HAproxy and keepalived or an other solution
Thanks

4

so i fixed the problem thank u any way

5

How did you fix it, I'm sure others would be interested.

6

HI
yes of curse !
I will write an article on the HA stack ERK ElasticSearch rsyslog server and Kibana
with template rsyslog on ElasticSearch
and also on the configuration server Rsyslog
and on best practice
because I use this stack to centralize logs ~ 3000 linux server and ~ 500 windows server