How to setup a logstash cluster of 3 nodes?


#1

Hi,

I have a Logstash configuration like below;

input {
	kafka{
		group_id => "mygroup"
		topics => ["mytopic"]
		bootstrap_servers => "192.168.0.1:9092,192.168.0.2:9092,192.168.0.3:9092"
		codec => json
		add_field => { "logtype" => "LOGFILE" }
	}
}

filter {
	date {
		match => [ "timestamp", "mm dd, yy hh:mm:ss" ]
		timezone => "UTC"
		target => "@timestamp"
	}
}

output{
	elasticsearch {
		hosts => ["192.168.0.1"]
		index => "myindex-%{+YYYY-MM-dd}"
	}
}

Logstash reads from Kafka and pushes to elasticsearch. I want to run logstash in my IPs 192.168.0.1, 192.168.0.2, and 192.168.0.3, in parallel, balancing load, as a cluster. How can I do this?

Thanks.


(system) #2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.