How to setup Kafka input in Logstash

Elastic Stack Logstash
1

Hi,

I want to read from Kafka and I have the following configuration;

kafka{
	group_id => "test-consumer-group"
	topics => ["testtopic"]
	bootstrap_servers => "192.168.0.1:<port>"
	codec => json
}

What port should I mention here? I am entirely new to Kafka. I have Kafka installed and I have the following config files under config folder;

  • connect-console-sink.properties
  • connect-console-source.properties
  • connect-distributed.properties
  • connect-file-sink.properties
  • connect-file-source.properties
  • connect-log4j.properties
  • connect-standalone.properties
  • consumer.properties
  • log4j.properties
  • producer.properties
  • server.properties
  • tools-log4j.properties
  • zookeeper.properties

I have seen clientPort=2181 in zookeeper.properties and bootstrap.servers=192.168.0.1:9092 in producer.properties. So, what IP port should I mention here and where can I get that from? is that Zookeeper IP and PORT or Kafka IP and PORT?

Thanks.

2

Hi @steffens , it would be helpful if you try answering this question?

3

According to docs,the bootstrap servers should be configured to 9092 (default kafka listener).

4

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.