(v6.2.3) Kafka plugin: Compatibility

The compatability link is broken, and what I saw from Confluence is extremely dated....

I see reference to "Client 1.0.0" for version 6.2.x.

So, that gives rise to questions:
1.) Will it also work+support for Kafka 1.1.0 (Latest stable, 3-2018)
2.) Similar to Kafka 1.0.0, are both Scala 2.12 & 2.11 supported?

I can confirm that the link from the Kafka Input Plugin docs is broken :weary:

https://cwiki.apache.org/confluence/display/KAFKA/Compatibility+Matrix

I don't have an immediate answer for you, but have filed a ticket on the availabilty of the matrix: logstash-plugins/logstash-input-kafka#261

1.) Will it also work+support for Kafka 1.1.0 (Latest stable, 3-2018)

Compatibility is up to the Kafka project as we simply consume the Kafka Client library that they release (this is why we choose to link to the Kafka project compatibility page). Bummer that it's giving a 503 right now :frowning:

Maybe ping the Apache.org or Kafka Project folks about the outage of their website?

2.) Similar to Kafka 1.0.0, are both Scala 2.12 & 2.11 supported?

I'm not sure what you are asking. Can you clarify? What do you want to use Scala for in Logstash?

Scala is the core technology under Kafka.

I have noticed some incompatibility, between Kafka versions, in particular, when the brokers are not on same Scala. In other words, kafka clients can only talk to specific Kafka broker versions.

I guess, the answer is whatever is supported by Kafka Client 1.0...

I'm not quite sure I follow. The Kafka compatibility documentation (to my knowledge) does not express anything about Scala. I recommend you consult with the Kafka community about this, as they're likely to have more details here.

For what it's worth, I can't recall any such compatibility problem in Logstash regarding Kafka Client and Kafka Broker where the cause at all mentioned Scala. I hope you are able to find your answers :slight_smile:

@rfrink the compatibility matrix is back up, and I have ensured that the Wayback Machine has a cached copy as of today:

https://web.archive.org/web/20180412202747/https://cwiki.apache.org/confluence/display/KAFKA/Compatibility+Matrix

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.