Kafka Codec Avro Plugin Polling Frequency

I'm planning on using the Codec Avro Plugin to deserialize incoming events from SQS. However, requests to the Kafka schema registry are rate-limited to 25 queries/second when using an HTTP URI.

How frequently does this plugin call the Kafka schema registry? Is it once per pipeline event or is there some caching behind the scenes that can reduce the number of requests?

Whatever the schema_uri option points to is read once when the pipeline is loaded and re-used until the pipeline is restarted.

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.