Changelog History
Page 1
-
v1.9.2 Changes
๐ This is a maintenance release:
- Bundles librdkafka v1.9.2.
- [Example](examples/docker_aws_lambda_example) for using go clients with AWS lambda (@jliunyu, #823).
- OAUTHBEARER unsecured [producer](examples/oauthbearer_producer_example), [consumer](examples/oauthbearer_consumer_example) and [OIDC](examples/oauthbearer_oidc_example) examples.
๐ confluent-kafka-go is based on librdkafka v1.9.2, see the ๐ librdkafka release notes โฌ๏ธ for a complete list of changes, enhancements, fixes and upgrade considerations.
-
v1.9.1 Changes
๐ This is a feature release:
- Schema Registry support for Avro [Generic](examples/avro_generic_producer_example) and [Specific](examples/avro_specific_producer_example), [Protocol Buffers](examples/protobuf_producer_example) and [JSON Schema](examples/json_producer_example). (@rayokota, #776).
- Built-in support for Mac OSX M1 / arm64. (#818).
๐ confluent-kafka-go is based on librdkafka v1.9.1, see the ๐ librdkafka release notes โฌ๏ธ for a complete list of changes, enhancements, fixes and upgrade considerations.
-
v1.9.0 Changes
๐ This is a feature release:
- OAUTHBEARER OIDC support
- KIP-140 Admin API ACL support
- Added MockCluster for functional testing of applications without the need for a real Kafka cluster (by @SourceFellows and @kkoehler, #729). See [examples/mock_cluster](examples/mock_cluster).
๐ Fixes
- Fix Rebalance events behavior for static membership (@jliunyu, #757, #798).
- Fix consumer close taking 10 seconds when there's no rebalance needed (@jliunyu, #757).
๐ confluent-kafka-go is based on librdkafka v1.9.0, see the ๐ librdkafka release notes โฌ๏ธ for a complete list of changes, enhancements, fixes and upgrade considerations.
-
v1.8.2 Changes
๐ This is a maintenance release:
- Bundles librdkafka v1.8.2
- Check termination channel while reading delivery reports (by @zjj)
- Added convenience method Consumer.StoreMessage() (@finncolman, #676)
๐ confluent-kafka-go is based on librdkafka v1.8.2, see the ๐ librdkafka release notes โฌ๏ธ for a complete list of changes, enhancements, fixes and upgrade considerations.
Note: There were no confluent-kafka-go v1.8.0 and v1.8.1 releases.
-
v1.8.0 Changes
๐ This is a maintenance release to upgrade the bundled librdkafka version to v1.8.0.
๐ confluent-kafka-go is based on librdkafka v1.8.0, see the ๐ librdkafka release notes โฌ๏ธ for a complete list of changes, enhancements, fixes and upgrade considerations.
-
v1.7.0 Changes
๐ confluent-kafka-go is based on librdkafka v1.7.0, see the ๐ librdkafka release notes โฌ๏ธ for a complete list of changes, enhancements, fixes and upgrade considerations.
โจ Enhancements
- Experimental Windows support (by @neptoess).
- The produced message headers are now available in the delivery report
Message.Headers
if the Producer'sgo.delivery.report.fields
configuration property is set to includeheaders
, e.g.:"go.delivery.report.fields": "key,value,headers"
This comes at a performance cost and are thus disabled by default.
๐ Fixes
- 0๏ธโฃ AdminClient.CreateTopics() previously did not accept default value(-1) of ReplicationFactor without specifying an explicit ReplicaAssignment, this is now fixed.
-
v1.6.1 Changes
๐ v1.6.1 is a feature release:
- KIP-429: Incremental consumer rebalancing - see [cooperative_consumer_example.go](examples/cooperative_consumer_example/cooperative_consumer_example.go) for an example how to use the new incremental rebalancing consumer.
- KIP-480: Sticky producer partitioner - increase throughput and decrease latency by sticking to a single random partition for some time.
- KIP-447: Scalable transactional producer - a single transaction producer can now be used for multiple input partitions.
๐ confluent-kafka-go is based on and bundles librdkafka v1.6.1, see the ๐ librdkafka release notes โฌ๏ธ for a complete list of changes, enhancements, fixes and upgrade considerations.
โจ Enhancements
go.delivery.report.fields=all,key,value,none
can now be used to avoid copying message key and/or value to the delivery report, improving performance in high-throughput applications (by @kevinconaway).
๐ Fixes
- Consumer.Close() previously did not trigger the final RevokePartitions callback, this is now fixed.
-
v1.5.2 Changes
November 05, 2020confluent-kafka-go v1.5.2
๐ v1.5.2 is a maintenance release with the following fixes and enhancements:
- ๐ Bundles librdkafka v1.5.2 - see release notes for all enhancements and fixes.
- ๐ Documentation fixes
๐ confluent-kafka-go is based on librdkafka v1.5.2, see the
๐ librdkafka release notes
โฌ๏ธ for a complete list of changes, enhancements, fixes and upgrade considerations. -
v1.4.2 Changes
May 07, 2020confluent-kafka-go v1.4.2
๐ v1.4.2 is a maintenance release:
- The bundled librdkafka directory (
kafka/librdkafka
) is no longer pruned by Go mod vendor import. - โฌ๏ธ Bundled librdkafka upgraded to v1.4.2, highlights:
- System root CA certificates should now be picked up automatically on most platforms
- Fix produce/consume hang after partition goes away and comes back,
such as when a topic is deleted and re-created (regression in v1.3.0).
librdkafka v1.4.2 changes
๐ See the librdkafka v1.4.2 release notes for changes to the bundled librdkafka included with the Go client.
- The bundled librdkafka directory (
-
v1.4.0 Changes
April 08, 2020confluent-kafka-go v1.4.0
- Added Transactional Producer API and full Exactly-Once-Semantics (EOS) support.
- A prebuilt version of the latest version of librdkafka is now bundled with the confluent-kafka-go client. A separate installation of librdkafka is NO LONGER REQUIRED or used.
- โ Added support for sending client (librdkafka) logs to
Logs()
channel. - โ Added
Consumer.Position()
to retrieve the current consumer offsets. - The
Error
type now has additional attributes, such asIsRetriable()
to deem if the errored operation can be retried. This is currently only exposed for the Transactional API. - โ Removed support for Go < 1.9
Transactional API
๐ librdkafka and confluent-kafka-go now has complete Exactly-Once-Semantics (EOS) functionality, supporting the idempotent producer (since v1.0.0), a transaction-aware consumer (since v1.2.0) and full producer transaction support (in this release).
This enables developers to create Exactly-Once applications with Apache Kafka.๐ See the Transactions in Apache Kafka page for an introduction and check the transactions example for a complete transactional application example.
Bundled librdkafka
The confluent-kafka-go client now comes with batteries included, namely prebuilt versions of librdkafka for the most popular platforms, you will thus no longer need to install or manage librdkafka separately.
๐ Supported platforms are:
- Mac OSX
- ๐ง glibc-based Linux x64 (e.g., RedHat, Debian, etc) - lacks Kerberos/GSSAPI support
- ๐ง musl-based Linux x64 (Alpine) - lacks Kerberos/GSSAPI support
๐ง These prebuilt librdkafka has all features (e.g., SSL, compression, etc) except for the Linux builds which due to libsasl2 dependencies does not have Kerberos/GSSAPI support.
๐ If you need Kerberos support, or you are running on a platform where the prebuilt librdkafka builds are not available (see above), you will need to install librdkafka separately (preferably through the Confluent APT and RPM repositories) and build your application with-tags dynamic
to disable the builtin librdkafka and instead link your application dynamically to librdkafka.librdkafka v1.4.0 changes
๐ Full librdkafka v1.4.0 release notes.
Highlights:
- KIP-98: Transactional Producer API
- KIP-345: Static consumer group membership (by @rnpridgeon)
- KIP-511: Report client software name and version to broker
- ๐ SASL SCRAM security fixes.