Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Release Dates

  • KIP Freeze: Sep 30, 2020 (a KIP must be accepted by this date in order to be considered for this release)
  • Feature Freeze: Oct 7, 2020 (major features merged & working on stabilization, minor features have PR, release branch cut; anything not in this state will be automatically moved to the next release in JIRA)
  • Code Freeze: Oct 21, 2020Release: estimated
  • Nov 6Released Dec 21, 2020


These dates are goals and subject to change, but we expect to stay on the Time Based Release Plan unless unexpected critical issues come up. While the target release date is fixed at ~2w after code freeze, RCs will roll out as needed until the release vote passes.

The release manager is Bill Bejeck

...

This is a list of key features/improvements/bugfixes that we can include with release notes:

How to Contribute

Before code freeze:

  • Participate in votes and discussions to land or postpone the open KIPs.
  • Review patches. We anticipate that this release will be bottlenecked mostly on reviews. The more reviewers, the more content we can fit in.
  • Write unit/integration/system tests. We want to preserve the tradition of high-quality releases in Apache Kafka. 

After code freeze:

  • Write more unit/integration/system testsWe want to preserve the tradition of high-quality releases in Apache Kafka.
  • Improve documentation
  • Test the release candidates
  • Open blocker JIRAs on critical issues found. Open non-blocker JIRAs on any other issues found.
  • Fix critical bugs
  • Review bug fixes
  • Vote on RCs. Even though only PMC votes are binding, community votes are super important as we evaluate the readiness of the release

Open Issues

Jira
serverASF JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
maximumIssues20
jqlQueryproject = KAFKA AND fixVersion = 2.7.0 AND status not in (resolved, closed) ORDER BY priority DESC, status DESC, updated DESC
serverId5aa69414-a9e9-3523-82ec-879b028fb15b

...

Also feel free to refer to this release page for more details of the included tickets.

Planned KIP Content

Note: The planned content is not binding - final content will be based the features committed by branch-cutting date. See Kafka Improvement Proposals for the full list of KIPs.

KIPJIRAComponent
KIP-662: Throw Exception when Source Topics of a Streams App are Deleted

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-10355

Kafka Streams
KIP-654: Aborted transaction with non-flushed data should throw a non-fatal exception

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-10186

Kafka Clients
KIP-651 - Support PEM format for SSL certificates and private key
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-10338


Core
KIP-648: Renaming getter method for Interactive Queries

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-10316

Kafka Streams
KIP-632: Add DirectoryConfigProvider

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-7370
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-10211


KIP-626: Rename StreamsConfig config variable name

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-10168

Kafka StreamsKIP-623: Add "internal-topics" option to streams application reset tool

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6435

Kafka Streams
KIP-620 Deprecate ConsumerConfig#addDeserializerToConfig and ProducerConfig#addSerializerToConfig

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-10044

Kafka Clients
KIP-617: Allow Kafka Streams State Stores to be iterated backwards

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-9929

Kafka Streams
KIP-616: Rename implicit Serdes instances in kafka-streams-scala

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-10020

Kafka Streams
KIP-613: Add end-to-end latency metrics to Streams

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-10054

Kafka Streams
KIP-612: Ability to Limit Connection Creation Rate on Brokersold 

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-10023
, current 

Core
KIP-607: Add Metrics to Kafka Streams to Report Properties of RocksDB

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-100249924

CoreKafka Streams
KIP-608 - Expose Kafka Metrics in Authorizer601: Configurable socket connection timeout in NetworkClient

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-99589893

Core
KIP-607: Add Metrics to Kafka Streams to Report Properties of RocksDB599: Throttle Create Topic, Create Partition and Delete Topic Operations

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-99249915

Kafka StreamsCore
KIP-601: Configurable socket connection timeout in NetworkClient597: MirrorMaker2 internal topics Formatters

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-9893-10232


KIP-584: Versioning scheme for features

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-9755

Core


KIP-599: Throttle Create Topic, Create Partition and Delete Topic Operations572: Improve timeouts and retries in Kafka Streams

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-99159274

CoreKafka Streams
KIP-597: MirrorMaker2 internal topics Formatters554: Add Broker-side SCRAM Config API

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-1023210259

Core
KIP-590: Redirect Zookeeper Mutation Protocols to The Controller545: support automated consumer offset sync across clusters in MM 2.0

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-97059076

Mirror Maker 2.0Core
KIP-589 497: Add inter-broker API to update Replica state in Controlleralter ISR

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-98378836

Core
KIP-588: Allow producers to recover gracefully from transaction timeouts478 - Strongly typed Processor API

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-98038410

Kafka ClientsStreams
KIP-584: Versioning scheme for features450: Sliding Window Aggregations in the DSL

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-97555636

Kafka Streams
KIP-580: Exponential Backoff for Kafka Clients431: Support of printing additional ConsumerRecord fields in DefaultMessageFormatter

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-98006733

Kafka ClientsTools


Postponed to subsequent release


KIPJIRAComponent
KIP-
572: Improve timeouts and retries in
671: Introduce Kafka Streams Specific Uncaught Exception Handler

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-

9274Kafka StreamsKIP-554: Add Broker-side SCRAM Config API

9331
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6943
,

Kafka Streams
KIP-653: Upgrade log4j to log4j2

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-9366


KIP-623: Add "internal-topics" option to streams application reset tool

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6435

Kafka Streams
KIP-608 - Expose Kafka Metrics in Authorizer

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-

10259

9958

Core
KIP-
545: support automated consumer offset sync across clusters in MM 2.0
590: Redirect Zookeeper Mutation Protocols to The Controller

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-

9076Mirror Maker 2.0

9705

Core
KIP-
497:
589 Add
inter-broker
API to
alter ISR
update Replica state in Controller

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-

8836

9837

Core
KIP-588: Allow producers to recover gracefully from transaction timeouts

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-9803

Kafka Clients
Core
KIP-
466
580:
Add support for List<T> serialization and deserialization
Exponential Backoff for Kafka Clients

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-

8326

9800

Kafka Clients
KIP-
431: Support of printing additional ConsumerRecord fields in DefaultMessageFormatter
508: Make Suppression State Queriable

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-

6733Kafka Tools

8403

Kafka Streams
KIP-466: Add support for List<T> serialization and deserialization

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-8326


KIP-418: A method-chaining way to branch KStream

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5488

Kafka Streams
KIP-373: Allow users to create delegation tokens for other users

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6945


KIP-359: Verify leader epoch in produce requests

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-7383

Core
KIP-280: Enhanced log compaction

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-7061

Core
KIP-216: IQ should throw different exceptions for different errors

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5876

Kafka Streams
KIP-81: Bound Fetch memory usage in the consumer

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-4133

Kafka Clients

Postponed to subsequent release

Comment
KIPJIRAComponentCommitter