...
KIP round-up
Next KIP Number: 481527
Use this number as the identifier for your KIP and increment this value.
...
Please insert new rows in sorted order (descending by KIP number).
| KIP (please keep this sorted by KIP number) | Release | ||||||
|---|---|---|---|---|---|---|---|
| 1 | KIP- | 465: Add Consolidated Connector Endpoint to Connect REST API500: Replace ZooKeeper with a Self-Managed Metadata Quorum | |||||
| 2 | KIP-482: The Kafka Protocol should Support Optional Tagged Fields | 2.3.0 | 2 | KIP-464: Defaults for AdminClient#createTopic2.4.0 (WIP) | |||
| 3 | KIP-462: Use local thread id for KStreams504 - Add new Java Authorizer Interface | 2.34.0 (WIP) | |||||
| 4 | KIP-461: Improve Replica Fetcher behavior at handling partition failure503: Add metric for number of topics marked for deletion | 2.34.0 (WIP) | |||||
| 5 | KIP- | 460: Admin Leader Election RPC497: Add inter-broker API to alter ISR | 2.4.0 (WIP) | ||||
| 6 | KIP- | 458: Connector Client Config Override Policy496: Administrative API to delete consumer offsets | 2. | 34.0 (WIP) | |||
| 7 | KIP- | 454: Expansion of the ConnectClusterState interface495: Dynamically Adjust Log Levels in Connect | 2. | 34.0 (WIP) | |||
| 8 | KIP-453: Add close() method to RocksDBConfigSetter488: Clean up Sum,Count,Total Metrics | 2.34.0 | |||||
| 9 | KIP- | 449: Add connector contexts to log messages in Connect workers484: Expose metrics for group and transaction metadata loading duration | 2. | 34.0 (WIP) | |||
| 10 | KIP-446: Add changelog topic configuration to KTable suppress481: SerDe Improvements for Connect Decimal type in JSON | 2.4.0 (WIP) | |||||
| 11 | KIP- | 445: In-memory Session Store480: Sticky Partitioner | 2. | 34.0 | |||
| 12 | KIP- | 443479: | Return to default segment.ms and segment.index.bytes in Streams repartition topicsAdd Materialized to Join | 2. | 34.0(WIP) | ||
| 13 | KIP-442: Return to default max poll interval in Streams476: Add Java AdminClient Interface | 2.34.0 | |||||
| 14 | KIP- | 436: Add a metric indicating start time475: New Metrics to Measure Number of Tasks on a Connector | 2. | 34.0 (WIP) | |||
| 15 | KIP- | 430 - Return Authorized Operations in Describe Responses474: To deprecate WindowStore#put(key, value) | 2. | 34.0 (WIP) | |||
| 16 | KIP- | 429471: | Kafka Consumer Incremental Rebalance ProtocolExpose RocksDB Metrics in Kafka Streams | 2.4.0 (WIP) | |||
| 17 | KIP- | 428: Add in-memory window store467: Augment ProduceResponse error messaging for specific culprit records | 2. | 34.0 (WIP) | |||
| 18 | KIP- | 427: Add AtMinIsr topic partition category (new metric & TopicCommand option)465: Add Consolidated Connector Endpoint to Connect REST API | 2.3.0 | ||||
| 19 | KIP-425: Add some Log4J Kafka Appender Properties for Producing to Secured Brokers464: Defaults for AdminClient#createTopic | 2.34.0 | |||||
| 20 | KIP-421: Support resolving externalized secrets in AbstractConfig462: Use local thread id for KStreams | 2.3.0 | |||||
| 21 | KIP- | 420: Add Single Value Fetch in Session Stores461: Improve Replica Fetcher behavior at handling partition failure | 2. | 23.0 | |||
| 22 | KIP-417: Allow JmxTool to connect to a secured RMI port460: Admin Leader Election RPC | 2.34.0 | |||||
| 23 | KIP-415: Incremental Cooperative Rebalancing in Kafka Connect458: Connector Client Config Override Policy | 2.3.0 | |||||
| 24 | KIP-414: Expose Embedded ClientIds in Kafka Streams455: Create an Administrative API for Replica Reassignment | 2.24.0 (WIP) | |||||
| 25 | KIP- | 412: Extend Admin API to support dvynamic application log levels454: Expansion of the ConnectClusterState interface | 2. | 43.0 | (WIP)|||
| 26 | KIP- | 411: Make default Kafka Connect worker task client IDs distinct453: Add close() method to RocksDBConfigSetter | 2.3.0 | ||||
| 27 | KIP- | 402: Improve fairness in SocketServer processors449: Add connector contexts to log messages in Connect workers | 2. | 2.2.0 (partially implemented) / 2.3.0 | |||
| 28 | KIP-394: Require member.id for initial join group request446: Add changelog topic configuration to KTable suppress | 2.24.0 (WIP) | |||||
| 29 | KIP-393: Time windowed serde to properly deserialize changelog input topic445: In-memory Session Store | 2.23.0 | |||||
| 30 | 386: Standardize on Min/Avg/Max metrics' default value | 2.23.0 | |||||
| 31 | KIP-382: MirrorMaker 2.0442: Return to default max poll interval in Streams | 2.43.0 (WIP) | |||||
| 32 | KIP-380: Detect outdated control requests and bounced brokers using broker generation440: Extend Connect Converter to support headers | 2.24.0 (WIP) | |||||
| 33 | KIP-377: TopicCommand to use AdminClient436: Add a metric indicating start time | 2.23.0 | |||||
| 34 | KIP-376: Implement AutoClosable on appropriate classes that want to be used in a try-with-resource statement434: Add Replica Fetcher and Log Cleaner Count Metrics | 2.24.0 (WIP) | |||||
| 35 | KIP-374: Add '--help' option to all available Kafka CLI commands430 - Return Authorized Operations in Describe Responses | 2.23.0 | |||||
| 36 | KIP-372: Naming Repartition Topics for Joins and Grouping429: Kafka Consumer Incremental Rebalance Protocol | 2.14.0 (WIP) | |||||
| 37 | KIP-371428: Add a configuration to build custom SSL principal namein-memory window store | 2.23.0 | |||||
| 38 | KIP 368: Allow SASL Connections to Periodically Re-Authenticate-427: Add AtMinIsr topic partition category (new metric & TopicCommand option) | 2.23.0 | |||||
| 39 | KIP-367 Introduce close(Duration) to Producer and AdminClient instead of close(long, TimeUnit)425: Add some Log4J Kafka Appender Properties for Producing to Secured Brokers | 2.23.0 | |||||
| 40 | KIP- | 366: Make FunctionConversions deprecated421: Support resolving externalized secrets in AbstractConfig | 2. | 13.0 | |||
| 41 | KIP- | 365: Materialized, Serialized, Joined, Consumed and Produced with implicit Serde420: Add Single Value Fetch in Session Stores | 2.2 | 2.1.0 | |||
| 42 | KIPKIP- | 361: Add Consumer Configuration to Disable Auto Topic Creation417: Allow JmxTool to connect to a secured RMI port | 2.3.0 | ||||
| 43 | KIP- | 359: Verify leader epoch in produce requests415: Incremental Cooperative Rebalancing in Kafka Connect | 2. | 43.0 | (WIP)|||
| 44 | KIP-358: Migrate Streams API to Duration instead of long ms times414: Expose Embedded ClientIds in Kafka Streams | 2.12.0 | |||||
| 45 | KIP-357: Add support to list ACLs per principal412: Extend Admin API to support dynamic application log levels | 2.14.0 (WIP) | |||||
| 46 | 356: Add withCachingDisabled() to StoreBuilder | 2. | 13.0 | ||||
| 47 | KIP-354: Add a Maximum Log Compaction Lag402: Improve fairness in SocketServer processors | 2.32.0 (partially implemented) / 2.3.0 | |||||
| 48 | KIP-353: Improve Kafka Streams Timestamp Synchronization401: TransformerSupplier/ProcessorSupplier StateStore connecting | 2.14.0 (WIP) | |||||
| 49 | KIP-351396: Add --under-min-isr option to describe topics commandCommit/List Offsets Operations to AdminClient | 2.34.0 (WIP) | |||||
| 50 | KIP-346: Improve LogCleaner behavior on error394: Require member.id for initial join group request | 2.12.0 | |||||
| 51 | KIP-345: Introduce static membership protocol to reduce consumer rebalances393: Time windowed serde to properly deserialize changelog input topic | 2.4.0 (WIP), partially available in 2.32.0 | |||||
| 52 | KIP-389: Introduce a configurable consumer group size limit | 2.2.0 | 52|||||
| 53 | KIP-342 Add support for custom SASL extensions in OAuthBearer authentication | 2.1.0 | 53 | KIP-341: Update Sticky Assignor's User Data Protocol | 386: Standardize on Min/Avg/Max metrics' default value | 2.22.3.0 | |
| 54 | KIP-340: Allow kafka-reassign-partitions.sh and kafka-log-dirs.sh to take admin client property file382: MirrorMaker 2.0 | 2.14.0 | |||||
| 55 | 339: Create a new IncrementalAlterConfigs API | 2. | 3.04.0 (WIP) | ||||
| 56 | KIP-338 Support to exclude the internal topics in kafka-topics.sh command380: Detect outdated control requests and bounced brokers using broker generation | 2.12.0 | |||||
| 57 | KIP-336: Consolidate ExtendedSerializer/Serializer and ExtendedDeserializer/Deserializer377: TopicCommand to use AdminClient | 2.12.0 | |||||
| 58 | KIP- | 332: Update AclCommand to use AdminClient API376: Implement AutoClosable on appropriate classes that want to be used in a try-with-resource statement | 2. | 12.0 | |||
| 59 | KIP-331 Add default implementation to close() and configure() for Serializer, Deserializer and Serde374: Add '--help' option to all available Kafka CLI commands | 2.32.0 | |||||
| 60 | KIP-330: Add retentionPeriod in SessionBytesStoreSupplier372: Naming Repartition Topics for Joins and Grouping | 2.1.0 | |||||
| 61 | KIP- | 328371: | Ability to suppress updates for KTablesAdd a configuration to build custom SSL principal name | 2. | 1.0 (partially implemented) /2. | 3.0 | (WIP)|
| 62 | KIP- | 324369: | Add method to get metrics() in AdminClientAlternative Partitioner to Support "Always Round-Robin" Selection | 2. | 14.0 | ||
| 63 | KIP -322: Return new error code for DeleteTopics API when topic deletion disabled.368: Allow SASL Connections to Periodically Re-Authenticate | 2.12.0 | |||||
| 64 | KIP-321: Update TopologyDescription to better represent Source and Sink Nodes367 Introduce close(Duration) to Producer and AdminClient instead of close(long, TimeUnit) | 2.12.0 | |||||
| 65 | KIP- | 320: Allow fetchers to detect and handle log truncation366: Make FunctionConversions deprecated | 2.1 | .0 (partially implemented) / 2.2.0 | |||
| 66 | KIP-319: Replace segments with segmentInterval in WindowBytesStoreSupplier365: Materialized, Serialized, Joined, Consumed and Produced with implicit Serde | 2.1.0 | |||||
| 67 | KIPKIP-313: Add KStream.flatTransform and KStream.flatTransformValues 361: Add Consumer Configuration to Disable Auto Topic Creation | 2.2.0 (partially implemented) / 2.3.0 | |||||
| 68 | KIP-312 Add Overloaded StreamsBuilder Build Method to Accept java.util.Properties360: Improve handling of unknown producer | 2.14.0 (WIP) | |||||
| 69 | KIP- | 308: Support dynamic update of max.connections.per.ip/max.connections.per.ip.overrides359: Verify leader epoch in produce requests | 2. | 14.0 (WIP) | |||
| 70 | KIP-307358: Allow to define custom processor names with KStreams DSLMigrate Streams API to Duration instead of long ms times | 2.31.0 (partial) | |||||
| 71 | KIP- | 306: Configuration for Delaying Response to Failed Authentication357: Add support to list ACLs per principal | 2.1.0 | ||||
| 72 | KIP- | 305356: Add | Connect primitive number converterswithCachingDisabled() to StoreBuilder | 2. | 01.0 | ||
| 73 | KIP-303354: Add Dynamic Routing in Streams Sinka Maximum Log Compaction Lag | 2.03.0 | |||||
| 74 | KIP-302 - Enable Kafka clients to use all DNS resolved IP addresses353: Improve Kafka Streams Timestamp Synchronization | 2.1.0 | |||||
| 75 | KIP-300: Add Windowed KTable API in StreamsBuilder352: Distinguish URPs caused by reassignment | 2.4.0 (WIP) | |||||
| 76 | KIP-298: Error Handling in Connect351: Add --under-min-isr option to describe topics command | 2.03.0 | |||||
| 77 | KIP-297: Externalizing Secrets for Connect Configurations346: Improve LogCleaner behavior on error | 2.0.01 | |||||
| 78 | KIP-295 Add Streams Configuration Allowing for Optional Topology Optimization345: Introduce static membership protocol to reduce consumer rebalances | 2.4.0 (WIP), partially available in 2.32.0.0 | |||||
| 79 | KIP-294 - Enable TLS hostname verification by default342 Add support for custom SASL extensions in OAuthBearer authentication | 2.01.0 | |||||
| 80 | KIP-292: Add transformValues() method to KTable341: Update Sticky Assignor's User Data Protocol | 2.03.0 | |||||
| 81 | KIP-290: Support for Prefixed ACLs340: Allow kafka-reassign-partitions.sh and kafka-log-dirs.sh to take admin client property file | 2.01.0 | |||||
| 82 | KIP-289: Improve the default group id behavior in KafkaConsumer339: Create a new IncrementalAlterConfigs API | 2.23.00 | |||||
| 83 | KIP- | 285: Connect Rest Extension Plugin338 Support to exclude the internal topics in kafka-topics.sh command | 2.1 | 2.0.0 | |||
| 84 | KIP-284: Set default retention ms for Streams repartition topics to Long.MAX_VALUE336: Consolidate ExtendedSerializer/Serializer and ExtendedDeserializer/Deserializer | 2.01.0 | |||||
| 85 | KIP- | 283: Efficient Memory Usage for Down-Conversion332: Update AclCommand to use AdminClient API | 2. | 01.0 | |||
| 86 | KIP-282: Add the listener name to the authentication context331 Add default implementation to close() and configure() for Serializer, Deserializer and Serde | 2.03.0 | |||||
| 87 | KIP-281: ConsumerPerformance: Increase Polling Loop Timeout and Make It Reachable by the End User330: Add retentionPeriod in SessionBytesStoreSupplier | 2.01.0 | |||||
| 88 | KIP- | 279: Fix log divergence between leader and follower after fast leader fail over328: Ability to suppress updates for KTables | 2.1.0 (partially implemented) / 2.3.0 (WIP) | 2.0.0||||
| 89 | KIP-278 - Add version option to Kafka's commands324: Add method to get metrics() in AdminClient | 2.01.0 | |||||
| 90 | KIP- | 277 - Fine Grained ACL for CreateTopics API322: Return new error code for DeleteTopics API when topic deletion disabled. | 2. | 01.0 | |||
| 91 | KIP- | 276 - Add StreamsConfig prefix for different consumers321: Update TopologyDescription to better represent Source and Sink Nodes | 2. | 01.0 | |||
| 92 | KIP- | 274: Kafka Streams Skipped Records Metrics320: Allow fetchers to detect and handle log truncation | 2.1.0 (partially implemented) / 2.2. | 2.0.0 | |||
| 93 | KIP-272: Add API version tag to broker's RequestsPerSec metric319: Replace segments with segmentInterval in WindowBytesStoreSupplier | 2.01.0 | |||||
| 94 | KIP-270 - A Scala Wrapper Library for Kafka Streams313: Add KStream.flatTransform and KStream.flatTransformValues | 2.2.0 (partially implemented) / 2.3.0 | |||||
| 95 | KIP- | 268: Simplify Kafka Streams Rebalance Metadata Upgrade312 Add Overloaded StreamsBuilder Build Method to Accept java.util.Properties | 2. | 01.0 | |||
| 96 | KIP-267308: Add Processor Unit Test Support to Kafka Streams Test UtilsSupport dynamic update of max.connections.per.ip/max.connections.per.ip.overrides | 2.01.0 | |||||
| 97 | KIP-266: Fix consumer indefinite blocking behavior307: Allow to define custom processor names with KStreams DSL | 2.03.0 (partial) | |||||
| 98 | KIP- | 265: Make Windowed Serde to public APIs306: Configuration for Delaying Response to Failed Authentication | 2. | 01.0 | |||
| 99 | KIP-261305: Add Single Value Fetch in Window StoresConnect primitive number converters | 2.0.0 | |||||
| 100 | KIP-258: Allow to Store Record Timestamps in RocksDB303: Add Dynamic Routing in Streams Sink | 2.30.0 (partially implemented) | |||||
| 101 | KIP- | 257 - Configurable Quota Management302 - Enable Kafka clients to use all DNS resolved IP addresses | 2. | 01.0 | |||
| 102 | KIP-255: OAuth Authentication via SASL/OAUTHBEARER300: Add Windowed KTable API in StreamsBuilder | 2.04.0 | |||||
| 103 | KIP- | 251: Allow timestamp manipulation in Processor API298: Error Handling in Connect | 2.0.0 | ||||
| 104 | KIP- | 249: Add Delegation Token Operations to KafkaAdminClient297: Externalizing Secrets for Connect Configurations | 2.0.0 | ||||
| 105 | KIP- | 247: Add public test utils for Kafka Streams295 Add Streams Configuration Allowing for Optional Topology Optimization | 2.0 | 1.1.0 | |||
| 106 | KIP | -245: Use Properties instead of StreamsConfig in KafkaStreams constructor-294 - Enable TLS hostname verification by default | 2.0.0 | ||||
| 107 | 244: Add Record Header support to Kafka Streams Processor API2.0.0 | Accepted | |||||
| 108 | KIP- | 243: Make ProducerConfig and ConsumerConfig constructors public292: Add transformValues() method to KTable | 2.0 | 1.1.0 | |||
| 109 | KIP- | 239 Add queryableStoreName() to GlobalKTable290: Support for Prefixed ACLs | 2.0 | 1.1.0 | |||
| 110 | KIP- | 238: Expose Kafka cluster ID in Connect REST API289: Improve the default group id behavior in KafkaConsumer | 2.2 | 1.1.0 | |||
| 111 | KIP-237: More Controller Health Metrics285: Connect Rest Extension Plugin | 2.0.0 | |||||
| 112 | KIP-235: Add DNS alias support for secured connection284: Set default retention ms for Streams repartition topics to Long.MAX_VALUE | 2.10.0 | |||||
| 113 | KIP- | 233: Simplify StreamsBuilder#addGlobalStore283: Efficient Memory Usage for Down-Conversion | 2.0 | 1.1.0 | |||
| 114 | KIP-231: Improve the Required ACL of ListGroups API282: Add the listener name to the authentication context | 2.10.0 | |||||
| 115 | KIP- | 229: DeleteGroups API281: ConsumerPerformance: Increase Polling Loop Timeout and Make It Reachable by the End User | 2.0 | 1.1.0 | |||
| 116 | KIP-227 - Introduce Incremental FetchRequests to Increase Partition Scalability279: Fix log divergence between leader and follower after fast leader fail over | 2.01.1.0 | |||||
| 117 | KIP- | 226 - Dynamic Broker Configuration278 - Add version option to Kafka's commands | 2.0 | 1.1.0 | |||
| 118 | KIP- | 225 - Use tags for consumer “records.lag” metrics277 - Fine Grained ACL for CreateTopics API | 2.0 | 1.1.0 | |||
| 119 | KIP-276 - 224: Add configuration parameter `retries` to Streams APIAdd StreamsConfig prefix for different consumers | 2.01.1.0 | |||||
| 120 | KIP-223 - Add per-topic min lead and per-partition lead metrics to KafkaConsumer274: Kafka Streams Skipped Records Metrics | 2.0.0 | |||||
| 121 | KIP- | 222 - Add Consumer Group operations to Admin API272: Add API version tag to broker's RequestsPerSec metric | 2.0.0 | ||||
| 122 | KIP | -220: Add AdminClient into-270 - A Scala Wrapper Library for Kafka Streams | ' ClientSupplier1 | 2. | 10.0 | ||
| 123 | KIP-219 - Improve quota communication268: Simplify Kafka Streams Rebalance Metadata Upgrade | 2.0.0 | |||||
| 124 | KIP-218: Make KafkaFuture.Function java 8 lambda compatible267: Add Processor Unit Test Support to Kafka Streams Test Utils | 2.01.1.0 | |||||
| 125 | KIP- | 215: Add topic regex support for Connect sinks266: Fix consumer indefinite blocking behavior | 2.0 | 1.1.0 | |||
| 126 | KIP-214: Add zookeeper.max.in.flight.requests config to the broker265: Make Windowed Serde to public APIs | 2.01.1.0 | |||||
| 127 | KIP- | 213 Support non-key joining in KTable261: Add Single Value Fetch in Window Stores | 2. | 40.0 | (WIP)|||
| 128 | KIP- | 212: Enforce set of legal characters for connector names258: Allow to Store Record Timestamps in RocksDB | 2.3.0 (partially implemented) | 1.1.0||||
| 129 | KIP-211: Revise Expiration Semantics of Consumer Group Offsets257 - Configurable Quota Management | 2.10.0 | |||||
| 130 | KIP- | 210 - Provide for custom error handling when Kafka Streams fails to produce255: OAuth Authentication via SASL/OAUTHBEARER | 2.0 | 1.1.0 | |||
| 131 | KIP-208: Add SSL support to Kafka Connect REST interface251: Allow timestamp manipulation in Processor API | 2.01.1.0 | |||||
| 132 | KIP-207: Offsets returned by ListOffsetsResponse should be monotonically increasing even during a partition leader change249: Add Delegation Token Operations to KafkaAdminClient | 2.20.0 | |||||
| 133 | KIP- | 206247: Add | support for UUID serialization and deserializationpublic test utils for Kafka Streams | 1 | 2.1.0 | ||
| 134 | KIP-205: Add all() and range() API to ReadOnlyWindowStore245: Use Properties instead of StreamsConfig in KafkaStreams constructor | 2.01.1.0 | |||||
| 135 | KIP- | 204 : Adding records deletion operation to the new Admin Client API244: Add Record Header support to Kafka Streams Processor API | 2.0 | 1.1.0 | |||
| 136 | KIP-203: Add toLowerCase support to sasl.kerberos.principal.to.local rule 243: Make ProducerConfig and ConsumerConfig constructors public | 1.1.0 | |||||
| 137 | KIP-202: Move merge239 Add queryableStoreName() from StreamsBuilder to KStreamGlobalKTable | 1.01.0 | |||||
| 138 | KIP-198: Remove ZK dependency from Streams Reset Tool238: Expose Kafka cluster ID in Connect REST API | 1.01.0 | |||||
| 139 | KIP-197 Connect REST API should include the connector type when describing a connector237: More Controller Health Metrics | 21.0.0 | |||||
| 140 | KIP- | 196235: Add | metrics to Kafka Connect frameworkDNS alias support for secured connection | 2. | 1.0 | .0||
| 141 | KIP-195: AdminClient.createPartitions233: Simplify StreamsBuilder#addGlobalStore | 1.01.0 | |||||
| 142 | KIP- | 192 : Provide cleaner semantics when idempotence is enabled231: Improve the Required ACL of ListGroups API | 2.1 | 1.0.0 | |||
| 143 | KIP-191: KafkaConsumer.subscribe() overload that takes just Pattern229: DeleteGroups API | 1.01.0 | |||||
| 144 | KIP-190: Handle client-ids consistently between clients and brokers227 - Introduce Incremental FetchRequests to Increase Partition Scalability | 1.01.0 | |||||
| 145 | KIP-189: Improve principal builder interface and add support for SASL-226 - Dynamic Broker Configuration | 1.01.0 | |||||
| 146 | KIP-188 - Add new metrics to support health checks225 - Use tags for consumer “records.lag” metrics | 1.01.0 | |||||
| 147 | KIP-187 - Add cumulative count metric for all Kafka rate metrics224: Add configuration parameter `retries` to Streams API | 1.01.0 | |||||
| 148 | KIP-186: Increase offsets retention default to 7 days-223 - Add per-topic min lead and per-partition lead metrics to KafkaConsumer | 2.0.0 | |||||
| 149 | KIP-183 - Change PreferredReplicaLeaderElectionCommand to use AdminClient222 - Add Consumer Group operations to Admin API | 2.20.0 | |||||
| 150 | KIP-182221: Reduce Streams DSL overloads and allow easier use of custom storage enginesEnhance DSL with Connecting Topic Creation and Repartition Hint | 2.4.0 (WIP)1.0.0 | |||||
| 151 | KIP-180: Add a broker metric specifying the number of consumer group rebalances in progress220: Add AdminClient into Kafka Streams' ClientSupplier | 1.1.0 | |||||
| 152 | KIP-177: Consumer perf tool should count rebalance time219 - Improve quota communication | 21.0.0 | |||||
| 153 | KIP- | 176: Remove deprecated new-consumer option for tools218: Make KafkaFuture.Function java 8 lambda compatible | 1.1 | 2.0.0 | |||
| 154 | KIP-175: Additional '--describe' views for ConsumerGroupCommand215: Add topic regex support for Connect sinks | 1.1.0 | |||||
| 155 | KIP-174 - Deprecate and remove internal converter configs in WorkerConfig214: Add zookeeper.max.in.flight.requests config to the broker | 1.12.0.0 | |||||
| 156 | KIP- | 173: Add prefix to StreamsConfig to enable setting default internal topic configs213 Support non-key joining in KTable | 2.4.0 (WIP) | 1.0.0||||
| 157 | KIP-171 - Extend Consumer Group Reset Offset for Stream Application212: Enforce set of legal characters for connector names | 1.1.0 | |||||
| 158 | KIP-168: Add GlobalTopicCount and GlobalPartitionCount metric per cluster211: Revise Expiration Semantics of Consumer Group Offsets | 2.1.0.0 | |||||
| 159 | KIP-167: Add interface for the state store restoration process-210 - Provide for custom error handling when Kafka Streams fails to produce | 1.01.0 | |||||
| 160 | KIP-164 - Add UnderMinIsrPartitionCount and per-partition UnderMinIsr metrics208: Add SSL support to Kafka Connect REST interface | 1.01.0 | |||||
| 161 | KIP- | 163: Lower the Minimum Required ACL Permission of OffsetFetch207: Offsets returned by ListOffsetsResponse should be monotonically increasing even during a partition leader change | 2.2 | 1.0.0 | |||
| 162 | KIP- | 162: Enable topic deletion by default206: Add support for UUID serialization and deserialization | 2. | 1.0 | .0|||
| 163 | KIP-161: streams deserialization exception handlers205: Add all() and range() API to ReadOnlyWindowStore | 1.01.0 | |||||
| 164 | KIP-160: Augment KStream.print(), KStream.writeAsText() to allow users pass in extra parameters in the printed string204 : Adding records deletion operation to the new Admin Client API | 1.1.1.0.0 | |||||
| 165 | KIP- | 157 - Add consumer config options to streams reset tool203: Add toLowerCase support to sasl.kerberos.principal.to.local rule | 1. | 01.0 | |||
| 166 | KIP- | 156 Add option "dry run" to Streams application reset tool202: Move merge() from StreamsBuilder to KStream | 1. | 0.11.0.0 | |||
| 167 | KIP- | 155 - Add range scan for windowed state stores198: Remove ZK dependency from Streams Reset Tool | 1 | 0.11.0.0 | |||
| 168 | KIP-154 Add Kafka Connect configuration properties for creating internal topics197 Connect REST API should include the connector type when describing a connector | 1.0.11.0.0 | |||||
| 169 | KIP-153: Include only client traffic in BytesOutPerSec metric196: Add metrics to Kafka Connect framework | 10.11.0.0 | |||||
| 170 | KIP-152 - Improve diagnostics for SASL authentication failures195: AdminClient.createPartitions | 1.0.0 | |||||
| 171 | KIP-151 Expose Connector type in REST API192 : Provide cleaner semantics when idempotence is enabled | 1.0.11.0.0 | |||||
| 172 | KIP-150 - Kafka-Streams Cogroup191: KafkaConsumer.subscribe() overload that takes just Pattern | 1.0.02.4.0 (WIP) | |||||
| 173 | KIP-149: Enabling key access in ValueTransformer, ValueMapper, and ValueJoiner190: Handle client-ids consistently between clients and brokers | 1.1.0 (partially implemented) (WIP for 2.4.0) | |||||
| 174 | KIP-146 - Classloading Isolation in Connect189: Improve principal builder interface and add support for SASL | 1.0.11.0.0 | |||||
| 175 | KIP-145 - Expose Record Headers in Kafka Connect188 - Add new metrics to support health checks | 1.10.0 | |||||
| 176 | KIP-144: Exponential backoff for broker reconnect attempts-187 - Add cumulative count metric for all Kafka rate metrics | 10.11.0.0 | |||||
| 177 | KIP-143: Controller Health Metrics186: Increase offsets retention default to 7 days | 2.0.11.0.0 | |||||
| 178 | KIP-140: Add administrative RPCs for adding, deleting, and listing ACLs-183 - Change PreferredReplicaLeaderElectionCommand to use AdminClient | 2.20.11.0.0 | |||||
| 179 | KIP-138: Change punctuate semantics182: Reduce Streams DSL overloads and allow easier use of custom storage engines | 1.0.0 | |||||
| 180 | KIP-137: Enhance TopicCommand --describe to show topics marked for deletion180: Add a broker metric specifying the number of consumer group rebalances in progress | 1.10.11.0.0 | |||||
| 181 | KIP-136: Add Listener name to SelectorMetrics tags177: Consumer perf tool should count rebalance time | 1.0.11.0.0 | |||||
| 182 | KIP- | 134: Delay initial consumer group rebalance176: Remove deprecated new-consumer option for tools | 2 | 0.11.0.0 | |||
| 183 | KIP-133: Describe and Alter Configs Admin APIs175: Additional '--describe' views for ConsumerGroupCommand | 1.10.11.0.0 | |||||
| 184 | KIP- | 130: Expose states of active tasks to KafkaStreams public API174 - Deprecate and remove internal converter configs in WorkerConfig | 2 | 1.0.0 | |||
| 185 | KIP-129: Streams Exactly-Once Semantics173: Add prefix to StreamsConfig to enable setting default internal topic configs | 1.0.11.0.0 | |||||
| 186 | KIP-128: Add ByteArrayConverter for Kafka Connect-171 - Extend Consumer Group Reset Offset for Stream Application | 1.10.11.0.0 | |||||
| 187 | KIP-126 - Allow KafkaProducer to split and resend oversized batches.168: Add GlobalTopicCount and GlobalPartitionCount metric per cluster | 10.11.0.0 | |||||
| 188 | KIP-124 - Request rate quotas167: Add interface for the state store restoration process | 1.0.11.0.0 | |||||
| 189 | -123: Allow per stream/table timestamp extractor -164 - Add UnderMinIsrPartitionCount and per-partition UnderMinIsr metrics | 10.11.0.0 | |||||
| 190 | 122: Add Reset Consumer Group Offsets tooling | 1. | 0.11.0.0 | ||||
| 191 | KIP-121: Add KStream peek method162: Enable topic deletion by default | 1.0.11.0.0 | |||||
| 192 | KIP-120: Cleanup Kafka Streams builder API161: streams deserialization exception handlers | 1.0.0 | |||||
| 193 | KIP-119: Drop Support for Scala 2.10 in Kafka 0.11160: Augment KStream.print(), KStream.writeAsText() to allow users pass in extra parameters in the printed string | 10.11.0.0 | |||||
| 194 | KIP | -118: Drop Support for Java 7-157 - Add consumer config options to streams reset tool | 1 | 2.0.0 | |||
| 195 | KIP- | 117: Add a public AdminClient API for Kafka admin operations156 Add option "dry run" to Streams application reset tool | 0.11.0.0 | ||||
| 196 | KIP- | 115: Enforce offsets.topic.replication.factor upon __consumer_offsets auto topic creation155 - Add range scan for windowed state stores | 0. | 0.11.0.0 | |||
| 197 | KIP-114: KTable state stores and improved semantics154 Add Kafka Connect configuration properties for creating internal topics | 0.11.0.0 | |||||
| 198 | KIP-113: Support replicas movement between log directories153: Include only client traffic in BytesOutPerSec metric | 0.11.01.1.0 | |||||
| 199 | KIP-112: Handle disk failure for JBOD152 - Improve diagnostics for SASL authentication failures | 1.0.0 | |||||
| 200 | KIP- | 110: Add Codec for ZStandard Compression151 Expose Connector type in REST API | 0.11.0 | 2.1.0 | |||
| 201 | KIP-109: Old Consumer Deprecation-150 - Kafka-Streams Cogroup | 2.4.0 (WIP)0.11.0.0 | |||||
| 202 | KIP-108: Create Topic Policy149: Enabling key access in ValueTransformer, ValueMapper, and ValueJoiner | 1.1.0 (partially implemented) (WIP for 2.4.0)0.10.2.0 | |||||
| 203 | KIP-107: Add deleteRecordsBefore() API in AdminClient-146 - Classloading Isolation in Connect | 0.11.0.0 | |||||
| 204 | KIP-106 - Change Default unclean.leader.election.enabled from True to False145 - Expose Record Headers in Kafka Connect | 1.10.11.0.0 | |||||
| 205 | KIP-105: Addition of Record Level for Sensors144: Exponential backoff for broker reconnect attempts | 0.1011.20.0 | |||||
| 206 | KIP-104: Granular Sensors for Streams 143: Controller Health Metrics | 0.1011.20.0 | |||||
| 207 | KIP-103: Separation of Internal and External traffic140: Add administrative RPCs for adding, deleting, and listing ACLs | 0.1011.20.0 | |||||
| 208 | KIP-102 - Add close with timeout for consumers138: Change punctuate semantics | 1.00.10.2.0 | |||||
| 209 | KIP-137: Enhance TopicCommand -101 - Alter Replication Protocol to use Leader Epoch rather than High Watermark for Truncationdescribe to show topics marked for deletion | 0.11.0.0 | |||||
| 210 | KIP-100 - Relax Type constraints in Kafka Streams API136: Add Listener name to SelectorMetrics tags | 0.1011.20.0 | |||||
| 211 | KIP-99: Add Global Tables to Kafka Streams134: Delay initial consumer group rebalance | 0.1011.20.0 | |||||
| 212 | KIP-98 - Exactly Once Delivery and Transactional Messaging133: Describe and Alter Configs Admin APIs | 0.11.0.0 | |||||
| 213 | KIP- | 97: Improved Kafka Client RPC Compatibility Policy130: Expose states of active tasks to KafkaStreams public API | 1.0. | 0.10.2.0 | |||
| 214 | KIP-96 - Add per partition metrics for in-sync and assigned replica count129: Streams Exactly-Once Semantics | 0.1011.20.0 | |||||
| 215 | KIP-94 Session Windows128: Add ByteArrayConverter for Kafka Connect | 0.1011.20.0 | |||||
| 216 | KIP-93: Improve invalid timestamp handling in Kafka Streams-126 - Allow KafkaProducer to split and resend oversized batches. | 0.1011.20.0 | |||||
| 217 | KIP-92 - Add per partition lag metrics to KafkaConsumer124 - Request rate quotas | 0.1011.20.0 | |||||
| 218 | KIP-91 Provide Intuitive User Timeouts in The Producer123: Allow per stream/table timestamp extractor | 0.11.02.1.0 | |||||
| 219 | KIP-90 - Remove zkClient dependency from Streams122: Add Reset Consumer Group Offsets tooling | 0.1011.20.0 | |||||
| 220 | KIP-89: Allow sink connectors to decouple flush and offset commit121: Add KStream peek method | 0. 1011. 20.0 | |||||
| 221 | KIP-88: OffsetFetch Protocol Update120: Cleanup Kafka Streams builder API | 1.00.10.2.0 | |||||
| 222 | KIP-86: Configurable SASL callback handlers119: Drop Support for Scala 2.10 in Kafka 0.11 | 0.112.0.0 | |||||
| 223 | KIP-85: Dynamic JAAS configuration for Kafka clients118: Drop Support for Java 7 | 2.0.0.10.2.0 | |||||
| 224 | KIP-84: Support SASL SCRAM mechanisms117: Add a public AdminClient API for Kafka admin operations | 0.1011.20.0 | |||||
| 225 | KIP-82 - Add Record Headers115: Enforce offsets.topic.replication.factor upon __consumer_offsets auto topic creation | 0.11.0.0 | |||||
| 226 | KIP-81: Bound Fetch memory usage in the consumer114: KTable state stores and improved semantics | 0.11.0.02.4.0 (WIP) | |||||
| 227 | KIP-79 - ListOffsetRequest/ListOffsetResponse v1 and add timestamp search methods to the new consumer113: Support replicas movement between log directories | 1.0.10.1.0 | |||||
| 228 | KIP-78: Cluster Id112: Handle disk failure for JBOD | 1.00.10.1.0 | |||||
| 229 | KIP- | 77: Improve Kafka Streams Join Semantics110: Add Codec for ZStandard Compression | 2.1 | 0.10.2.0 | |||
| 230 | KIP-75 - Add per-connector Converters109: Old Consumer Deprecation | 0.1011.10.0 | |||||
| 231 | KIP-74: Add Fetch Response Size Limit in Bytes108: Create Topic Policy | 0.10.12.0 | |||||
| 232 | KIP-73: Replication Quotas107: Add deleteRecordsBefore() API in AdminClient | 0.1011.10.0 | |||||
| 233 | 72: Allow putting a bound on memory consumed by Incoming request 106 - Change Default unclean.leader.election.enabled from True to False | 0.111.0.0 | |||||
| 234 | KIP-71: Enable log compaction and deletion to co-exist105: Addition of Record Level for Sensors | 0.10.12.0 | |||||
| 235 | KIP-70: Revise Partition Assignment Semantics on New Consumer's Subscription Change104: Granular Sensors for Streams | 0.10.12.0 | |||||
| 236 | KIP-67: Queryable state for Kafka Streams103: Separation of Internal and External traffic | 0.10.12.0 | |||||
| 237 | KIP-66: Single Message Transforms for Kafka Connect-102 - Add close with timeout for consumers | 0.10.2.0 / 0.11.0.0 | |||||
| 238 | KIP-101 - Alter Replication Protocol to use Leader Epoch rather than High Watermark for Truncation | 0.11.0 | 238 | KIP-65: Expose timestamps to Connect | 0.10.1.0 | ||
| 239 | KIP-63: Unify store and downstream caching in streams-100 - Relax Type constraints in Kafka Streams API | 0.10.12.0 | |||||
| 240 | KIP-62: Allow consumer to send heartbeats from a background thread99: Add Global Tables to Kafka Streams | 0.10.12.0 | |||||
| 241 | KIP-60 - Make Java client classloading more flexible98 - Exactly Once Delivery and Transactional Messaging | 0.1011.10.0 | |||||
| 242 | KIP-58 - Make Log Compaction Point Configurable97: Improved Kafka Client RPC Compatibility Policy | 0.10.12.0 | |||||
| 243 | KIP-57 - Interoperable LZ4 Framing96 - Add per partition metrics for in-sync and assigned replica count | 0.10.20.10.0.0 | |||||
| 244 | KIP-56: Allow cross origin HTTP requests on all HTTP methods94 Session Windows | 0.10.02.0 | |||||
| 245 | KIP-55: Secure Quotas for Authenticated Users93: Improve invalid timestamp handling in Kafka Streams | 0.10.12.0 | |||||
| 246 | KIP-54: Sticky Partition Assignment Strategy92 - Add per partition lag metrics to KafkaConsumer | 0.1110.02.0 | |||||
| 247 | KIP-52: Connector Control APIs91 Provide Intuitive User Timeouts in The Producer | 2.1.00.10.0.0 | |||||
| 248 | KIP-51 - List Connectors REST API90 - Remove zkClient dependency from Streams | 0.10.02.0 | |||||
| 249 | KIP-50 - Move Authorizer to o.a.k.common package89: Allow sink connectors to decouple flush and offset commit | 0.10.12.0 | |||||
| 250 | KIP-48 Delegation token support for Kafka88: OffsetFetch Protocol Update | 0.10.21.1.0 | |||||
| 251 | KIP-86: Configurable SASL callback handlers | 245 - Standardize all client sequence interaction on j.u.Collection.0.10.0.0 | |||||
| 252 | KIP-4385: Kafka SASL enhancementsDynamic JAAS configuration for Kafka clients | 0.10.02.0 | |||||
| 253 | KIP-42: Add Producer and Consumer Interceptors84: Support SASL SCRAM mechanisms | 0.10.02.0 | |||||
| 254 | KIP-41: Consumer Max Records-82 - Add Record Headers | 0.1011.0.0 | |||||
| 255 | KIP-40: ListGroups and DescribeGroup81: Bound Fetch memory usage in the consumer | 2.4.0 (WIP)0.9.0.0 | |||||
| 256 | KIP-38: ZooKeeper Authentication-79 - ListOffsetRequest/ListOffsetResponse v1 and add timestamp search methods to the new consumer | 0.910.01.0 | |||||
| 257 | KIP-36 - Rack aware replica assignment78: Cluster Id | 0.10.01.0 | |||||
| 258 | KIP-35 - Retrieving protocol version77: Improve Kafka Streams Join Semantics | 0.10.02.0 | |||||
| 259 | KIP-33 75 - Add a time based log indexper-connector Converters | 0.10.1.0 | |||||
| 260 | KIP-32 - Add timestamps to Kafka message74: Add Fetch Response Size Limit in Bytes | 0.10.01.0 | |||||
| 261 | KIP-31 - Move to relative offsets in compressed message sets73: Replication Quotas | 0.10.01.0 | |||||
| 262 | KIP-28 - Add a processor client72: Allow putting a bound on memory consumed by Incoming request | 10.10.0.0 | |||||
| 263 | KIP-26 - Add Kafka Connect framework for data import/export71: Enable log compaction and deletion to co-exist | 0.910.01.0 | |||||
| 264 | KIP-25 - System test improvements70: Revise Partition Assignment Semantics on New Consumer's Subscription Change | 0.910.01.0 | |||||
| 265 | KIP-22 - Expose a Partitioner interface in the new producer67: Queryable state for Kafka Streams | 0.910.01.0 | |||||
| 266 | KIP-21 - Dynamic Configuration66: Single Message Transforms for Kafka Connect | 0.910.2.0 / 0.11.0.0 (WIP) | |||||
| 267 | KIP-20 Enable log preallocate to improve consume performance under windows and some old Linux file system65: Expose timestamps to Connect | 0.910.01.0 | |||||
| 268 | KIP-19 - Add a request timeout to NetworkClient63: Unify store and downstream caching in streams | 0.910.01.0 | |||||
| 269 | KIP-16 - Automated Replica Lag Tuning62: Allow consumer to send heartbeats from a background thread | 0.910.01.0 | |||||
| 270 | KIP-15 - Add a close method with a timeout in the producer60 - Make Java client classloading more flexible | 0.910.01.0 | |||||
| 271 | KIP-13 - Quota Design58 - Make Log Compaction Point Configurable | 0.910.01.0 | |||||
| 272 | KIP-12 - Kafka Sasl/Kerberos and SSL implementation57 - Interoperable LZ4 Framing | 0.910.0.0 | |||||
| 273 | KIP-11 - Kafka Authorizer design56: Allow cross origin HTTP requests on all HTTP methods | 0.910.0.0 | |||||
| 274 | KIP-8 - Add a flush method to the producer API55: Secure Quotas for Authenticated Users | 0.910.01.0 | |||||
| 275 | KIP-4 - Metadata Protocol Changes54: Sticky Partition Assignment Strategy | 0.1011.0.0 | |||||
| 276 | KIP-4 - Command line and centralized administrative operations52: Connector Control APIs | 0.910.0.0, | |||||
| 277 | KIP-51 - List Connectors REST API | 0.10.0.0, 0.10. | |||||
| 278 | KIP-48 Delegation token support for Kafka | 1.1.0 | |||||
| 277279 | KIP-3 - Mirror Maker Enhancement45 - Standardize all client sequence interaction on j.u.Collection. | 0.910.0.0 | |||||
| 278280 | KIP-2 - Refactor brokers to allow listening on multiple ports and IPs43: Kafka SASL enhancements | 0.910.0.0 | |||||
| 279281 | KIP-1 - Remove support of request.required.acks42: Add Producer and Consumer Interceptors | 0.910.0.0 |
...
KIPs under discussion
Please insert new rows in sorted order (ascending by KIP number). Please move the adopted/accepted KIPs to the "Adopted KIPs" table above.
Please insert new rows in sorted order (by KIP number).
Dormant/inactive KIPs
Please insert new rows in sorted order (ascending by KIP number).
Discarded KIPs
Please insert new rows in sorted order (ascending by KIP number).
KIP Discussion Recordings
...