...
KIP round-up
Next KIP Number: 490530
Use this number as the identifier for your KIP and increment this value.
...
Please insert new rows in sorted order (descending by KIP number).
KIP (please keep this sorted by KIP number) | Release | ||||||
---|---|---|---|---|---|---|---|
1 | KIP- | 465: Add Consolidated Connector Endpoint to Connect REST API500: Replace ZooKeeper with a Self-Managed Metadata Quorum | |||||
2 | KIP-482: The Kafka Protocol should Support Optional Tagged Fields | 2.3.0 | 2 | KIP-464: Defaults for AdminClient#createTopic2.4.0 (WIP) | |||
3 | KIP-462: Use local thread id for KStreams504 - Add new Java Authorizer Interface | 2.34.0 (WIP) | |||||
4 | KIP-461: Improve Replica Fetcher behavior at handling partition failure503: Add metric for number of topics marked for deletion | 2.34.0 (WIP) | |||||
5 | KIP- | 460: Admin Leader Election RPC497: Add inter-broker API to alter ISR | 2.4.0 (WIP) | ||||
6 | KIP- | 458: Connector Client Config Override Policy496: Administrative API to delete consumer offsets | 2. | 34.0 (WIP) | |||
7 | KIP- | 454: Expansion of the ConnectClusterState interface495: Dynamically Adjust Log Levels in Connect | 2. | 34.0 (WIP) | |||
8 | KIP-453: Add close() method to RocksDBConfigSetter488: Clean up Sum,Count,Total Metrics | 2.34.0 | |||||
9 | KIP- | 449: Add connector contexts to log messages in Connect workers484: Expose metrics for group and transaction metadata loading duration | 2. | 34.0 (WIP) | |||
10 | KIP-446: Add changelog topic configuration to KTable suppress481: SerDe Improvements for Connect Decimal type in JSON | 2.4.0 (WIP) | |||||
11 | KIP- | 445: In-memory Session Store480: Sticky Partitioner | 2. | 34.0 | |||
12 | KIP- | 443479: | Return to default segment.ms and segment.index.bytes in Streams repartition topicsAdd Materialized to Join | 2. | 34.0(WIP) | ||
13 | KIP-442: Return to default max poll interval in Streams476: Add Java AdminClient Interface | 2.34.0 | |||||
14 | KIP- | 436: Add a metric indicating start time475: New Metrics to Measure Number of Tasks on a Connector | 2. | 34.0 (WIP) | |||
15 | KIP- | 430 - Return Authorized Operations in Describe Responses474: To deprecate WindowStore#put(key, value) | 2. | 34.0 (WIP) | |||
16 | KIP- | 429471: | Kafka Consumer Incremental Rebalance ProtocolExpose RocksDB Metrics in Kafka Streams | 2.4.0 (WIP) | |||
17 | KIP- | 428: Add in-memory window store467: Augment ProduceResponse error messaging for specific culprit records | 2. | 34.0 (WIP) | |||
18 | KIP- | 427: Add AtMinIsr topic partition category (new metric & TopicCommand option)465: Add Consolidated Connector Endpoint to Connect REST API | 2.3.0 | ||||
19 | KIP-425: Add some Log4J Kafka Appender Properties for Producing to Secured Brokers464: Defaults for AdminClient#createTopic | 2.34.0 | |||||
20 | KIP-421: Support resolving externalized secrets in AbstractConfig462: Use local thread id for KStreams | 2.3.0 | |||||
21 | KIP- | 420: Add Single Value Fetch in Session Stores461: Improve Replica Fetcher behavior at handling partition failure | 2. | 23.0 | |||
22 | KIP-417: Allow JmxTool to connect to a secured RMI port460: Admin Leader Election RPC | 2.34.0 | |||||
23 | KIP-415: Incremental Cooperative Rebalancing in Kafka Connect458: Connector Client Config Override Policy | 2.3.0 | |||||
24 | KIP-414: Expose Embedded ClientIds in Kafka Streams455: Create an Administrative API for Replica Reassignment | 2.24.0 (WIP) | |||||
25 | KIP- | 412: Extend Admin API to support dvynamic application log levels454: Expansion of the ConnectClusterState interface | 2. | 43.0 | (WIP)|||
26 | KIP- | 411: Make default Kafka Connect worker task client IDs distinct453: Add close() method to RocksDBConfigSetter | 2.3.0 | ||||
27 | KIP- | 402: Improve fairness in SocketServer processors449: Add connector contexts to log messages in Connect workers | 2. | 2.2.0 (partially implemented) / 2.3.0 | |||
28 | KIP-394: Require member.id for initial join group request446: Add changelog topic configuration to KTable suppress | 2.24.0 (WIP) | |||||
29 | KIP-393: Time windowed serde to properly deserialize changelog input topic445: In-memory Session Store | 2.23.0 | |||||
30 | 386: Standardize on Min/Avg/Max metrics' default value | 2.23.0 | |||||
31 | KIP-382: MirrorMaker 2.0442: Return to default max poll interval in Streams | 2.43.0 (WIP) | |||||
32 | KIP-380: Detect outdated control requests and bounced brokers using broker generation440: Extend Connect Converter to support headers | 2.24.0 (WIP) | |||||
33 | KIP-377: TopicCommand to use AdminClient436: Add a metric indicating start time | 2.23.0 | |||||
34 | KIP-376: Implement AutoClosable on appropriate classes that want to be used in a try-with-resource statement434: Add Replica Fetcher and Log Cleaner Count Metrics | 2.24.0 (WIP) | |||||
35 | KIP-374: Add '--help' option to all available Kafka CLI commands430 - Return Authorized Operations in Describe Responses | 2.23.0 | |||||
36 | KIP-372: Naming Repartition Topics for Joins and Grouping429: Kafka Consumer Incremental Rebalance Protocol | 2.14.0 (WIP) | |||||
37 | KIP-371428: Add a configuration to build custom SSL principal namein-memory window store | 2.23.0 | |||||
38 | KIP 368: Allow SASL Connections to Periodically Re-Authenticate-427: Add AtMinIsr topic partition category (new metric & TopicCommand option) | 2.23.0 | |||||
39 | KIP-367 Introduce close(Duration) to Producer and AdminClient instead of close(long, TimeUnit)425: Add some Log4J Kafka Appender Properties for Producing to Secured Brokers | 2.23.0 | |||||
40 | KIP- | 366: Make FunctionConversions deprecated421: Support resolving externalized secrets in AbstractConfig | 2. | 13.0 | |||
41 | KIP- | 365: Materialized, Serialized, Joined, Consumed and Produced with implicit Serde420: Add Single Value Fetch in Session Stores | 2.2 | 2.1.0 | |||
42 | KIPKIP- | 361: Add Consumer Configuration to Disable Auto Topic Creation417: Allow JmxTool to connect to a secured RMI port | 2.3.0 | ||||
43 | KIP- | 359: Verify leader epoch in produce requests415: Incremental Cooperative Rebalancing in Kafka Connect | 2. | 43.0 | (WIP)|||
44 | KIP-358: Migrate Streams API to Duration instead of long ms times414: Expose Embedded ClientIds in Kafka Streams | 2.12.0 | |||||
45 | KIP-357: Add support to list ACLs per principal412: Extend Admin API to support dynamic application log levels | 2.14.0 (WIP) | |||||
46 | 356: Add withCachingDisabled() to StoreBuilder | 2. | 13.0 | ||||
47 | KIP-354: Add a Maximum Log Compaction Lag402: Improve fairness in SocketServer processors | 2.32.0 (partially implemented) / 2.3.0 | |||||
48 | KIP-353: Improve Kafka Streams Timestamp Synchronization401: TransformerSupplier/ProcessorSupplier StateStore connecting | 2.14.0 (WIP) | |||||
49 | KIP-351396: Add --under-min-isr option to describe topics commandCommit/List Offsets Operations to AdminClient | 2.34.0 (WIP) | |||||
50 | KIP-346: Improve LogCleaner behavior on error394: Require member.id for initial join group request | 2.12.0 | |||||
51 | KIP-345: Introduce static membership protocol to reduce consumer rebalances393: Time windowed serde to properly deserialize changelog input topic | 2.4.0 (WIP), partially available in 2.32.0 | |||||
52 | KIP-389: Introduce a configurable consumer group size limit | 2.2.0 | 52|||||
53 | KIP-342 Add support for custom SASL extensions in OAuthBearer authentication | 2.1.0 | 53 | KIP-341: Update Sticky Assignor's User Data Protocol | 386: Standardize on Min/Avg/Max metrics' default value | 2.22.3.0 | |
54 | KIP-340: Allow kafka-reassign-partitions.sh and kafka-log-dirs.sh to take admin client property file382: MirrorMaker 2.0 | 2.14.0 | |||||
55 | 339: Create a new IncrementalAlterConfigs API | 2. | 3.04.0 (WIP) | ||||
56 | KIP-338 Support to exclude the internal topics in kafka-topics.sh command380: Detect outdated control requests and bounced brokers using broker generation | 2.12.0 | |||||
57 | KIP-336: Consolidate ExtendedSerializer/Serializer and ExtendedDeserializer/Deserializer377: TopicCommand to use AdminClient | 2.12.0 | |||||
58 | KIP- | 332: Update AclCommand to use AdminClient API376: Implement AutoClosable on appropriate classes that want to be used in a try-with-resource statement | 2. | 12.0 | |||
59 | KIP-331 Add default implementation to close() and configure() for Serializer, Deserializer and Serde374: Add '--help' option to all available Kafka CLI commands | 2.32.0 | |||||
60 | KIP-330: Add retentionPeriod in SessionBytesStoreSupplier372: Naming Repartition Topics for Joins and Grouping | 2.1.0 | |||||
61 | KIP- | 328371: | Ability to suppress updates for KTablesAdd a configuration to build custom SSL principal name | 2. | 1.0 (partially implemented) /2. | 3.0 | (WIP)|
62 | KIP- | 324369: | Add method to get metrics() in AdminClientAlternative Partitioner to Support "Always Round-Robin" Selection | 2. | 14.0 | ||
63 | KIP -322: Return new error code for DeleteTopics API when topic deletion disabled.368: Allow SASL Connections to Periodically Re-Authenticate | 2.12.0 | |||||
64 | KIP-321: Update TopologyDescription to better represent Source and Sink Nodes367 Introduce close(Duration) to Producer and AdminClient instead of close(long, TimeUnit) | 2.12.0 | |||||
65 | KIP- | 320: Allow fetchers to detect and handle log truncation366: Make FunctionConversions deprecated | 2.1 | .0 (partially implemented) / 2.2.0 | |||
66 | KIP-319: Replace segments with segmentInterval in WindowBytesStoreSupplier365: Materialized, Serialized, Joined, Consumed and Produced with implicit Serde | 2.1.0 | |||||
67 | KIPKIP-313: Add KStream.flatTransform and KStream.flatTransformValues 361: Add Consumer Configuration to Disable Auto Topic Creation | 2.2.0 (partially implemented) / 2.3.0 | |||||
68 | KIP-312 Add Overloaded StreamsBuilder Build Method to Accept java.util.Properties360: Improve handling of unknown producer | 2.14.0 (WIP) | |||||
69 | KIP- | 308: Support dynamic update of max.connections.per.ip/max.connections.per.ip.overrides359: Verify leader epoch in produce requests | 2. | 14.0 (WIP) | |||
70 | KIP-307358: Allow to define custom processor names with KStreams DSLMigrate Streams API to Duration instead of long ms times | 2.31.0 (partial) | |||||
71 | KIP- | 306: Configuration for Delaying Response to Failed Authentication357: Add support to list ACLs per principal | 2.1.0 | ||||
72 | KIP- | 305356: Add | Connect primitive number converterswithCachingDisabled() to StoreBuilder | 2. | 01.0 | ||
73 | KIP-303354: Add Dynamic Routing in Streams Sinka Maximum Log Compaction Lag | 2.03.0 | |||||
74 | KIP-302 - Enable Kafka clients to use all DNS resolved IP addresses353: Improve Kafka Streams Timestamp Synchronization | 2.1.0 | |||||
75 | KIP-300: Add Windowed KTable API in StreamsBuilder352: Distinguish URPs caused by reassignment | 2.4.0 (WIP) | |||||
76 | KIP-298: Error Handling in Connect351: Add --under-min-isr option to describe topics command | 2.03.0 | |||||
77 | KIP-297: Externalizing Secrets for Connect Configurations346: Improve LogCleaner behavior on error | 2.0.01 | |||||
78 | KIP-295 Add Streams Configuration Allowing for Optional Topology Optimization345: Introduce static membership protocol to reduce consumer rebalances | 2.4.0 (WIP), partially available in 2.32.0.0 | |||||
79 | KIP-294 - Enable TLS hostname verification by default342 Add support for custom SASL extensions in OAuthBearer authentication | 2.01.0 | |||||
80 | KIP-292: Add transformValues() method to KTable341: Update Sticky Assignor's User Data Protocol | 2.03.0 | |||||
81 | KIP-290: Support for Prefixed ACLs340: Allow kafka-reassign-partitions.sh and kafka-log-dirs.sh to take admin client property file | 2.01.0 | |||||
82 | KIP-289: Improve the default group id behavior in KafkaConsumer339: Create a new IncrementalAlterConfigs API | 2.23.00 | |||||
83 | KIP- | 285: Connect Rest Extension Plugin338 Support to exclude the internal topics in kafka-topics.sh command | 2.1 | 2.0.0 | |||
84 | KIP-284: Set default retention ms for Streams repartition topics to Long.MAX_VALUE336: Consolidate ExtendedSerializer/Serializer and ExtendedDeserializer/Deserializer | 2.01.0 | |||||
85 | KIP- | 283: Efficient Memory Usage for Down-Conversion332: Update AclCommand to use AdminClient API | 2. | 01.0 | |||
86 | KIP-282: Add the listener name to the authentication context331 Add default implementation to close() and configure() for Serializer, Deserializer and Serde | 2.03.0 | |||||
87 | KIP-281: ConsumerPerformance: Increase Polling Loop Timeout and Make It Reachable by the End User330: Add retentionPeriod in SessionBytesStoreSupplier | 2.01.0 | |||||
88 | KIP- | 279: Fix log divergence between leader and follower after fast leader fail over328: Ability to suppress updates for KTables | 2.1.0 (partially implemented) / 2.3.0 (WIP) | 2.0.0||||
89 | KIP-278 - Add version option to Kafka's commands324: Add method to get metrics() in AdminClient | 2.01.0 | |||||
90 | KIP- | 277 - Fine Grained ACL for CreateTopics API322: Return new error code for DeleteTopics API when topic deletion disabled. | 2. | 01.0 | |||
91 | KIP- | 276 - Add StreamsConfig prefix for different consumers321: Update TopologyDescription to better represent Source and Sink Nodes | 2. | 01.0 | |||
92 | KIP- | 274: Kafka Streams Skipped Records Metrics320: Allow fetchers to detect and handle log truncation | 2.1.0 (partially implemented) / 2.2. | 2.0.0 | |||
93 | KIP-272: Add API version tag to broker's RequestsPerSec metric319: Replace segments with segmentInterval in WindowBytesStoreSupplier | 2.01.0 | |||||
94 | KIP-270 - A Scala Wrapper Library for Kafka Streams313: Add KStream.flatTransform and KStream.flatTransformValues | 2.2.0 (partially implemented) / 2.3.0 | |||||
95 | KIP- | 268: Simplify Kafka Streams Rebalance Metadata Upgrade312 Add Overloaded StreamsBuilder Build Method to Accept java.util.Properties | 2. | 01.0 | |||
96 | KIP- | 267309: Add | Processor Unit Test Support to Kafka Streams Test UtilstoUpperCase support to sasl.kerberos.principal.to.local rule | 2. | 04.0 | ||
97 | KIP- | 266: Fix consumer indefinite blocking behavior308: Support dynamic update of max.connections.per.ip/max.connections.per.ip.overrides | 2. | 01.0 | |||
98 | KIP- | 265307: | Make Windowed Serde to public APIsAllow to define custom processor names with KStreams DSL | 2. | 03.0 (partial) | ||
99 | KIP- | 261: Add Single Value Fetch in Window Stores306: Configuration for Delaying Response to Failed Authentication | 2. | 01.0 | |||
100 | KIP- | 258: Allow to Store Record Timestamps in RocksDB305: Add Connect primitive number converters | 2. | 30.0 | (partially implemented)|||
101 | KIP- | 257 - Configurable Quota Management303: Add Dynamic Routing in Streams Sink | 2.0.0 | ||||
102 | KIP-255: OAuth Authentication via SASL/OAUTHBEARER-302 - Enable Kafka clients to use all DNS resolved IP addresses | 2.01.0 | |||||
103 | KIP- | 251: Allow timestamp manipulation in Processor API300: Add Windowed KTable API in StreamsBuilder | 2. | 04.0 | |||
104 | KIP- | 249: Add Delegation Token Operations to KafkaAdminClient298: Error Handling in Connect | 2.0.0 | ||||
105 | KIP- | 247: Add public test utils for Kafka Streams297: Externalizing Secrets for Connect Configurations | 2.0 | 1.1.0 | |||
106 | KIP- | 245: Use Properties instead of StreamsConfig in KafkaStreams constructor295 Add Streams Configuration Allowing for Optional Topology Optimization | 2.0.0 | ||||
107 | KIP-244: Add Record Header support to Kafka Streams Processor API-294 - Enable TLS hostname verification by default | 2.0.0 | |||||
108 | 243: Make ProducerConfig and ConsumerConfig constructors public | Accepted1.1.0 | |||||
109 | KIP- | 239292: Add | queryableStoreNametransformValues() method to | GlobalKTableKTable | 12. | 10.0 | |
110 | KIP- | 238: Expose Kafka cluster ID in Connect REST API290: Support for Prefixed ACLs | 2.0 | 1.1.0 | |||
111 | KIP- | 237: More Controller Health Metrics289: Improve the default group id behavior in KafkaConsumer | 2.2 | 2.0.0 | |||
112 | KIP- | 235: Add DNS alias support for secured connection285: Connect Rest Extension Plugin | 2. | 10.0 | |||
113 | KIP- | 233: Simplify StreamsBuilder#addGlobalStore284: Set default retention ms for Streams repartition topics to Long.MAX_VALUE | 2.0 | 1.1.0 | |||
114 | KIP-231: Improve the Required ACL of ListGroups API283: Efficient Memory Usage for Down-Conversion | 2.10.0 | |||||
115 | KIP- | 229: DeleteGroups API282: Add the listener name to the authentication context | 2.0 | 1.1.0 | |||
116 | KIP- | 227 - Introduce Incremental FetchRequests to Increase Partition Scalability281: ConsumerPerformance: Increase Polling Loop Timeout and Make It Reachable by the End User | 2.0 | 1.1.0 | |||
117 | KIP-226 - Dynamic Broker Configuration279: Fix log divergence between leader and follower after fast leader fail over | 2.01.1.0 | |||||
118 | KIP- | 225 - Use tags for consumer “records.lag” metrics278 - Add version option to Kafka's commands | 2.0 | 1.1.0 | |||
119 | KIP | -224: Add configuration parameter `retries` to Streams API-277 - Fine Grained ACL for CreateTopics API | 2.0 | 1.1.0 | |||
120 | KIP-223 - Add per-topic min lead and per-partition lead metrics to KafkaConsumer276 - Add StreamsConfig prefix for different consumers | 2.0.0 | |||||
121 | KIP-222 - Add Consumer Group operations to Admin API274: Kafka Streams Skipped Records Metrics | 2.0.0 | |||||
122 | KIP- | 220272: Add | AdminClient into Kafka Streams' ClientSupplierAPI version tag to broker's RequestsPerSec metric | 2.0 | 1.1.0 | ||
123 | KIP- | 219 - Improve quota communication270 - A Scala Wrapper Library for Kafka Streams | 2.0.0 | ||||
124 | KIP-218: Make KafkaFuture.Function java 8 lambda compatible268: Simplify Kafka Streams Rebalance Metadata Upgrade | 2.01.1.0 | |||||
125 | KIP-215: Add topic regex support for Connect sinks267: Add Processor Unit Test Support to Kafka Streams Test Utils | 2.01.1.0 | |||||
126 | KIP- | 214: Add zookeeper.max.in.flight.requests config to the broker266: Fix consumer indefinite blocking behavior | 2.0 | 1.1.0 | |||
127 | KIP- | 213 Support non-key joining in KTable265: Make Windowed Serde to public APIs | 2. | 40.0 | (WIP)|||
128 | KIP-212: Enforce set of legal characters for connector names261: Add Single Value Fetch in Window Stores | 2.01.1.0 | |||||
129 | KIP- | 211: Revise Expiration Semantics of Consumer Group Offsets258: Allow to Store Record Timestamps in RocksDB | 2. | 13.0 (partially implemented) | |||
130 | KIP-210 - Provide for custom error handling when Kafka Streams fails to produce257 - Configurable Quota Management | 2.01.1.0 | |||||
131 | KIP- | 208: Add SSL support to Kafka Connect REST interface255: OAuth Authentication via SASL/OAUTHBEARER | 2.0 | 1.1.0 | |||
132 | KIP-207: Offsets returned by ListOffsetsResponse should be monotonically increasing even during a partition leader change251: Allow timestamp manipulation in Processor API | 2.20.0 | |||||
133 | KIP- | 206249: Add | support for UUID serialization and deserializationDelegation Token Operations to KafkaAdminClient | 2. | 10.0 | ||
134 | KIP-205: Add all() and range() API to ReadOnlyWindowStore247: Add public test utils for Kafka Streams | 1.1.0 | |||||
135 | KIP-204 : Adding records deletion operation to the new Admin Client API245: Use Properties instead of StreamsConfig in KafkaStreams constructor | 2.01.1.0 | |||||
136 | KIP- | 203244: Add | toLowerCase support to sasl.kerberos.principal.to.local rule 1.1Record Header support to Kafka Streams Processor API | 2.0.0 | |||
137 | KIP-202: Move merge() from StreamsBuilder to KStream243: Make ProducerConfig and ConsumerConfig constructors public | 1.01.0 | |||||
138 | KIP-198: Remove ZK dependency from Streams Reset Tool239 Add queryableStoreName() to GlobalKTable | 1.01.0 | |||||
139 | KIP-197 238: Expose Kafka cluster ID in Connect REST API should include the connector type when describing a connector | 1.01.0 | |||||
140 | KIP-196: Add metrics to Kafka Connect framework237: More Controller Health Metrics | 21.0.0 | |||||
141 | KIP- | 195: AdminClient.createPartitions235: Add DNS alias support for secured connection | 2.1 | 1.0.0 | |||
142 | KIP-192 : Provide cleaner semantics when idempotence is enabled233: Simplify StreamsBuilder#addGlobalStore | 1.01.0 | |||||
143 | KIP- | 191: KafkaConsumer.subscribe() overload that takes just Pattern231: Improve the Required ACL of ListGroups API | 2.1 | 1.0.0 | |||
144 | KIP-190: Handle client-ids consistently between clients and brokers229: DeleteGroups API | 1.01.0 | |||||
145 | KIP-189: Improve principal builder interface and add support for SASL-227 - Introduce Incremental FetchRequests to Increase Partition Scalability | 1.01.0 | |||||
146 | KIP-188 - Add new metrics to support health checks226 - Dynamic Broker Configuration | 1.01.0 | |||||
147 | KIP-187 - Add cumulative count metric for all Kafka rate 225 - Use tags for consumer “records.lag” metrics | 1.01.0 | |||||
148 | KIP-186: Increase offsets retention default to 7 days224: Add configuration parameter `retries` to Streams API | 1.12.0.0 | |||||
149 | KIP-183 - Change PreferredReplicaLeaderElectionCommand to use AdminClient-223 - Add per-topic min lead and per-partition lead metrics to KafkaConsumer | 2.20.0 | |||||
150 | KIP-182: Reduce Streams DSL overloads and allow easier use of custom storage engines222 - Add Consumer Group operations to Admin API | 21.0.0 | |||||
151 | KIP-180: Add a broker metric specifying the number of consumer group rebalances in progress221: Enhance DSL with Connecting Topic Creation and Repartition Hint | 2.4.0 (WIP)1.1.0 | |||||
152 | KIP-177: Consumer perf tool should count rebalance time220: Add AdminClient into Kafka Streams' ClientSupplier | 1.01.0 | |||||
153 | KIP | -176: Remove deprecated new-consumer option for tools-219 - Improve quota communication | 2.0.0 | ||||
154 | KIP-175: Additional '--describe' views for ConsumerGroupCommand218: Make KafkaFuture.Function java 8 lambda compatible | 1.1.0 | |||||
155 | KIP-174 - Deprecate and remove internal converter configs in WorkerConfig215: Add topic regex support for Connect sinks | 1.12.0.0 | |||||
156 | KIP-173214: Add prefix to StreamsConfig to enable setting default internal topic configszookeeper.max.in.flight.requests config to the broker | 1.01.0 | |||||
157 | KIP- | 171 - Extend Consumer Group Reset Offset for Stream Application213 Support non-key joining in KTable | 2.4.0 (WIP) | 1.1.0||||
158 | KIP-168: Add GlobalTopicCount and GlobalPartitionCount metric per cluster212: Enforce set of legal characters for connector names | 1.01.0 | |||||
159 | KIP-167: Add interface for the state store restoration process211: Revise Expiration Semantics of Consumer Group Offsets | 2.11.0.0 | |||||
160 | KIP-164 - Add UnderMinIsrPartitionCount and per-partition UnderMinIsr metrics210 - Provide for custom error handling when Kafka Streams fails to produce | 1.01.0 | |||||
161 | KIP- | 163: Lower the Minimum Required ACL Permission of OffsetFetch208: Add SSL support to Kafka Connect REST interface | 1. | 01.0 | |||
162 | KIP-162: Enable topic deletion by default207: Offsets returned by ListOffsetsResponse should be monotonically increasing even during a partition leader change | 2.21.0.0 | |||||
163 | KIP- | 161: streams deserialization exception handlers206: Add support for UUID serialization and deserialization | 2. | 1.0 | .0|||
164 | KIP-160: Augment KStream.print(), KStream.writeAsText() to allow users pass in extra parameters in the printed string205: Add all() and range() API to ReadOnlyWindowStore | 1.11.0.0 | |||||
165 | KIP- | 157 - Add consumer config options to streams reset tool204 : Adding records deletion operation to the new Admin Client API | 1. | 01.0 | |||
166 | KIP- | 156 Add option "dry run" to Streams application reset tool203: Add toLowerCase support to sasl.kerberos.principal.to.local rule | 1.1 | 0.11.0.0 | |||
167 | KIP- | 155 - Add range scan for windowed state stores202: Move merge() from StreamsBuilder to KStream | 1 | 0.11.0.0 | |||
168 | KIP-154 Add Kafka Connect configuration properties for creating internal topics198: Remove ZK dependency from Streams Reset Tool | 1.0.11.0.0 | |||||
169 | KIP-153: Include only client traffic in BytesOutPerSec metric197 Connect REST API should include the connector type when describing a connector | 1.0.11.0.0 | |||||
170 | KIP-152 - Improve diagnostics for SASL authentication failures196: Add metrics to Kafka Connect framework | 1.0.0 | |||||
171 | KIP-151 Expose Connector type in REST API195: AdminClient.createPartitions | 1.0.11.0.0 | |||||
172 | KIP-150 - Kafka-Streams Cogroup192 : Provide cleaner semantics when idempotence is enabled | 1.0.02.4.0 (WIP) | |||||
173 | KIP-149: Enabling key access in ValueTransformer, ValueMapper, and ValueJoiner191: KafkaConsumer.subscribe() overload that takes just Pattern | 1.0.01.1.0 (partially implemented) (WIP for 2.4.0) | |||||
174 | KIP-146 - Classloading Isolation in Connect190: Handle client-ids consistently between clients and brokers | 10.11.0.0 | |||||
175 | KIP-145 - Expose Record Headers in Kafka Connect189: Improve principal builder interface and add support for SASL | 1.10.0 | |||||
176 | KIP-144: Exponential backoff for broker reconnect attempts188 - Add new metrics to support health checks | 1.0.11.0.0 | |||||
177 | KIP-143: Controller Health Metrics187 - Add cumulative count metric for all Kafka rate metrics | 1.0.11.0.0 | |||||
178 | KIP-140: Add administrative RPCs for adding, deleting, and listing ACLs186: Increase offsets retention default to 7 days | 2.0.11.0.0 | |||||
179 | KIP-138: Change punctuate semantics183 - Change PreferredReplicaLeaderElectionCommand to use AdminClient | 2.21.0.0 | |||||
180 | KIP-137: Enhance TopicCommand --describe to show topics marked for deletion182: Reduce Streams DSL overloads and allow easier use of custom storage engines | 1.0.11.0.0 | |||||
181 | KIP-136: Add Listener name to SelectorMetrics tags180: Add a broker metric specifying the number of consumer group rebalances in progress | 1.10.11.0.0 | |||||
182 | KIP-134: Delay initial consumer group rebalance177: Consumer perf tool should count rebalance time | 10.11.0.0 | |||||
183 | KIP- | 133: Describe and Alter Configs Admin APIs176: Remove deprecated new-consumer option for tools | 2 | 0.11.0.0 | |||
184 | KIP- | 130: Expose states of active tasks to KafkaStreams public API175: Additional '--describe' views for ConsumerGroupCommand | 1. | 01.0 | |||
185 | KIP-129: Streams Exactly-Once Semantics174 - Deprecate and remove internal converter configs in WorkerConfig | 2.0.11.0.0 | |||||
186 | KIP-128173: Add ByteArrayConverter for Kafka Connectprefix to StreamsConfig to enable setting default internal topic configs | 10.11.0.0 | |||||
187 | KIP-126 - Allow KafkaProducer to split and resend oversized batches.171 - Extend Consumer Group Reset Offset for Stream Application | 1.1.00.11.0.0 | |||||
188 | KIP-124 - Request rate quotas168: Add GlobalTopicCount and GlobalPartitionCount metric per cluster | 10.11.0.0 | |||||
189 | KIP-123: Allow per stream/table timestamp extractor167: Add interface for the state store restoration process | 1.0.11.0.0 | |||||
190 | 122: Add Reset Consumer Group Offsets tooling Add UnderMinIsrPartitionCount and per-partition UnderMinIsr metrics | 1.0.00.11.0.0 | |||||
191 | 121: Add KStream peek method | 1 | 0.11.0.0 | ||||
192 | KIP-120: Cleanup Kafka Streams builder API162: Enable topic deletion by default | 1.0.0 | |||||
193 | KIP-161: streams deserialization exception handlers | 1.119: Drop Support for Scala 2.10 in Kafka 0.110.11.0.0 | |||||
194 | KIP-118: Drop Support for Java 7160: Augment KStream.print(), KStream.writeAsText() to allow users pass in extra parameters in the printed string | 12.0.0 | |||||
195 | KIP-157 - | 117: Add a public AdminClient API for Kafka admin operationsAdd consumer config options to streams reset tool | 1 | 0.11.0.0 | |||
196 | KIP- | 115: Enforce offsets.topic.replication.factor upon __consumer_offsets auto topic creation156 Add option "dry run" to Streams application reset tool | 0.11.0.0 | ||||
197 | KIP- | 114: KTable155 - Add range scan for windowed state stores | and improved semantics0.11.0.0 | ||||
198 | KIP-113: Support replicas movement between log directories154 Add Kafka Connect configuration properties for creating internal topics | 0.11.01.1.0 | |||||
199 | KIP-112: Handle disk failure for JBOD153: Include only client traffic in BytesOutPerSec metric | 0.111.0.0 | |||||
200 | KIP | -110: Add Codec for ZStandard Compression-152 - Improve diagnostics for SASL authentication failures | 1.0 | 2.1.0 | |||
201 | KIP-109: Old Consumer Deprecation151 Expose Connector type in REST API | 0.11.0.0 | |||||
202 | KIP-108: Create Topic Policy-150 - Kafka-Streams Cogroup | 2.4.0 (WIP)0.10.2.0 | |||||
203 | KIP-107: Add deleteRecordsBefore() API in AdminClient149: Enabling key access in ValueTransformer, ValueMapper, and ValueJoiner | 1.1.0 (partially implemented) (WIP for 2.4.0)0.11.0.0 | |||||
204 | KIP-106 - Change Default unclean.leader.election.enabled from True to False146 - Classloading Isolation in Connect | 0.11.0.0 | |||||
205 | KIP-105: Addition of Record Level for Sensors145 - Expose Record Headers in Kafka Connect | 1.1.0.10.2.0 | |||||
206 | KIP-104144: Granular Sensors for Streams Exponential backoff for broker reconnect attempts | 0.1011.20.0 | |||||
207 | KIP-103: Separation of Internal and External traffic143: Controller Health Metrics | 0.1011.20.0 | |||||
208 | KIP-102 - Add close with timeout for consumers140: Add administrative RPCs for adding, deleting, and listing ACLs | 0.1011.20.0 | |||||
209 | KIP-101 - Alter Replication Protocol to use Leader Epoch rather than High Watermark for Truncation138: Change punctuate semantics | 1.0.11.0.0 | |||||
210 | KIP-100 - Relax Type constraints in Kafka Streams API137: Enhance TopicCommand --describe to show topics marked for deletion | 0.1011.20.0 | |||||
211 | KIP-99136: Add Global Tables to Kafka StreamsListener name to SelectorMetrics tags | 0.1011.20.0 | |||||
212 | KIP-98 - Exactly Once Delivery and Transactional Messaging134: Delay initial consumer group rebalance | 0.11.0.0 | |||||
213 | KIP-97: Improved Kafka Client RPC Compatibility Policy133: Describe and Alter Configs Admin APIs | 0.1011.20.0 | |||||
214 | KIP- | 96 - Add per partition metrics for in-sync and assigned replica count130: Expose states of active tasks to KafkaStreams public API | 1.0. | 0.10.2.0 | |||
215 | KIP-94 Session Windows129: Streams Exactly-Once Semantics | 0.1011.20.0 | |||||
216 | KIP-93: Improve invalid timestamp handling in Kafka Streams128: Add ByteArrayConverter for Kafka Connect | 0.1011.20.0 | |||||
217 | KIP-92 - Add per partition lag metrics to KafkaConsumer126 - Allow KafkaProducer to split and resend oversized batches. | 0.1011.20.0 | |||||
218 | KIP-91 Provide Intuitive User Timeouts in The Producer-124 - Request rate quotas | 0.11.02.1.0 | |||||
219 | KIP-90 - Remove zkClient dependency from Streams123: Allow per stream/table timestamp extractor | 0.1011.20.0 | |||||
220 | KIP-89: Allow sink connectors to decouple flush and offset commit122: Add Reset Consumer Group Offsets tooling | 0.1011.20.0 | |||||
221 | KIP-88: OffsetFetch Protocol Update121: Add KStream peek method | 0. 1011. 20.0 | |||||
222 | KIP-86: Configurable SASL callback handlers120: Cleanup Kafka Streams builder API | 12.0.0 | |||||
223 | KIP-85: Dynamic JAAS configuration for Kafka clients119: Drop Support for Scala 2.10 in Kafka 0.11 | 0.1011.20.0 | |||||
224 | KIP-84118: Support SASL SCRAM mechanismsDrop Support for Java 7 | 2.00.10.2.0 | |||||
225 | KIP-82 - Add Record Headers117: Add a public AdminClient API for Kafka admin operations | 0.11.0.0 | |||||
226 | KIP-81: Bound Fetch memory usage in the consumer115: Enforce offsets.topic.replication.factor upon __consumer_offsets auto topic creation | 0.11.0.02.4.0 (WIP) | |||||
227 | KIP-79 - ListOffsetRequest/ListOffsetResponse v1 and add timestamp search methods to the new consumer114: KTable state stores and improved semantics | 0.1011.10.0 | |||||
228 | KIP-78: Cluster Id113: Support replicas movement between log directories | 1.0.10.1.0 | |||||
229 | KIP-77: Improve Kafka Streams Join Semantics112: Handle disk failure for JBOD | 1.0.0.10.2.0 | |||||
230 | KIP- | 75 - Add per-connector Converters110: Add Codec for ZStandard Compression | 2 | 0.10.1.0 | |||
231 | KIP-74: Add Fetch Response Size Limit in Bytes109: Old Consumer Deprecation | 0.1011.10.0 | |||||
232 | KIP-73: Replication Quotas108: Create Topic Policy | 0.10.12.0 | |||||
233 | KIP-72: Allow putting a bound on memory consumed by Incoming request 107: Add deleteRecordsBefore() API in AdminClient | 0.111.0.0 | |||||
234 | -71: Enable log compaction and deletion to co-exist -106 - Change Default unclean.leader.election.enabled from True to False | 0.1011.10.0 | |||||
235 | KIP-70: Revise Partition Assignment Semantics on New Consumer's Subscription Change105: Addition of Record Level for Sensors | 0.10.12.0 | |||||
236 | KIP-67104: Queryable state Granular Sensors for Kafka Streams | 0.10.12.0 | |||||
237 | KIP-66: Single Message Transforms for Kafka Connect103: Separation of Internal and External traffic | 0.10.2.0 | |||||
238 | KIP-102 - Add close with timeout for consumers | / 0.1110.02.0 | |||||
238239 | KIP-65: Expose timestamps to Connect-101 - Alter Replication Protocol to use Leader Epoch rather than High Watermark for Truncation | 0.1011.10.0 | |||||
239240 | KIP-63: Unify store and downstream caching in streams100 - Relax Type constraints in Kafka Streams API | 0.10.12.0 | |||||
240241 | KIP-62: Allow consumer to send heartbeats from a background thread99: Add Global Tables to Kafka Streams | 0.10.12.0 | |||||
241242 | KIP-60 - Make Java client classloading more flexible98 - Exactly Once Delivery and Transactional Messaging | 0.10.1.0 | 242 | KIP-58 - Make Log Compaction Point Configurable | 0.10.1.11.0.0 | ||
243 | KIP-57 - Interoperable LZ4 Framing97: Improved Kafka Client RPC Compatibility Policy | 0.10.02.0 | |||||
244 | KIP-56: Allow cross origin HTTP requests on all HTTP methods96 - Add per partition metrics for in-sync and assigned replica count | 0.10.02.0 | |||||
245 | KIP-55: Secure Quotas for Authenticated Users94 Session Windows | 0.10.12.0 | |||||
246 | KIP-54: Sticky Partition Assignment Strategy93: Improve invalid timestamp handling in Kafka Streams | 0.1110.02.0 | |||||
247 | KIP-52: Connector Control APIs92 - Add per partition lag metrics to KafkaConsumer | 0.10.02.0 | |||||
248 | KIP-51 - List Connectors REST API91 Provide Intuitive User Timeouts in The Producer | 2.10.10.0.0 | |||||
249 | KIP-50 - Move Authorizer to o.a.k.common package90 - Remove zkClient dependency from Streams | 0.10.12.0 | |||||
250 | KIP-48 Delegation token support for Kafka89: Allow sink connectors to decouple flush and offset commit | 0.10.21.1.0 | |||||
251 | KIP-45 - Standardize all client sequence interaction on j.u.Collection.88: OffsetFetch Protocol Update | 0.10.02.0 | |||||
252 | KIP-4386: Kafka Configurable SASL enhancementscallback handlers | 02.10.0.0 | |||||
253 | KIP-42: Add Producer and Consumer Interceptors85: Dynamic JAAS configuration for Kafka clients | 0.10.02.0 | |||||
254 | KIP-41: Consumer Max Records84: Support SASL SCRAM mechanisms | 0.10.02.0 | |||||
255 | KIP-40: ListGroups and DescribeGroup-82 - Add Record Headers | 0.911.0.0 | |||||
256 | KIP-38: ZooKeeper Authentication81: Bound Fetch memory usage in the consumer | 2.4.0 (WIP)0.9.0.0 | |||||
257 | KIP-36 - Rack aware replica assignment79 - ListOffsetRequest/ListOffsetResponse v1 and add timestamp search methods to the new consumer | 0.10.01.0 | |||||
258 | KIP-35 - Retrieving protocol version78: Cluster Id | 0.10.01.0 | |||||
259 | KIP-33 - Add a time based log index77: Improve Kafka Streams Join Semantics | 0.10.12.0 | |||||
260 | KIP-32 75 - Add timestamps to Kafka messageper-connector Converters | 0.10.01.0 | |||||
261 | KIP-31 - Move to relative offsets in compressed message sets74: Add Fetch Response Size Limit in Bytes | 0.10.01.0 | |||||
262 | KIP-28 - Add a processor client73: Replication Quotas | 0.10.01.0 | |||||
263 | KIP-26 - Add Kafka Connect framework for data import/export72: Allow putting a bound on memory consumed by Incoming request | 10.9.0.0 | |||||
264 | KIP-25 - System test improvements71: Enable log compaction and deletion to co-exist | 0.910.01.0 | |||||
265 | KIP-22 - Expose a Partitioner interface in the new producer70: Revise Partition Assignment Semantics on New Consumer's Subscription Change | 0.910.01.0 | |||||
266 | KIP-21 - Dynamic Configuration67: Queryable state for Kafka Streams | 0.910.01.0 (WIP) | |||||
267 | KIP-20 Enable log preallocate to improve consume performance under windows and some old Linux file system66: Single Message Transforms for Kafka Connect | 0.10.2.0 / 0.110.9.0.0 | |||||
268 | KIP-19 - Add a request timeout to NetworkClient65: Expose timestamps to Connect | 0.910.01.0 | |||||
269 | KIP-16 - Automated Replica Lag Tuning63: Unify store and downstream caching in streams | 0.910.01.0 | |||||
270 | KIP-15 - Add a close method with a timeout in the producer62: Allow consumer to send heartbeats from a background thread | 0.910.01.0 | |||||
271 | KIP-13 - Quota Design60 - Make Java client classloading more flexible | 0.910.01.0 | |||||
272 | KIP-12 - Kafka Sasl/Kerberos and SSL implementation58 - Make Log Compaction Point Configurable | 0.910.01.0 | |||||
273 | KIP-11 - Kafka Authorizer design57 - Interoperable LZ4 Framing | 0.910.0.0 | |||||
274 | KIP-8 - Add a flush method to the producer API56: Allow cross origin HTTP requests on all HTTP methods | 0.910.0.0 | |||||
275 | KIP-4 - Metadata Protocol Changes55: Secure Quotas for Authenticated Users | 0.10.01.0 | |||||
276 | KIP-4 - Command line and centralized administrative operations54: Sticky Partition Assignment Strategy | 0.911.0.0 | |||||
277 | KIP-52: Connector Control APIs | , 0.10.0.0, | |||||
278 | KIP-51 - List Connectors REST API | 0.10.10.0 | |||||
277279 | KIP-3 - Mirror Maker Enhancement | 0.9.0.0 | 48 Delegation token support for Kafka | 1.1.0 | |||
280278 | KIP-2 - Refactor brokers to allow listening on multiple ports and IPs45 - Standardize all client sequence interaction on j.u.Collection. | 0.910.0.0 | |||||
279281 | KIP-1 - Remove support of request.required.acks43: Kafka SASL enhancements | 0.910.0.0 |
...
KIPs under discussion
Please insert new rows in sorted order (ascending by KIP number). Please move the adopted/accepted KIPs to the "Adopted KIPs" table above.
Please insert new rows in sorted order (by KIP number).
Dormant/inactive KIPs
Please insert new rows in sorted order (ascending by KIP number).
Discarded KIPs
Please insert new rows in sorted order (ascending by KIP number).
KIP Discussion Recordings
...