...
- Click
. Take the next available KIP number and give your proposal a descriptive heading. e.g. "KIP 42: Allow Infinite Retention With Bounded Disk Usage".Create from template templateName 54329345 templateId 54329345 title KIP-NEXT: Insert Title Here buttonLabel Create KIP - Fill in the sections as described above
- Start a [DISCUSS] thread on the Apache mailing list. Please ensure that the subject of the thread is of the format [DISCUSS] KIP-{your KIP number} {your KIP heading} The and the body contains a link to your new KIP. The discussion should happen on the mailing list, not on the wiki, since the wiki comment system doesn't work well for larger discussions. In the process of the discussion you may update the proposal. You should let people know the changes you are making. When you feel you have a finalized proposal
- Once the proposal is finalized call a [VOTE] to have the proposal adopted. These proposals are more serious than code changes and more serious even than release votes. The criteria for acceptance is lazy majority. The vote should remain open for at least 72 hours.
- Please update the KIP wiki page, and the index below, to reflect the current stage of the KIP after a vote. This acts as the permanent record indicating the result of the KIP (e.g., Accepted or Rejected). Also report the result of the KIP vote to the voting thread on the mailing list so the conclusion is clear.
KIP round-up
Next KIP Number: 464526
Use this number as the identifier for your KIP and increment this value.
...
Please insert new rows in sorted order (descending by KIP number).
KIP (please keep this sorted by KIP number) | Release | |||||
---|---|---|---|---|---|---|
1 | KIP- | 446: Add changelog topic configuration to KTable suppress482: The Kafka Protocol should Support Optional Tagged Fields | 2. | 34.0 (WIP) | ||
2 | KIP-445: In-memory Session Store504 - Add new Java Authorizer Interface | 2.34.0 (WIP) | ||||
3 | KIP-443: Return to default segment.ms and segment.index.bytes in Streams repartition topics503: Add metric for number of topics marked for deletion | 2.34.0 (WIP) | ||||
4 | KIP-442: Return to default max poll interval in Streams497: Add inter-broker API to alter ISR | 2.34.0 (WIP) | ||||
5 | KIP-436: Add a metric indicating start time496: Administrative API to delete consumer offsets | 2.34.0 (WIP) | ||||
6 | KIP-417: Allow JmxTool to connect to a secured RMI port488: Clean up Sum,Count,Total Metrics | 2.34.0 | ||||
7 | KIP- | 415: Incremental Cooperative Rebalancing in Kafka Connect484: Expose metrics for group and transaction metadata loading duration | 2. | 34.0 (WIP) | ||
8 | KIP- | 427: Add AtMinIsr topic partition category (new metric & TopicCommand option)480: Sticky Partitioner | 2. | 34.0 | ||
9 | KIP- | 430 - Return Authorized Operations in Describe Responses479: Add Materialized to Join | 2. | 34.0(WIP) | ||
10 | KIP- | 428476: Add | in-memory window storeJava AdminClient Interface | 2. | 34.0 | |
11 | KIP- | 425: Add some Log4J Kafka Appender Properties for Producing to Secured Brokers475: New Metrics to Measure Number of Tasks on a Connector | 2. | 34.0 (WIP) | ||
12 | KIP- | 420: Add Single Value Fetch in Session Stores474: To deprecate WindowStore#put(key, value) | 2. | 24.0 (WIP) | ||
13 | KIP- | 412: Extend Admin API to support dynamic application log levels471: Expose RocksDB Metrics in Kafka Streams | 2. | 34.0 (WIP) | ||
14 | KIP-414: Expose Embedded ClientIds in Kafka Streams467: Augment ProduceResponse error messaging for specific culprit records | 2.24.0 (WIP) | ||||
15 | KIP-402: Improve fairness in SocketServer processors465: Add Consolidated Connector Endpoint to Connect REST API | 2.23.0 (WIP) | ||||
16 | KIP-394: Require member.id for initial join group request464: Defaults for AdminClient#createTopic | 2.24.0 | ||||
17 | KIP-393: Time windowed serde to properly deserialize changelog input topic462: Use local thread id for KStreams | 2.23.0 | ||||
18 | KIP-386: Standardize on Min/Avg/Max metrics' default value461: Improve Replica Fetcher behavior at handling partition failure | 2.23.0 | ||||
19 | KIP- | 382: MirrorMaker 2.0460: Admin Leader Election RPC | 2. | 34.0 | (WIP)||
20 | KIP- | 380: Detect outdated control requests and bounced brokers using broker generation458: Connector Client Config Override Policy | 2. | 23.0 | ||
21 | KIP-377: TopicCommand to use AdminClient455: Create an Administrative API for Replica Reassignment | 2.24.0 (WIP) | ||||
22 | KIP-376: Implement AutoClosable on appropriate classes that want to be used in a try-with-resource statement454: Expansion of the ConnectClusterState interface | 2.23.0 | ||||
23 | KIP-374453: Add '--help' option to all available Kafka CLI commandsclose() method to RocksDBConfigSetter | 2.23.0 | ||||
24 | KIP- | 372: Naming Repartition Topics for Joins and Grouping449: Add connector contexts to log messages in Connect workers | 2. | 13.0 | ||
25 | KIP- | 371446: Add | achangelog topic configuration to | build custom SSL principal nameKTable suppress | 2. | 24.0 (WIP) |
26 | KIP | 368: Allow SASL Connections to Periodically Re-Authenticate-445: In-memory Session Store | 2. | 23.0 | ||
27 | 367 Introduce close(Duration) to Producer and AdminClient instead of close(long, TimeUnit) | 2.32.2.0 | ||||
28 | KIP- | 366: Make FunctionConversions deprecated442: Return to default max poll interval in Streams | 2. | 13.0 | ||
29 | KIP-365: Materialized, Serialized, Joined, Consumed and Produced with implicit Serde440: Extend Connect Converter to support headers | 2.14.0 (WIP) | ||||
30 | KIPKIP-361436: Add Consumer Configuration to Disable Auto Topic Creationa metric indicating start time | 2.3.0 (WIP) | ||||
31 | KIP-359: Verify leader epoch in produce requests430 - Return Authorized Operations in Describe Responses | 2.3.0 (WIP) | ||||
32 | KIP-358: Migrate Streams API to Duration instead of long ms times429: Kafka Consumer Incremental Rebalance Protocol | 2.14.0 (WIP) | ||||
33 | KIP-357428: Add support to list ACLs per principalin-memory window store | 2.13.0 | ||||
34 | KIP- | 356427: Add | withCachingDisabled() to StoreBuilderAtMinIsr topic partition category (new metric & TopicCommand option) | 2. | 13.0 | |
35 | KIP-353425: Improve Kafka Streams Timestamp SynchronizationAdd some Log4J Kafka Appender Properties for Producing to Secured Brokers | 2.13.0 | ||||
36 | KIP-351: Add --under-min-isr option to describe topics command421: Support resolving externalized secrets in AbstractConfig | 2.3.0 | ||||
37 | KIP- | 346: Improve LogCleaner behavior on error420: Add Single Value Fetch in Session Stores | 2. | 12.0 | ||
38 | KIP- | 342 Add support for custom SASL extensions in OAuthBearer authentication417: Allow JmxTool to connect to a secured RMI port | 2. | 13.0 | ||
39 | KIP- | 341: Update Sticky Assignor's User Data Protocol415: Incremental Cooperative Rebalancing in Kafka Connect | 2.3.0 | (WIP)|||
40 | KIP-340: Allow kafka-reassign-partitions.sh and kafka-log-dirs.sh to take admin client property file414: Expose Embedded ClientIds in Kafka Streams | 2.22.1.0 | ||||
41 | KIP- | 339: Create a new IncrementalAlterConfigs API412: Extend Admin API to support dynamic application log levels | 2. | 3.04.0 (WIP) | ||
42 | 338 Support to exclude the internal topics in kafka-topics.sh command | 2. | 13.0 | |||
43 | KIP-336: Consolidate ExtendedSerializer/Serializer and ExtendedDeserializer/Deserializer402: Improve fairness in SocketServer processors | 2.2.0 (partially implemented) / 2.32.1.0 | ||||
44 | KIP- | 332: Update AclCommand to use AdminClient API401: TransformerSupplier/ProcessorSupplier StateStore connecting | 2. | 14.0 (WIP) | ||
45 | KIP-331 Add default implementation to close() and configure() for Serializer, Deserializer and Serde396: Add Commit/List Offsets Operations to AdminClient | 2.34.0 (WIP) | ||||
46 | KIP-330: Add retentionPeriod in SessionBytesStoreSupplier394: Require member.id for initial join group request | 2.12.0 | ||||
47 | KIP-328393: Ability to suppress updates for KTablesTime windowed serde to properly deserialize changelog input topic | 2.2.02.1.0 (partially implemented) / 2.3.0 (WIP) | ||||
48 | KIP- | 324: Add method to get metrics() in AdminClient389: Introduce a configurable consumer group size limit | 2. | 12.0 | ||
49 | KIP- | 322: Return new error code for DeleteTopics API when topic deletion disabled.386: Standardize on Min/Avg/Max metrics' default value | 2. | 12.0 | ||
50 | KIP-321: Update TopologyDescription to better represent Source and Sink Nodes382: MirrorMaker 2.0 | 2.14.0 | ||||
51 | 320: Allow fetchers to detect and handle log truncation | 2. | 14.0 ( | partially implemented) / 2.2.0WIP) | ||
52 | KIP-319: Replace segments with segmentInterval in WindowBytesStoreSupplier380: Detect outdated control requests and bounced brokers using broker generation | 2.12.0 | ||||
53 | KIP-313: Add KStream.flatTransform and KStream.flatTransformValues 377: TopicCommand to use AdminClient | 2.2.0 (partially implemented) | ||||
54 | KIP-376: Implement AutoClosable on appropriate classes that want to be used in a try-with-resource statement | 2.2/ 2.3.0 | ||||
5455 | KIP-312 Add Overloaded StreamsBuilder Build Method to Accept java.util.Properties374: Add '--help' option to all available Kafka CLI commands | 2.12.0 | 55||||
56 | KIP- | 308: Support dynamic update of max.connections.per.ip/max.connections.per.ip.overrides372: Naming Repartition Topics for Joins and Grouping | 2.1.0 | |||
5657 | KIP- | 306: Configuration for Delaying Response to Failed Authentication371: Add a configuration to build custom SSL principal name | 2. | 12.0 | ||
5758 | KIP-305: Add Connect primitive number converters369: Alternative Partitioner to Support "Always Round-Robin" Selection | 2.04.0 | ||||
5859 | KIP | -303: Add Dynamic Routing in Streams Sink368: Allow SASL Connections to Periodically Re-Authenticate | 2. | 02.0 | ||
5960 | KIP-302 - Enable Kafka clients to use all DNS resolved IP addresses367 Introduce close(Duration) to Producer and AdminClient instead of close(long, TimeUnit) | 2.12.0 | ||||
6061 | KIP- | 298: Error Handling in Connect366: Make FunctionConversions deprecated | 2. | 01.0 | 61||
62 | KIP-297: Externalizing Secrets for Connect Configurations365: Materialized, Serialized, Joined, Consumed and Produced with implicit Serde | 2.01.0 | 62||||
63 | KIPKIP-295 361: Add Streams Configuration Allowing for Optional Topology OptimizationConsumer Configuration to Disable Auto Topic Creation | 2.03.0 | 63||||
64 | KIP-294 - Enable TLS hostname verification by default360: Improve handling of unknown producer | 2.04.0 (WIP) | 64||||
65 | KIP-292: Add transformValues() method to KTable359: Verify leader epoch in produce requests | 2.0.0 | 65 | KIP-290: Support for Prefixed ACLs | 2.0.04.0 (WIP) | |
66 | KIP-289: Improve the default group id behavior in KafkaConsumer358: Migrate Streams API to Duration instead of long ms times | 2.21.0 | ||||
67 | KIP-285: Connect Rest Extension Plugin357: Add support to list ACLs per principal | 2.01.0 | ||||
68 | KIP-284: Set default retention ms for Streams repartition topics to Long.MAX_VALUE356: Add withCachingDisabled() to StoreBuilder | 2.01.0 | ||||
69 | KIP-283: Efficient Memory Usage for Down-Conversion354: Add a Maximum Log Compaction Lag | 2.03.0 | ||||
70 | KIP-282: Add the listener name to the authentication context353: Improve Kafka Streams Timestamp Synchronization | 2.01.0 | ||||
71 | KIP-281: ConsumerPerformance: Increase Polling Loop Timeout and Make It Reachable by the End User352: Distinguish URPs caused by reassignment | 2.04.0 (WIP) | ||||
72 | KIP- | 279: Fix log divergence between leader and follower after fast leader fail over351: Add --under-min-isr option to describe topics command | 2. | 03.0 | ||
73 | KIP-278 - Add version option to Kafka's commands346: Improve LogCleaner behavior on error | 2.0.01 | ||||
74 | KIP-277 - Fine Grained ACL for CreateTopics API345: Introduce static membership protocol to reduce consumer rebalances | 2.4.0 (WIP), partially available in 2.3.0 | ||||
75 | KIP- | 276 -342 Add | StreamsConfig prefix for different consumerssupport for custom SASL extensions in OAuthBearer authentication | 2. | 01.0 | |
76 | KIP- | 274: Kafka Streams Skipped Records Metrics341: Update Sticky Assignor's User Data Protocol | 2. | 03.0 | ||
77 | KIP-272: Add API version tag to broker's RequestsPerSec metric340: Allow kafka-reassign-partitions.sh and kafka-log-dirs.sh to take admin client property file | 2.12.0.0 | ||||
78 | KIP-270 - A Scala Wrapper Library for Kafka Streams339: Create a new IncrementalAlterConfigs API | 2.03.00 | ||||
79 | KIP | -268: Simplify Kafka Streams Rebalance Metadata Upgrade-338 Support to exclude the internal topics in kafka-topics.sh command | 2. | 01.0 | ||
80 | KIP- | 267: Add Processor Unit Test Support to Kafka Streams Test Utils336: Consolidate ExtendedSerializer/Serializer and ExtendedDeserializer/Deserializer | 2. | 01.0 | ||
81 | KIP- | 266: Fix consumer indefinite blocking behavior332: Update AclCommand to use AdminClient API | 2. | 01.0 | ||
82 | KIP- | 265: Make Windowed Serde to public APIs331 Add default implementation to close() and configure() for Serializer, Deserializer and Serde | 2. | 03.0 | ||
83 | KIP- | 261330: Add | Single Value Fetch in Window StoresretentionPeriod in SessionBytesStoreSupplier | 2. | 01.0 | |
84 | KIP-258328: Allow to Store Record Timestamps in RocksDBAbility to suppress updates for KTables | 2.1.0 (partially implemented) / 2.3.0 (WIP) | ||||
85 | KIP- | 257 - Configurable Quota Management324: Add method to get metrics() in AdminClient | 2. | 01.0 | ||
86 | KIP- | 255: OAuth Authentication via SASL/OAUTHBEARER322: Return new error code for DeleteTopics API when topic deletion disabled. | 2. | 01.0 | ||
87 | KIP- | 251: Allow timestamp manipulation in Processor API321: Update TopologyDescription to better represent Source and Sink Nodes | 2. | 01.0 | ||
88 | KIP- | 249: Add Delegation Token Operations to KafkaAdminClient320: Allow fetchers to detect and handle log truncation | 2.1.0 (partially implemented) / 2.2 | 2.0.0 | ||
89 | KIP- | 247: Add public test utils for Kafka Streams319: Replace segments with segmentInterval in WindowBytesStoreSupplier | 2 | 1.1.0 | ||
90 | KIP- | 245: Use Properties instead of StreamsConfig in KafkaStreams constructor313: Add KStream.flatTransform and KStream.flatTransformValues | 2.2.0 (partially implemented) / 2.3.0 | |||
91 | KIP-244: Add Record Header support to Kafka Streams Processor API312 Add Overloaded StreamsBuilder Build Method to Accept java.util.Properties | 2.01.0 | ||||
92 | KIP-243: Make ProducerConfig and ConsumerConfig constructors public308: Support dynamic update of max.connections.per.ip/max.connections.per.ip.overrides | 21.1.0 | ||||
93 | KIP- | 239 Add queryableStoreName() to GlobalKTable307: Allow to define custom processor names with KStreams DSL | 2.3.0 (partial) | 1.1.0|||
94 | KIP- | 238: Expose Kafka cluster ID in Connect REST API306: Configuration for Delaying Response to Failed Authentication | 2 | 1.1.0 | ||
95 | KIP-237: More Controller Health Metrics305: Add Connect primitive number converters | 2.0.0 | ||||
96 | KIP-235303: Add DNS alias support for secured connectionDynamic Routing in Streams Sink | 2.10.0 | ||||
97 | KIP | -233: Simplify StreamsBuilder#addGlobalStore-302 - Enable Kafka clients to use all DNS resolved IP addresses | 2 | 1.1.0 | ||
98 | KIP-231: Improve the Required ACL of ListGroups API300: Add Windowed KTable API in StreamsBuilder | 2.14.0 | ||||
99 | KIP- | 229: DeleteGroups API298: Error Handling in Connect | 2.0 | 1.1.0 | ||
100 | KIP- | 227 - Introduce Incremental FetchRequests to Increase Partition Scalability297: Externalizing Secrets for Connect Configurations | 2.0 | 1.1.0 | ||
101 | KIP- | 226 - Dynamic Broker Configuration295 Add Streams Configuration Allowing for Optional Topology Optimization | 2.0 | 1.1.0 | ||
102 | KIP- | 225 - Use tags for consumer “records.lag” metrics294 - Enable TLS hostname verification by default | 2.0 | 1.1.0 | ||
103 | 224: Add configuration parameter `retries` to Streams API | 1.1.0 | Accepted | |||
104 | KIP- | 223 - Add per-topic min lead and per-partition lead metrics to KafkaConsumer292: Add transformValues() method to KTable | 2.0.0 | |||
105 | KIP- | 222 - Add Consumer Group operations to Admin API290: Support for Prefixed ACLs | 2.0.0 | |||
106 | KIP- | 220: Add AdminClient into Kafka Streams' ClientSupplier289: Improve the default group id behavior in KafkaConsumer | 2.2 | 1.1.0 | ||
107 | KIP-219 - Improve quota communication285: Connect Rest Extension Plugin | 2.0.0 | ||||
108 | KIP- | 218: Make KafkaFuture.Function java 8 lambda compatible284: Set default retention ms for Streams repartition topics to Long.MAX_VALUE | 2.0 | 1.1.0 | ||
109 | KIP- | 215: Add topic regex support for Connect sinks283: Efficient Memory Usage for Down-Conversion | 2.0 | 1.1.0 | ||
110 | KIP- | 214282: Add | zookeeper.max.in.flight.requests config to the brokerthe listener name to the authentication context | 2.0 | 1.1.0 | |
111 | KIP-213 Support non-key joining in KTable281: ConsumerPerformance: Increase Polling Loop Timeout and Make It Reachable by the End User | 2.30.0 (WIP) | ||||
112 | KIP-212: Enforce set of legal characters for connector names279: Fix log divergence between leader and follower after fast leader fail over | 2.01.1.0 | ||||
113 | KIP | -211: Revise Expiration Semantics of Consumer Group Offsets-278 - Add version option to Kafka's commands | 2. | 10.0 | ||
114 | KIP- | 210277 - | Provide for custom error handling when Kafka Streams fails to produceFine Grained ACL for CreateTopics API | 2.0. | 1.1.0 | |
115 | KIP-276 - 208: Add SSL support to Kafka Connect REST interfaceAdd StreamsConfig prefix for different consumers | 2.01.1.0 | ||||
116 | KIP-207: Offsets returned by ListOffsetsResponse should be monotonically increasing even during a partition leader change274: Kafka Streams Skipped Records Metrics | 2.20.0 | ||||
117 | KIP-206: Add support for UUID serialization and deserialization272: Add API version tag to broker's RequestsPerSec metric | 2.10.0 | ||||
118 | KIP- | 205: Add all() and range() API to ReadOnlyWindowStore270 - A Scala Wrapper Library for Kafka Streams | 2.0 | 1.1.0 | ||
119 | KIP-204 : Adding records deletion operation to the new Admin Client API268: Simplify Kafka Streams Rebalance Metadata Upgrade | 2.01.1.0 | ||||
120 | KIP-203267: Add toLowerCase support to sasl.kerberos.principal.to.local rule Processor Unit Test Support to Kafka Streams Test Utils | 2.01.1.0 | ||||
121 | KIP- | 202: Move merge() from StreamsBuilder to KStream266: Fix consumer indefinite blocking behavior | 2 | 1.0.0 | ||
122 | KIP-198: Remove ZK dependency from Streams Reset Tool265: Make Windowed Serde to public APIs | 21.0.0 | ||||
123 | KIP-197 Connect REST API should include the connector type when describing a connector261: Add Single Value Fetch in Window Stores | 21.0.0 | ||||
124 | KIP- | 196258: | Add metrics to Kafka Connect frameworkAllow to Store Record Timestamps in RocksDB | 2.3.0 (partially implemented) | 1.0.0||
125 | KIP-195: AdminClient.createPartitions-257 - Configurable Quota Management | 21.0.0 | ||||
126 | KIP- | 192 : Provide cleaner semantics when idempotence is enabled255: OAuth Authentication via SASL/OAUTHBEARER | 2 | 1.0.0 | ||
127 | KIP-191: KafkaConsumer.subscribe() overload that takes just Pattern251: Allow timestamp manipulation in Processor API | 21.0.0 | ||||
128 | KIP-190: Handle client-ids consistently between clients and brokers249: Add Delegation Token Operations to KafkaAdminClient | 21.0.0 | ||||
129 | KIP-189: Improve principal builder interface and add support for SASL247: Add public test utils for Kafka Streams | 1.01.0 | ||||
130 | KIP-188 - Add new metrics to support health checks245: Use Properties instead of StreamsConfig in KafkaStreams constructor | 21.0.0 | ||||
131 | KIP- | 187 - Add cumulative count metric for all Kafka rate metrics244: Add Record Header support to Kafka Streams Processor API | 2 | 1.0.0 | ||
132 | KIP-186: Increase offsets retention default to 7 days243: Make ProducerConfig and ConsumerConfig constructors public | 1.12.0.0 | ||||
133 | KIP-183 - Change PreferredReplicaLeaderElectionCommand to use AdminClient239 Add queryableStoreName() to GlobalKTable | 1.12.2.0 | ||||
134 | KIP-182: Reduce Streams DSL overloads and allow easier use of custom storage engines238: Expose Kafka cluster ID in Connect REST API | 1.01.0 | ||||
135 | KIP-180: Add a broker metric specifying the number of consumer group rebalances in progress237: More Controller Health Metrics | 2.01.1.0 | ||||
136 | KIP- | 177: Consumer perf tool should count rebalance time235: Add DNS alias support for secured connection | 2.1 | 1.0.0 | ||
137 | KIP- | 176: Remove deprecated new-consumer option for tools233: Simplify StreamsBuilder#addGlobalStore | 1.1 | 2.0.0 | ||
138 | KIP- | 175: Additional '--describe' views for ConsumerGroupCommand231: Improve the Required ACL of ListGroups API | 2 | 1.1.0 | ||
139 | KIP-174 - Deprecate and remove internal converter configs in WorkerConfig229: DeleteGroups API | 1.12.0.0 | ||||
140 | KIP-173: Add prefix to StreamsConfig to enable setting default internal topic configs-227 - Introduce Incremental FetchRequests to Increase Partition Scalability | 1.01.0 | ||||
141 | KIP-171 - Extend Consumer Group Reset Offset for Stream Application226 - Dynamic Broker Configuration | 1.1.0 | ||||
142 | KIP-168: Add GlobalTopicCount and GlobalPartitionCount metric per cluster-225 - Use tags for consumer “records.lag” metrics | 1.01.0 | ||||
143 | KIP-167224: Add interface for the state store restoration processconfiguration parameter `retries` to Streams API | 1.01.0 | ||||
144 | KIP-164 223 - Add UnderMinIsrPartitionCount per-topic min lead and per-partition UnderMinIsr lead metrics to KafkaConsumer | 12.0.0 | ||||
145 | KIP | -163: Lower the Minimum Required ACL Permission of OffsetFetch-222 - Add Consumer Group operations to Admin API | 2 | 1.0.0 | ||
146 | KIP-162: Enable topic deletion by default221: Enhance DSL with Connecting Topic Creation and Repartition Hint | 2.4.0 (WIP)1.0.0 | ||||
147 | KIP-161: streams deserialization exception handlers220: Add AdminClient into Kafka Streams' ClientSupplier | 1.01.0 | ||||
148 | KIP-160: Augment KStream.print(), KStream.writeAsText() to allow users pass in extra parameters in the printed 219 - Improve quota communication | 2 string1.0.0 | ||||
149 | KIP- | 157 - Add consumer config options to streams reset tool218: Make KafkaFuture.Function java 8 lambda compatible | 1. | 01.0 | ||
150 | KIP- | 156 Add option "dry run" to Streams application reset tool215: Add topic regex support for Connect sinks | 1.1.0 | 0.11.0.0|||
151 | KIP- | 155 - Add range scan for windowed state stores214: Add zookeeper.max.in.flight.requests config to the broker | 1.1.0 | 0.11.0.0|||
152 | KIP- | 154 Add Kafka Connect configuration properties for creating internal topics213 Support non-key joining in KTable | 2.4.0 (WIP) | 0.11.0.0|||
153 | KIP-153: Include only client traffic in BytesOutPerSec metric212: Enforce set of legal characters for connector names | 1.1.00.11.0.0 | ||||
154 | KIP-152 - Improve diagnostics for SASL authentication failures211: Revise Expiration Semantics of Consumer Group Offsets | 2.11.0.0 | ||||
155 | KIP-151 Expose Connector type in REST API-210 - Provide for custom error handling when Kafka Streams fails to produce | 1.1.00.11.0.0 | ||||
156 | KIP-150 - Kafka-Streams Cogroup208: Add SSL support to Kafka Connect REST interface | 1.1.02.3.0 (WIP) | ||||
157 | KIP-149: Enabling key access in ValueTransformer, ValueMapper, and ValueJoiner207: Offsets returned by ListOffsetsResponse should be monotonically increasing even during a partition leader change | 2.2.01.1.0 (partially implemented) (WIP for 2.3.0) | ||||
158 | KIP- | 146 - Classloading Isolation in Connect206: Add support for UUID serialization and deserialization | 2.1 | 0.11.0.0 | ||
159 | KIP-145 - Expose Record Headers in Kafka Connect205: Add all() and range() API to ReadOnlyWindowStore | 1.1.0 | ||||
160 | KIP-144: Exponential backoff for broker reconnect attempts204 : Adding records deletion operation to the new Admin Client API | 1.10.11.0.0 | ||||
161 | KIP-143: Controller Health Metrics203: Add toLowerCase support to sasl.kerberos.principal.to.local rule | 1.10.11.0.0 | ||||
162 | KIP-140: Add administrative RPCs for adding, deleting, and listing ACLs202: Move merge() from StreamsBuilder to KStream | 1.0.11.0.0 | ||||
163 | KIP-138: Change punctuate semantics198: Remove ZK dependency from Streams Reset Tool | 1.0.0 | ||||
164 | KIP-137: Enhance TopicCommand --describe to show topics marked for deletion197 Connect REST API should include the connector type when describing a connector | 10.11.0.0 | ||||
165 | KIP-136196: Add Listener name to SelectorMetrics tagsmetrics to Kafka Connect framework | 10.11.0.0 | ||||
166 | KIP-134: Delay initial consumer group rebalance195: AdminClient.createPartitions | 10.11.0.0 | ||||
167 | KIP-133: Describe and Alter Configs Admin APIs192 : Provide cleaner semantics when idempotence is enabled | 10.11.0.0 | ||||
168 | KIP- | 130: Expose states of active tasks to KafkaStreams public API191: KafkaConsumer.subscribe() overload that takes just Pattern | 1.0.0 | |||
169 | KIP-129190: Streams Exactly-Once SemanticsHandle client-ids consistently between clients and brokers | 10.11.0.0 | ||||
170 | KIP-128: Add ByteArrayConverter for Kafka Connect189: Improve principal builder interface and add support for SASL | 10.11.0.0 | ||||
171 | KIP-126 - Allow KafkaProducer to split and resend oversized batches.188 - Add new metrics to support health checks | 1.0.11.0.0 | ||||
172 | KIP-124 - Request rate quotas187 - Add cumulative count metric for all Kafka rate metrics | 10.11.0.0 | ||||
173 | KIP-123: Allow per stream/table timestamp extractor186: Increase offsets retention default to 7 days | 2.0.11.0.0 | ||||
174 | KIP-122: Add Reset Consumer Group Offsets tooling-183 - Change PreferredReplicaLeaderElectionCommand to use AdminClient | 2.20.11.0.0 | ||||
175 | KIP-121: Add KStream peek method182: Reduce Streams DSL overloads and allow easier use of custom storage engines | 10.11.0.0 | ||||
176 | KIP-120: Cleanup Kafka Streams builder API180: Add a broker metric specifying the number of consumer group rebalances in progress | 1.01.0 | ||||
177 | KIP-177: Consumer perf tool should count rebalance time | 1119: Drop Support for Scala 2.10 in Kafka 0.110.11.0.0 | ||||
178 | KIP- | 118: Drop Support for Java 7176: Remove deprecated new-consumer option for tools | 2.0.0 | |||
179 | KIP-117: Add a public AdminClient API for Kafka admin operations175: Additional '--describe' views for ConsumerGroupCommand | 1.1.00.11.0.0 | ||||
180 | KIP-115: Enforce offsets.topic.replication.factor upon __consumer_offsets auto topic creation | 0.11.0.0 | -174 - Deprecate and remove internal converter configs in WorkerConfig | 2.0.0 | ||
181 | KIP-114: KTable state stores and improved semantics173: Add prefix to StreamsConfig to enable setting default internal topic configs | 1.0.11.0.0 | ||||
182 | KIP-113: Support replicas movement between log directories171 - Extend Consumer Group Reset Offset for Stream Application | 1.1.0 | ||||
183 | KIP-112: Handle disk failure for JBOD168: Add GlobalTopicCount and GlobalPartitionCount metric per cluster | 1.0.0 | ||||
184 | KIP- | 110167: Add | Codec for ZStandard Compression2.1interface for the state store restoration process | 1.0.0 | ||
185 | -109: Old Consumer Deprecation -164 - Add UnderMinIsrPartitionCount and per-partition UnderMinIsr metrics | 1.0.11.0.0 | ||||
186 | 108: Create Topic Policy | 1.0. | 0.10.2.0 | |||
187 | KIP-107: Add deleteRecordsBefore() API in AdminClient162: Enable topic deletion by default | 10.11.0.0 | ||||
188 | KIP-161: streams deserialization exception handlers | 1106 - Change Default unclean.leader.election.enabled from True to False0.11.0.0 | ||||
189 | KIP-105: Addition of Record Level for Sensors160: Augment KStream.print(), KStream.writeAsText() to allow users pass in extra parameters in the printed string | 1.00.10.2.0 | ||||
190 | KIP | -104: Granular Sensors for Streams-157 - Add consumer config options to streams reset tool | 1.0. | 0.10.2.0 | ||
191 | KIP- | 103: Separation of Internal and External traffic156 Add option "dry run" to Streams application reset tool | 0. | 1011. | 20.0 | |
192 | KIP- | 102155 - Add | close with timeout for consumersrange scan for windowed state stores | 0. | 1011. | 20.0 |
193 | KIP-101 - Alter Replication Protocol to use Leader Epoch rather than High Watermark for Truncation154 Add Kafka Connect configuration properties for creating internal topics | 0.11.0.0 | ||||
194 | KIP-100 - Relax Type constraints in Kafka Streams API153: Include only client traffic in BytesOutPerSec metric | 0.1011.20.0 | ||||
195 | KIP-99: Add Global Tables to Kafka Streams-152 - Improve diagnostics for SASL authentication failures | 1.0.0.10.2.0 | ||||
196 | KIP-98 - Exactly Once Delivery and Transactional Messaging151 Expose Connector type in REST API | 0.11.0.0 | ||||
197 | KIP-150 - 97: Improved Kafka Client RPC Compatibility PolicyKafka-Streams Cogroup | 2.4.0 (WIP)0.10.2.0 | ||||
198 | KIP-96 - Add per partition metrics for in-sync and assigned replica count149: Enabling key access in ValueTransformer, ValueMapper, and ValueJoiner | 1.1.0 (partially implemented) (WIP for 2.4.0)0.10.2.0 | ||||
199 | KIP-94 Session Windows-146 - Classloading Isolation in Connect | 0. 1011. 20.0 | ||||
200 | KIP-93: Improve invalid timestamp handling -145 - Expose Record Headers in Kafka StreamsConnect | 01.10.21.0 | ||||
201 | KIP-92 - Add per partition lag metrics to KafkaConsumer144: Exponential backoff for broker reconnect attempts | 0.1011.20.0 | ||||
202 | KIP-91 Provide Intuitive User Timeouts in The Producer143: Controller Health Metrics | 0.11.02.1.0 | ||||
203 | KIP-90 - Remove zkClient dependency from Streams140: Add administrative RPCs for adding, deleting, and listing ACLs | 0.1011.20.0 | ||||
204 | KIP-89: Allow sink connectors to decouple flush and offset commit138: Change punctuate semantics | 1.00.10.2.0 | ||||
205 | KIP-88: OffsetFetch Protocol Update137: Enhance TopicCommand --describe to show topics marked for deletion | 0.1011.20.0 | ||||
206 | KIP-86: Configurable SASL callback handlers136: Add Listener name to SelectorMetrics tags | 0.112.0.0 | ||||
207 | KIP-85: Dynamic JAAS configuration for Kafka clients134: Delay initial consumer group rebalance | 0.1011.20.0 | ||||
208 | KIP-84: Support SASL SCRAM mechanisms133: Describe and Alter Configs Admin APIs | 0.1011.20.0 | ||||
209 | KIP- | 82 - Add Record Headers130: Expose states of active tasks to KafkaStreams public API | 1 | 0.11.0.0 | ||
210 | KIP-81: Bound Fetch memory usage in the consumer129: Streams Exactly-Once Semantics | 0.11.0.02.2.0 (WIP) | ||||
211 | KIP-79 - ListOffsetRequest/ListOffsetResponse v1 and add timestamp search methods to the new consumer128: Add ByteArrayConverter for Kafka Connect | 0.1011.10.0 | ||||
212 | KIP-78: Cluster Id126 - Allow KafkaProducer to split and resend oversized batches. | 0.1011.10.0 | ||||
213 | KIP-77: Improve Kafka Streams Join Semantics-124 - Request rate quotas | 0.1011.20.0 | ||||
214 | KIP-75 - Add per-connector Converters123: Allow per stream/table timestamp extractor | 0.1011.10.0 | ||||
215 | KIP-74122: Add Fetch Response Size Limit in BytesReset Consumer Group Offsets tooling | 0.1011.10.0 | ||||
216 | KIP-73: Replication Quotas121: Add KStream peek method | 0. 1011. 10.0 | ||||
217 | KIP-72: Allow putting a bound on memory consumed by Incoming request 120: Cleanup Kafka Streams builder API | 1.0.0 | ||||
218 | KIP-71: Enable log compaction and deletion to co-exist119: Drop Support for Scala 2.10 in Kafka 0.11 | 0.1011.10.0 | ||||
219 | KIP-70: Revise Partition Assignment Semantics on New Consumer's Subscription Change118: Drop Support for Java 7 | 2.0.00.10.1.0 | ||||
220 | KIP-67: Queryable state 117: Add a public AdminClient API for Kafka Streamsadmin operations | 0.1011.10.0 | ||||
221 | KIP-66: Single Message Transforms for Kafka Connect115: Enforce offsets.topic.replication.factor upon __consumer_offsets auto topic creation | 00.10.2.0 / 0.11.0.0 | ||||
222 | KIP-65: Expose timestamps to Connect114: KTable state stores and improved semantics | 0.1011.10.0 | ||||
223 | KIP-63: Unify store and downstream caching in streams113: Support replicas movement between log directories | 1.0.10.1.0 | ||||
224 | KIP-62: Allow consumer to send heartbeats from a background thread112: Handle disk failure for JBOD | 1.0.0.10.1.0 | ||||
225 | KIP- | 60 - Make Java client classloading more flexible110: Add Codec for ZStandard Compression | 2. | 0.10.1.0 | ||
226 | KIP-58 - Make Log Compaction Point Configurable109: Old Consumer Deprecation | 0.1011.10.0 | ||||
227 | KIP-57 - Interoperable LZ4 Framing108: Create Topic Policy | 0.10.02.0 | ||||
228 | KIP-56: Allow cross origin HTTP requests on all HTTP methods107: Add deleteRecordsBefore() API in AdminClient | 0.1011.0.0 | ||||
229 | -55: Secure Quotas for Authenticated Users -106 - Change Default unclean.leader.election.enabled from True to False | 0.1011.10.0 | ||||
230 | KIP-54: Sticky Partition Assignment Strategy105: Addition of Record Level for Sensors | 0.1110.02.0 | ||||
231 | KIP-52: Connector Control APIs104: Granular Sensors for Streams | 0.10.02.0 | ||||
232 | KIP-51 - List Connectors REST API103: Separation of Internal and External traffic | 0.10.02.0 | ||||
233 | KIP-50 - Move Authorizer to o.a.k.common package102 - Add close with timeout for consumers | 0.10.12.0 | ||||
234 | KIP-48 Delegation token support for Kafka-101 - Alter Replication Protocol to use Leader Epoch rather than High Watermark for Truncation | 0.11.01.1.0 | ||||
235 | KIP-45 - Standardize all client sequence interaction on j.u.Collection.100 - Relax Type constraints in Kafka Streams API | 0.10.02.0 | ||||
236 | KIP-4399: Kafka SASL enhancementsAdd Global Tables to Kafka Streams | 0.10.02.0 | ||||
237 | KIP-42: Add Producer and Consumer Interceptors-98 - Exactly Once Delivery and Transactional Messaging | 0.1011.0.0 | ||||
238 | KIP-41: Consumer Max Records97: Improved Kafka Client RPC Compatibility Policy | 0.10.02.0 | ||||
239 | KIP-40: ListGroups and DescribeGroup-96 - Add per partition metrics for in-sync and assigned replica count | 0.910.02.0 | ||||
240 | KIP-38: ZooKeeper Authentication94 Session Windows | 0.910.02.0 | ||||
241 | KIP-36 - Rack aware replica assignment93: Improve invalid timestamp handling in Kafka Streams | 0.10.02.0 | ||||
242 | KIP-35 - Retrieving protocol version92 - Add per partition lag metrics to KafkaConsumer | 0.10.02.0 | ||||
243 | KIP-33 - Add a time based log index91 Provide Intuitive User Timeouts in The Producer | 20.10.1.0 | ||||
244 | KIP-32 - Add timestamps to Kafka message90 - Remove zkClient dependency from Streams | 0.10.02.0 | ||||
245 | KIP-31 - Move to relative offsets in compressed message sets89: Allow sink connectors to decouple flush and offset commit | 0.10.02.0 | ||||
246 | KIP-28 - Add a processor client88: OffsetFetch Protocol Update | 0.10.02.0 | ||||
247 | KIP-26 - Add Kafka Connect framework for data import/export86: Configurable SASL callback handlers | 20.9.0.0 | ||||
248 | KIP-25 - System test improvements85: Dynamic JAAS configuration for Kafka clients | 0.910.02.0 | ||||
249 | KIP-22 - Expose a Partitioner interface in the new producer84: Support SASL SCRAM mechanisms | 0.910.02.0 | ||||
250 | KIP-21 - Dynamic Configuration82 - Add Record Headers | 0.9.011.0.0 | ||||
251 | KIP-81: Bound Fetch memory usage in the consumer | 2.4.0 (WIP) | ||||
251252 | KIP-20 Enable log preallocate to improve consume performance under windows and some old Linux file system | 0.9.0.0 | 252 | KIP-19 - Add a request timeout to NetworkClient | -79 - ListOffsetRequest/ListOffsetResponse v1 and add timestamp search methods to the new consumer | 0.10.10.9.0.0 |
253 | KIP-16 - Automated Replica Lag Tuning78: Cluster Id | 0.910.01.0 | ||||
254 | KIP-15 - Add a close method with a timeout in the producer77: Improve Kafka Streams Join Semantics | 0.910.02.0 | ||||
255 | KIP-75 - 13 - Quota DesignAdd per-connector Converters | 0.910.01.0 | ||||
256 | KIP-12 - Kafka Sasl/Kerberos and SSL implementation74: Add Fetch Response Size Limit in Bytes | 0.910.01.0 | ||||
257 | KIP-11 - Kafka Authorizer design73: Replication Quotas | 0.910.01.0 | ||||
258 | KIP-8 - Add a flush method to the producer API72: Allow putting a bound on memory consumed by Incoming request | 1.0.9.0.0 | ||||
259 | KIP-4 - Metadata Protocol Changes71: Enable log compaction and deletion to co-exist | 0.10.01.0 | ||||
260 | KIP-4 - Command line and centralized administrative operations70: Revise Partition Assignment Semantics on New Consumer's Subscription Change | 0.9.0.0, 0.10.0.0, 0.10.1.0 | ||||
261 | KIP-3 - Mirror Maker Enhancement67: Queryable state for Kafka Streams | 0.910.01.0 | ||||
262 | KIP-2 - Refactor brokers to allow listening on multiple ports and IPs66: Single Message Transforms for Kafka Connect | 0.10.2.0 / 0.110.9.0.0 | ||||
263 | KIP-1 - Remove support of request.required.acks65: Expose timestamps to Connect | 0.910.01.0 |
...
KIPs under discussion
Please insert new rows in sorted order (ascending by KIP number). Please move the adopted/accepted KIPs to the "Adopted KIPs" table above.
Please insert new rows in sorted order (by KIP number).
Dormant/inactive KIPs
Please insert new rows in sorted order (ascending by KIP number).
Discarded KIPs
Please insert new rows in sorted order (ascending by KIP number).
KIP Discussion Recordings
...