Page History

This page describes a proposed Kafka Improvement Proposal (KIP) process for proposing a major change to Kafka.

To create your own KIP, click on

Create from template

templateName	54329345
templateId	54329345
title	KIP-NEXT: Insert Title Here
buttonLabel	Create KIP

. If you don't have permission, please send an email with your Wiki ID to dev@kafka.apache.org and request permission (http://kafka.apache.org/contact). Also add an entry to the table KIPs under discussion (for Streams API KIPs, please also add it to Kafka Streams sub page).

...

Click
Create from template
templateName 54329345
templateId 54329345
title KIP-NEXT: Insert Title Here
buttonLabel Create KIP
. Take the next available KIP number and give your proposal a descriptive heading. e.g. "KIP 42: Allow Infinite Retention With Bounded Disk Usage".
Fill in the sections as described above
Start a [DISCUSS] thread on the Apache mailing list. Please ensure that the subject of the thread is of the format [DISCUSS] KIP-{your KIP number} {your KIP heading} The and the body contains a link to your new KIP. The discussion should happen on the mailing list, not on the wiki, since the wiki comment system doesn't work well for larger discussions. In the process of the discussion you may update the proposal. You should let people know the changes you are making. When you feel you have a finalized proposal
Once the proposal is finalized call a [VOTE] to have the proposal adopted. These proposals are more serious than code changes and more serious even than release votes. The criteria for acceptance is lazy majority. The vote should remain open for at least 72 hours.
Please update the KIP wiki page, and the index below, to reflect the current stage of the KIP after a vote. This acts as the permanent record indicating the result of the KIP (e.g., Accepted or Rejected). Also report the result of the KIP vote to the voting thread on the mailing list so the conclusion is clear.

KIP round-up

Next KIP Number: 405530

Use this number as the identifier for your KIP and increment this value.

Adopted KIPs

Please insert new rows in sorted order (descending by KIP number).

331 Add default implementation to close() and configure() for Serializer, Deserializer and Serde2371: Add a configuration to build custom SSL principal name2 368: Allow SASL Connections to Periodically Re-Authenticate2365 Materialized, Serialized, Joined, Consumed and Produced with implicit Serde359: Verify leader epoch in produce requests2358: Migrate Streams API to Duration instead of long ms times2339: Create a new IncrementalAlterConfigs API2 (WIP)338 Support to exclude the internal topics in kafka-topics.sh command1332: Update AclCommand to use AdminClient API1330 retentionPeriod in SessionBytesStoreSupplier1322: Return new error code for DeleteTopics API when topic deletion disabled.1308: Support dynamic update of max.connections.per.ip/max.connections.per.ip.overrides1306: Configuration for Delaying Response to Failed Authentication1298: Error Handling in Connect0297: Externalizing Secrets for Connect Configurations0295 Add Streams Configuration Allowing for Optional Topology Optimization0292: Add transformValues() method to KTable0290: Support for Prefixed ACLs0285: Connect Rest Extension Plugin0281: ConsumerPerformance: Increase Polling Loop Timeout and Make It Reachable by the End User0279: Fix log divergence between leader and follower after fast leader fail over0277 - Fine Grained ACL for CreateTopics API0276 - Add StreamsConfig prefix for different consumers0274: Kafka Streams Skipped Records Metrics0268: Simplify Kafka Streams Rebalance Metadata Upgrade0266: Fix consumer indefinite blocking behavior0261: Add Single Value Fetch in Window Stores0KIP251: Allow timestamp manipulation in Processor API0249: Add Delegation Token Operations to KafkaAdminClient0247: Add public test utils for Kafka Streams1.1.0245: Use Properties instead of StreamsConfig in KafkaStreams constructor0244 Record Header Kafka Streams Processor API0243: Make ProducerConfig and ConsumerConfig constructors public1239 Add queryableStoreName() to GlobalKTable1.1238 Expose Kafka cluster ID in Connect REST API1237: More Controller Health Metrics0233: Simplify StreamsBuilder#addGlobalStore1.1.0229: DeleteGroups API1227 - Introduce Incremental FetchRequests to Increase Partition Scalability1.1226 - Dynamic Broker Configuration1225 - Use tags for consumer “records.lag” metrics1.1.0224: Add configuration parameter `retries` to Streams API1223 - Add per-topic min lead and per-partition lead metrics to KafkaConsumer0220: Add AdminClient into Kafka Streams' ClientSupplier1.1219 - Improve quota communication0218: Make KafkaFuture.Function java 8 lambda compatible1.1.0215 topic regex support for Connect sinks1212: Enforce set of legal characters for connector names1211: Revise Expiration Semantics of Consumer Group Offsets210 - Provide for custom error handling when Kafka Streams fails to produce1208 SSL support to Kafka Connect REST interfaceWIP)98205: Add all() and range() API to ReadOnlyWindowStore1100203 toLowerCase 1KIP-186: Increase offsets retention default to 7 days182: Reduce Streams DSL overloads and allow easier use of custom storage engines1180: Add a broker metric specifying the number of consumer group rebalances in progress1.1175: Additional '--describe' views for ConsumerGroupCommandKIP-174 - Deprecate and remove internal converter configs in WorkerConfig173 prefix to StreamsConfig to enable setting default internal topic configs1171 - Extend Consumer Group Reset Offset for Stream Application1.1167: Add interface for the state store restoration process1164 - Add UnderMinIsrPartitionCount and per-partition UnderMinIsr metrics1-163: Lower the Minimum Required ACL Permission of OffsetFetch1161: streams deserialization exception handlers1157 - Add consumer config options to streams reset tool1155 - Add range scan for windowed state stores0.11.133152 - Improve diagnostics for SASL authentication failures10.11.140 administrative RPCs for adding, deleting, and listing ACLs0.11.0.0137: Enhance TopicCommand --describe to show topics marked for deletion0.11.0.0130: Expose states of active tasks to KafkaStreams public API0118: Drop Support for Java 7089: Allow sink connectors to decouple flush and offset commit0.10.278: Cluster Id0.10.73: Replication Quotas0.10.172: Allow putting a bound on memory consumed by Incoming request 171: Enable log compaction and deletion to co-exist10145 - Standardize all client sequence interaction on j.u.Collection.0.10.20 Enable log preallocate to improve consume performance under windows and some old Linux file system0.9.0

	KIP (please keep this sorted by KIP number)	Release
1	KIP-500: Replace ZooKeeper with a Self-Managed Metadata Quorum
2	KIP-511: Collect and Expose Client's Name and Version in the Brokers	2.4351: Add --under-min-isr option to describe topics command2.2.0 (WIP)
23	KIP-394: Require member.id for initial join group request504 - Add new Java Authorizer Interface	2.24.0 (WIP)
34	KIP-386: Standardize on Min/Avg/Max metrics' default value	2.2.0	4	KIP-380: Detect outdated control requests and bounced brokers using broker generation	503: Add metric for number of topics marked for deletion	2.4.0 (WIP)2.2.0
5	KIP-377: TopicCommand to use AdminClient497: Add inter-broker API to alter ISR	2.24.0 (WIP)
6	KIP-376: Implement AutoClosable on appropriate classes that want to be used in a try-with-resource statement496: Administrative API to delete consumer offsets	2.24.0 (WIP)
7	KIP-	495: Dynamically Adjust Log Levels in Connect	2.	4.0 (WIP)
8	KIP-372: Naming Repartition Topics for Joins and Grouping488: Clean up Sum,Count,Total Metrics	2.14.0
9	KIP-	484: Expose metrics for group and transaction metadata loading duration	2.	4.0 (WIP)
10	KIP	-482: The Kafka Protocol should Support Optional Tagged Fields	2.	4.0 (WIP)
11	KIP-367 Introduce close(Duration) to Producer and AdminClient instead of close(long, TimeUnit)481: SerDe Improvements for Connect Decimal type in JSON	2.24.0 (WIP)
12	KIP-366: Make FunctionConversions deprecated480: Sticky Partitioner	2.14.0
13	KIP-	479:	Add Materialized to Join	2.4.0(WIP)
14	KIP-476: Add Java AdminClient Interface	2.4.0	2.1.0	14	K IP-361: Add Consumer Configuration to Disable Auto Topic Creation	2.2.0 (WIP)
15	KIP-	475: New Metrics to Measure Number of Tasks on a Connector	2.	4.0 (WIP)
16	KIP-	474: To deprecate WindowStore#put(key, value)	2.	4.0 (WIP)
17	KIP-357: Add support to list ACLs per principal471: Expose RocksDB Metrics in Kafka Streams	2. 1 4.0 (WIP)
18	KIP-356: Add withCachingDisabled() to StoreBuilder467: Augment ProduceResponse error messaging for specific culprit records	2.14.0 (WIP)
19	KIP-353: Improve Kafka Streams Timestamp Synchronization465: Add Consolidated Connector Endpoint to Connect REST API	2.13.0
20	KIP-346: Improve LogCleaner behavior on error464: Defaults for AdminClient#createTopic	2.14.0
21	KIP-342 Add support for custom SASL extensions in OAuthBearer authentication462: Use local thread id for KStreams	2.13.0
22	KIP-341: Update Sticky Assignor's User Data Protocol461: Improve Replica Fetcher behavior at handling partition failure	2.23.0 (WIP)
23	KIP-	460: Admin Leader Election RPC	2.	4.0
24	KIP-	458: Connector Client Config Override Policy	2.	3.0
25	KIP-340: Allow kafka-reassign-partitions.sh and kafka-log-dirs.sh to take admin client property file455: Create an Administrative API for Replica Reassignment	2.14.0 (WIP)
26	KIP-336: Consolidate ExtendedSerializer/Serializer and ExtendedDeserializer/Deserializer454: Expansion of the ConnectClusterState interface	2.13.0
27	KIP-	453: Add close() method to RocksDBConfigSetter	2.	3.0
28	KIP-	449: Add	connector contexts to log messages in Connect workers	2.	3.0
29	KIP-328: Ability to suppress updates for KTables446: Add changelog topic configuration to KTable suppress	2.24.0 (WIP)
30	KIP-324: Add method to get metrics() in AdminClient445: In-memory Session Store	2.13.0
31	KIP-	443: Return to default segment.ms and segment.index.bytes in Streams repartition topics	2.	3.0
32	KIP-321442: Update TopologyDescription to better represent Source and Sink NodesReturn to default max poll interval in Streams	2.13.0
33	KIP-320: Allow fetchers to detect and handle log truncation440: Extend Connect Converter to support headers	2.14.0 (WIP)
34	KIP-319: Replace segments with segmentInterval in WindowBytesStoreSupplier436: Add a metric indicating start time	2.13.0
35	KIP-313434: Add KStream.flatTransform and KStream.flatTransformValues Replica Fetcher and Log Cleaner Count Metrics	2.24.0 (WIP)
36	KIP-430 - Return Authorized Operations in Describe Responses	2.3-312 Add Overloaded StreamsBuilder Build Method to Accept java.util.Properties2.1.0
37	KIP-	429: Kafka Consumer Incremental Rebalance Protocol	2.	4.0 (WIP)
38	KIP-	428: Add in-memory window store	2.	3.0
39	KIP-305427: Add Connect primitive number convertersAtMinIsr topic partition category (new metric & TopicCommand option)	2.03.0
40	KIP-303: Add Dynamic Routing in Streams Sink425: Add some Log4J Kafka Appender Properties for Producing to Secured Brokers	2.03.0
41	KIP-302 - Enable Kafka clients to use all DNS resolved IP addresses421: Support resolving externalized secrets in AbstractConfig	2.32.1.0
42	KIP-	420: Add Single Value Fetch in Session Stores	2.	2.0
43	KIP-	417: Allow JmxTool to connect to a secured RMI port	2.	3.0
44	KIP-	415: Incremental Cooperative Rebalancing in Kafka Connect	2.	3.0
45	KIP-294 - Enable TLS hostname verification by default414: Expose Embedded ClientIds in Kafka Streams	2.02.0
46	KIP-	412: Extend Admin API to support dynamic application log levels	2.	4.0 (WIP)
47	KIP-	411: Make default Kafka Connect worker task client IDs distinct	2.	3.0
48	KIP-289402: Improve the default group id behavior in KafkaConsumerfairness in SocketServer processors	2.2.0 (partially implemented) / 2.3.0
49	KIP-	401: TransformerSupplier/ProcessorSupplier StateStore connecting	2.	4.0 (WIP)
50	KIP-284: Set default retention ms for Streams repartition topics to Long.MAX_VALUE396: Add Commit/List Offsets Operations to AdminClient	2.04.0 (WIP)
51	KIP-283: Efficient Memory Usage for Down-Conversion394: Require member.id for initial join group request	2.02.0
52	KIP-282: Add the listener name to the authentication context393: Time windowed serde to properly deserialize changelog input topic	2.02.0
53	KIP-	389: Introduce a configurable consumer group size limit	2.	2.0
54	KIP-	386: Standardize on Min/Avg/Max metrics' default value	2.	2.0
55	KIP-278 - Add version option to Kafka's commands382: MirrorMaker 2.0	2.04.0
56	KIP-	379: Multiple Consumer Group Management	2.	4.0 (WIP)
57	KIP-	380: Detect outdated control requests and bounced brokers using broker generation	2.	2.0
58	KIP-	377: TopicCommand to use AdminClient	2.	2.0
59	KIP-272: Add API version tag to broker's RequestsPerSec metric376: Implement AutoClosable on appropriate classes that want to be used in a try-with-resource statement	2.02.0
60	KIP-270 - A Scala Wrapper Library for Kafka Streams374: Add '--help' option to all available Kafka CLI commands	2.02.0
61	KIP-	372: Naming Repartition Topics for Joins and Grouping	2.	1.0
62	KIP-267371: Add Processor Unit Test Support to Kafka Streams Test Utilsa configuration to build custom SSL principal name	2.02.0
63	KIP-	369: Alternative Partitioner to Support "Always Round-Robin" Selection	2.	4.0
64	KIP -265: Make Windowed Serde to public APIs368: Allow SASL Connections to Periodically Re-Authenticate	2.02.0
65	KIP-	367 Introduce close(Duration) to Producer and AdminClient instead of close(long, TimeUnit)	2.	2.0
66	KIP-257 - Configurable Quota Management366: Make FunctionConversions deprecated	2.01.0
67	KIP-255: OAuth Authentication via SASL/OAUTHBEARER365: Materialized, Serialized, Joined, Consumed and Produced with implicit Serde	2.01.0
68	K IP-	361: Add Consumer Configuration to Disable Auto Topic Creation	2.	3.0
69	KIP-	360: Improve handling of unknown producer	2.	4.0 (WIP)
70	KIP-	359: Verify leader epoch in produce requests	2.4.0 (WIP)
71	KIP-	358: Migrate Streams API to Duration instead of long ms times	2.	1.0
72	KIP-	357: Add	support to	list ACLs per principal	2.	1.0
73	KIP-	356: Add withCachingDisabled() to StoreBuilder	2	.1.0
74	KIP-	354: Add a Maximum Log Compaction Lag	2.3	.0
75	KIP-	353:	Improve Kafka Streams Timestamp Synchronization	2	.1.0
76	KIP-	352: Distinguish URPs caused by reassignment	2.	4.0 (WIP)
77	KIP-235: Add DNS alias support for secured connection351: Add --under-min-isr option to describe topics command	2.13.0
78	KIP-	346: Improve LogCleaner behavior on error	2.1
79	KIP-231: Improve the Required ACL of ListGroups API345: Introduce static membership protocol to reduce consumer rebalances	2.4.0 (WIP), partially available in 2.32.1.0
80	KIP-	342 Add support for custom SASL extensions in OAuthBearer authentication	2	.1.0
81	KIP-	341: Update Sticky Assignor's User Data Protocol	2.3	.0
82	KIP-340: Allow kafka-	reassign-partitions.sh and kafka-log-dirs.sh to take admin client property file	2	.1.0
83	KIP-	339: Create a new IncrementalAlterConfigs API	2.3.0
84	KIP-	338 Support to exclude the internal topics in kafka-topics.sh command	2	.1.0
85	KIP-	336: Consolidate ExtendedSerializer/Serializer and ExtendedDeserializer/Deserializer	2.	1.0
86	KIP-222 - Add Consumer Group operations to Admin 332: Update AclCommand to use AdminClient API	2.01.0
87	KIP-	331 Add default implementation to close() and configure() for Serializer, Deserializer and Serde	2.3	.0
88	KIP-	330: Add retentionPeriod in SessionBytesStoreSupplier	2.	1.0
89	KIP-	328: Ability to suppress updates for KTables	2.1.0 (partially implemented) / 2.3.0 (WIP)
90	KIP-	324: Add	method to get metrics() in AdminClient	2	.1.0
91	KIP-214: Add zookeeper.max.in.flight.requests config to the broker322: Return new error code for DeleteTopics API when topic deletion disabled.	21.1.0
92	KIP-	321: Update TopologyDescription to better represent Source and Sink Nodes	2	.1.0
93	KIP-	320: Allow fetchers to detect and handle log truncation	2.1.0 (partially implemented) / 2.2.0
94	KIP-	319: Replace segments with segmentInterval in WindowBytesStoreSupplier	2	.1.0
95	KIP-	313: Add	KStream.flatTransform and KStream.flatTransformValues	1.1.0	96	KIP-207: Offsets returned by ListOffsetsResponse should be monotonically increasing even during a partition leader change	2.2.0 (	97	KIP-206: Add support for UUID serialization and deserialization	partially implemented) / 2.3 2.1 .0
96	KIP-	312 Add Overloaded StreamsBuilder Build Method to Accept java.util.Properties	2	1.1.0	99	KIP-204 : Adding records deletion operation to the new Admin Client API	.1.0
97	KIP-	309: Add	toUpperCase support to sasl.kerberos.principal.to.local rule	1	2.	4.0
10198	KIP-202: Move merge() from StreamsBuilder to KStream	1.0.0
102	KIP-198: Remove ZK dependency from Streams Reset Tool	1.0.0
103	KIP-197 Connect REST API should include the connector type when describing a connector	1.0.0
104	KIP-196: Add metrics to Kafka Connect framework	1.0.0
105	KIP-195: AdminClient.createPartitions	1.0.0
106	KIP-192 : Provide cleaner semantics when idempotence is enabled	1.0.0
107	KIP-191: KafkaConsumer.subscribe() overload that takes just Pattern	1.0.0
108	KIP-190: Handle client-ids consistently between clients and brokers	1.0.0
109	KIP-189: Improve principal builder interface and add support for SASL	1.0.0
110	KIP-188 - Add new metrics to support health checks	1.0.0
111	KIP-187 - Add cumulative count metric for all Kafka rate metrics	1.0.0
308: Support dynamic update of max.connections.per.ip/max.connections.per.ip.overrides	2.1.0
99	KIP-307: Allow to define custom processor names with KStreams DSL	2.3.0 (partial)
100	KIP-306: Configuration for Delaying Response to Failed Authentication	2.1.0
101	KIP-305: Add Connect primitive number converters	2.0.0
102	KIP-303: Add Dynamic Routing in Streams Sink	2.0.0
103	KIP-302 - Enable Kafka clients to use all DNS resolved IP addresses	2.1.0
104	KIP-300: Add Windowed KTable API in StreamsBuilder	2.4.0
105	KIP-298: Error Handling in Connect	2.0.0
106	KIP-297: Externalizing Secrets for Connect Configurations	2.0.0
107	KIP-295 Add Streams Configuration Allowing for Optional Topology Optimization	2.0.0
108	KIP-294 - Enable TLS hostname verification by default	112		2.0.0
113109	KIP- 183 - Change PreferredReplicaLeaderElectionCommand to use AdminClient 291: Separating controller connections and requests from the data plane	Accepted
110	KIP-292: Add transformValues() method to KTable	2.0.0
114111	KIP-	290: Support for Prefixed ACLs	2	.0.0
115112	KIP-	289: Improve the default group id behavior in KafkaConsumer	2.2	.0
116113	KIP-177: Consumer perf tool should count rebalance time285: Connect Rest Extension Plugin	21.0.0
117114	KIP-176: Remove deprecated new-consumer option for tools284: Set default retention ms for Streams repartition topics to Long.MAX_VALUE	2.0.0
118115	KIP-	1.1.0	119	283: Efficient Memory Usage for Down-Conversion	2.0.0
120116	KIP-	282: Add	the listener name to the authentication context	2	.0.0
121117	KIP-	281: ConsumerPerformance: Increase Polling Loop Timeout and Make It Reachable by the End User	2.0	.0
122118	KIP-168: Add GlobalTopicCount and GlobalPartitionCount metric per cluster279: Fix log divergence between leader and follower after fast leader fail over	21.0.0
123119	KIP-	278 - Add version option to Kafka's commands	2	.0.0
124120	KIP-	277 - Fine Grained ACL for CreateTopics API	2	.0.0
125121	KIP	-276 - Add StreamsConfig prefix for different consumers	2	.0.0
126122	KIP-162: Enable topic deletion by default274: Kafka Streams Skipped Records Metrics	21.0.0
127123	KIP-	272: Add API version tag to broker's RequestsPerSec metric	2	.0.0
128124	KIP-270 - A Scala Wrapper Library for Kafka Streams	2.0.0
125	KIP-268: Simplify Kafka Streams Rebalance Metadata Upgrade	2-160: Augment KStream.print(), KStream.writeAsText() to allow users pass in extra parameters in the printed string1.0.0
129126	KIP-	267: Add Processor Unit Test Support to Kafka Streams Test Utils	2	.0.0
130127	KIP-156 Add option "dry run" to Streams application reset tool266: Fix consumer indefinite blocking behavior	20.11.0.0
131128	KIP-	265: Make Windowed Serde to public APIs	2.	0.0
132129	KIP-154 Add Kafka Connect configuration properties for creating internal topics261: Add Single Value Fetch in Window Stores	2.0.11.0.0
130	KIP-258: Allow to Store Record Timestamps in RocksDB	2.3.0 (partially implemented)
131	KIP-257 - Configurable Quota Management	2153: Include only client traffic in BytesOutPerSec metric0.11.0.0
134132	KIP-	255: OAuth Authentication via SASL/OAUTHBEARER	2	.0.0
135133	KIP-151 Expose Connector type in REST 251: Allow timestamp manipulation in Processor API	02.11.0.0
136134	KIP-150 - Kafka-Streams Cogroup249: Add Delegation Token Operations to KafkaAdminClient	2.2.0 (WIP)0.0
135137	KIP-149: Enabling key access in ValueTransformer, ValueMapper, and ValueJoiner247: Add public test utils for Kafka Streams	1.1.0 (partially implemented) (WIP for 2.2.0)
136	KIP-245: Use Properties instead of StreamsConfig in KafkaStreams constructor	2.0.0
137	KIP-244: Add Record Header support to Kafka Streams Processor API	2.	138	KIP-146 - Classloading Isolation in Connect	0.0
139138	KIP-145 - Expose Record Headers in Kafka Connect243: Make ProducerConfig and ConsumerConfig constructors public	1.1.0
140139	KIP-144: Exponential backoff for broker reconnect attempts239 Add queryableStoreName() to GlobalKTable	1.10.11.0.0
141140	KIP-143: Controller Health Metrics238: Expose Kafka cluster ID in Connect REST API	1.1.0
141	KIP-237: More Controller Health Metrics	2.0.11.0.0
142	KIP-	235: Add	DNS alias support for secured connection	2.1.0
143	KIP-138: Change punctuate semantics233: Simplify StreamsBuilder#addGlobalStore	1.01.0
144	KIP-	231: Improve the Required ACL of ListGroups API	2.1.0
145	KIP-136: Add Listener name to SelectorMetrics tags229: DeleteGroups API	1.10.11.0.0
146	KIP-134: Delay initial consumer group rebalance-227 - Introduce Incremental FetchRequests to Increase Partition Scalability	1.10.11.0.0
147	KIP-133: Describe and Alter Configs Admin APIs226 - Dynamic Broker Configuration	1.1.00.11.0.0
148	KIP-	225 - Use tags for consumer “records.lag” metrics	1.	1.0
149	KIP-129224: Streams Exactly-Once SemanticsAdd configuration parameter `retries` to Streams API	1.10.11.0.0
150	KIP-128: Add ByteArrayConverter for Kafka Connect223 - Add per-topic min lead and per-partition lead metrics to KafkaConsumer	20.11.0.0
151	KIP-126 - Allow KafkaProducer to split and resend oversized batches.222 - Add Consumer Group operations to Admin API	2.0.11.0.0
152	KIP-124 - Request rate quotas221: Enhance DSL with Connecting Topic Creation and Repartition Hint	2.4.0 (WIP)0.11.0.0
153	KIP-123: Allow per stream/table timestamp extractor220: Add AdminClient into Kafka Streams' ClientSupplier	1.10.11.0.0
154	KIP-122: Add Reset Consumer Group Offsets tooling219 - Improve quota communication	20.11.0.0
155	KIP-121: Add KStream peek method218: Make KafkaFuture.Function java 8 lambda compatible	1.10.11.0.0
156	KIP-120: Cleanup Kafka Streams builder API215: Add topic regex support for Connect sinks	1.01.0
157	KIP-119: Drop Support for Scala 2.10 in Kafka 0.11214: Add zookeeper.max.in.flight.requests config to the broker	1.1.00.11.0.0
158	KIP-	213 Support non-key joining in KTable	2.	4.0 (WIP)
159	KIP-117: Add a public AdminClient API for Kafka admin operations212: Enforce set of legal characters for connector names	1.10.11.0.0
160	KIP-115: Enforce offsets.topic.replication.factor upon __consumer_offsets auto topic creation211: Revise Expiration Semantics of Consumer Group Offsets	2.1.00.11.0.0
161	KIP-114: KTable state stores and improved semantics210 - Provide for custom error handling when Kafka Streams fails to produce	1.1.00.11.0.0
162	KIP-113: Support replicas movement between log directories208: Add SSL support to Kafka Connect REST interface	1.1.0
163	KIP-112: Handle disk failure for JBOD207: Offsets returned by ListOffsetsResponse should be monotonically increasing even during a partition leader change	2.21.0.0
164	KIP-110206: Add Codec for ZStandard Compressionsupport for UUID serialization and deserialization	2.1.0
165	KIP-109: Old Consumer Deprecation205: Add all() and range() API to ReadOnlyWindowStore	1.1.00.11.0.0
166	KIP-108: Create Topic Policy204 : Adding records deletion operation to the new Admin Client API	1.10.10.2.0
167	KIP-107203: Add deleteRecordsBefore() API in AdminClient	0.11.0.0	toLowerCase support to sasl.kerberos.principal.to.local rule	1.1.0
168	KIP-202: Move merge() from StreamsBuilder to KStream	1.	168	KIP-106 - Change Default unclean.leader.election.enabled from True to False	0.11.0.0
169	KIP-105: Addition of Record Level for Sensors198: Remove ZK dependency from Streams Reset Tool	1.0.0.10.2.0
170	KIP-104: Granular Sensors for Streams 197 Connect REST API should include the connector type when describing a connector	1.00.10.2.0
171	KIP-103: Separation of Internal and External traffic196: Add metrics to Kafka Connect framework	1.00.10.2.0
172	KIP-102 - Add close with timeout for consumers195: AdminClient.createPartitions	1.00.10.2.0
173	KIP-101 - Alter Replication Protocol to use Leader Epoch rather than High Watermark for Truncation192 : Provide cleaner semantics when idempotence is enabled	1.0.11.0.0
174	KIP-100 - Relax Type constraints in Kafka Streams API191: KafkaConsumer.subscribe() overload that takes just Pattern	1.00.10.2.0
175	KIP-99: Add Global Tables to Kafka Streams190: Handle client-ids consistently between clients and brokers	1.0.0.10.2.0
176	KIP-98 - Exactly Once Delivery and Transactional Messaging189: Improve principal builder interface and add support for SASL	1.0.11.0.0
177	KIP-97: Improved Kafka Client RPC Compatibility Policy-188 - Add new metrics to support health checks	1.0.0.10.2.0
178	KIP-96 187 - Add per partition metrics for in-sync and assigned replica countcumulative count metric for all Kafka rate metrics	1.00.10.2.0
179	KIP-94 Session Windows186: Increase offsets retention default to 7 days	2.00.10.2.0
180	KIP-93: Improve invalid timestamp handling in Kafka Streams-183 - Change PreferredReplicaLeaderElectionCommand to use AdminClient	2.0.10.2.0
181	KIP-92 - Add per partition lag metrics to KafkaConsumer182: Reduce Streams DSL overloads and allow easier use of custom storage engines	1.0.0.10.2.0
182	KIP-91 Provide Intuitive User Timeouts in The Producer180: Add a broker metric specifying the number of consumer group rebalances in progress	12.1.0
183	KIP-90 - Remove zkClient dependency from Streams177: Consumer perf tool should count rebalance time	1.00.10.2.0
184	KIP-	176: Remove deprecated new-consumer option for tools	2.0	.0
185	KIP-88: OffsetFetch Protocol Update175: Additional '--describe' views for ConsumerGroupCommand	1.10.10.2.0
186	KIP-86: Configurable SASL callback handlers174 - Deprecate and remove internal converter configs in WorkerConfig	2.0.0
187	KIP-85: Dynamic JAAS configuration for Kafka clients173: Add prefix to StreamsConfig to enable setting default internal topic configs	1.0.0.10.2.0
188	KIP-84: Support SASL SCRAM mechanisms171 - Extend Consumer Group Reset Offset for Stream Application	1.10.10.2.0
189	KIP-82 - Add Record Headers168: Add GlobalTopicCount and GlobalPartitionCount metric per cluster	1.0.11.0.0
190	KIP-81: Bound Fetch memory usage in the consumer167: Add interface for the state store restoration process	1.0.02.2.0 (WIP)
191	KIP- 79 - ListOffsetRequest/ListOffsetResponse v1 and add timestamp search methods to the new consumer 164 - Add UnderMinIsrPartitionCount and per-partition UnderMinIsr metrics	1.0.0.10.1.0
192	KIP-	163: Lower the Minimum Required ACL Permission of OffsetFetch	1.0.0
193	KIP-77: Improve Kafka Streams Join Semantics162: Enable topic deletion by default	1.0.0.10.2.0
194	KIP-75 - Add per-connector Converters161: streams deserialization exception handlers	1.00.10.1.0
195	KIP-74: Add Fetch Response Size Limit in Bytes160: Augment KStream.print(), KStream.writeAsText() to allow users pass in extra parameters in the printed string	1.0.0.10.1.0
196	KIP-	157 - Add consumer config options to streams reset tool	1.0	.0
197	KIP-	156 Add option "dry run" to Streams application reset tool	0.11	.0.0
198	KIP-	155 - Add range scan for windowed state stores	0.	11.	0.0
199	KIP-70: Revise Partition Assignment Semantics on New Consumer's Subscription Change154 Add Kafka Connect configuration properties for creating internal topics	0.1011.10.0
200	KIP-67: Queryable state for Kafka Streams153: Include only client traffic in BytesOutPerSec metric	0.1011.10.0
201	KIP-66: Single Message Transforms for Kafka Connect-152 - Improve diagnostics for SASL authentication failures	1.0.0
202	KIP-151 Expose Connector type in REST API	0.10.2.0 / 0.11.0.0
202203	KIP-65: Expose timestamps to Connect	0.10.1.0	150 - Kafka-Streams Cogroup	2.4.0 (WIP)
204203	KIP-63: Unify store and downstream caching in streams149: Enabling key access in ValueTransformer, ValueMapper, and ValueJoiner	10.10.1.0	204	KIP-62: Allow consumer to send heartbeats from a background thread	0.10.1.0(partially implemented) (WIP for 2.4.0)
205	KIP-60 - Make Java client classloading more flexible146 - Classloading Isolation in Connect	0. 10 11. 1 0.0
206	KIP-58 - Make Log Compaction Point Configurable145 - Expose Record Headers in Kafka Connect	10.10.1.0
207	KIP-57 - Interoperable LZ4 Framing144: Exponential backoff for broker reconnect attempts	0.1011.0.0
208	KIP-56: Allow cross origin HTTP requests on all HTTP methods143: Controller Health Metrics	0.1011.0.0
209	KIP-55: Secure Quotas for Authenticated Users140: Add administrative RPCs for adding, deleting, and listing ACLs	0.1011.10.0
210	KIP-54: Sticky Partition Assignment Strategy138: Change punctuate semantics	10.11.0.0
211	KIP-52: Connector Control APIs137: Enhance TopicCommand --describe to show topics marked for deletion	0.1011.0.0
212	KIP-51 - List Connectors REST API136: Add Listener name to SelectorMetrics tags	0.1011.0.0
213	KIP-134: Delay initial consumer group rebalance	0.11.0.050 - Move Authorizer to o.a.k.common package0.10.1.0
214	KIP-48 Delegation token support for Kafka133: Describe and Alter Configs Admin APIs	0.11.01.1.0
215	KIP-	130: Expose states of active tasks to KafkaStreams public API	1.	0.0
216	KIP-43: Kafka SASL enhancements129: Streams Exactly-Once Semantics	0.1011.0.0
217	KIP-42128: Add Producer and Consumer InterceptorsByteArrayConverter for Kafka Connect	0.1011.0.0
218	KIP-41: Consumer Max Records-126 - Allow KafkaProducer to split and resend oversized batches.	0.1011.0.0
219	KIP-40: ListGroups and DescribeGroup124 - Request rate quotas	0.911.0.0
220	KIP-38: ZooKeeper Authentication123: Allow per stream/table timestamp extractor	0.911.0.0
221	KIP-36 - Rack aware replica assignment122: Add Reset Consumer Group Offsets tooling	0.1011.0.0
222	KIP-35 - Retrieving protocol version121: Add KStream peek method	0. 10 11.0.0
223	KIP-33 - Add a time based log index120: Cleanup Kafka Streams builder API	1.00.10.1.0
224	KIP-32 - Add timestamps to Kafka message119: Drop Support for Scala 2.10 in Kafka 0.11	0.1011.0.0
225	KIP-31 - Move to relative offsets in compressed message sets118: Drop Support for Java 7	20.10.0.0
226	KIP-28 - 117: Add a processor clientpublic AdminClient API for Kafka admin operations	0.1011.0.0
227	KIP-26 - Add Kafka Connect framework for data import/export115: Enforce offsets.topic.replication.factor upon __consumer_offsets auto topic creation	0.911.0.0
228	KIP-25 - System test improvements114: KTable state stores and improved semantics	0.911.0.0
229	KIP-22 - Expose a Partitioner interface in the new producer113: Support replicas movement between log directories	1.1.00.9.0.0
230	KIP-21 - Dynamic Configuration112: Handle disk failure for JBOD	1.0.9.0.0 (WIP)
231	KIP-	110: Add Codec for ZStandard Compression	2.1	.0
232	KIP-19 - Add a request timeout to NetworkClient109: Old Consumer Deprecation	0.911.0.0
233	KIP-16 - Automated Replica Lag Tuning108: Create Topic Policy	0.910.02.0
234	KIP-15 - Add a close method with a timeout in the producer107: Add deleteRecordsBefore() API in AdminClient	0.911.0.0
235	KIP- 13 - Quota Design 106 - Change Default unclean.leader.election.enabled from True to False	0.911.0.0
236	KIP-12 - Kafka Sasl/Kerberos and SSL implementation105: Addition of Record Level for Sensors	0.910.02.0
237	KIP-11 - Kafka Authorizer design104: Granular Sensors for Streams	0.910.02.0
238	KIP-8 - Add a flush method to the producer API103: Separation of Internal and External traffic	0.910.02.0
239	KIP-4 - Metadata Protocol Changes102 - Add close with timeout for consumers	0.10.02.0
240	KIP-4 - Command line and centralized administrative operations101 - Alter Replication Protocol to use Leader Epoch rather than High Watermark for Truncation	0.11.0.00.9.0.0, 0.10.0.0, 0.10.1.0
241	KIP-3 - Mirror Maker Enhancement100 - Relax Type constraints in Kafka Streams API	0.910.02.0
242	KIP-2 - Refactor brokers to allow listening on multiple ports and IPs99: Add Global Tables to Kafka Streams	0.910.02.0
243	KIP-1 - Remove support of request.required.acks98 - Exactly Once Delivery and Transactional Messaging	0.911.0.0

...

KIP59: Proposal for a kafka broker command

244	KIP	Comment	-	Sent emails to Dev discussion group. Work tracked under KAFKA-3663.
KIP-125: ZookeeperConsumerConnector to KafkaConsumer Migration and Rollback
KIP-131 - Add access to OffsetStorageReader from SourceConnector
KIP-135 : Send of null key to a compacted topic should throw non-retriable error back to user
KIP 141 - ProducerRecord & SourceRecord: Add timestamp constructors
KIP-142: Add ListTopicsRequest to efficiently list all the topics in a cluster
KIP-148: Add a connect timeout for client
KIP-158: Kafka Connect should allow source connectors to set topic-specific settings for new topics
KIP-159: Introducing Rich functions to Streams
KIP-165: Extend Interactive Queries for return latest update timestamp per key
KIP-166 - Add a tool to make amounts of replicas and leaders on brokers balanced
KIP-169 - Lag-Aware Partition Assignment Strategy
KIP-178: Size-based log directory selection strategy
KIP-185: Make exactly once in order delivery the default producer setting
KIP-193: Add SchemaBuilder.from(Schema)
KIP-199: Add Kafka Connect offset tool
KIP-201: Rationalising Policy interfaces
KIP-209: C onnection String Support
KIP-213 Support non-key joining in KTable
KIP-216: IQ should throw different exceptions for different errors
KIP-217: Expose a timeout to allow an expired ZK session to be re-created
KIP-221: Repartition Topic Hints in Streams
KIP-228 Negative record timestamp support	Voting in progress
KIP-234: add support for getting topic defaults from AdminClient
KIP-236: Interruptible Partition Reassignment
KIP-240: AdminClient.listReassignments() AdminClient.describeReassignments()
KIP-242: Mask password in Kafka Connect Rest API response
KIP-248 - Create New ConfigCommand That Uses The New AdminClient	Voting in progress (pending on more binding votes)
KIP-250 Add Support for Quorum-based Producer Acknowledgment
KIP-252 - Extend ACLs to allow filtering based on ip ranges and subnets
KIP-253: Support in-order message delivery with partition expansion	Discussion
KIP-254: JsonConverter Exception Handeling
KIP-258: Allow to Store Record Timestamps in RocksDB	depends on KIP-268
KIP-259: Improve Streams DSL Timestamp Propagation Semantics
KIP-260: add primary join operation for Stream-Stream join (WIP)	Draft
KIP-262: Metadata should include number of state stores for task	depends on KIP-268
KIP-264: Add a consumer metric to record raw fetch size	Voting in progress
KIP-271: Add NetworkClient redirector	Discussion
KIP-273: Kafka to support using ETCD beside Zookeeper	Discussion
KIP-275 - Indicate "isClosing" in the SinkTaskContext	Voting in progress
KIP-280: Enhanced log compaction	Discussion
KIP-291: Separating controller connections and requests from the data plane	Accepted
KIP-293 Add new metrics for consumer/replication fetch requests	Voting in progress
KIP-296: Add connector level configurability for producer/consumer client configs	Discussion
KIP-300: Add Windowed KTable API in StreamsBuilder	Discussion
KIP-301: Schema Inferencing for JsonConverter	Discussion
KIP-304: Connect runtime mode improvements for container platforms	Discussion
KIP-314: KTable to GlobalKTable Bi-directional Join	Discussion
KIP-315: Stream Join Sticky Assignor	Discussion
KIP-316: Command-line overrides for ConnectDistributed worker properties	Discussion
KIP-317: Add transparent data encryption functionality	Discussion
KIP-320: Allow fetchers to detect and handle log truncation	Discussion
KIP-325: Extend Consumer Group Command to Show Beginning Offsets	Voting in Progress
KIP-326: Schedulable KTable as Graph source	Discussion
KIP-333: Add faster mode of rebalancing	Discussion
KIP-334 - Include partitions in exceptions raised during consumer record deserialization/validation
KIP-335: Consider configurations for KafkaStreams	Discussion
KIP-345: Introduce static membership protocol to reduce consumer rebalances	Voting In Progress
KIP-347: Enable batching in FindCoordinatorRequest	Discussion
KIP-348 Eliminate null from SourceTask#poll()	KIP-350: Allow kafka-topics.sh to take brokerid as parameter to show partitions associated with it
KIP-354: Add a Maximum Log Compaction Lag	Accepted
KIP-356: Add KafkaConsumer fetch-error-rate and fetch-error-total metrics	Discussion
KIP-360: Improve handling of unknown producer	Discussion
K IP-362: Support Dynamic Session Window	Discussion
KIP-363: Allow performance tools to print final results to output file	Discussion
KIP-370: Remove Orphan Partitions	Discussion
KIP-373: Allow users to create delegation tokens for other users	Discussion
KIP-374: Add '--help' option to all available Kafka CLI commands	Accepted
KIP-375: Kafka Clients - make Metadata#TOPIC_EXPIRY_MS configurable	Discussion
KIP-378: Enable Dependency Injection for Kafka Streams handlers	Discussion
KIP-379: Multiple Consumer Group Management	Discussion
KIP-381: Connect: Tell about records that had their offsets flushed in callback	Voting in progress
KIP-382: MirrorMaker 2.0	Discussion
KIP-383: Pluggable interface for SSL Factory	Voting in progress
KIP-385: Avoid throwing away prefetched data	Discussion
KIP-387: Fair Message Consumption Across Partitions in KafkaConsumer	Discussion
KIP-388: Add observer interface to record request and response	Discussion
KIP-389: Introduce a configurable consumer group size limit	Discussion
KIP-390: Add producer option to adjust compression level	Discussion, JIRA exists with pull-request
KIP-391: Allow Producing with Offsets for Cluster Replication	Discussion, JIRA exists with pull-request
KIP-392: Allow consumers to fetch from closest replica	Discussion
KIP-393: Time windowed serde to properly deserialize changelog input topic	Discussion, JIRA exists with pull-request
KIP-395: Encypt-then-MAC Delegation token metadata
KIP-396: Add Commit/List Offsets Operations to AdminClient	Discussion
KIP-397: Add methods to override fetch offsets based on timestamp	Discussion
KIP-398: Support reading trust store from classpath	Discussion
KIP-401: TransformerSupplier/ProcessorSupplier Enhancements	Discussion
KIP-402: Improve fairness in SocketServer processors	Discussion
KIP-403: Increase ProducerPerformance precision by using nanoTime	Draft
KIP-349: Priorities for Source Topics	Voting in progress (pending more binding votes)
KIP-404: Add Kafka Connect configuration parameter for disabling WADL output on OPTIONS request	Discussion

...

97: Improved Kafka Client RPC Compatibility Policy	0.10.2.0
245	KIP-96 - Add per partition metrics for in-sync and assigned replica count	0.10.2.0
246	KIP-94 Session Windows	0.10.2.0
247	KIP-93: Improve invalid timestamp handling in Kafka Streams	0.10.2.0
248	KIP-92 - Add per partition lag metrics to KafkaConsumer	0.10.2.0
249	KIP-91 Provide Intuitive User Timeouts in The Producer	2.1.0
250	KIP-90 - Remove zkClient dependency from Streams	0.10.2.0
251	KIP-89: Allow sink connectors to decouple flush and offset commit	0.10.2.0
252	KIP-88: OffsetFetch Protocol Update	0.10.2.0
253	KIP-86: Configurable SASL callback handlers	2.0.0
254	KIP-85: Dynamic JAAS configuration for Kafka clients	0.10.2.0
255	KIP-84: Support SASL SCRAM mechanisms	0.10.2.0
256	KIP-82 - Add Record Headers	0.11.0.0
257	KIP-81: Bound Fetch memory usage in the consumer	2.4.0 (WIP)
258	KIP-79 - ListOffsetRequest/ListOffsetResponse v1 and add timestamp search methods to the new consumer	0.10.1.0
259	KIP-78: Cluster Id	0.10.1.0
260	KIP-77: Improve Kafka Streams Join Semantics	0.10.2.0
261	KIP-75 - Add per-connector Converters	0.10.1.0
262	KIP-74: Add Fetch Response Size Limit in Bytes	0.10.1.0
263	KIP-73: Replication Quotas	0.10.1.0
264	KIP-72: Allow putting a bound on memory consumed by Incoming request	1.0.0
265	KIP-71: Enable log compaction and deletion to co-exist	0.10.1.0
266	KIP-70: Revise Partition Assignment Semantics on New Consumer's Subscription Change	0.10.1.0
267	KIP-67: Queryable state for Kafka Streams	0.10.1.0
268	KIP-66: Single Message Transforms for Kafka Connect	0.10.2.0 / 0.11.0.0
269	KIP-65: Expose timestamps to Connect	0.10.1.0
270	KIP-63: Unify store and downstream caching in streams	0.10.1.0
271	KIP-62: Allow consumer to send heartbeats from a background thread	0.10.1.0
272	KIP-60 - Make Java client classloading more flexible	0.10.1.0
273	KIP-58 - Make Log Compaction Point Configurable	0.10.1.0
274	KIP-57 - Interoperable LZ4 Framing	0.10.0.0
275	KIP-56: Allow cross origin HTTP requests on all HTTP methods	0.10.0.0
276	KIP-55: Secure Quotas for Authenticated Users	0.10.1.0
277	KIP-54: Sticky Partition Assignment Strategy	0.11.0.0
278	KIP-52: Connector Control APIs	0.10.0.0
279	KIP-51 - List Connectors REST API	0.10.0.0
280	KIP-48 Delegation token support for Kafka	1.1.0
281	KIP-45 - Standardize all client sequence interaction on j.u.Collection.	0.10.0.0
282	KIP-43: Kafka SASL enhancements	0.10.0.0
283	KIP-42: Add Producer and Consumer Interceptors	0.10.0.0
284	KIP-41: Consumer Max Records	0.10.0.0
285	KIP-40: ListGroups and DescribeGroup	0.9.0.0
286	KIP-38: ZooKeeper Authentication	0.9.0.0
287	KIP-36 - Rack aware replica assignment	0.10.0.0
288	KIP-35 - Retrieving protocol version	0.10.0.0
289	KIP-33 - Add a time based log index	0.10.1.0
290	KIP-32 - Add timestamps to Kafka message	0.10.0.0
291	KIP-31 - Move to relative offsets in compressed message sets	0.10.0.0
292	KIP-28 - Add a processor client	0.10.0.0
293	KIP-26 - Add Kafka Connect framework for data import/export	0.9.0.0
294	KIP-25 - System test improvements	0.9.0.0
295	KIP-22 - Expose a Partitioner interface in the new producer	0.9.0.0
296	KIP-21 - Dynamic Configuration	0.9.0.0 (WIP)
297	KIP-20 Enable log preallocate to improve consume performance under windows and some old Linux file system	0.9.0.0
298	KIP-19 - Add a request timeout to NetworkClient	0.9.0.0
299	KIP-16 - Automated Replica Lag Tuning	0.9.0.0
300	KIP-15 - Add a close method with a timeout in the producer	0.9.0.0
301	KIP-13 - Quota Design	0.9.0.0
302	KIP-12 - Kafka Sasl/Kerberos and SSL implementation	0.9.0.0
303	KIP-11 - Kafka Authorizer design	0.9.0.0
304	KIP-8 - Add a flush method to the producer API	0.9.0.0
305	KIP-4 - Metadata Protocol Changes	0.10.0.0
306	KIP-4 - Command line and centralized administrative operations	0.9.0.0, 0.10.0.0, 0.10.1.0
307	KIP-3 - Mirror Maker Enhancement	0.9.0.0
308	KIP-2 - Refactor brokers to allow listening on multiple ports and IPs	0.9.0.0
309	KIP-1 - Remove support of request.required.acks	0.9.0.0

KIPs under discussion

Please insert new rows in sorted order (ascending by KIP number). Please move the adopted/accepted KIPs to the "Adopted KIPs" table above.

KIP	Comment
KIP-59: Proposal for a kafka broker command	Sent emails to Dev discussion group. Work tracked under KAFKA-3663.
KIP-125: ZookeeperConsumerConnector to KafkaConsumer Migration and Rollback
KIP-131 - Add access to OffsetStorageReader from SourceConnector
KIP-135 : Send of null key to a compacted topic should throw non-retriable error back to user
KIP 141 - ProducerRecord & SourceRecord: Add timestamp constructors
KIP-142: Add ListTopicsRequest to efficiently list all the topics in a cluster
KIP-148: Add a connect timeout for client
KIP-158: Kafka Connect should allow source connectors to set topic-specific settings for new topics
KIP-159: Introducing Rich functions to Streams
KIP-166 - Add a tool to make amounts of replicas and leaders on brokers balanced
KIP-169 - Lag-Aware Partition Assignment Strategy
KIP-178: Size-based log directory selection strategy
KIP-185: Make exactly once in order delivery the default producer setting
KIP-193: Add SchemaBuilder.from(Schema)
KIP-199: Add Kafka Connect offset tool
KIP-201: Rationalising Policy interfaces
KIP-209: C onnection String Support
KIP-216: IQ should throw different exceptions for different errors
KIP-217: Expose a timeout to allow an expired ZK session to be re-created
KIP-228 Negative record timestamp support	Voting in progress
KIP-234: add support for getting topic defaults from AdminClient
KIP-236: Interruptible Partition Reassignment	Discussion
KIP-240: AdminClient.listReassignments() AdminClient.describeReassignments()
KIP-242: Mask password in Kafka Connect Rest API response
KIP-250 Add Support for Quorum-based Producer Acknowledgment
KIP-252 - Extend ACLs to allow filtering based on ip ranges and subnets
KIP-253: Support in-order message delivery with partition expansion	Discussion
KIP-254: JsonConverter Exception Handeling
KIP-259: Improve Streams DSL Timestamp Propagation Semantics
KIP-260: add primary join operation for Stream-Stream join (WIP)	Draft
KIP-264: Add a consumer metric to record raw fetch size	Voting in progress
KIP-271: Add NetworkClient redirector	Discussion
KIP-273: Kafka to support using ETCD beside Zookeeper	Discussion
KIP-275 - Indicate "isClosing" in the SinkTaskContext	Voting in progress
KIP-280: Enhanced log compaction	Discussion
KIP-293 Add new metrics for consumer/replication fetch requests	Voting in progress
KIP-296: Add connector level configurability for producer/consumer client configs	Discussion
KIP-301: Schema Inferencing for JsonConverter	Discussion
KIP-304: Connect runtime mode improvements for container platforms	Discussion
KIP-314: KTable to GlobalKTable Bi-directional Join	Discussion
KIP-315: Stream Join Sticky Assignor	Discussion
KIP-316: Command-line overrides for ConnectDistributed worker properties	Discussion
KIP-317: Add end-to-end data encryption functionality to Apache Kafka	Discussion
KIP-325: Extend Consumer Group Command to Show Beginning Offsets	Voting in Progress345
KIP-326: Schedulable KTable as Graph source	Discussion
KIP-333: Add faster mode of rebalancing	Discussion
KIP-334 - Include partitions in exceptions raised during consumer record deserialization/validation
KIP-335: Consider configurations for KafkaStreams	Discussion
KIP-347: Enable batching in FindCoordinatorRequest	Discussion
KIP-348 Eliminate null from SourceTask#poll()
KIP-350: Allow kafka-topics.sh to take brokerid as parameter to show partitions associated with it
KIP-356: Add KafkaConsumer fetch-error-rate and fetch-error-total metrics	Discussion
KIP-360: Improve handling of unknown producer	Discussion
K IP-362: Support Dynamic Session Window	Discussion
KIP-363: Allow performance tools to print final results to output file	Discussion
KIP-370: Remove Orphan Partitions	Discussion
KIP-373: Allow users to create delegation tokens for other users	Discussion
KIP-375: Kafka Clients - make Metadata#TOPIC_EXPIRY_MS configurable	Discussion
KIP-378: Enable Dependency Injection for Kafka Streams handlers	Discussion
KIP-381: Connect: Tell about records that had their offsets flushed in callback	Voting in progress (restarted 18th January 2019, due to no votes in first attempt)
KIP-383: Pluggable interface for SSL Factory	Voting in progress
KIP-384: Add config for incompatible changes to persistent metadata	Discussion
KIP-385: Avoid throwing away prefetched data	Discussion
KIP-387: Fair Message Consumption Across Partitions in KafkaConsumer	Discussion
KIP-388: Add observer interface to record request and response	Discussion
KIP-390: Allow fine-grained configuration for compression	Discussion, JIRA exists with pull-request
KIP-391: Allow Producing with Offsets for Cluster Replication	Discussion, JIRA exists with pull-request
KIP-392: Allow consumers to fetch from closest replica	Discussion
KIP-395: Encypt-then-MAC Delegation token metadata
KIP-397: Add methods to override fetch offsets based on timestamp	Discussion
KIP-398: Support reading trust store from classpath	Discussion
KIP-399: Extend ProductionExceptionHandler to cover serialization exceptions	Discussion
KIP-400: Improve exit status in case of errors in ConsoleProducer	Discussion
KIP-403: Increase ProducerPerformance precision by using nanoTime	Draft
KIP-405: Kafka Tiered Storage	Discussion
KIP-406: GlobalStreamThread should honor custom offset policy.	Discussion
KIP-407: Kafka Connect support override worker kafka api configuration with connector configuration that post by rest api
KIP-408: Add asynchronous processing to Kafka Streams	Discussion
KIP-409: Allow creating under-replicated topics and partitions
KIP-410: Add metric for request handler thread pool utilization by request type	Discussion
KIP-416: Notify SourceTask of ACK'd offsets, metadata	Discussion
KIP-418: A method-chaining way to branch KStream	Discussion, JIRA exists with pull-request
KIP-419: Safely notify Kafka Connect SourceTask is stopped	Voting in progress, JIRA exists with pull request
KIP-422: Add support for client quota configuration in the Kafka Admin Client	Discussion, JIRA exists with pull-request
KIP-423: Add JoinReason to Consumer Join Group Protocol	Discussion
KIP-424: Allow suppression of intermediate events based on wall clock time	Discussion
KIP-426: Persist Broker Id to Zookeeper	Discussion
KIP-431: Support of printing additional ConsumerRecord fields in DefaultMessageFormatter	Voting in progress, JIRA exists with pull-request
KIP-435: Internal Partition Reassignment Batching	Discussion
KIP-437: Custom replacement for MaskField SMT	Voting in progress, JIRA exists with pull-request
KIP-438: Expose task, connector IDs in Connect API	Discussion
KIP-439: Cleanup built-in Store interfaces	Discussion
KIP-441: Smooth Scaling Out for Kafka Streams	Discussion
KIP-444: Augment metrics for Kafka Streams	Discussion
KIP-447: Producer scalability for exactly once semantics	Discussion
KIP-448: Add State Stores Unit Test Support to Kafka Streams Test Utils	Discussion
KIP-450: Sliding Window Aggregations in the DSL	Discussion
KIP-452: Tool to view cluster status	Discussion, JIRA exists
KIP-457: Add DISCONNECTED status to Kafka Streams	Discussion
KIP-459: Improve KafkaStreams#close	Discussion
KIP-463: Auto-configure non-default Serdes passed alongside the TopologyBuilder	Under discussion
KIP-466: Add support for List<T> serialization and deserialization	Voting in progress
KIP-468: Avoid decompression of record when validate record at server in the scene of inPlaceAssignment .	Under discussion
KIP-470: TopologyTestDriver test input and output usability improvements	Voting in progress
KIP-473: Enable KafkaLog4JAppender to use SASL Authentication Callback Handlers	Under Discussion
KIP-477: Add PATCH method for connector config in Connect REST API	Under Discussion
KIP-478 - Strongly typed Processor API	Under Discussion
KIP-486: Support custom way to load KeyStore and TrustStore	Under Discussion
KIP-487: Automatic Topic Creation on Producer	Under Discussion
KIP-489: Kafka Consumer Record Latency Metric	Under Discussion
KIP-490: New metric to count offsets expired without being consumed by a consumer group	Under discussion
KIP-491: Preferred Leader Deprioritized List (Temporary Blacklist)	Under discussion
KIP-494: Connect REST Endpoint to get Transformations (SMTs)
KIP-498: Add client-side configuration for maximum response size to protect against OOM	Sent emails to Dev discussion group. Work tracked under KAFKA-4090.
KIP-499 - Unify connection name flag for command line tool	Under discussion
KIP-499: Create a controller RPC for changing configurations
KIP-502: Connect SinkTask.put(...) to specify ArrayList<SinkRecord> in Signature
KIP-505: Add new public method to only update assignment metadata in consumer	Under discussion
KIP-506: Allow setting SCRAM password via Admin interface	Under discussion
KIP-507: Securing Internal Connect REST Endpoints	Voting in progress, draft available
KIP-508: Make Suppression State Queriable	Under discussion
KIP-509: Rebalance and restart Producers	Under discussion
KIP-510: Metrics library upgrade	Under discussion
KIP-512: Adding headers to RecordMetaData	Sent mail to dev discussion group
KIP-513: Distinguish between Key and Value serdes in scala wrapper library for kafka streams
KIP-514:Add a bounded flush() API to Kafka Producer
KIP-515: Reorganize checkpoint system in log cleaner to per partition
KIP-516: Topic Identifiers & Topic Deletion State Improvements	Under discussion
KIP-517: Add consumer metrics to observe user poll behavior	Under discussion
KIP-518: Allow listing consumer groups per state	Under discussion
KIP-519: Make SSL context/engine configuration extensible	Under discussion
KIP-521: Enable redirection of Connect's log4j messages to a file by default	Voting in progress
KIP-522: Update BrokerApiVersionsCommand to use AdminClient	Draft
KIP-523: Add KStream#toTable to the Streams DSL	Under discussion
KIP-525 - Return topic metadata and configs in CreateTopics response	Under discussion
KIP-526: Reduce Producer Metadata Lookups for Large Number of Topics	Under discussion
KIP-527: Add NullSerde to Serdes	Under discussion
KIP-528: Deprecate PartitionGrouper configuration and interface	Under discussion

Dormant/inactive KIPs

Please insert new rows in sorted order (ascending by KIP number).

KIP	Comment
KIP-6 - New reassignment partition logic for rebalancing	Needs more detail
KIP-10 - Running Producer, Consumers and Brokers on Mesos
KIP-14 - Tools standardization
KIP-17 - Add HighwaterMarkOffset to OffsetFetchResponse
KIP-23 - Add JSON/CSV output and looping options to ConsumerGroupCommand
KIP-27 - Conditional Publish
KIP-30 - Allow for brokers to have plug-able consensus and meta data storage sub systems
KIP-37 - Add Namespaces to Kafka
KIP-39: Pinning controller to broker
KIP-44 - Allow Kafka to have a customized security protocol
KIP-46 - Self Healing
KIP-47 - Add timestamp-based log deletion policy
KIP-49 - Fair Partition Assignment Strategy
KIP-53 - Add custom policies for reconnect attempts to NetworkdClient
KIP-59: Proposal for a kafka broker command
KIP-64 -Allow underlying distributed filesystem to take over replication depending on configuration
KIP-68 Add a consumed log retention before log retention
KIP-69 - Kafka Schema Registry	Draft
KIP-76 Enable getting password from executable rather than passing as plaintext in config files
KIP-87 - Add Compaction Tombstone Flag	Possibly displaced by KIP-82
KIP-95: Incremental Batch Processing for Kafka Streams
KIP-269: Substitution Within Configuration Values
KIP-349: Priorities for Source Topics	Functionality can be realized with existing API although at a lower level.
KIP-399: Extend ProductionExceptionHandler to cover serialization exceptions

Discarded KIPs

Please insert new rows in sorted order (ascending by KIP number).

KIP

Comment

KIP-5 - Broker Configuration Management

Superseded by KIP-21

KIP-7 - Security - IP Filtering

KIP-9 - SSL Support

Adopted via KAFKA-1690 but not via this KIP process

KIP-18 - JBOD Support

Superseded by KIP-112 and KIP-113

KIP-24 - Remove ISR information from TopicMetadataRequest and add broker level metadata request

KIP-29 - Add an IsrPropagateIntervalMs configuration to KafkaConfig

No longer need after KAFKA-2722

KIP-34 Add Partitioner Change Listener to Partitioner Interface for Multiple Use Case

Per feedback it is better do this parition() method and avoid Thread Coordination etc.

KIP-80: Kafka Rest Server

KIP-83 - Allow multiple SASL authenticated Java clients in a single JVM process

After KIP-85, no interface changes, reduced to KAFKA-4180

KIP-111: Kafka should preserve the Principal generated by the PrincipalBuilder while processing the request received on socket channel, on the broker.

Covered by KIP-189

KIP-116: Add State Store Checkpoint Interval Configuration

Currently not needed as checkpointing can be done on commit interval.

KIP-127: Pluggable JAAS LoginModule configuration for SSL

Similar functionality can be implemented using a custom PrincipalBuilder.

KIP-132: Augment KStream.print to allow extra parameters in the printed string

Duplicated by KIP-160

KIP-147: Add missing type parameters to StateStoreSupplier factories and KGroupedStream/Table methods

Covered by KIP-182

KIP-165: Extend Interactive Queries for return latest update timestamp per key

Covered by KIP-258

KIP-170: Enhanced TopicCreatePolicy and introduction of TopicDeletePolicy

Superseded by KIP-201: Rationalising Policy interfaces

KIP 172: Add regular-expression topic support for sink connector

Superseded by KIP-215: Add topic regex support for Connect sinks

KIP-179: Change ReassignPartitionsCommand to use AdminClient

KIP-184: Rename LogCleaner and related classes to LogCompactor

A lot of configuration change will cause more trouble and doesn't seems to be worth it

KIP 230: Name Windowing Joins

Covered by KIP-372: Naming Repartition Topics for Joins and Grouping

KIP-232: Detect outdated metadata using per-partition leaderEpoch field

Merged into KIP-320: Allow fetchers to detect and handle log truncation

KIP-246: Connect producers and consumers should inherit worker configs

Withdrawn because proposal could not be made backward compatible with existing behavior

KIP-248 - Create New ConfigCommand That Uses The New AdminClient

Discarded by author as it's partly covered in KIP-339 and KIP-422

KIP-262: Metadata should include number of state stores for task

Rejected since metadata is no longer required.

KIP-263: Allow broker to skip sanity check of inactive segments on broker startup

Withdrawn because the solution we agreed on does not require interface change

KIP-286: producer.send() should not block on metadata update

Withdrawn because the benefit of not having to wait for metadata is probably not worth the complexity added in producer.

KIP-288: [DISCARDED] Consumer.poll() timeout semantic change and new waitForAssignment method

Discarded in deference to KIP-266

KIP-310: Add a Kafka Source Connector to Kafka Connect

Withdrawn in favor of KIP-382.

KIP-327: Add describe all topics API to AdminClient

Withdrawn in-favor of filter support in Metadata API and KIP-142

KIP-344: The auto-generated client id should be passed to MetricsReporter

Bug fix so KIP not needed

KIP-364: Remove implicit Materialized, Consumed and Produced

Subsumed by KIP-365

KIP-404: Add Kafka Connect configuration parameter for disabling WADL output on OPTIONS request

Discarded, reported as a bug by

Jira

server	ASF JIRA
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b
key	KAFKA-7759

KIP-432: Additional Broker-Side Opt-In for Default, Unsecure SASL/OAUTHBEARER Implementation

A "security sanity check tool" is a more generic and appropriate solution.

KIP-451: Make TopologyTestDriver output iterable

Discarded in favor of KIP-456

KIP-456: Helper classes to make it simpler to write test logic with TopologyTestDriver

Discarded in favor of KIP-470

KIP-472: Add header to RecordContext/ProducerRecord

Discarded due to change being far more complex than necessary for a simple bug

KIP-485: Make topic optional when using through() operations in DSL

Moved to KIP-221

KIP-50 - Move Authorizer to o.a.k.common package

Superseded by KIP-504

...

Discarded KIPs

KIP	Comment
KIP-5 - Broker Configuration Management	Superseded by KIP-21
KIP-7 - Security - IP Filtering
KIP-9 - SSL Support	Adopted via KAFKA-1690 but not via this KIP process
KIP-18 - JBOD Support	Superseded by KIP-112 and KIP-113
KIP-24 - Remove ISR information from TopicMetadataRequest and add broker level metadata request
KIP-29 - Add an IsrPropagateIntervalMs configuration to KafkaConfig	No longer need after KAFKA-2722
KIP-34 Add Partitioner Change Listener to Partitioner Interface for Multiple Use Case	Per feedback it is better do this parition() method and avoid Thread Coordination etc.
KIP-80: Kafka Rest Server
KIP-83 - Allow multiple SASL authenticated Java clients in a single JVM process	After KIP-85, no interface changes, reduced to KAFKA-4180
KIP-116: Add State Store Checkpoint Interval Configuration	Currently not needed as checkpointing can be done on commit interval.
KIP-127: Pluggable JAAS LoginModule configuration for SSL	Similar functionality can be implemented using a custom PrincipalBuilder.
KIP-132: Augment KStream.print to allow extra parameters in the printed string	Duplicated by KIP-160
KIP-184: Rename LogCleaner and related classes to LogCompactor	A lot of configuration change will cause more trouble and doesn't seems to be worth it
KIP-111: Kafka should preserve the Principal generated by the PrincipalBuilder while processing the request received on socket channel, on the broker.	Covered by KIP-189
KIP-147: Add missing type parameters to StateStoreSupplier factories and KGroupedStream/Table methods	Covered by KIP-182
KIP-170: Enhanced TopicCreatePolicy and introduction of TopicDeletePolicy	Superseded by KIP-201: Rationalising Policy interfaces
KIP 172: Add regular-expression topic support for sink connector	Superseded by KIP-215: Add topic regex support for Connect sinks
KIP-179: Change ReassignPartitionsCommand to use AdminClient
KIP 230: Name Windowing Joins	Covered by KIP-372: Naming Repartition Topics for Joins and Grouping
KIP-232: Detect outdated metadata using per-partition leaderEpoch field	Merged into KIP-320: Allow fetchers to detect and handle log truncation
KIP-246: Connect producers and consumers should inherit worker configs	Withdrawn because proposal could not be made backward compatible with existing behavior
KIP-263: Allow broker to skip sanity check of inactive segments on broker startup	Withdrawn because the solution we agreed on does not require interface change
KIP-286: producer.send() should not block on metadata update	Withdrawn because the benefit of not having to wait for metadata is probably not worth the complexity added in producer.
KIP-288: [DISCARDED] Consumer.poll() timeout semantic change and new waitForAssignment method	Discarded in deference to KIP-266
KIP-310: Add a Kafka Source Connector to Kafka Connect	Withdrawn in favor of KIP-382.
KIP-327: Add describe all topics API to AdminClient	Withdrawn in-favor of filter support in Metadata API and KIP-142
KIP-344: The auto-generated client id should be passed to MetricsReporter	Bug fix so KIP not needed
KIP-364: Remove implicit Materialized, Consumed and Produced	Subsumed by KIP-365

KIP Discussion Recordings

...

Space shortcuts

Child pages

Versions Compared

Old Version 1179

New Version 1534

Key

KIP round-up

Adopted KIPs

KIPs under discussion

Discarded KIPs

Discarded KIPs

KIP Discussion Recordings