Page History

...

KIP round-up

Next KIP Number: 495526

Use this number as the identifier for your KIP and increment this value.

...

455: Create an Administrative API for Replica Reassignment453: Add close() method to RocksDBConfigSetter3446: Add changelog topic configuration to KTable suppress429: Kafka Consumer Incremental Rebalance Protocol (WIP)427: Add AtMinIsr topic partition category (new metric & TopicCommand option)3417: Allow JmxTool to connect to a secured RMI port3415: Incremental Cooperative Rebalancing in Kafka Connect412 Extend Admin API to support dynamic application log levels4 (WIP)411 Make default Kafka Connect worker task client IDs distinct3386: Standardize on Min/Avg/Max metrics' default value2382: MirrorMaker 2.04 (WIP)376: Implement AutoClosable on appropriate classes that want to be used in a try-with-resource statement374: Add '--help' option to all available Kafka CLI commands2372: Naming Repartition Topics for Joins and Grouping1371: Add a configuration to build custom SSL principal name367 Introduce close(Duration) to Producer and AdminClient instead of close(long, TimeUnit)2366: Make FunctionConversions deprecated1353: Improve Kafka Streams Timestamp Synchronization1340: Allow kafka-reassign-partitions.sh and kafka-log-dirs.sh to take admin client property file1339: Create a new IncrementalAlterConfigs API30 -338 Support to exclude the internal topics in kafka-topics.sh command1322: Return new error code for DeleteTopics API when topic deletion disabled.321 Update TopologyDescription to better represent Source and Sink Nodes308: Support dynamic update of max.connections.per.ip/max.connections.per.ip.overrides2.1305: Add Connect primitive number converters0295 Add Streams Configuration Allowing for Optional Topology Optimization0279: Fix log divergence between leader and follower after fast leader fail over0278 - Add version option to Kafka's commands0276 - Add StreamsConfig prefix for different consumers0268: Simplify Kafka Streams Rebalance Metadata Upgrade0267: Add Processor Unit Test Support to Kafka Streams Test Utils265: Make Windowed Serde to public APIs-261: Add Single Value Fetch in Window Stores258: Allow to Store Record Timestamps in RocksDB2.3.0 (partially implemented)257 - Configurable Quota Management251: Allow timestamp manipulation in Processor API0247: Add public test utils for Kafka Streams1.1245: Use Properties instead of StreamsConfig in KafkaStreams constructor243: Make ProducerConfig and ConsumerConfig constructors public1.1-238: Expose Kafka cluster ID in Connect REST API1.1237: More Controller Health Metrics235: Add DNS alias support for secured connection1-229: DeleteGroups API1.1225 - Use tags for consumer “records.lag” metrics1.1222 - Add Consumer Group operations to Admin API0219 - Improve quota communication213 Support non-key joining in KTable4 (WIP)212: Enforce set of legal characters for connector names1.1204 : Adding records deletion operation to the new Admin Client API1183 - Change PreferredReplicaLeaderElectionCommand to use AdminClient2176: Remove deprecated new-consumer option for tools2.0174 - Deprecate and remove internal converter configs in WorkerConfig0163: Lower the Minimum Required ACL Permission of OffsetFetch157 - Add consumer config options to streams reset tool156 Add option "dry run" to Streams application reset tool0.11155 range scan for windowed state stores0.11.0.11133: Describe and Alter Configs Admin APIs0.11.130: Expose states of active tasks to KafkaStreams public API126 - Allow KafkaProducer to split and resend oversized batches.0.11124 - Request rate quotas123: Allow per stream/table timestamp extractor110 Codec for ZStandard Compression2.1104: Granular Sensors for Streams 0.10.2.86: Configurable SASL callback handlers0

	KIP (please keep this sorted by KIP number)	Release
1	KIP-	482: The Kafka Protocol should Support Optional Tagged Fields	2.4.0 (WIP)
2	KIP-488: Clean up Sum,Count,Total Metrics-504 - Add new Java Authorizer Interface	2.4.0 (WIP)
3	KIP-484: Expose metrics for group and transaction metadata loading duration503: Add metric for number of topics marked for deletion	2.4.0 (WIP)
4	KIP-465497: Add Consolidated Connector Endpoint to Connect REST APIinter-broker API to alter ISR	2.34.0 (WIP)
5	KIP-464: Defaults for AdminClient#createTopic496: Administrative API to delete consumer offsets	2.4.0 (WIP)
6	KIP-462: Use local thread id for KStreams488: Clean up Sum,Count,Total Metrics	2.34.0
7	KIP-461: Improve Replica Fetcher behavior at handling partition failure484: Expose metrics for group and transaction metadata loading duration	2.34.0 (WIP)
8	KIP-460: Admin Leader Election RPC480: Sticky Partitioner	2.4.0
9	KIP-458: Connector Client Config Override Policy479: Add Materialized to Join	2.34.0(WIP)
10	KIP-454: Expansion of the ConnectClusterState interface476: Add Java AdminClient Interface	2.34.0
11	KIP-	475: New Metrics to Measure Number of Tasks on a Connector	2.	4.0 (WIP)
12	KIP-449: Add connector contexts to log messages in Connect workers 474: To deprecate WindowStore#put(key, value)	2.34.0 (WIP)
13	KIP-	471: Expose RocksDB Metrics in Kafka Streams	2.4.0 (WIP)
14	KIP-445: In-memory Session Store467: Augment ProduceResponse error messaging for specific culprit records	2.34.0 (WIP)
15	KIP-443: Return to default segment.ms and segment.index.bytes in Streams repartition topics465: Add Consolidated Connector Endpoint to Connect REST API	2.3.0
16	KIP-442: Return to default max poll interval in Streams464: Defaults for AdminClient#createTopic	2.34.0
17	KIP-436: Add a metric indicating start time462: Use local thread id for KStreams	2.3.0
18	KIP-430 - Return Authorized Operations in Describe Responses461: Improve Replica Fetcher behavior at handling partition failure	2.3.0
19	KIP-	460: Admin Leader Election RPC	2.4.0
20	KIP-428: Add in-memory window store458: Connector Client Config Override Policy	2.3.0
21	KIP-	455: Create an Administrative API for Replica Reassignment	2.	4.0 (WIP)
22	KIP-425: Add some Log4J Kafka Appender Properties for Producing to Secured Brokers454: Expansion of the ConnectClusterState interface	2.3.0
23	KIP-421: Support resolving externalized secrets in AbstractConfig 453: Add close() method to RocksDBConfigSetter	2.3.0
24	KIP-420449: Add Single Value Fetch in Session Storesconnector contexts to log messages in Connect workers	2.23.0
25	KIP-	446: Add changelog topic configuration to KTable suppress	2.	4.0 (WIP)
26	KIP-	445: In-memory Session Store	2.3.0
27	KIP- 414: Expose Embedded ClientIds in Kafka Streams 443: Return to default segment.ms and segment.index.bytes in Streams repartition topics	2.23.0
28	KIP-	442:	Return to default max poll interval in Streams	2.	3.0
29	KIP-	440:	Extend Connect Converter to support headers	2.	4.0 (WIP)
30	KIP-402: Improve fairness in SocketServer processors436: Add a metric indicating start time	2.2.2.0 (partially implemented) / 2.3.0
31	KIP-394: Require member.id for initial join group request430 - Return Authorized Operations in Describe Responses	2.23.0
32	KIP-393: Time windowed serde to properly deserialize changelog input topic429: Kafka Consumer Incremental Rebalance Protocol	2.24.0 (WIP)
33	KIP-	428: Add in-memory window store	2.	3.0
34	KIP-	427: Add AtMinIsr topic partition category (new metric & TopicCommand option)	2.	3.0
35	KIP-380: Detect outdated control requests and bounced brokers using broker generation425: Add some Log4J Kafka Appender Properties for Producing to Secured Brokers	2.23.0
36	KIP-377: TopicCommand to use AdminClient421: Support resolving externalized secrets in AbstractConfig	2.23.0
37	KIP-	420: Add Single Value Fetch in Session Stores	2.2.0
38	KIP-	417: Allow JmxTool to connect to a secured RMI port	2.	3.0
39	KIP-	415: Incremental Cooperative Rebalancing in Kafka Connect	2.	3.0
40	KIP-	414: Expose Embedded ClientIds in Kafka Streams	2.2.0
41	KIP 368: Allow SASL Connections to Periodically Re-Authenticate-412: Extend Admin API to support dynamic application log levels	2.24.0 (WIP)
42	KIP-	411: Make default Kafka Connect worker task client IDs distinct	2.	3.0
43	KIP-	402: Improve fairness in SocketServer processors	2.	2.0 (partially implemented) / 2.3.0
44	KIP-365: Materialized, Serialized, Joined, Consumed and Produced with implicit Serde401: TransformerSupplier/ProcessorSupplier StateStore connecting	2.14.0 (WIP)
45	KIPKIP-361396: Add Consumer Configuration to Disable Auto Topic CreationCommit/List Offsets Operations to AdminClient	2.34.0 (WIP)
46	KIP-359: Verify leader epoch in produce requests394: Require member.id for initial join group request	2.42.0 (WIP)
47	KIP-358: Migrate Streams API to Duration instead of long ms times393: Time windowed serde to properly deserialize changelog input topic	2.12.0
48	KIP-357: Add support to list ACLs per principal389: Introduce a configurable consumer group size limit	2.12.0
49	KIP-356: Add withCachingDisabled() to StoreBuilder386: Standardize on Min/Avg/Max metrics' default value	2.12.0
50	KIP-354: Add a Maximum Log Compaction Lag382: MirrorMaker 2.0	2.34.0
51	KIP-	379: Multiple Consumer Group Management	2.	4.0 (WIP)
52	KIP-351: Add --under-min-isr option to describe topics command380: Detect outdated control requests and bounced brokers using broker generation	2.32.0
53	KIP-346: Improve LogCleaner behavior on error377: TopicCommand to use AdminClient	2.2.02.1
54	KIP-345: Introduce static membership protocol to reduce consumer rebalances376: Implement AutoClosable on appropriate classes that want to be used in a try-with-resource statement	2.22.4.0 (WIP), partially available in 2.3.0
55	KIP-342 Add support for custom SASL extensions in OAuthBearer authentication374: Add '--help' option to all available Kafka CLI commands	2.12.0
56	KIP-341: Update Sticky Assignor's User Data Protocol372: Naming Repartition Topics for Joins and Grouping	2.31.0
57	KIP-	371: Add a configuration to build custom SSL principal name	2.	2.0
58	KIP-	369: Alternative Partitioner to Support "Always Round-Robin" Selection	2.	4.	0
59	KIP	368: Allow SASL Connections to Periodically Re-Authenticate	2.	2.0
60	KIP-336: Consolidate ExtendedSerializer/Serializer and ExtendedDeserializer/Deserializer367 Introduce close(Duration) to Producer and AdminClient instead of close(long, TimeUnit)	2.12.0
61	KIP-332: Update AclCommand to use AdminClient API366: Make FunctionConversions deprecated	2.1.0
62	KIP-331 Add default implementation to close() and configure() for Serializer, Deserializer and 365: Materialized, Serialized, Joined, Consumed and Produced with implicit Serde	2.31.0
63	KIPK IP-330361: Add retentionPeriod in SessionBytesStoreSupplierConsumer Configuration to Disable Auto Topic Creation	2.13.0
64	KIP-328: Ability to suppress updates for KTables360: Improve handling of unknown producer	2.1.0 (partially implemented) / 2.34.0 (WIP)
65	KIP-324: Add method to get metrics() in AdminClient359: Verify leader epoch in produce requests	2.14.0 (WIP)
66	KIP-	358: Migrate Streams API to Duration instead of long ms times	2.1.0
67	KIP-	357:	Add support to list ACLs per principal	2.1.0
68	KIP-320: Allow fetchers to detect and handle log truncation356: Add withCachingDisabled() to StoreBuilder	2.1.0 (partially implemented) / 2.2.0
69	KIP-319: Replace segments with segmentInterval in WindowBytesStoreSupplier354: Add a Maximum Log Compaction Lag	2.13.0
70	KIP-313: Add KStream.flatTransform and KStream.flatTransformValues 353: Improve Kafka Streams Timestamp Synchronization	2.21.0 (partially implemented) / 2.3.0
71	KIP-312 Add Overloaded StreamsBuilder Build Method to Accept java.util.Properties352: Distinguish URPs caused by reassignment	2.14.0 (WIP)
72	KIP-	351: Add --under-min-isr option to describe topics command	2.3	.0
73	KIP-307: Allow to define custom processor names with KStreams DSL346: Improve LogCleaner behavior on error	2.3.0 (partial)1
74	KIP-306: Configuration for Delaying Response to Failed Authentication345: Introduce static membership protocol to reduce consumer rebalances	2.4.0 (WIP), partially available in 2.32.1.0
75	KIP-	342 Add support for custom SASL extensions in OAuthBearer authentication	2.	1.0
76	KIP-303: Add Dynamic Routing in Streams Sink341: Update Sticky Assignor's User Data Protocol	2.03.0
77	KIP-302 - Enable Kafka clients to use all DNS resolved IP addresses340: Allow kafka-reassign-partitions.sh and kafka-log-dirs.sh to take admin client property file	2.1.0
78	KIP-300: Add Windowed KTable API in StreamsBuilder339: Create a new IncrementalAlterConfigs API	2.43.00
79	KIP-298: Error Handling in Connect338 Support to exclude the internal topics in kafka-topics.sh command	2.01.0
80	KIP-297: Externalizing Secrets for Connect Configurations336: Consolidate ExtendedSerializer/Serializer and ExtendedDeserializer/Deserializer	2.01.0
81	KIP-	332: Update AclCommand to use AdminClient API	2.	1.0
82	KIP-294 - Enable TLS hostname verification by default331 Add default implementation to close() and configure() for Serializer, Deserializer and Serde	2.03.0
83	KIP-292330: Add transformValues() method to KTableretentionPeriod in SessionBytesStoreSupplier	2.01.0
84	KIP-290: Support for Prefixed ACLs328: Ability to suppress updates for KTables	2.1.0 (partially implemented) / 2.3.0 (WIP)
85	KIP-289: Improve the default group id behavior in KafkaConsumer324: Add method to get metrics() in AdminClient	2.21.0
86	KIP-285: Connect Rest Extension Plugin322: Return new error code for DeleteTopics API when topic deletion disabled.	2.01.0
87	KIP-284: Set default retention ms for Streams repartition topics to Long.MAX_VALUE321: Update TopologyDescription to better represent Source and Sink Nodes	2.01.0
88	KIP-283: Efficient Memory Usage for Down-Conversion320: Allow fetchers to detect and handle log truncation	2.1.0 (partially implemented) / 2.2.0
89	KIP-282: Add the listener name to the authentication context319: Replace segments with segmentInterval in WindowBytesStoreSupplier	2.01.0
90	KIP-281: ConsumerPerformance: Increase Polling Loop Timeout and Make It Reachable by the End User313: Add KStream.flatTransform and KStream.flatTransformValues	2.2.0 (partially implemented) / 2.3 2.0 .0
91	KIP-	312 Add Overloaded StreamsBuilder Build Method to Accept java.util.Properties	2.	1.0
92	KIP-	308: Support dynamic update of max.connections.per.ip/max.connections.per.ip.overrides	2.	1.0
93	KIP-277 - Fine Grained ACL for CreateTopics API307: Allow to define custom processor names with KStreams DSL	2.03.0 (partial)
94	KIP-	306: Configuration for Delaying Response to Failed Authentication	2.	1.0
95	KIP-274: Kafka Streams Skipped Records Metrics305: Add Connect primitive number converters	2.0.0
96	KIP-272303: Add API version tag to broker's RequestsPerSec metricDynamic Routing in Streams Sink	2.0.0
97	KIP-270 - A Scala Wrapper Library for Kafka Streams302 - Enable Kafka clients to use all DNS resolved IP addresses	2.01.0
98	KIP-	300: Add Windowed KTable API in StreamsBuilder	2.	4.0
99	KIP-	298: Error Handling in Connect	2.0.0
100	KIP-266: Fix consumer indefinite blocking behavior297: Externalizing Secrets for Connect Configurations	2.0.0
101	KIP-	295 Add Streams Configuration Allowing for Optional Topology Optimization	2.0.0
102	KIP	-294 - Enable TLS hostname verification by default	2.0.0
103	KIP-	291: Separating controller connections and requests from the data plane	Accepted
104	KIP-	292: Add transformValues() method to KTable	2.0.0
105	KIP-255: OAuth Authentication via SASL/OAUTHBEARER290: Support for Prefixed ACLs	2.0.0
106	KIP-	289: Improve the default group id behavior in KafkaConsumer	2.	2.0
107	KIP-249: Add Delegation Token Operations to KafkaAdminClient285: Connect Rest Extension Plugin	2.0.0
108	KIP-	284: Set default retention ms for Streams repartition topics to Long.MAX_VALUE	2.0	.0
109	KIP-	283: Efficient Memory Usage for Down-Conversion	2.0.0
110	KIP-244282: Add Record Header support to Kafka Streams Processor APIthe listener name to the authentication context	2.0.0
111	KIP-	281: ConsumerPerformance: Increase Polling Loop Timeout and Make It Reachable by the End User	2.0	.0
112	KIP-239 Add queryableStoreName() to GlobalKTable279: Fix log divergence between leader and follower after fast leader fail over	2.01.1.0
113	KIP	-278 - Add version option to Kafka's commands	2.0	.0
114	KIP-	277 - Fine Grained ACL for CreateTopics API	2.0.0
115	KIP-	276 - Add StreamsConfig prefix for different consumers	2.	0.0
116	KIP-233: Simplify StreamsBuilder#addGlobalStore274: Kafka Streams Skipped Records Metrics	2.01.1.0
117	KIP-231: Improve the Required ACL of ListGroups API272: Add API version tag to broker's RequestsPerSec metric	2.10.0
118	KIP	-270 - A Scala Wrapper Library for Kafka Streams	2.0	.0
119	KIP-227 - Introduce Incremental FetchRequests to Increase Partition Scalability268: Simplify Kafka Streams Rebalance Metadata Upgrade	2.01.1.0
120	KIP-226 - Dynamic Broker Configuration267: Add Processor Unit Test Support to Kafka Streams Test Utils	2.01.1.0
121	KIP-	266: Fix consumer indefinite blocking behavior	2.0	.0
122	KIP-224: Add configuration parameter `retries` to Streams API265: Make Windowed Serde to public APIs	2.01.1.0
123	KIP-223 - Add per-topic min lead and per-partition lead metrics to KafkaConsumer261: Add Single Value Fetch in Window Stores	2.0.0
124	KIP-	258: Allow to Store Record Timestamps in RocksDB	2.	3.0 (partially implemented)
125	KIP-220: Add AdminClient into Kafka Streams' ClientSupplier257 - Configurable Quota Management	2.01.1.0
126	KIP-	255: OAuth Authentication via SASL/OAUTHBEARER	2.0.0
127	KIP-218: Make KafkaFuture.Function java 8 lambda compatible251: Allow timestamp manipulation in Processor API	2.0.1.1.0
128	KIP-215249: Add topic regex support for Connect sinksDelegation Token Operations to KafkaAdminClient	2.01.1.0
129	KIP-214: Add zookeeper.max.in.flight.requests config to the broker247: Add public test utils for Kafka Streams	1.1.0
130	KIP-	245: Use Properties instead of StreamsConfig in KafkaStreams constructor	2.	0.0
131	KIP-	244: Add Record Header support to Kafka Streams Processor API	2.0	.0
132	KIP-211: Revise Expiration Semantics of Consumer Group Offsets243: Make ProducerConfig and ConsumerConfig constructors public	12.1.0
133	KIP-210 - Provide for custom error handling when Kafka Streams fails to produce239 Add queryableStoreName() to GlobalKTable	1.1.0
134	KIP-208: Add SSL support to Kafka 238: Expose Kafka cluster ID in Connect REST interfaceAPI	1.1.0
135	KIP-207: Offsets returned by ListOffsetsResponse should be monotonically increasing even during a partition leader change237: More Controller Health Metrics	2.20.0
136	KIP-206235: Add DNS alias support for UUID serialization and deserializationsecured connection	2.1.0
137	KIP-205: Add all() and range() API to ReadOnlyWindowStore233: Simplify StreamsBuilder#addGlobalStore	1.1.0
138	KIP-	231: Improve the Required ACL of ListGroups API	2	.1.0
139	KIP-203: Add toLowerCase support to sasl.kerberos.principal.to.local rule 229: DeleteGroups API	1.1.0
140	KIP-202: Move merge() from StreamsBuilder to KStream227 - Introduce Incremental FetchRequests to Increase Partition Scalability	1.01.0
141	KIP-198: Remove ZK dependency from Streams Reset Tool-226 - Dynamic Broker Configuration	1.01.0
142	KIP-197 Connect REST API should include the connector type when describing a connector-225 - Use tags for consumer “records.lag” metrics	1.01.0
143	KIP-196224: Add metrics to Kafka Connect frameworkconfiguration parameter `retries` to Streams API	1.01.0
144	KIP-195: AdminClient.createPartitions223 - Add per-topic min lead and per-partition lead metrics to KafkaConsumer	21.0.0
145	KIP-192 : Provide cleaner semantics when idempotence is enabled-222 - Add Consumer Group operations to Admin API	21.0.0
146	KIP-191: KafkaConsumer.subscribe() overload that takes just Pattern221: Enhance DSL with Connecting Topic Creation and Repartition Hint	2.4.0 (WIP)1.0.0
147	KIP-190: Handle client-ids consistently between clients and brokers220: Add AdminClient into Kafka Streams' ClientSupplier	1.01.0
148	KIP-219 - 189: Improve principal builder interface and add support for SASLImprove quota communication	21.0.0
149	KIP-188 - Add new metrics to support health checks218: Make KafkaFuture.Function java 8 lambda compatible	1.01.0
150	KIP-187 - Add cumulative count metric for all Kafka rate metrics215: Add topic regex support for Connect sinks	1.01.0
151	KIP-186: Increase offsets retention default to 7 days214: Add zookeeper.max.in.flight.requests config to the broker	1.12.0.0
152	KIP-	213 Support non-key joining in KTable	2.	4.0 (WIP)
153	KIP-182: Reduce Streams DSL overloads and allow easier use of custom storage engines212: Enforce set of legal characters for connector names	1.01.0
154	KIP-180: Add a broker metric specifying the number of consumer group rebalances in progress211: Revise Expiration Semantics of Consumer Group Offsets	21.1.0
155	KIP-177: Consumer perf tool should count rebalance time-210 - Provide for custom error handling when Kafka Streams fails to produce	1.01.0
156	KIP-	208: Add SSL support to Kafka Connect REST interface	1.1	.0
157	KIP-175: Additional '--describe' views for ConsumerGroupCommand207: Offsets returned by ListOffsetsResponse should be monotonically increasing even during a partition leader change	2.21.1.0
158	KIP-	206: Add support for UUID serialization and deserialization	2.	1.0
159	KIP-173205: Add prefix to StreamsConfig to enable setting default internal topic configsall() and range() API to ReadOnlyWindowStore	1.01.0
160	KIP-171 - Extend Consumer Group Reset Offset for Stream Application204 : Adding records deletion operation to the new Admin Client API	1.1.0
161	KIP-168: Add GlobalTopicCount and GlobalPartitionCount metric per cluster203: Add toLowerCase support to sasl.kerberos.principal.to.local rule	1.01.0
162	KIP-167: Add interface for the state store restoration process202: Move merge() from StreamsBuilder to KStream	1.0.0
163	KIP-164 - Add UnderMinIsrPartitionCount and per-partition UnderMinIsr metrics198: Remove ZK dependency from Streams Reset Tool	1.0.0
164	KIP-	197 Connect REST API should include the connector type when describing a connector	1.0.0
165	KIP-162: Enable topic deletion by default196: Add metrics to Kafka Connect framework	1.0.0
166	KIP-161: streams deserialization exception handlers195: AdminClient.createPartitions	1.0.0
167	KIP-192 : Provide cleaner semantics when idempotence is enabled	1.0.0
168	KIP-191: KafkaConsumer.subscribe() overload that takes just Pattern160: Augment KStream.print(), KStream.writeAsText() to allow users pass in extra parameters in the printed string	1.0.0
168169	KIP-	190: Handle client-ids consistently between clients and brokers	1.0.0
169170	KIP-	189: Improve principal builder interface and add support for SASL	1	.0.0
170171	KIP-	188 - Add	new metrics to support health checks	1.	0.0
171172	KIP-154 Add Kafka Connect configuration properties for creating internal topics187 - Add cumulative count metric for all Kafka rate metrics	10.11.0.0
172173	KIP-153: Include only client traffic in BytesOutPerSec metric186: Increase offsets retention default to 7 days	20.11.0.0
173174	KIP-152 - Improve diagnostics for SASL authentication failures183 - Change PreferredReplicaLeaderElectionCommand to use AdminClient	2.21.0.0
174175	KIP-151 Expose Connector type in REST API182: Reduce Streams DSL overloads and allow easier use of custom storage engines	10.11.0.0
175176	KIP-150 - Kafka-Streams Cogroup	2.4.0 (WIP)
176	KIP-149: Enabling key access in ValueTransformer, ValueMapper, and ValueJoiner	1.1.0 (partially implemented) (WIP for 2.4.0)
180: Add a broker metric specifying the number of consumer group rebalances in progress	1.1.0
177	KIP-177: Consumer perf tool should count rebalance time	1.0.0
178	KIP-176: Remove deprecated new-consumer option for tools	2	177	KIP-146 - Classloading Isolation in Connect	.0.0
178179	KIP-175: Additional '-145 - Expose Record Headers in Kafka Connect-describe' views for ConsumerGroupCommand	1.1.0
179180	KIP-144: Exponential backoff for broker reconnect attempts	0.11.0.0	180	KIP-143: Controller Health Metrics	174 - Deprecate and remove internal converter configs in WorkerConfig	20.11.0.0
181	KIP-140: Add administrative RPCs for adding, deleting, and listing ACLs173: Add prefix to StreamsConfig to enable setting default internal topic configs	1.0.11.0.0
182	KIP-138: Change punctuate semantics-171 - Extend Consumer Group Reset Offset for Stream Application	1.01.0
183	KIP-137: Enhance TopicCommand --describe to show topics marked for deletion168: Add GlobalTopicCount and GlobalPartitionCount metric per cluster	10.11.0.0
184	KIP-136167: Add Listener name to SelectorMetrics tagsinterface for the state store restoration process	1.0.11.0.0
185	KIP -134: Delay initial consumer group rebalance -164 - Add UnderMinIsrPartitionCount and per-partition UnderMinIsr metrics	1.0.11.0.0
186	KIP-	163: Lower the Minimum Required ACL Permission of OffsetFetch	1.	0.0
187	KIP-	162: Enable topic deletion by default	1.0.0
188	KIP-129: Streams Exactly-Once Semantics161: streams deserialization exception handlers	10.11.0.0
189	KIP-128: Add ByteArrayConverter for Kafka Connect160: Augment KStream.print(), KStream.writeAsText() to allow users pass in extra parameters in the printed string	1.0.11.0.0
190	KIP-	157 - Add consumer config options to streams reset tool	1	.0.0
191	KIP-	156 Add option "dry run" to Streams application reset tool	0.11.0.0
192	KIP-	155 - Add range scan for windowed state stores	0.11.0.0
193	KIP-122: Add Reset Consumer Group Offsets tooling154 Add Kafka Connect configuration properties for creating internal topics	0.11.0.0
194	KIP-121: Add KStream peek method153: Include only client traffic in BytesOutPerSec metric	0.11.0.0
195	KIP-120: Cleanup Kafka Streams builder API152 - Improve diagnostics for SASL authentication failures	1.0.0
196	KIP-119: Drop Support for Scala 2.10 in Kafka 0.11151 Expose Connector type in REST API	0.11.0.0
197	KIP-118: Drop Support for Java 7150 - Kafka-Streams Cogroup	2.0.04.0 (WIP)
198	KIP-117: Add a public AdminClient API for Kafka admin operations149: Enabling key access in ValueTransformer, ValueMapper, and ValueJoiner	1.1.0 (partially implemented) (WIP for 2.4.0)0.11.0.0
199	KIP-115: Enforce offsets.topic.replication.factor upon __consumer_offsets auto topic creation-146 - Classloading Isolation in Connect	0.11.0.0
200	KIP-114: KTable state stores and improved semantics-145 - Expose Record Headers in Kafka Connect	1.10.11.0.0
201	KIP-113: Support replicas movement between log directories144: Exponential backoff for broker reconnect attempts	0.11.01.1.0
202	KIP-112: Handle disk failure for JBOD143: Controller Health Metrics	0.111.0.0
203	KIP-	140: Add	administrative RPCs for adding, deleting, and listing ACLs	0.11.0.0
204	KIP-109: Old Consumer Deprecation138: Change punctuate semantics	10.11.0.0
205	KIP-108: Create Topic Policy137: Enhance TopicCommand --describe to show topics marked for deletion	0.1011.20.0
206	KIP-107136: Add deleteRecordsBefore() API in AdminClientListener name to SelectorMetrics tags	0.11.0.0
207	KIP-106 - Change Default unclean.leader.election.enabled from True to False134: Delay initial consumer group rebalance	0.11.0.0
208	KIP-105: Addition of Record Level for Sensors133: Describe and Alter Configs Admin APIs	0.1011.20.0
209	KIP-	130: Expose states of active tasks to KafkaStreams public API	1.0.	0
210	KIP-103: Separation of Internal and External traffic129: Streams Exactly-Once Semantics	0.1011.20.0
211	KIP-102 - Add close with timeout for consumers128: Add ByteArrayConverter for Kafka Connect	0.1011.20.0
212	KIP-101 - Alter Replication Protocol to use Leader Epoch rather than High Watermark for Truncation126 - Allow KafkaProducer to split and resend oversized batches.	0.11.0.0
213	KIP-100 - Relax Type constraints in Kafka Streams API124 - Request rate quotas	0.1011.20.0
214	KIP-99: Add Global Tables to Kafka Streams123: Allow per stream/table timestamp extractor	0.1011.20.0
215	KIP-98 - Exactly Once Delivery and Transactional Messaging122: Add Reset Consumer Group Offsets tooling	0.11.0.0
216	KIP-97: Improved Kafka Client RPC Compatibility Policy121: Add KStream peek method	0. 10 11. 2 0.0
217	KIP-96 - Add per partition metrics for in-sync and assigned replica count120: Cleanup Kafka Streams builder API	1.00.10.2.0
218	KIP-94 Session Windows119: Drop Support for Scala 2.10 in Kafka 0.11	0.1011.20.0
219	KIP-93: Improve invalid timestamp handling in Kafka Streams118: Drop Support for Java 7	2.00.10.2.0
220	KIP-92 - Add per partition lag metrics to KafkaConsumer117: Add a public AdminClient API for Kafka admin operations	0.1011.20.0
221	KIP-91 Provide Intuitive User Timeouts in The Producer115: Enforce offsets.topic.replication.factor upon __consumer_offsets auto topic creation	0.11.02.1.0
222	KIP-90 - Remove zkClient dependency from Streams114: KTable state stores and improved semantics	0.1011.20.0
223	KIP-89: Allow sink connectors to decouple flush and offset commit113: Support replicas movement between log directories	1.10.10.2.0
224	KIP-88: OffsetFetch Protocol Update112: Handle disk failure for JBOD	1.0.0.10.2.0
225	KIP-	110: Add Codec for ZStandard Compression	2.	1.0
226	KIP-85: Dynamic JAAS configuration for Kafka clients109: Old Consumer Deprecation	0.1011.20.0
227	KIP-84: Support SASL SCRAM mechanisms108: Create Topic Policy	0.10.2.0
228	KIP-82 - Add Record Headers107: Add deleteRecordsBefore() API in AdminClient	0.11.0.0
229	KIP -81: Bound Fetch memory usage in the consumer	2.4.0 (WIP)
230	KIP-79 - ListOffsetRequest/ListOffsetResponse v1 and add timestamp search methods to the new consumer	0.10.1.0
-106 - Change Default unclean.leader.election.enabled from True to False	0.11.0.0
230	KIP-105: Addition of Record Level for Sensors	231	KIP-78: Cluster Id	0.10.12.0
232231	KIP-77: Improve Kafka Streams Join Semantics104: Granular Sensors for Streams	0.10.2.0
233232	KIP-75 - Add per-connector Converters103: Separation of Internal and External traffic	0.10.12.0
234233	KIP-74: Add Fetch Response Size Limit in Bytes102 - Add close with timeout for consumers	0.10.12.0
235234	KIP-101 - 73: Replication QuotasAlter Replication Protocol to use Leader Epoch rather than High Watermark for Truncation	0.1011.10.0
236235	KIP-72: Allow putting a bound on memory consumed by Incoming request 100 - Relax Type constraints in Kafka Streams API	0.10.21.0.0
237236	KIP-71: Enable log compaction and deletion to co-exist99: Add Global Tables to Kafka Streams	0.10.12.0
238237	KIP-70: Revise Partition Assignment Semantics on New Consumer's Subscription Change-98 - Exactly Once Delivery and Transactional Messaging	0.1011.10.0
239238	KIP-6797: Queryable state for Kafka StreamsImproved Kafka Client RPC Compatibility Policy	0.10.12.0
240239	KIP-66: Single Message Transforms for Kafka Connect96 - Add per partition metrics for in-sync and assigned replica count	0.10.2.0 / 0.11.0.0
241240	KIP-65: Expose timestamps to Connect94 Session Windows	0.10.12.0
242241	KIP-63: Unify store and downstream caching in streams93: Improve invalid timestamp handling in Kafka Streams	0.10.12.0
243242	KIP-62: Allow consumer to send heartbeats from a background thread-92 - Add per partition lag metrics to KafkaConsumer	0.10.2.0
243	KIP-91 Provide Intuitive User Timeouts in The Producer	2.1.0
244	KIP-60 - Make Java client classloading more flexible90 - Remove zkClient dependency from Streams	0.10.12.0
245	KIP-58 - Make Log Compaction Point Configurable89: Allow sink connectors to decouple flush and offset commit	0.10.12.0
246	KIP-57 - Interoperable LZ4 Framing88: OffsetFetch Protocol Update	0.10.02.0
247	KIP-56: Allow cross origin HTTP requests on all HTTP methods86: Configurable SASL callback handlers	2.0.10.0.0
248	KIP-55: Secure Quotas for Authenticated Users85: Dynamic JAAS configuration for Kafka clients	0.10.12.0
249	KIP-54: Sticky Partition Assignment Strategy84: Support SASL SCRAM mechanisms	0.1110.02.0
250	KIP-52: Connector Control APIs-82 - Add Record Headers	0.1011.0.0
251	KIP-51 - List Connectors REST API81: Bound Fetch memory usage in the consumer	2.4.0 (WIP)0.10.0.0
252	KIP-50 - Move Authorizer to o.a.k.common package79 - ListOffsetRequest/ListOffsetResponse v1 and add timestamp search methods to the new consumer	0.10.1.0
253	KIP-48 Delegation token support for Kafka78: Cluster Id	0.101.1.0
254	KIP-45 - Standardize all client sequence interaction on j.u.Collection.77: Improve Kafka Streams Join Semantics	0.10.02.0
255	KIP-43: Kafka SASL enhancements-75 - Add per-connector Converters	0.10.01.0
256	KIP-4274: Add Producer and Consumer InterceptorsFetch Response Size Limit in Bytes	0.10.01.0
257	KIP-41: Consumer Max Records73: Replication Quotas	0.10.01.0
258	KIP-40: ListGroups and DescribeGroup72: Allow putting a bound on memory consumed by Incoming request	10.9.0.0
259	KIP-38: ZooKeeper Authentication71: Enable log compaction and deletion to co-exist	0.910.01.0
260	KIP-36 - Rack aware replica assignment70: Revise Partition Assignment Semantics on New Consumer's Subscription Change	0.10.01.0
261	KIP-35 - Retrieving protocol version67: Queryable state for Kafka Streams	0.10.01.0
262	KIP-33 - Add a time based log index66: Single Message Transforms for Kafka Connect	0.10.1.2.0 / 0.11.0.0
263	KIP-32 - Add 65: Expose timestamps to Kafka messageConnect	0.10.01.0
264	KIP-31 - Move to relative offsets in compressed message sets63: Unify store and downstream caching in streams	0.10.01.0
265	KIP-28 - Add a processor client62: Allow consumer to send heartbeats from a background thread	0.10.01.0
266	KIP-26 - Add Kafka Connect framework for data import/export60 - Make Java client classloading more flexible	0.910.01.0
267	KIP-25 - System test improvements58 - Make Log Compaction Point Configurable	0.910.01.0
268	KIP-22 - Expose a Partitioner interface in the new producer57 - Interoperable LZ4 Framing	0.910.0.0
269	KIP-21 - Dynamic Configuration56: Allow cross origin HTTP requests on all HTTP methods	0.910.0.0 (WIP)
270	KIP-20 Enable log preallocate to improve consume performance under windows and some old Linux file system55: Secure Quotas for Authenticated Users	0.910.01.0
271	KIP-19 - Add a request timeout to NetworkClient54: Sticky Partition Assignment Strategy	0.911.0.0
272	KIP-16 - Automated Replica Lag Tuning52: Connector Control APIs	0.910.0.0
273	KIP-15 - Add a close method with a timeout in the producer51 - List Connectors REST API	0.910.0.0
274	KIP-13 - Quota Design48 Delegation token support for Kafka	1.1.00.9.0.0
275	KIP-12 - Kafka Sasl/Kerberos and SSL implementation45 - Standardize all client sequence interaction on j.u.Collection.	0.910.0.0
276	KIP-11 - Kafka Authorizer design43: Kafka SASL enhancements	0.910.0.0
277	KIP-8 - Add a flush method to the producer API42: Add Producer and Consumer Interceptors	0.910.0.0
278	KIP-4 - Metadata Protocol Changes41: Consumer Max Records	0.10.0.0
279	KIP-4 - Command line and centralized administrative operations40: ListGroups and DescribeGroup	0.9.0.0, 0.10.0.0, 0.10.1.0
280	KIP-3 - Mirror Maker Enhancement38: ZooKeeper Authentication	0.9.0.0
281	KIP-2 - Refactor brokers to allow listening on multiple ports and IPs36 - Rack aware replica assignment	0.910.0.0
282	KIP-1 - Remove support of request.required.acks35 - Retrieving protocol version	0.910.0.0

...

283	KIP-33 - Add a time based log index	0.10.1.0
284	KIP-32 - Add timestamps to Kafka message	0.10.0.0
285	KIP-31 - Move to relative offsets in compressed message sets	0.10.0.0
286	KIP-28 - Add a processor client	0.10.0.0
287	KIP-26 - Add Kafka Connect framework for data import/export	0.9.0.0
288	KIP-25 - System test improvements	0.9.0.0
289	KIP-22 - Expose a Partitioner interface in the new producer	0.9.0.0
290	KIP-21 - Dynamic Configuration	0.9.0.0 (WIP)
291	KIP-20 Enable log preallocate to improve consume performance under windows and some old Linux file system	0.9.0.0
292	KIP-19 - Add a request timeout to NetworkClient	0.9.0.0
293	KIP-16 - Automated Replica Lag Tuning	0.9.0.0
294	KIP-15 - Add a close method with a timeout in the producer	0.9.0.0
295	KIP-13 - Quota Design	0.9.0.0
296	KIP-12 - Kafka Sasl/Kerberos and SSL implementation	0.9.0.0
297	KIP-11 - Kafka Authorizer design	0.9.0.0
298	KIP-8 - Add a flush method to the producer API	0.9.0.0
299	KIP-4 - Metadata Protocol Changes	0.10.0.0
300	KIP-4 - Command line and centralized administrative operations	0.9.0.0, 0.10.0.0, 0.10.1.0
301	KIP-3 - Mirror Maker Enhancement	0.9.0.0
302	KIP-2 - Refactor brokers to allow listening on multiple ports and IPs	0.9.0.0
303	KIP-1 - Remove support of request.required.acks	0.9.0.0

KIPs under discussion

Please insert new rows in sorted order (ascending by KIP number). Please move the adopted/accepted KIPs to the "Adopted KIPs" table above.

KIP	Comment
KIP-59: Proposal for a kafka broker command	Sent emails to Dev discussion group. Work tracked under KAFKA-3663.
KIP-125: ZookeeperConsumerConnector to KafkaConsumer Migration and Rollback
KIP-131 - Add access to OffsetStorageReader from SourceConnector
KIP-135 : Send of null key to a compacted topic should throw non-retriable error back to user
KIP 141 - ProducerRecord & SourceRecord: Add timestamp constructors
KIP-142: Add ListTopicsRequest to efficiently list all the topics in a cluster
KIP-148: Add a connect timeout for client
KIP-158: Kafka Connect should allow source connectors to set topic-specific settings for new topics
KIP-159: Introducing Rich functions to Streams
KIP-166 - Add a tool to make amounts of replicas and leaders on brokers balanced
KIP-169 - Lag-Aware Partition Assignment Strategy
KIP-178: Size-based log directory selection strategy
KIP-185: Make exactly once in order delivery the default producer setting
KIP-193: Add SchemaBuilder.from(Schema)
KIP-199: Add Kafka Connect offset tool
KIP-201: Rationalising Policy interfaces
KIP-209: C onnection String Support
KIP-216: IQ should throw different exceptions for different errors
KIP-217: Expose a timeout to allow an expired ZK session to be re-created
KIP-228 Negative record timestamp support	Voting in progress
KIP-234: add support for getting topic defaults from AdminClient
KIP-236: Interruptible Partition Reassignment	Discussion
KIP-240: AdminClient.listReassignments() AdminClient.describeReassignments()
KIP-242: Mask password in Kafka Connect Rest API response
KIP-250 Add Support for Quorum-based Producer Acknowledgment
KIP-252 - Extend ACLs to allow filtering based on ip ranges and subnets
KIP-253: Support in-order message delivery with partition expansion	Discussion
KIP-254: JsonConverter Exception Handeling
KIP-259: Improve Streams DSL Timestamp Propagation Semantics
KIP-260: add primary join operation for Stream-Stream join (WIP)	Draft
KIP-264: Add a consumer metric to record raw fetch size	Voting in progress
KIP-271: Add NetworkClient redirector	Discussion
KIP-273: Kafka to support using ETCD beside Zookeeper	Discussion
KIP-275 - Indicate "isClosing" in the SinkTaskContext	Voting in progress
KIP-280: Enhanced log compaction	Discussion
KIP-293 Add new metrics for consumer/replication fetch requests	Voting in progress
KIP-296: Add connector level configurability for producer/consumer client configs	Discussion
KIP-301: Schema Inferencing for JsonConverter	Discussion
KIP-304: Connect runtime mode improvements for container platforms	Discussion
KIP-309: Add toUpperCase support to sasl.kerberos.principal.to.local rule	Discussion
KIP-314: KTable to GlobalKTable Bi-directional Join	Discussion
KIP-315: Stream Join Sticky Assignor	Discussion
KIP-316: Command-line overrides for ConnectDistributed worker properties	Discussion
KIP-317: Add end-to-end data encryption functionality to Apache Kafka	Discussion
KIP-325: Extend Consumer Group Command to Show Beginning Offsets	Voting in Progress345
KIP-326: Schedulable KTable as Graph source	Discussion
KIP-333: Add faster mode of rebalancing	Discussion
KIP-334 - Include partitions in exceptions raised during consumer record deserialization/validation
KIP-335: Consider configurations for KafkaStreams	Discussion
KIP-347: Enable batching in FindCoordinatorRequest	Discussion
KIP-348 Eliminate null from SourceTask#poll()
KIP-350: Allow kafka-topics.sh to take brokerid as parameter to show partitions associated with it
KIP-356: Add KafkaConsumer fetch-error-rate and fetch-error-total metrics	Discussion
KIP-360: Improve handling of unknown producer	Discussion
K IP-362: Support Dynamic Session Window	Discussion
KIP-363: Allow performance tools to print final results to output file	Discussion
KIP-370: Remove Orphan Partitions	Discussion
KIP-373: Allow users to create delegation tokens for other users	Discussion
KIP-375: Kafka Clients - make Metadata#TOPIC_EXPIRY_MS configurable	Discussion
KIP-378: Enable Dependency Injection for Kafka Streams handlers	Discussion
KIP-381: Connect: Tell about records that had their offsets flushed in callback	Voting in progress (restarted 18th January 2019, due to no votes in first attempt)
KIP-383: Pluggable interface for SSL Factory	Voting in progress
KIP-384: Add config for incompatible changes to persistent metadata	Discussion
KIP-385: Avoid throwing away prefetched data	Discussion
KIP-387: Fair Message Consumption Across Partitions in KafkaConsumer	Discussion
KIP-388: Add observer interface to record request and response	Discussion
KIP-390: Allow fine-grained configuration for compression	Discussion, JIRA exists with pull-request
KIP-391: Allow Producing with Offsets for Cluster Replication	Discussion, JIRA exists with pull-request
KIP-392: Allow consumers to fetch from closest replica	Discussion
KIP-395: Encypt-then-MAC Delegation token metadata
KIP-397: Add methods to override fetch offsets based on timestamp	Discussion
KIP-398: Support reading trust store from classpath	Discussion
KIP-399: Extend ProductionExceptionHandler to cover serialization exceptions	Discussion
KIP-400: Improve exit status in case of errors in ConsoleProducer	Discussion
KIP-403: Increase ProducerPerformance precision by using nanoTime	Draft
KIP-405: Kafka Tiered Storage	Discussion
KIP-406: GlobalStreamThread should honor custom offset policy.	Discussion
KIP-407: Kafka Connect support override worker kafka api configuration with connector configuration that post by rest api
KIP-408: Add asynchronous processing to Kafka Streams	Discussion
KIP-409: Allow creating under-replicated topics and partitions
KIP-410: Add metric for request handler thread pool utilization by request type	Discussion
KIP-416: Notify SourceTask of ACK'd offsets, metadata	Discussion
KIP-418: A method-chaining way to branch KStream	Discussion, JIRA exists with pull-request
KIP-419: Safely notify Kafka Connect SourceTask is stopped	Voting in progress, JIRA exists with pull request
KIP-422: Add support for client quota configuration in the Kafka Admin Client

Please insert new rows in sorted order (ascending by KIP number).

416: Notify SourceTask of ACK'd offsets, metadata

KIP	Comment
KIP-59: Proposal for a kafka broker command	Sent emails to Dev discussion group. Work tracked under KAFKA-3663.
KIP-125: ZookeeperConsumerConnector to KafkaConsumer Migration and Rollback	KIP-131 - Add access to OffsetStorageReader from SourceConnector	KIP-135 : Send of null key to a compacted topic should throw non-retriable error back to user	KIP 141 - ProducerRecord & SourceRecord: Add timestamp constructors	KIP-142: Add ListTopicsRequest to efficiently list all the topics in a cluster	KIP-148: Add a connect timeout for client	KIP-158: Kafka Connect should allow source connectors to set topic-specific settings for new topics	KIP-159: Introducing Rich functions to Streams	KIP-166 - Add a tool to make amounts of replicas and leaders on brokers balanced	KIP-169 - Lag-Aware Partition Assignment Strategy	KIP-178: Size-based log directory selection strategy	KIP-185: Make exactly once in order delivery the default producer setting	KIP-193: Add SchemaBuilder.from(Schema)	KIP-199: Add Kafka Connect offset tool	KIP-201: Rationalising Policy interfaces	KIP-209: C onnection String Support	KIP-216: IQ should throw different exceptions for different errors	KIP-217: Expose a timeout to allow an expired ZK session to be re-created
KIP-221: Enhance KStream with Connecting Topic Creation and Repartition Hint	Discussion
KIP-228 Negative record timestamp support	Voting in progress
KIP-234: add support for getting topic defaults from AdminClient
KIP-236: Interruptible Partition Reassignment	Discussion
KIP-240: AdminClient.listReassignments() AdminClient.describeReassignments()	KIP-242: Mask password in Kafka Connect Rest API response	KIP-250 Add Support for Quorum-based Producer Acknowledgment	KIP-252 - Extend ACLs to allow filtering based on ip ranges and subnets
KIP-253: Support in-order message delivery with partition expansion	Discussion
KIP-254: JsonConverter Exception Handeling	KIP-259: Improve Streams DSL Timestamp Propagation Semantics
KIP-260: add primary join operation for Stream-Stream join (WIP)	Draft
KIP-264: Add a consumer metric to record raw fetch size	Voting in progress
KIP-271: Add NetworkClient redirector	Discussion
KIP-273: Kafka to support using ETCD beside Zookeeper	Discussion
KIP-275 - Indicate "isClosing" in the SinkTaskContext	Voting in progress
KIP-280: Enhanced log compaction	Discussion
KIP-291: Separating controller connections and requests from the data plane	Accepted
KIP-293 Add new metrics for consumer/replication fetch requests	Voting in progress
KIP-296: Add connector level configurability for producer/consumer client configs	Discussion
KIP-301: Schema Inferencing for JsonConverter	Discussion
KIP-304: Connect runtime mode improvements for container platforms	Discussion
KIP-314: KTable to GlobalKTable Bi-directional Join	Discussion
KIP-315: Stream Join Sticky Assignor	Discussion
KIP-316: Command-line overrides for ConnectDistributed worker properties	Discussion
KIP-317: Add end-to-end data encryption functionality to Apache Kafka	Discussion
KIP-325: Extend Consumer Group Command to Show Beginning Offsets	Voting in Progress345
KIP-326: Schedulable KTable as Graph source	Discussion
KIP-333: Add faster mode of rebalancing	Discussion
KIP-334 - Include partitions in exceptions raised during consumer record deserialization/validation
KIP-335: Consider configurations for KafkaStreams	Discussion
KIP-347: Enable batching in FindCoordinatorRequest	Discussion
KIP-348 Eliminate null from SourceTask#poll()	KIP-350: Allow kafka-topics.sh to take brokerid as parameter to show partitions associated with it
KIP-356: Add KafkaConsumer fetch-error-rate and fetch-error-total metrics	Discussion
KIP-360: Improve handling of unknown producer	Discussion
K IP-362: Support Dynamic Session Window	Discussion
KIP-363: Allow performance tools to print final results to output file	Discussion
KIP-369: Alternative Partitioner to Support "Always Round-Robin" Selection	Accepted
KIP-370: Remove Orphan Partitions	Discussion
KIP-373: Allow users to create delegation tokens for other users	Discussion
KIP-375: Kafka Clients - make Metadata#TOPIC_EXPIRY_MS configurable	Discussion
KIP-378: Enable Dependency Injection for Kafka Streams handlers	Discussion
KIP-379: Multiple Consumer Group Management	Accepted
KIP-381: Connect: Tell about records that had their offsets flushed in callback	Voting in progress (restarted 18th January 2019, due to no votes in first attempt)
KIP-383: Pluggable interface for SSL Factory	Voting in progress
KIP-384: Add config for incompatible changes to persistent metadata	Discussion
KIP-385: Avoid throwing away prefetched data	Discussion
KIP-387: Fair Message Consumption Across Partitions in KafkaConsumer	Discussion
KIP-388: Add observer interface to record request and response	Discussion
KIP-389: Introduce a configurable consumer group size limit	Accepted
KIP-390: Allow fine-grained configuration for compression	Discussion, JIRA exists with pull-request
KIP-391: Allow Producing with Offsets for Cluster Replication	Discussion, JIRA exists with pull-request
KIP-392423: Allow consumers to fetch from closest replicaAdd JoinReason to Consumer Join Group Protocol	Discussion
KIP-395: Encypt-then-MAC Delegation token metadata424: Allow suppression of intermediate events based on wall clock time	Discussion
KIP-396: Add Commit/List Offsets Operations to AdminClient	Discussion	426: Persist Broker Id to Zookeeper	Discussion
KIP-431: Support of printing additional ConsumerRecord fields in DefaultMessageFormatter	Voting in progress, JIRA exists with pull-request
KIP-434: Add Replica Fetcher and Log Cleaner Count Metrics KIP-397: Add methods to override fetch offsets based on timestamp	Discussion
KIP-398: Support reading trust store from classpath435: Internal Partition Reassignment Batching	Discussion
KIP-399: Extend ProductionExceptionHandler to cover serialization exceptions437: Custom replacement for MaskField SMT	Voting in progress, JIRA exists with pull-requestDiscussion
KIP-400: Improve exit status in case of errors in ConsoleProducer438: Expose task, connector IDs in Connect API	Discussion
KIP-401: TransformerSupplier/ProcessorSupplier StateStore connecting	Voting in progress	KIP-403: Increase ProducerPerformance precision by using nanoTime	439: Cleanup built-in Store interfaces	DiscussionDraft
KIP-405441: Kafka Tiered StorageSmooth Scaling Out for Kafka Streams	Discussion
KIP-406: GlobalStreamThread should honor custom offset policy.444: Augment metrics for Kafka Streams	Discussion
KIP-407: Kafka Connect support override worker kafka api configuration with connector configuration that post by rest api447: Producer scalability for exactly once semantics	Discussion
KIP-408448: Add asynchronous processing State Stores Unit Test Support to Kafka Streams Test Utils	Discussion
KIP-409: Allow creating under-replicated topics and partitions450: Sliding Window Aggregations in the DSL	Discussion
KIP-452: Tool to view cluster status	Discussion, JIRA exists
KIP-410: Add metric for request handler thread pool utilization by request type457: Add DISCONNECTED status to Kafka Streams	Discussion Discussion
KIP-	459: Improve KafkaStreams#close	Discussion
KIP-418: A method-chaining way to branch KStream	Discussion, JIRA exists with pull-request
KIP-419: Safely notify Kafka Connect SourceTask is stopped	Voting in progress, JIRA exists with pull request
KIP-421: Support resolving externalized secrets in AbstractConfig	Accepted
KIP-422: Add support for client quota configuration in the Kafka Admin Client	Discussion, JIRA exists with pull-request
KIP-423: Add JoinReason to Consumer Join Group Protocol	Discussion
KIP-424: Allow suppression of intermediate events based on wall clock time	Discussion
KIP-426: Persist Broker Id to Zookeeper	Discussion
KIP-431: Support of printing additional ConsumerRecord fields in DefaultMessageFormatter	Voting in progress, JIRA exists with pull-request
KIP-434: Add Replica Fetcher and Log Cleaner Count Metrics	Discussion
KIP-435: Internal Partition Reassignment Batching	Discussion
KIP-437: Custom replacement for MaskField SMT	Voting in progress, JIRA exists with pull-request
KIP-438: Expose task, connector IDs in Connect API	Discussion
KIP-439: Cleanup built-in Store interfaces	Discussion
KIP-440: Extend Connect Converter to support headers	Voting in progress
KIP-444: Augment metrics for Kafka Streams	Discussion
KIP-448: Add State Stores Unit Test Support to Kafka Streams Test Utils	Discussion
KIP-450: Sliding Window Aggregations in the DSL	Discussion
KIP-452: Tool to view cluster status	Discussion, JIRA exists
KIP-457: Add DISCONNECTED status to Kafka Streams	Discussion
KIP-459: Improve KafkaStreams#close	Discussion
KIP-463: Auto-configure non-default Serdes passed alongside the TopologyBuilder	Under discussion
KIP-466: Add support for List<T> serialization and deserialization	Voting in progress
KIP-468: Avoid decompression of record when validate record at server in the scene of inPlaceAssignment .	Under discussion
KIP-470: TopologyTestDriver test input and output usability improvements	Under discussion
KIP-471: Expose RocksDB Metrics in Kafka Streams	Accepted
KIP-473: Enable KafkaLog4JAppender to use SASL Authentication Callback Handlers	Under Discussion
KIP-474: To deprecate WindowStore#put(key, value)	Accepted
KIP-475: New Metrics to Measure Number of Tasks on a Connector	Accepted
KIP-476: Add Java AdminClient Interface	Under Discussion
KIP-477: Add PATCH method for connector config in Connect REST API	Under Discussion
KIP-478 - Strongly typed Processor API	Under Discussion
KIP-479: Add Materialized to Join	Under Discussion
KIP-480: Sticky Partitioner	Accepted
KIP-481: SerDe Improvements for Connect Decimal type in JSON	Under Discussion
KIP-482: Optional fields in the Kafka Protocol
463: Auto-configure non-default Serdes passed alongside the TopologyBuilder	Under discussion
KIP-466: Add support for List<T> serialization and deserialization	Voting in progress
KIP-468: Avoid decompression of record when validate record at server in the scene of inPlaceAssignment .	Under discussion
KIP-470: TopologyTestDriver test input and output usability improvements	Under discussion
KIP-473: Enable KafkaLog4JAppender to use SASL Authentication Callback Handlers	Under Discussion
KIP-477: Add PATCH method for connector config in Connect REST API	Under Discussion
KIP-478 - Strongly typed Processor API	Under Discussion
KIP-481: SerDe Improvements for Connect Decimal type in JSON	Under Discussion
KIP-486: Support custom way to load KeyStore and TrustStore	Under Discussion
KIP-487: Automatic Topic Creation on Producer	Under Discussion
KIP-489: Kafka Consumer Record Latency Metric	Under Discussion
KIP-490: New metric to count offsets expired without being consumed by a consumer group	Under discussion
KIP-491: Preferred Leader Deprioritized List (Temporary Blacklist)	Under discussion
KIP-494: Connect REST Endpoint to get Transformations (SMTs)
KIP-495: Dynamically Adjust Log Levels in Connect	Sent mail to dev discussion group.
KIP-498: Add client-side configuration for maximum response size to protect against OOM	Sent emails to Dev discussion group. Work tracked under KAFKA-4090.
KIP-499 - Unify connection name flag for command line tool	Under discussion
KIP-499: Create a controller RPC for changing configurations
KIP-500: Replace ZooKeeper with a Self-Managed Metadata Quorum
KIP-502: Connect SinkTask.put(...) to specify ArrayList<SinkRecord> in Signature
KIP-505: Add new public method to only update assignment metadata in consumer	Under discussion
KIP-506: Allow setting SCRAM password via Admin interface	Under discussion
KIP-507: Securing Internal Connect REST Endpoints	Under discussion
KIP-508: Make Suppression State Queriable	Under discussion
KIP-509: Rebalance and restart Producers	Under discussion
KIP-510: Metrics library upgrade	Under discussion
KIP-511: Collect and Expose Client's Name and Version in the Brokers
KIP-512: Adding headers to RecordMetaData	Sent mail to dev discussion group
KIP-513: Distinguish between Key and Value serdes in scala wrapper library for kafka streams
KIP-514:Add a bounded flush() API to Kafka Producer
KIP-515: Reorganize checkpoint system in log cleaner to per partition
KIP-516: Topic Identifiers & Topic Deletion State Improvements	Under discussion
KIP-517: Add consumer metric indicating time between poll calls	Under discussion
KIP-518: Allow listing consumer groups per state	Under discussion
KIP-519: Make SSL context/engine configuration extensible	Under discussion
KIP-521: Enable redirection of Connect's log4j messages to a file by default	Under discussion
KIP-522: Update BrokerApiVersionsCommand to use AdminClient	Draft
KIP-523: Add KStream#toTable to the Streams DSL	Under discussion
KIP-525 - Return topic metadata and configs in CreateTopics response
KIP-487: Automatic Topic Creation on Producer	Under Discussion
KIP-489: Kafka Consumer Record Latency Metric	Under Discussion
KIP-490: log when consumer groups lose a message because offset has been deleted	Under discussion
KIP-491: Preferred Leader Deprioritized List (Temporary Blacklist)	Under discussion

Dormant/inactive KIPs

...

KIP	Comment
KIP-6 - New reassignment partition logic for rebalancing	Needs more detail
KIP-10 - Running Producer, Consumers and Brokers on Mesos
KIP-14 - Tools standardization
KIP-17 - Add HighwaterMarkOffset to OffsetFetchResponse
KIP-23 - Add JSON/CSV output and looping options to ConsumerGroupCommand
KIP-27 - Conditional Publish
KIP-30 - Allow for brokers to have plug-able consensus and meta data storage sub systems
KIP-37 - Add Namespaces to Kafka
KIP-39: Pinning controller to broker
KIP-44 - Allow Kafka to have a customized security protocol
KIP-46 - Self Healing
KIP-47 - Add timestamp-based log deletion policy
KIP-49 - Fair Partition Assignment Strategy
KIP-53 - Add custom policies for reconnect attempts to NetworkdClient
KIP-59: Proposal for a kafka broker command
KIP-64 -Allow underlying distributed filesystem to take over replication depending on configuration
KIP-68 Add a consumed log retention before log retention
KIP-69 - Kafka Schema Registry	Draft
KIP-76 Enable getting password from executable rather than passing as plaintext in config files
KIP-87 - Add Compaction Tombstone Flag	Possibly displaced by KIP-82
KIP-95: Incremental Batch Processing for Kafka Streams
KIP-269: Substitution Within Configuration Values
KIP-349: Priorities for Source Topics	Functionality can be realized with existing API although at a lower level.
KIP-399: Extend ProductionExceptionHandler to cover serialization exceptions