Page History

...

To create your own KIP, click on

Create from template

templateName	54329345
templateId	54329345
title	KIP-NEXT: Insert Title Here
buttonLabel	Create KIP

. If you don't have permission, please send an email with your Wiki ID to dev@kafka.apache.org and request permission (http://kafka.apache.org/contact). Also add an entry to the table KIPs under discussion (for Streams API KIPs, please also add it to Kafka Streams sub page).

Table of Contents

476

Purpose

We want to make Kafka a core architectural component for users. We also support a large number of integrations with other tools, systems, and clients. Keeping this kind of usage health requires a high level of compatibility between releases — core architectural elements can't break compatibility or shift functionality from release to release. As a result each new major feature or public api has to be done in a way that we can stick with it going forward.

...

KIP round-up

Next KIP Number: 510530

Use this number as the identifier for your KIP and increment this value.

...

488: Clean up Sum,Count,Total Metrics480: Sticky Partitioner479 Materialized to Join465: Add Consolidated Connector Endpoint to Connect REST API3460: Admin Leader Election RPC455: Create an Administrative API for Replica Reassignment453: Add close() method to RocksDBConfigSetter3446: Add changelog topic configuration to KTable suppress429: Kafka Consumer Incremental Rebalance Protocol (WIP)427: Add AtMinIsr topic partition category (new metric & TopicCommand option)3417: Allow JmxTool to connect to a secured RMI port3415: Incremental Cooperative Rebalancing in Kafka Connect412 Extend Admin API to support dynamic application log levels4 (WIP)411 Make default Kafka Connect worker task client IDs distinct3386: Standardize on Min/Avg/Max metrics' default value2382: MirrorMaker 2.02.4.0 (WIP)376: Implement AutoClosable on appropriate classes that want to be used in a try-with-resource statement374: Add '--help' option to all available Kafka CLI commands2372: Naming Repartition Topics for Joins and Grouping1371: Add a configuration to build custom SSL principal name367 Introduce close(Duration) to Producer and AdminClient instead of close(long, TimeUnit)2366: Make FunctionConversions deprecated2.1353: Improve Kafka Streams Timestamp Synchronization1340: Allow kafka-reassign-partitions.sh and kafka-log-dirs.sh to take admin client property file1339: Create a new IncrementalAlterConfigs API30 -338 Support to exclude the internal topics in kafka-topics.sh command1322: Return new error code for DeleteTopics API when topic deletion disabled.321 Update TopologyDescription to better represent Source and Sink Nodes77308: Support dynamic update of max.connections.per.ip/max.connections.per.ip.overrides.0305: Add Connect primitive number converters0295 Add Streams Configuration Allowing for Optional Topology Optimization0279: Fix log divergence between leader and follower after fast leader fail over0277 - Fine Grained ACL for CreateTopics API0276 - Add StreamsConfig prefix for different consumers0274: Kafka Streams Skipped Records Metrics0272 API version tag to broker's RequestsPerSec metric268: Simplify Kafka Streams Rebalance Metadata Upgrade0267 Processor Unit Test Support to Kafka Streams Test Utils0265: Make Windowed Serde to public APIs261: Add Single Value Fetch in Window Stores251: Allow timestamp manipulation in Processor API249: Add Delegation Token Operations to KafkaAdminClient0245: Use Properties instead of StreamsConfig in KafkaStreams constructor243: Make ProducerConfig and ConsumerConfig constructors public1.1239 Add queryableStoreName() to GlobalKTable1.1237: More Controller Health Metrics231: Improve the Required ACL of ListGroups API1229 DeleteGroups API1.1227 - Introduce Incremental FetchRequests to Increase Partition Scalability1.1224: Add configuration parameter `retries` to Streams API1.1221: Enhance DSL with Connecting Topic Creation and Repartition Hint4WIP219 - Improve quota communication213 Support non-key joining in KTable4 (WIP)212: Enforce set of legal characters for connector names1.1204 : Adding records deletion operation to the new Admin Client API1183 - Change PreferredReplicaLeaderElectionCommand to use AdminClient2176: Remove deprecated new-consumer option for tools2.0174 - Deprecate and remove internal converter configs in WorkerConfig0163: Lower the Minimum Required ACL Permission of OffsetFetch157 - Add consumer config options to streams reset tool156 Add option "dry run" to Streams application reset tool0.11155 range scan for windowed state stores0.11.181145 - Expose Record Headers in Kafka Connect1.1133: Describe and Alter Configs Admin APIs0.11.130: Expose states of active tasks to KafkaStreams public API126 - Allow KafkaProducer to split and resend oversized batches.0.11.124 - Request rate quotas-123: Allow per stream/table timestamp extractor110 Codec for ZStandard Compression2.1104: Granular Sensors for Streams 0.10.286: Configurable SASL callback handlers0

	KIP (please keep this sorted by KIP number)	Release
1	KIP-	500: Replace ZooKeeper with a Self-Managed Metadata Quorum
2	KIP-511: Collect and Expose Client's Name and Version in the Brokers	2.4.0	2	KIP-484: Expose metrics for group and transaction metadata loading duration	2.4.0 (WIP)
3	KIP-	504 - Add new Java Authorizer Interface	2.4.0 (WIP)
4	KIP-	503: Add	metric for number of topics marked for deletion	2.4.0 (WIP)
5	KIP-476497: Add Java AdminClient Interfaceinter-broker API to alter ISR	2.4.0 (WIP)
6	KIP-467: Augment ProduceResponse error messaging for specific culprit records496: Administrative API to delete consumer offsets	2.4.0 (WIP)
7	KIP-	495: Dynamically Adjust Log Levels in Connect	2.	4.0 (WIP)
8	KIP-464: Defaults for AdminClient#createTopic488: Clean up Sum,Count,Total Metrics	2.4.0
9	KIP-462: Use local thread id for KStreams484: Expose metrics for group and transaction metadata loading duration	2.34.0 (WIP)
10	KIP-461: Improve Replica Fetcher behavior at handling partition failure482: The Kafka Protocol should Support Optional Tagged Fields	2.34.0 (WIP)
11	KIP-	481: SerDe Improvements for Connect Decimal type in JSON	2.4.0 (WIP)
12	KIP-458: Connector Client Config Override Policy480: Sticky Partitioner	2.34.0
13	KIP-	479: Add Materialized to Join	2.4.0(WIP)
14	KIP-454: Expansion of the ConnectClusterState interface476: Add Java AdminClient Interface	2.34.0
15	KIP-	475: New Metrics to Measure Number of Tasks on a Connector	2.	4.0 (WIP)
16	KIP-449: Add connector contexts to log messages in Connect workers 474: To deprecate WindowStore#put(key, value)	2.34.0 (WIP)
17	KIP-	471: Expose RocksDB Metrics in Kafka Streams	2.4.0 (WIP)
18	KIP-445: In-memory Session Store467: Augment ProduceResponse error messaging for specific culprit records	2.34.0 (WIP)
19	KIP-443: Return to default segment.ms and segment.index.bytes in Streams repartition topics465: Add Consolidated Connector Endpoint to Connect REST API	2.3.0
20	KIP-442: Return to default max poll interval in Streams464: Defaults for AdminClient#createTopic	2.34.0
21	KIP-436: Add a metric indicating start time462: Use local thread id for KStreams	2.3.0
22	KIP-430 - Return Authorized Operations in Describe Responses461: Improve Replica Fetcher behavior at handling partition failure	2.3.0
23	KIP-	460: Admin Leader Election RPC	2.4.0
24	KIP-428: Add in-memory window store458: Connector Client Config Override Policy	2.3.0
25	KIP-	455: Create an Administrative API for Replica Reassignment	2.	4.0 (WIP)
26	KIP-425: Add some Log4J Kafka Appender Properties for Producing to Secured Brokers454: Expansion of the ConnectClusterState interface	2.3.0
27	KIP-421: Support resolving externalized secrets in AbstractConfig 453: Add close() method to RocksDBConfigSetter	2.3.0
28	KIP-420449: Add Single Value Fetch in Session Storesconnector contexts to log messages in Connect workers	2.23.0
29	KIP-	446: Add changelog topic configuration to KTable suppress	2.	4.0 (WIP)
30	KIP-	445: In-memory Session Store	2.3.0
31	KIP- 414: Expose Embedded ClientIds in Kafka Streams 443: Return to default segment.ms and segment.index.bytes in Streams repartition topics	2.23.0
32	KIP-	442:	Return to default max poll interval in Streams	2.	3.0
33	KIP-	440:	Extend Connect Converter to support headers	2.	4.0 (WIP)
34	KIP-402: Improve fairness in SocketServer processors436: Add a metric indicating start time	2.2.0 (partially implemented) / 2.3.0
35	KIP-396434: Add Commit/List Offsets Operations to AdminClientReplica Fetcher and Log Cleaner Count Metrics	2.4.0 (WIP)
36	KIP-394: Require member.id for initial join group request430 - Return Authorized Operations in Describe Responses	2.23.0
37	KIP-393: Time windowed serde to properly deserialize changelog input topic429: Kafka Consumer Incremental Rebalance Protocol	2.24.0 (WIP)
38	KIP-	428: Add in-memory window store	2.	3.0
39	KIP-	427: Add AtMinIsr topic partition category (new metric & TopicCommand option)	2.3.0
40	KIP-380: Detect outdated control requests and bounced brokers using broker generation425: Add some Log4J Kafka Appender Properties for Producing to Secured Brokers	2.23.0
41	KIP-377: TopicCommand to use AdminClient421: Support resolving externalized secrets in AbstractConfig	2.23.0
42	KIP-	420: Add Single Value Fetch in Session Stores	2.2.0
43	KIP-	417: Allow JmxTool to connect to a secured RMI port	2.	3.0
44	KIP-	415: Incremental Cooperative Rebalancing in Kafka Connect	2.	3.0
45	KIP-	414: Expose Embedded ClientIds in Kafka Streams	2.2.0
46	KIP 368: Allow SASL Connections to Periodically Re-Authenticate-412: Extend Admin API to support dynamic application log levels	2.24.0 (WIP)
47	KIP-	411: Make default Kafka Connect worker task client IDs distinct	2.	3.0
48	KIP-	402: Improve fairness in SocketServer processors	2.2.0 (partially implemented) / 2.3	.0
49	KIP-365: Materialized, Serialized, Joined, Consumed and Produced with implicit Serde401: TransformerSupplier/ProcessorSupplier StateStore connecting	2.14.0 (WIP)
50	KIPKIP-361396: Add Consumer Configuration to Disable Auto Topic CreationCommit/List Offsets Operations to AdminClient	2.34.0 (WIP)
51	KIP-359: Verify leader epoch in produce requests394: Require member.id for initial join group request	2.42.0 (WIP)
52	KIP-358: Migrate Streams API to Duration instead of long ms times393: Time windowed serde to properly deserialize changelog input topic	2.12.0
53	KIP-357: Add support to list ACLs per principal389: Introduce a configurable consumer group size limit	2.12.0
54	KIP-356: Add withCachingDisabled() to StoreBuilder386: Standardize on Min/Avg/Max metrics' default value	2.12.0
55	KIP-354: Add a Maximum Log Compaction Lag382: MirrorMaker 2.0	2.34.0
56	KIP-	379: Multiple Consumer Group Management	2.	4.0 (WIP)
57	KIP-351: Add --under-min-isr option to describe topics command380: Detect outdated control requests and bounced brokers using broker generation	2.32.0
58	KIP-346: Improve LogCleaner behavior on error377: TopicCommand to use AdminClient	2.12.0
59	KIP-345: Introduce static membership protocol to reduce consumer rebalances376: Implement AutoClosable on appropriate classes that want to be used in a try-with-resource statement	2.2.2.4.0 (WIP), partially available in 2.3.0
60	KIP-342 Add support for custom SASL extensions in OAuthBearer authentication374: Add '--help' option to all available Kafka CLI commands	2.12.0
61	KIP-341: Update Sticky Assignor's User Data Protocol372: Naming Repartition Topics for Joins and Grouping	2.31.0
62	KIP-	371: Add a configuration to build custom SSL principal name	2.	2.0
63	KIP-	369: Alternative Partitioner to Support "Always Round-Robin" Selection	2.	4.	0
64	KIP	368: Allow SASL Connections to Periodically Re-Authenticate	2.	2.0
65	KIP-336: Consolidate ExtendedSerializer/Serializer and ExtendedDeserializer/Deserializer367 Introduce close(Duration) to Producer and AdminClient instead of close(long, TimeUnit)	2.22.1.0
66	KIP-332: Update AclCommand to use AdminClient API366: Make FunctionConversions deprecated	2.1.0
67	KIP-331 Add default implementation to close() and configure() for Serializer, Deserializer and 365: Materialized, Serialized, Joined, Consumed and Produced with implicit Serde	2.31.0
68	KIPK IP-330361: Add retentionPeriod in SessionBytesStoreSupplierConsumer Configuration to Disable Auto Topic Creation	2.13.0
69	KIP-328: Ability to suppress updates for KTables360: Improve handling of unknown producer	2.14.0 (partially implemented) / 2.3.0 (WIP)
70	KIP-324: Add method to get metrics() in AdminClient359: Verify leader epoch in produce requests	2.14.0 (WIP)
71	KIP-	358: Migrate Streams API to Duration instead of long ms times	2.1.0
72	KIP-	357:	Add support to list ACLs per principal	2.1.0
73	KIP-320: Allow fetchers to detect and handle log truncation356: Add withCachingDisabled() to StoreBuilder	2.1.0 (partially implemented) / 2.2
74	KIP-354: Add a Maximum Log Compaction Lag	2.3.0
7475	KIP-319: Replace segments with segmentInterval in WindowBytesStoreSupplier353: Improve Kafka Streams Timestamp Synchronization	2.1.0
7576	KIP-313: Add KStream.flatTransform and KStream.flatTransformValues 352: Distinguish URPs caused by reassignment	2.24.0 (partially implementedWIP) / 2.3.0
7677	KIP-312 Add Overloaded StreamsBuilder Build Method to Accept java.util.Properties351: Add --under-min-isr option to describe topics command	2.13.0
78	KIP-	346: Improve LogCleaner behavior on error	2.1
7879	KIP-307: Allow to define custom processor names with KStreams DSL345: Introduce static membership protocol to reduce consumer rebalances	2.34.0 (partial)	79	KIP-306: Configuration for Delaying Response to Failed Authentication	2.1WIP), partially available in 2.3.0
80	KIP-	342 Add support for custom SASL extensions in OAuthBearer authentication	2.	1.0
81	KIP-303: Add Dynamic Routing in Streams Sink341: Update Sticky Assignor's User Data Protocol	2.03.0
82	KIP-302 - Enable Kafka clients to use all DNS resolved IP addresses-340: Allow kafka-reassign-partitions.sh and kafka-log-dirs.sh to take admin client property file	2.1.0
83	KIP-300: Add Windowed KTable API in StreamsBuilder339: Create a new IncrementalAlterConfigs API	2.43.00
84	KIP-298: Error Handling in Connect338 Support to exclude the internal topics in kafka-topics.sh command	2.01.0
85	KIP-297: Externalizing Secrets for Connect Configurations336: Consolidate ExtendedSerializer/Serializer and ExtendedDeserializer/Deserializer	2.01.0
86	KIP-	332: Update AclCommand to use AdminClient API	2.	1.0
87	KIP-294 - Enable TLS hostname verification by default331 Add default implementation to close() and configure() for Serializer, Deserializer and Serde	2.03.0
88	KIP-292330: Add transformValues() method to KTableretentionPeriod in SessionBytesStoreSupplier	2.01.0
89	KIP-290: Support for Prefixed ACLs328: Ability to suppress updates for KTables	2.1.0 (partially implemented) / 2.3.0 (WIP)
90	KIP-289: Improve the default group id behavior in KafkaConsumer324: Add method to get metrics() in AdminClient	2.21.0
91	KIP-285: Connect Rest Extension Plugin322: Return new error code for DeleteTopics API when topic deletion disabled.	2.01.0
92	KIP-284: Set default retention ms for Streams repartition topics to Long.MAX_VALUE321: Update TopologyDescription to better represent Source and Sink Nodes	2.01.0
93	KIP-283: Efficient Memory Usage for Down-Conversion320: Allow fetchers to detect and handle log truncation	2.1.0 (partially implemented) / 2.22.0.0
94	KIP-282: Add the listener name to the authentication context319: Replace segments with segmentInterval in WindowBytesStoreSupplier	2.01.0
95	KIP-281: ConsumerPerformance: Increase Polling Loop Timeout and Make It Reachable by the End User313: Add KStream.flatTransform and KStream.flatTransformValues	2.2.0 (partially implemented) / 2.3 2.0 .0
96	KIP-	312 Add Overloaded StreamsBuilder Build Method to Accept java.util.Properties	2.	1.0
97	KIP-278 - Add version option to Kafka's commands309: Add toUpperCase support to sasl.kerberos.principal.to.local rule	2.04.0
98	KIP-	308: Support dynamic update of max.connections.per.ip/max.connections.per.ip.overrides	2.	1.0
99	KIP-	307: Allow to define custom processor names with KStreams DSL	2.	3.0 (partial)
100	KIP-	306: Configuration for Delaying Response to Failed Authentication	2.	1.0
101	KIP-	305: Add	Connect primitive number converters	2.0.0
102	KIP-270 - A Scala Wrapper Library for Kafka Streams303: Add Dynamic Routing in Streams Sink	2.0.0
103	KIP-302 -	Enable Kafka clients to use all DNS resolved IP addresses	2.	1.0
104	KIP-	300: Add	Windowed KTable API in StreamsBuilder	2.	4.0
105	KIP-266: Fix consumer indefinite blocking behavior298: Error Handling in Connect	2.0.0
106	KIP-	297: Externalizing Secrets for Connect Configurations	2.0.0
107	KIP-	295 Add Streams Configuration Allowing for Optional Topology Optimization	2.0.0
108	KIP-258: Allow to Store Record Timestamps in RocksDB-294 - Enable TLS hostname verification by default	2.30.0 (partially implemented)
109	KIP- 257 - Configurable Quota Management 291: Separating controller connections and requests from the data plane	Accepted2.0.0
110	KIP-255: OAuth Authentication via SASL/OAUTHBEARER292: Add transformValues() method to KTable	2.0.0
111	KIP-	290: Support for Prefixed ACLs	2.0.0
112	KIP-	289: Improve the default group id behavior in KafkaConsumer	2.	2.0
113	KIP-247: Add public test utils for Kafka Streams285: Connect Rest Extension Plugin	2.01.1.0
114	KIP-	284: Set default retention ms for Streams repartition topics to Long.MAX_VALUE	2.0.0
115	KIP-244: Add Record Header support to Kafka Streams Processor API283: Efficient Memory Usage for Down-Conversion	2.0.0
116	KIP-	282: Add the listener name to the authentication context	2.0	.0
117	KIP-	281: ConsumerPerformance: Increase Polling Loop Timeout and Make It Reachable by the End User	2.0	.0
118	KIP-238: Expose Kafka cluster ID in Connect REST API279: Fix log divergence between leader and follower after fast leader fail over	2.01.1.0
119	KIP-	278 - Add version option to Kafka's commands	2.0.0
120	KIP-235: Add DNS alias support for secured connection277 - Fine Grained ACL for CreateTopics API	2.10.0
121	KIP-233: Simplify StreamsBuilder#addGlobalStore276 - Add StreamsConfig prefix for different consumers	2.01.1.0
122	KIP-	274: Kafka Streams Skipped Records Metrics	2.	0.0
123	KIP-	272:	Add API version tag to broker's RequestsPerSec metric	2.0.0
124	KIP-	270 - A Scala Wrapper Library for Kafka Streams	2.0	.0
125	KIP-226 - Dynamic Broker Configuration268: Simplify Kafka Streams Rebalance Metadata Upgrade	2.01.1.0
126	KIP-225 - Use tags for consumer “records.lag” metrics267: Add Processor Unit Test Support to Kafka Streams Test Utils	2.01.1.0
127	KIP-	266: Fix consumer indefinite blocking behavior	2.0	.0
128	KIP-223 - Add per-topic min lead and per-partition lead metrics to KafkaConsumer265: Make Windowed Serde to public APIs	2.0.0
129	KIP-222 - Add Consumer Group operations to Admin API261: Add Single Value Fetch in Window Stores	2.0.0
130	KIP-	258: Allow to Store Record Timestamps in RocksDB	2.	3.0 (	partially implemented)
131	KIP-220: Add AdminClient into Kafka Streams' ClientSupplier-257 - Configurable Quota Management	2.01.1.0
132	KIP-	255: OAuth Authentication via SASL/OAUTHBEARER	2.0.0
133	KIP-218: Make KafkaFuture.Function java 8 lambda compatible251: Allow timestamp manipulation in Processor API	2.01.1.0
134	KIP-215249: Add topic regex support for Connect sinksDelegation Token Operations to KafkaAdminClient	2.01.1.0
135	KIP-214: Add zookeeper.max.in.flight.requests config to the broker247: Add public test utils for Kafka Streams	1.1.0
136	KIP-	245: Use Properties instead of StreamsConfig in KafkaStreams constructor	2.	0.0
137	KIP-	244: Add Record Header support to Kafka Streams Processor API	2.0	.0
138	KIP-211: Revise Expiration Semantics of Consumer Group Offsets243: Make ProducerConfig and ConsumerConfig constructors public	12.1.0
139	KIP-210 - Provide for custom error handling when Kafka Streams fails to produce239 Add queryableStoreName() to GlobalKTable	1.1.0
140	KIP-208: Add SSL support to Kafka 238: Expose Kafka cluster ID in Connect REST interfaceAPI	1.1.0
141	KIP-207: Offsets returned by ListOffsetsResponse should be monotonically increasing even during a partition leader change237: More Controller Health Metrics	2.20.0
142	KIP-206235: Add DNS alias support for UUID serialization and deserializationsecured connection	2.1.0
143	KIP-205: Add all() and range() API to ReadOnlyWindowStore233: Simplify StreamsBuilder#addGlobalStore	1.1.0
144	KIP-	231: Improve the Required ACL of ListGroups API	2	.1.0
145	KIP-203: Add toLowerCase support to sasl.kerberos.principal.to.local rule 229: DeleteGroups API	1.1.0
146	KIP-202: Move merge() from StreamsBuilder to KStream-227 - Introduce Incremental FetchRequests to Increase Partition Scalability	1.01.0
147	KIP-198: Remove ZK dependency from Streams Reset Tool226 - Dynamic Broker Configuration	1.01.0
148	KIP-197 Connect REST API should include the connector type when describing a connector-225 - Use tags for consumer “records.lag” metrics	1.01.0
149	KIP-196224: Add metrics to Kafka Connect frameworkconfiguration parameter `retries` to Streams API	1.01.0
150	KIP-195: AdminClient.createPartitions-223 - Add per-topic min lead and per-partition lead metrics to KafkaConsumer	21.0.0
151	KIP-192 : Provide cleaner semantics when idempotence is enabled-222 - Add Consumer Group operations to Admin API	21.0.0
152	KIP-191: KafkaConsumer.subscribe() overload that takes just Pattern221: Enhance DSL with Connecting Topic Creation and Repartition Hint	2.4.0 (WIP)1.0.0
153	KIP-190: Handle client-ids consistently between clients and brokers220: Add AdminClient into Kafka Streams' ClientSupplier	1.01.0
154	KIP-189: Improve principal builder interface and add support for SASL219 - Improve quota communication	21.0.0
155	KIP-188 - Add new metrics to support health checks218: Make KafkaFuture.Function java 8 lambda compatible	1.01.0
156	KIP-187 - Add cumulative count metric for all Kafka rate metrics215: Add topic regex support for Connect sinks	1.01.0
157	KIP-186: Increase offsets retention default to 7 days214: Add zookeeper.max.in.flight.requests config to the broker	1.12.0.0
158	KIP-	213 Support non-key joining in KTable	2.	4.0 (WIP)
159	KIP-182: Reduce Streams DSL overloads and allow easier use of custom storage engines212: Enforce set of legal characters for connector names	1.01.0
160	KIP-180: Add a broker metric specifying the number of consumer group rebalances in progress211: Revise Expiration Semantics of Consumer Group Offsets	21.1.0
161	KIP-177: Consumer perf tool should count rebalance time210 - Provide for custom error handling when Kafka Streams fails to produce	1.01.0
162	KIP-	208: Add SSL support to Kafka Connect REST interface	1.1	.0
163	KIP-175: Additional '--describe' views for ConsumerGroupCommand207: Offsets returned by ListOffsetsResponse should be monotonically increasing even during a partition leader change	2.21.1.0
164	KIP-	206: Add support for UUID serialization and deserialization	2.	1.0
165	KIP-173205: Add prefix to StreamsConfig to enable setting default internal topic configsall() and range() API to ReadOnlyWindowStore	1.01.0
166	KIP-171 - Extend Consumer Group Reset Offset for Stream Application204 : Adding records deletion operation to the new Admin Client API	1.1.0
167	KIP-168: Add GlobalTopicCount and GlobalPartitionCount metric per cluster203: Add toLowerCase support to sasl.kerberos.principal.to.local rule	1.01.0
168	KIP-167: Add interface for the state store restoration process202: Move merge() from StreamsBuilder to KStream	1.0.0
169	KIP-164 - Add UnderMinIsrPartitionCount and per-partition UnderMinIsr metrics198: Remove ZK dependency from Streams Reset Tool	1.0.0
170	KIP-	197 Connect REST API should include the connector type when describing a connector	1.0.0
171	KIP-162: Enable topic deletion by default196: Add metrics to Kafka Connect framework	1.0.0
172	KIP-161: streams deserialization exception handlers195: AdminClient.createPartitions	1.0.0
173	KIP-192 : Provide cleaner semantics when idempotence is enabled	1.0.0
174	KIP-191: KafkaConsumer.subscribe() overload that takes just Pattern160: Augment KStream.print(), KStream.writeAsText() to allow users pass in extra parameters in the printed string	1.0.0
174175	KIP-	190: Handle client-ids consistently between clients and brokers	1.0.0
175176	KIP-	189: Improve principal builder interface and add support for SASL	1	.0.0
176177	KIP-	188 - Add	new metrics to support health checks	1.	0.0
177178	KIP-154 Add Kafka Connect configuration properties for creating internal topics187 - Add cumulative count metric for all Kafka rate metrics	10.11.0.0
178179	KIP-153: Include only client traffic in BytesOutPerSec metric186: Increase offsets retention default to 7 days	2.0.11.0.0
179180	KIP-152 - Improve diagnostics for SASL authentication failures183 - Change PreferredReplicaLeaderElectionCommand to use AdminClient	2.21.0.0
180181	KIP-151 Expose Connector type in REST API182: Reduce Streams DSL overloads and allow easier use of custom storage engines	10.11.0.0		KIP-150 - Kafka-Streams Cogroup	2.4.0 (WIP)
182	KIP-149: Enabling key access in ValueTransformer, ValueMapper, and ValueJoiner180: Add a broker metric specifying the number of consumer group rebalances in progress	1.1.0 (partially implemented)(WIP for 2.4.0)
183	KIP-146 - Classloading Isolation in Connect177: Consumer perf tool should count rebalance time	10.11.0.0
184	KIP-	176: Remove deprecated new-consumer option for tools	2.0	.0
185	KIP-144: Exponential backoff for broker reconnect attempts175: Additional '--describe' views for ConsumerGroupCommand	1.10.11.0.0
186	KIP-143: Controller Health Metrics-174 - Deprecate and remove internal converter configs in WorkerConfig	20.11.0.0
187	KIP-140: Add administrative RPCs for adding, deleting, and listing ACLs173: Add prefix to StreamsConfig to enable setting default internal topic configs	10.11.0.0
188	KIP-138: Change punctuate semantics-171 - Extend Consumer Group Reset Offset for Stream Application	1.01.0
189	KIP-137: Enhance TopicCommand --describe to show topics marked for deletion168: Add GlobalTopicCount and GlobalPartitionCount metric per cluster	10.11.0.0
190	KIP-136167: Add Listener name to SelectorMetrics tagsinterface for the state store restoration process	1.0.00.11.0.0
191	KIP -134: Delay initial consumer group rebalance -164 - Add UnderMinIsrPartitionCount and per-partition UnderMinIsr metrics	10.11.0.0
192	KIP-	163: Lower the Minimum Required ACL Permission of OffsetFetch	1.	0.0
193	KIP-	162: Enable topic deletion by default	1.0.0
194	KIP-129: Streams Exactly-Once Semantics161: streams deserialization exception handlers	10.11.0.0
195	KIP-128: Add ByteArrayConverter for Kafka Connect160: Augment KStream.print(), KStream.writeAsText() to allow users pass in extra parameters in the printed string	10.11.0.0
196	KIP-	157 - Add consumer config options to streams reset tool	1.	0.0
197	KIP-	156 Add option "dry run" to Streams application reset tool	0.11.0.0
198	KIP	-155 - Add range scan for windowed state stores	0.11.0.0
199	KIP-122: Add Reset Consumer Group Offsets tooling154 Add Kafka Connect configuration properties for creating internal topics	0.11.0.0
200	KIP-121: Add KStream peek method153: Include only client traffic in BytesOutPerSec metric	0.11.0.0
201	KIP-120: Cleanup Kafka Streams builder API-152 - Improve diagnostics for SASL authentication failures	1.0.0
202	KIP-119: Drop Support for Scala 2.10 in Kafka 0.11151 Expose Connector type in REST API	0.11.0.0
203	KIP-118: Drop Support for Java 7-150 - Kafka-Streams Cogroup	2.0.04.0 (WIP)
204	KIP-117: Add a public AdminClient API for Kafka admin operations149: Enabling key access in ValueTransformer, ValueMapper, and ValueJoiner	1.1.0 (partially implemented) (WIP for 2.4.0)0.11.0.0
205	KIP-115: Enforce offsets.topic.replication.factor upon __consumer_offsets auto topic creation-146 - Classloading Isolation in Connect	0.11.0.0
206	KIP-114: KTable state stores and improved semantics-145 - Expose Record Headers in Kafka Connect	1.1.00.11.0.0
207	KIP-113: Support replicas movement between log directories144: Exponential backoff for broker reconnect attempts	0.11.01.1.0
208	KIP-112: Handle disk failure for JBOD143: Controller Health Metrics	0.111.0.0
209	KIP-	140: Add	administrative RPCs for adding, deleting, and listing ACLs	0.11.0.0
210	KIP-109: Old Consumer Deprecation138: Change punctuate semantics	1.0.11.0.0
211	KIP-108: Create Topic Policy137: Enhance TopicCommand --describe to show topics marked for deletion	0.1011.20.0
212	KIP-107136: Add deleteRecordsBefore() API in AdminClientListener name to SelectorMetrics tags	0.11.0.0
213	KIP-106 - Change Default unclean.leader.election.enabled from True to False134: Delay initial consumer group rebalance	0.11.0.0
214	KIP-105: Addition of Record Level for Sensors133: Describe and Alter Configs Admin APIs	0.1011.20.0
215	KIP-	130: Expose states of active tasks to KafkaStreams public API	1.0	.0
216	KIP-103: Separation of Internal and External traffic129: Streams Exactly-Once Semantics	0.1011.20.0
217	KIP-102 - Add close with timeout for consumers128: Add ByteArrayConverter for Kafka Connect	0.1011.20.0
218	KIP-101 - Alter Replication Protocol to use Leader Epoch rather than High Watermark for Truncation126 - Allow KafkaProducer to split and resend oversized batches.	0.11.0.0
219	KIP-100 - Relax Type constraints in Kafka Streams API124 - Request rate quotas	0.1011.20.0
220	KIP-99: Add Global Tables to Kafka Streams123: Allow per stream/table timestamp extractor	0.1011.20.0
221	KIP-98 - Exactly Once Delivery and Transactional Messaging122: Add Reset Consumer Group Offsets tooling	0.11.0.0
222	KIP-97: Improved Kafka Client RPC Compatibility Policy121: Add KStream peek method	0. 10 11. 2 0.0
223	KIP-96 - Add per partition metrics for in-sync and assigned replica count120: Cleanup Kafka Streams builder API	1.00.10.2.0
224	KIP-94 Session Windows119: Drop Support for Scala 2.10 in Kafka 0.11	0.1011.20.0
225	KIP-93: Improve invalid timestamp handling in Kafka Streams118: Drop Support for Java 7	2.00.10.2.0
226	KIP-92 - Add per partition lag metrics to KafkaConsumer117: Add a public AdminClient API for Kafka admin operations	0.1011.20.0
227	KIP-91 Provide Intuitive User Timeouts in The Producer115: Enforce offsets.topic.replication.factor upon __consumer_offsets auto topic creation	0.11.02.1.0
228	KIP-90 - Remove zkClient dependency from Streams114: KTable state stores and improved semantics	0.1011.20.0
229	KIP-89: Allow sink connectors to decouple flush and offset commit113: Support replicas movement between log directories	1.1.0.10.2.0
230	KIP-88: OffsetFetch Protocol Update112: Handle disk failure for JBOD	1.0.0.10.2.0
231	KIP-	110: Add Codec for ZStandard Compression	2.	1.0
232	KIP-85: Dynamic JAAS configuration for Kafka clients109: Old Consumer Deprecation	0.1011.20.0
233	KIP-84: Support SASL SCRAM mechanisms108: Create Topic Policy	0.10.2.0
234	KIP-82 - Add Record Headers107: Add deleteRecordsBefore() API in AdminClient	0.11.0.0
235	KIP -81: Bound Fetch memory usage in the consumer	2.4.0 (WIP)	-106 - Change Default unclean.leader.election.enabled from True to False	0.11.0.0
236	KIP-105: Addition of Record Level for Sensors	236	KIP-79 - ListOffsetRequest/ListOffsetResponse v1 and add timestamp search methods to the new consumer	0.10.12.0
237	KIP-78: Cluster Id104: Granular Sensors for Streams	0.10.12.0
238	KIP-77: Improve Kafka Streams Join Semantics103: Separation of Internal and External traffic	0.10.2.0
239	KIP-75 102 - Add per-connector Convertersclose with timeout for consumers	0.10.12.0
240	KIP-74: Add Fetch Response Size Limit in Bytes101 - Alter Replication Protocol to use Leader Epoch rather than High Watermark for Truncation	0.1011.10.0
241	KIP-73: Replication Quotas-100 - Relax Type constraints in Kafka Streams API	0.10.12.0
242	KIP-72: Allow putting a bound on memory consumed by Incoming request 99: Add Global Tables to Kafka Streams	0.10.21.0.0
243	KIP-71: Enable log compaction and deletion to co-exist-98 - Exactly Once Delivery and Transactional Messaging	0.1011.10.0
244	KIP-70: Revise Partition Assignment Semantics on New Consumer's Subscription Change97: Improved Kafka Client RPC Compatibility Policy	0.10.12.0
245	KIP-67: Queryable state for Kafka Streams96 - Add per partition metrics for in-sync and assigned replica count	0.10.12.0
246	KIP-66: Single Message Transforms for Kafka Connect94 Session Windows	0.10.2.0 / 0.11.0.0
247	KIP-65: Expose timestamps to Connect93: Improve invalid timestamp handling in Kafka Streams	0.10.12.0
248	KIP-63: Unify store and downstream caching in streams92 - Add per partition lag metrics to KafkaConsumer	0.10.12.0
249	KIP-62: Allow consumer to send heartbeats from a background thread91 Provide Intuitive User Timeouts in The Producer	2.0.10.1.0
250	KIP-60 - Make Java client classloading more flexible90 - Remove zkClient dependency from Streams	0.10.12.0
251	KIP-58 - Make Log Compaction Point Configurable89: Allow sink connectors to decouple flush and offset commit	0.10.12.0
252	KIP-57 - Interoperable LZ4 Framing88: OffsetFetch Protocol Update	0.10.02.0
253	KIP-56: Allow cross origin HTTP requests on all HTTP methods86: Configurable SASL callback handlers	20.10.0.0
254	KIP-55: Secure Quotas for Authenticated Users85: Dynamic JAAS configuration for Kafka clients	0.10.12.0
255	KIP-54: Sticky Partition Assignment Strategy84: Support SASL SCRAM mechanisms	0.1110.02.0
256	KIP-52: Connector Control APIs-82 - Add Record Headers	0.1011.0.0
257	KIP-51 - List Connectors REST API81: Bound Fetch memory usage in the consumer	2.4.0 (WIP)0.10.0.0
258	KIP-48 Delegation token support for Kafka	1.1.0	79 - ListOffsetRequest/ListOffsetResponse v1 and add timestamp search methods to the new consumer	0.10.1.0
259	KIP-78: Cluster Id	259	KIP-45 - Standardize all client sequence interaction on j.u.Collection.	0.10.01.0
260	KIP-4377: Improve Kafka SASL enhancementsStreams Join Semantics	0.10.02.0
261	KIP-42: Add Producer and Consumer Interceptors75 - Add per-connector Converters	0.10.01.0
262	KIP-41: Consumer Max Records74: Add Fetch Response Size Limit in Bytes	0.10.01.0
263	KIP-40: ListGroups and DescribeGroup73: Replication Quotas	0.910.01.0
264	KIP-38: ZooKeeper Authentication72: Allow putting a bound on memory consumed by Incoming request	10.9.0.0
265	KIP-36 - Rack aware replica assignment71: Enable log compaction and deletion to co-exist	0.10.01.0
266	KIP-35 - Retrieving protocol version70: Revise Partition Assignment Semantics on New Consumer's Subscription Change	0.10.01.0
267	KIP-33 - Add a time based log index67: Queryable state for Kafka Streams	0.10.1.0
268	KIP-32 - Add timestamps to Kafka message66: Single Message Transforms for Kafka Connect	0.10.2.0 / 0.11.0.0
269	KIP-31 - Move to relative offsets in compressed message sets65: Expose timestamps to Connect	0.10.01.0
270	KIP-28 - Add a processor client63: Unify store and downstream caching in streams	0.10.01.0
271	KIP-26 - Add Kafka Connect framework for data import/export62: Allow consumer to send heartbeats from a background thread	0.910.01.0
272	KIP-25 - System test improvements60 - Make Java client classloading more flexible	0.910.01.0
273	KIP-22 - Expose a Partitioner interface in the new producer58 - Make Log Compaction Point Configurable	0.910.01.0
274	KIP-21 - Dynamic Configuration57 - Interoperable LZ4 Framing	0.910.0.0 (WIP)
275	KIP-20 Enable log preallocate to improve consume performance under windows and some old Linux file system56: Allow cross origin HTTP requests on all HTTP methods	0.910.0.0
276	KIP-19 - Add a request timeout to NetworkClient55: Secure Quotas for Authenticated Users	0.910.01.0
277	KIP-16 - Automated Replica Lag Tuning54: Sticky Partition Assignment Strategy	0.911.0.0
278	KIP-15 - Add a close method with a timeout in the producer52: Connector Control APIs	0.910.0.0
279	KIP-13 - Quota Design51 - List Connectors REST API	0.910.0.0
280	KIP-12 - Kafka Sasl/Kerberos and SSL implementation48 Delegation token support for Kafka	1.10.9.0.0
281	KIP-11 - Kafka Authorizer design45 - Standardize all client sequence interaction on j.u.Collection.	0.910.0.0
282	KIP-8 - Add a flush method to the producer API43: Kafka SASL enhancements	0.910.0.0
283	KIP-4 - Metadata Protocol Changes42: Add Producer and Consumer Interceptors	0.10.0.0
284	KIP-4 - Command line and centralized administrative operations41: Consumer Max Records	0.910.0.0,
285	KIP-40: ListGroups and DescribeGroup	0.109.0.0
286	KIP-38: ZooKeeper Authentication	, 0.109.10.0
285287	KIP-3 - Mirror Maker Enhancement36 - Rack aware replica assignment	0.910.0.0
286288	KIP-2 - Refactor brokers to allow listening on multiple ports and IPs35 - Retrieving protocol version	0.910.0.0
287289	KIP-1 - Remove support of request.required.acks33 - Add a time based log index	0.910.01.0

...

290	KIP-32 - Add timestamps to Kafka message	0.10.0.0
291	KIP-31 - Move to relative offsets in compressed message sets	0.10.0.0
292	KIP-28 - Add a processor client	0.10.0.0
293	KIP-26 - Add Kafka Connect framework for data import/export	0.9.0.0
294	KIP-25 - System test improvements	0.9.0.0
295	KIP-22 - Expose a Partitioner interface in the new producer	0.9.0.0
296	KIP-21 - Dynamic Configuration	0.9.0.0 (WIP)
297	KIP-20 Enable log preallocate to improve consume performance under windows and some old Linux file system	0.9.0.0
298	KIP-19 - Add a request timeout to NetworkClient	0.9.0.0
299	KIP-16 - Automated Replica Lag Tuning	0.9.0.0
300	KIP-15 - Add a close method with a timeout in the producer	0.9.0.0
301	KIP-13 - Quota Design	0.9.0.0
302	KIP-12 - Kafka Sasl/Kerberos and SSL implementation	0.9.0.0
303	KIP-11 - Kafka Authorizer design	0.9.0.0
304	KIP-8 - Add a flush method to the producer API	0.9.0.0
305	KIP-4 - Metadata Protocol Changes	0.10.0.0
306	KIP-4 - Command line and centralized administrative operations	0.9.0.0, 0.10.0.0, 0.10.1.0
307	KIP-3 - Mirror Maker Enhancement	0.9.0.0
308	KIP-2 - Refactor brokers to allow listening on multiple ports and IPs	0.9.0.0
309	KIP-1 - Remove support of request.required.acks	0.9.0.0

KIPs under discussion

Please insert new rows in sorted order (ascending by KIP number). Please move the adopted/accepted KIPs to the "Adopted KIPs" table above.

KIP	Comment

Please insert new rows in sorted order (ascending by KIP number). Please move the adopted/accepted KIPs to the "Adopted KIPs" table above.

KIP-499: Create a controller RPC for changing configurations416 Notify SourceTask of ACK'd offsets, metadata440: Extend Connect Converter to support headers444: Augment metrics for Kafka Streams470: TopologyTestDriver test input and output usability improvements

KIP	Comment

KIP-59: Proposal for a kafka broker command	Sent emails to Dev discussion group. Work tracked under KAFKA-3663.
KIP-125: ZookeeperConsumerConnector to KafkaConsumer Migration and Rollback
KIP-131 - Add access to OffsetStorageReader from SourceConnector
KIP-135 : Send of null key to a compacted topic should throw non-retriable error back to user
KIP 141 - ProducerRecord & SourceRecord: Add timestamp constructors
KIP-142: Add ListTopicsRequest to efficiently list all the topics in a cluster
KIP-148: Add a connect timeout for client
KIP-158: Kafka Connect should allow source connectors to set topic-specific settings for new topics
KIP-159: Introducing Rich functions to Streams
KIP-166 - Add a tool to make amounts of replicas and leaders on brokers balanced
KIP-169 - Lag-Aware Partition Assignment Strategy
KIP-178: Size-based log directory selection strategy
KIP-185: Make exactly once in order delivery the default producer setting
KIP-193: Add SchemaBuilder.from(Schema)
KIP-199: Add Kafka Connect offset tool
KIP-201: Rationalising Policy interfaces
KIP-209: C onnection String Support
KIP-216: IQ should throw different exceptions for different errors
KIP-217: Expose a timeout to allow an expired ZK session to be re-created
KIP-228 Negative record timestamp support	Voting in progress
KIP-234: add support for getting topic defaults from AdminClient
KIP-236: Interruptible Partition Reassignment	Discussion
KIP-240: AdminClient.listReassignments() AdminClient.describeReassignments()
KIP-242: Mask password in Kafka Connect Rest API response
KIP-250 Add Support for Quorum-based Producer Acknowledgment
KIP-252 - Extend ACLs to allow filtering based on ip ranges and subnets
KIP-253: Support in-order message delivery with partition expansion	Discussion
KIP-254: JsonConverter Exception Handeling
KIP-259: Improve Streams DSL Timestamp Propagation Semantics
KIP-260: add primary join operation for Stream-Stream join (WIP)	Draft
KIP-264: Add a consumer metric to record raw fetch size	Voting in progress
KIP-271: Add NetworkClient redirector	Discussion
KIP-273: Kafka to support using ETCD beside Zookeeper	Discussion
KIP-275 - Indicate "isClosing" in the SinkTaskContext	Voting in progress
KIP-280: Enhanced log compaction	Discussion	KIP-291: Separating controller connections and requests from the data plane	Accepted
KIP-293 Add new metrics for consumer/replication fetch requests	Voting in progress
KIP-296: Add connector level configurability for producer/consumer client configs	Discussion
KIP-301: Schema Inferencing for JsonConverter	Discussion
KIP-304: Connect runtime mode improvements for container platforms	Discussion
KIP-314: KTable to GlobalKTable Bi-directional Join	Discussion
KIP-315: Stream Join Sticky Assignor	Discussion
KIP-316: Command-line overrides for ConnectDistributed worker properties	Discussion
KIP-317: Add end-to-end data encryption functionality to Apache Kafka	Discussion
KIP-325: Extend Consumer Group Command to Show Beginning Offsets	Voting in Progress345
KIP-326: Schedulable KTable as Graph source	Discussion
KIP-333: Add faster mode of rebalancing	Discussion
KIP-334 - Include partitions in exceptions raised during consumer record deserialization/validation
KIP-335: Consider configurations for KafkaStreams	Discussion
KIP-347: Enable batching in FindCoordinatorRequest	Discussion
KIP-348 Eliminate null from SourceTask#poll()
KIP-350: Allow kafka-topics.sh to take brokerid as parameter to show partitions associated with it
KIP-356: Add KafkaConsumer fetch-error-rate and fetch-error-total metrics	Discussion
KIP-360: Improve handling of unknown producer	Discussion
K IP-362: Support Dynamic Session Window	Discussion
KIP-363: Allow performance tools to print final results to output file	Discussion
KIP-369: Alternative Partitioner to Support "Always Round-Robin" Selection	Accepted	KIP-370: Remove Orphan Partitions	Discussion
KIP-373: Allow users to create delegation tokens for other users	Discussion
KIP-375: Kafka Clients - make Metadata#TOPIC_EXPIRY_MS configurable	Discussion
KIP-378: Enable Dependency Injection for Kafka Streams handlers	Discussion
KIP-379: Multiple Consumer Group Management	Accepted	KIP-381: Connect: Tell about records that had their offsets flushed in callback	Voting in progress (restarted 18th January 2019, due to no votes in first attempt)
KIP-383: Pluggable interface for SSL Factory	Voting in progress
KIP-384: Add config for incompatible changes to persistent metadata	Discussion
KIP-385: Avoid throwing away prefetched data	Discussion
KIP-387: Fair Message Consumption Across Partitions in KafkaConsumer	Discussion
KIP-388: Add observer interface to record request and response	Discussion	KIP-389: Introduce a configurable consumer group size limit	Accepted
KIP-390: Allow fine-grained configuration for compression	Discussion, JIRA exists with pull-request
KIP-391: Allow Producing with Offsets for Cluster Replication	Discussion, JIRA exists with pull-request
KIP-392: Allow consumers to fetch from closest replica	Discussion
KIP-395: Encypt-then-MAC Delegation token metadata
KIP-397: Add methods to override fetch offsets based on timestamp	Discussion
KIP-398: Support reading trust store from classpath	Discussion
KIP-399: Extend ProductionExceptionHandler to cover serialization exceptions	Discussion
KIP-400: Improve exit status in case of errors in ConsoleProducer	Discussion
KIP-401: TransformerSupplier/ProcessorSupplier StateStore connecting	Voting in progress	KIP-403: Increase ProducerPerformance precision by using nanoTime	Draft
KIP-405: Kafka Tiered Storage	Discussion
KIP-406: GlobalStreamThread should honor custom offset policy.	Discussion
KIP-407: Kafka Connect support override worker kafka api configuration with connector configuration that post by rest api
KIP-408: Add asynchronous processing to Kafka Streams	Discussion
KIP-409: Allow creating under-replicated topics and partitions KIP-410: Add metric for request handler thread pool utilization by request type partitions
KIP-410: Add metric for request handler thread pool utilization by request type	Discussion
KIP-416: Notify SourceTask of ACK'd offsets, metadata	Discussion
KIP-418: A method-chaining way to branch KStream	Discussion, JIRA exists with pull-request
KIP-419: Safely notify Kafka Connect SourceTask is stopped	Voting in progress, JIRA exists with pull request
KIP-422: Add support for client quota configuration in the Kafka Admin Client	Discussion, JIRA exists with pull-request
KIP-423: Add JoinReason to Consumer Join Group Protocol	Discussion
KIP-	424:	Allow suppression of intermediate events based on wall clock time	Discussion
KIP-418: A method-chaining way to branch KStream426: Persist Broker Id to Zookeeper	Discussion
KIP-431: Support of printing additional ConsumerRecord fields in DefaultMessageFormatter	Voting in progressDiscussion, JIRA exists with pull-request
KIP-435: Internal Partition Reassignment Batching	Discussion
KIP-419: Safely notify Kafka Connect SourceTask is stopped437: Custom replacement for MaskField SMT	Voting in progress, JIRA exists with pull-request
KIP-421: Support resolving externalized secrets in AbstractConfig 438: Expose task, connector IDs in Connect API	DiscussionAccepted
KIP-422: Add support for client quota configuration in the Kafka Admin Client439: Cleanup built-in Store interfaces	DiscussionDiscussion, JIRA exists with pull-request
KIP-423: Add JoinReason to Consumer Join Group Protocol441: Smooth Scaling Out for Kafka Streams	Discussion
KIP-424: Allow suppression of intermediate events based on wall clock time444: Augment metrics for Kafka Streams	Discussion
KIP-426: Persist Broker Id to Zookeeper447: Producer scalability for exactly once semantics	Discussion
KIP-431448: Support of printing additional ConsumerRecord fields in DefaultMessageFormatterAdd State Stores Unit Test Support to Kafka Streams Test Utils	DiscussionVoting in progress, JIRA exists with pull-request
KIP-434: Add Replica Fetcher and Log Cleaner Count Metrics450: Sliding Window Aggregations in the DSL	Discussion
KIP-435: Internal Partition Reassignment Batching452: Tool to view cluster status	Discussion, JIRA existsDiscussion
KIP-437: Custom replacement for MaskField SMT457: Add DISCONNECTED status to Kafka Streams	Discussion Voting in progress, JIRA exists with pull-request
KIP-438: Expose task, connector IDs in Connect API459: Improve KafkaStreams#close	Discussion
KIP-439: Cleanup built-in Store interfaces463: Auto-configure non-default Serdes passed alongside the TopologyBuilder	Under discussionDiscussion
KIP-	466: Add support for List<T> serialization and deserialization	Voting in progress
KIP-441: Smooth Scaling Out for Kafka Streams468: Avoid decompression of record when validate record at server in the scene of inPlaceAssignment .	Under discussionDiscussion
KIP-	Discussion
KIP-447: Producer scalability for exactly once semantics	Discussion
KIP-448: Add State Stores Unit Test Support to Kafka Streams Test Utils	Discussion
KIP-450: Sliding Window Aggregations in the DSL	Discussion
KIP-452: Tool to view cluster status	Discussion, JIRA exists
KIP-457: Add DISCONNECTED status to Kafka Streams	Discussion
KIP-459: Improve KafkaStreams#close	Discussion
KIP-463: Auto-configure non-default Serdes passed alongside the TopologyBuilder	Under discussion
KIP-466: Add support for List<T> serialization and deserialization	Voting in progress
470: TopologyTestDriver test input and output usability improvements	Voting in progress
KIP-473: Enable KafkaLog4JAppender to use SASL Authentication Callback Handlers	Under Discussion
KIP-477: Add PATCH method for connector config in Connect REST API	Under Discussion
KIP-478 - Strongly typed Processor API	Under Discussion
KIP-486: Support custom way to load KeyStore and TrustStore	Under Discussion
KIP-487: Automatic Topic Creation on Producer	Under Discussion
KIP-489: Kafka Consumer Record Latency Metric	Under Discussion
KIP-490: New metric to count offsets expired without being consumed by a consumer group KIP-468: Avoid decompression of record when validate record at server in the scene of inPlaceAssignment .	Under discussion
KIP-	491: Preferred Leader Deprioritized List (Temporary Blacklist)	Under discussion
KIP-471: Expose RocksDB Metrics in Kafka StreamsAccepted494: Connect REST Endpoint to get Transformations (SMTs)
KIP-473: Enable KafkaLog4JAppender to use SASL Authentication Callback Handlers	Under Discussion
KIP-474: To deprecate WindowStore#put(key, value)	Accepted
KIP-475: New Metrics to Measure Number of Tasks on a Connector	Accepted
KIP-477: Add PATCH method for connector config in Connect REST API	Under Discussion
KIP-478 - Strongly typed Processor API	Under Discussion
KIP-481: SerDe Improvements for Connect Decimal type in JSON	Under Discussion
KIP-482: Optional fields in the Kafka Protocol
KIP-486: Support custom way to load KeyStore and TrustStore	Under Discussion
KIP-487: Automatic Topic Creation on Producer	Under Discussion
KIP-489: Kafka Consumer Record Latency Metric	Under Discussion
KIP-490: New metric to count offsets expired without being consumed by a consumer group	Under discussion
KIP-491: Preferred Leader Deprioritized List (Temporary Blacklist)	Under discussion
KIP-494: Connect REST Endpoint for Transformations (SMTs) and other Plugins
498: Add client-side configuration for maximum response size to protect against OOM	Sent emails to Dev discussion group. Work tracked under KAFKA-4090.
KIP-499 - Unify connection name flag for command line tool	Under discussion
KIP-499: Create a controller RPC for changing configurations
KIP-502: Connect SinkTask.put(...) to specify ArrayList<SinkRecord> in Signature
KIP-505: Add new public method to only update assignment metadata in consumer	Under discussion
KIP-506: Allow setting SCRAM password via Admin interface	Under discussion
KIP-507: Securing Internal Connect REST Endpoints	Voting in progress, draft available
KIP-508: Make Suppression State Queriable	Under discussion
KIP-509: Rebalance and restart Producers	Under discussion
KIP-510: Metrics library upgrade	Under discussion
KIP-512: Adding headers to RecordMetaData	Sent mail to dev discussion group
KIP-513: Distinguish between Key and Value serdes in scala wrapper library for kafka streams
KIP-514:Add a bounded flush() API to Kafka Producer
KIP-515: Reorganize checkpoint system in log cleaner to per partition
KIP-516: Topic Identifiers & Topic Deletion State Improvements	Under discussion
KIP-517: Add consumer metrics to observe user poll behavior	Under discussion
KIP-518: Allow listing consumer groups per state	Under discussion
KIP-519: Make SSL context/engine configuration extensible	Under discussion
KIP-521: Enable redirection of Connect's log4j messages to a file by default	Voting in progress
KIP-522: Update BrokerApiVersionsCommand to use AdminClient	Draft
KIP-523: Add KStream#toTable to the Streams DSL	Under discussion
KIP-525 - Return topic metadata and configs in CreateTopics response	Under discussion
KIP-526: Reduce Producer Metadata Lookups for Large Number of Topics	Under discussion
KIP-527: Add NullSerde to Serdes	Under discussion
KIP-528: Deprecate PartitionGrouper configuration and interface	Under discussion
KIP-495: Dynamically Adjust Log Levels in Connect	Sent mail to dev discussion group.
KIP-498: Add client-side configuration for maximum response size to protect against OOM	Sent emails to Dev discussion group. Work tracked under KAFKA-4090.
KIP-499 - Unify connection name flag for command line tool	Under discussion
KIP-500: Replace ZooKeeper with a Self-Managed Metadata Quorum	KIP-502: Connect SinkTask.put(...) to specify ArrayList<SinkRecord> in Signature	KIP-503: Add metric for number of topics marked for deletion	KIP-504 - Add new Java Authorizer Interface
KIP-505: Add new public method to only update assignment metadata in consumer	Under discussion
KIP-506: Allow setting SCRAM password via Admin interface	Under discussion
KIP-507: Securing Internal Connect REST Endpoints	Under discussion
KIP-508: Make Suppression State Queriable	Under discussion
KIP-509: Rebalance and restart Producers	Under discussion
KIP-510: Metrics library upgrade

Dormant/inactive KIPs

Please insert new rows in sorted order (ascending by KIP number).

...

Space shortcuts

Child pages

Versions Compared

Old Version 1478

New Version 1534

Key

Purpose

KIP round-up

KIPs under discussion