Page History

...

To create your own KIP, click on

Create from template

templateName	54329345
templateId	54329345
title	KIP-NEXT: Insert Title Here
buttonLabel	Create KIP

. If you don't have permission, please send an email with your Wiki ID to dev@kafka.apache.org and request permission (http://kafka.apache.org/contact). Also add an entry to the table KIPs under discussion (for Streams API KIPs, please also add it to Kafka Streams sub page).

Table of Contents

476

Purpose

We want to make Kafka a core architectural component for users. We also support a large number of integrations with other tools, systems, and clients. Keeping this kind of usage health requires a high level of compatibility between releases — core architectural elements can't break compatibility or shift functionality from release to release. As a result each new major feature or public api has to be done in a way that we can stick with it going forward.

...

KIP round-up

Next KIP Number: 502526

Use this number as the identifier for your KIP and increment this value.

...

488: Clean up Sum,Count,Total Metrics461: Improve Replica Fetcher behavior at handling partition failure3458: Connector Client Config Override Policy3455: Create an Administrative API for Replica Reassignment454: Expansion of the ConnectClusterState interface3453: Add close() method to RocksDBConfigSetter3449: Add connector contexts to log messages in Connect workers 3436: Add a metric indicating start time3430 - Return Authorized Operations in Describe Responses428: Add in-memory window store427 AtMinIsr topic partition category (new metric & TopicCommand option)425 some Log4J Kafka Appender Properties for Producing to Secured Brokers420: Add Single Value Fetch in Session Stores2417 Allow JmxTool to connect to a secured RMI portKIP-415: Incremental Cooperative Rebalancing in Kafka Connect30412 Admin API dynamic application log levels31411: Make default Kafka Connect worker task client IDs distinct34393: Time windowed serde to properly deserialize changelog input topic235386: Standardize on Min/Avg/Max metrics' default value238377: TopicCommand to use AdminClient39376: Implement AutoClosable on appropriate classes that want to be used in a try-with-resource statement240374: Add '--help' option to all available Kafka CLI commands2366: Make FunctionConversions deprecated1359: Verify leader epoch in produce requests4 (WIP)357: Add support to list ACLs per principal1356: Add withCachingDisabled() to StoreBuilder1341: Update Sticky Assignor's User Data Protocol359340: Allow kafka-reassign-partitions.sh and kafka-log-dirs.sh to take admin client property file2.1338 Support to exclude the internal topics in kafka-topics.sh commandKIP332: Update AclCommand to use AdminClient API168322: Return new error code for DeleteTopics API when topic deletion disabled.17173308: Support dynamic update of max.connections.per.ip/max.connections.per.ip.overrides176305: Add Connect primitive number converters07879302 - Enable Kafka clients to use all DNS resolved IP addresses290: Support for Prefixed ACLs0285: Connect Rest Extension Plugin2.0281: ConsumerPerformance: Increase Polling Loop Timeout and Make It Reachable by the End User2.0279: Fix log divergence between leader and follower after fast leader fail over0277 - Fine Grained ACL for CreateTopics API276 - Add StreamsConfig prefix for different consumers274: Kafka Streams Skipped Records Metrics0268: Simplify Kafka Streams Rebalance Metadata Upgrade267: Add Processor Unit Test Support to Kafka Streams Test Utils261 Single Value Fetch in Window Stores257 - Configurable Quota Management0255: OAuth Authentication via SASL/OAUTHBEARER251: Allow timestamp manipulation in Processor API249: Add Delegation Token Operations to KafkaAdminClient247 public test utils for Kafka Streams1.1245: Use Properties instead of StreamsConfig in KafkaStreams constructor244: Add Record Header support to Kafka Streams Processor API243: Make ProducerConfig and ConsumerConfig constructors public1.1-239 Add queryableStoreName() to GlobalKTable1.1-233: Simplify StreamsBuilder#addGlobalStore1.1231: Improve the Required ACL of ListGroups API1227 - Introduce Incremental FetchRequests to Increase Partition Scalability1.1224: Add configuration parameter `retries` to Streams API1.1.0222 - Add Consumer Group operations to Admin API215 topic regex support for Connect sinks1.1213 Support non-key joining in KTable2.4.0 (WIP)210 - Provide for custom error handling when Kafka Streams fails to produce1207: Offsets returned by ListOffsetsResponse should be monotonically increasing even during a partition leader change2206: Add support for UUID serialization and deserialization2188 - Add new metrics to support health checks1.0.0177: Consumer perf tool should count rebalance time1.0176: Remove deprecated new-consumer option for tools2.0163: Lower the Minimum Required ACL Permission of OffsetFetch157 consumer config options to streams reset tool156 Add option "dry run" to Streams application reset tool0.11.155 - Add range scan for windowed state stores0.11150 - Kafka-Streams Cogroup4.0 (WIP)137: Enhance TopicCommand --describe to show topics marked for deletion0.11129: Streams Exactly-Once Semantics128: ByteArrayConverter for Kafka Connect110 Codec for ZStandard Compression2.1107: Add deleteRecordsBefore() API in AdminClient0.1190 - Remove zkClient dependency from Streams0.10.2.

	KIP (please keep this sorted by KIP number)	Release
1	KIP-	482: The Kafka Protocol should Support Optional Tagged Fields	2.4.0 (WIP)
2	KIP-484: Expose metrics for group and transaction metadata loading duration-504 - Add new Java Authorizer Interface	2.4.0 (WIP)
3	KIP-476503: Add Java AdminClient Interfacemetric for number of topics marked for deletion	2.4.0 (WIP)
4	KIP-467: Augment ProduceResponse error messaging for specific culprit records497: Add inter-broker API to alter ISR	2.4.0 (WIP)
5	KIP-465: Add Consolidated Connector Endpoint to Connect REST API496: Administrative API to delete consumer offsets	2.34.0 (WIP)
6	KIP-464: Defaults for AdminClient#createTopic488: Clean up Sum,Count,Total Metrics	2.4.0
7	KIP-462: Use local thread id for KStreams484: Expose metrics for group and transaction metadata loading duration	2.34.0 (WIP)
8	KIP-	480: Sticky Partitioner	2.	4.0
9	KIP-460: Admin Leader Election RPC479: Add Materialized to Join	2.4.0(WIP)
10	KIP-	476: Add Java AdminClient Interface	2.	4.0
11	KIP-	475: New Metrics to Measure Number of Tasks on a Connector	2.4.0 (WIP)
12	KIP-	474: To deprecate WindowStore#put(key, value)	2.	4.0 (WIP)
13	KIP-	471: Expose RocksDB Metrics in Kafka Streams	2.	4.0 (WIP)
14	KIP-	467: Augment ProduceResponse error messaging for specific culprit records	2.	4.0 (WIP)
15	KIP-446465: Add changelog topic configuration to KTable suppressConsolidated Connector Endpoint to Connect REST API	2.43.0 (WIP)
16	KIP-445: In-memory Session Store464: Defaults for AdminClient#createTopic	2.34.0
17	KIP-443: Return to default segment.ms and segment.index.bytes in Streams repartition topics462: Use local thread id for KStreams	2.3.0
18	KIP-442: Return to default max poll interval in Streams461: Improve Replica Fetcher behavior at handling partition failure	2.3.0
19	KIP-	460: Admin Leader Election RPC	2.	4.0
20	KIP-	458: Connector Client Config Override Policy	2.3.0
21	KIP-429: Kafka Consumer Incremental Rebalance Protocol455: Create an Administrative API for Replica Reassignment	2.4.0 (WIP)
22	KIP-	454: Expansion of the ConnectClusterState interface	2.3.0
23	KIP-	453: Add	close() method to RocksDBConfigSetter	2.3.0
24	KIP-	449: Add	connector contexts to log messages in Connect workers	2.3.0
25	KIP-421: Support resolving externalized secrets in AbstractConfig 446: Add changelog topic configuration to KTable suppress	2.34.0 (WIP)
26	KIP-	445: In-memory Session Store	2.	3.0
27	KIP-	443:	2.3.0	28	Return to default segment.ms and segment.index.bytes in Streams repartition topics	2.3.0
2928	KIP-414: Expose Embedded ClientIds in Kafka 442: Return to default max poll interval in Streams	2.23.0
29	KIP-	440: Extend	Connect Converter to support	headers	2.4.0 (WIP)
30	KIP-	436: Add a metric indicating start time	2.3.0
3231	KIP-402: Improve fairness in SocketServer processors-430 - Return Authorized Operations in Describe Responses	2.2.0 (partially implemented) / 2.3.0
3332	KIP-394: Require member.id for initial join group request429: Kafka Consumer Incremental Rebalance Protocol	2.24.0 (WIP)
33	KIP-	428: Add in-memory window store	2.	3.0
34	KIP-	427: Add AtMinIsr topic partition category (new metric & TopicCommand option)	2.	3.0
3635	KIP-382: MirrorMaker 2.0425: Add some Log4J Kafka Appender Properties for Producing to Secured Brokers	2.43.0 (WIP)
3736	KIP-380: Detect outdated control requests and bounced brokers using broker generation421: Support resolving externalized secrets in AbstractConfig	2.23.0
37	KIP-	420: Add Single Value Fetch in Session Stores	2.2.0
38	KIP-	417: Allow JmxTool to connect to a secured RMI port	2.	3.0
39	KIP-	415: Incremental Cooperative Rebalancing in Kafka Connect	2.	3.0
4140	KIP-372: Naming Repartition Topics for Joins and Grouping414: Expose Embedded ClientIds in Kafka Streams	2.12.0
4241	KIP-371: Add a configuration to build custom SSL principal name412: Extend Admin API to support dynamic application log levels	2.24.0 (WIP)
4342	KIP 368: Allow SASL Connections to Periodically Re-Authenticate -411: Make default Kafka Connect worker task client IDs distinct	2.23.0
4443	KIP-367 Introduce close(Duration) to Producer and AdminClient instead of close(long, TimeUnit)402: Improve fairness in SocketServer processors	2.2.0 (partially implemented) / 2.3.0
44	KIP-401: TransformerSupplier/ProcessorSupplier StateStore connecting	2.4.0 (WIP)2.2.0
45	KIP-	396: Add Commit/List Offsets Operations to AdminClient	2.	4.0 (WIP)
46	KIP-365: Materialized, Serialized, Joined, Consumed and Produced with implicit Serde394: Require member.id for initial join group request	2.12.0
47	KIPKIP-361: Add Consumer Configuration to Disable Auto Topic Creation393: Time windowed serde to properly deserialize changelog input topic	2.32.0
48	KIP-	389: Introduce a configurable consumer group size limit	2.	2.0
49	KIP-358: Migrate Streams API to Duration instead of long ms times386: Standardize on Min/Avg/Max metrics' default value	2.12.0
50	KIP-	382: MirrorMaker 2.0	2.	4.0
51	KIP-	379: Multiple Consumer Group Management	2.	4.0 (WIP)
52	KIP-354: Add a Maximum Log Compaction Lag380: Detect outdated control requests and bounced brokers using broker generation	2.32.0
53	KIP-353: Improve Kafka Streams Timestamp Synchronization377: TopicCommand to use AdminClient	2.12.0
54	KIP-351: Add --under-min-isr option to describe topics command376: Implement AutoClosable on appropriate classes that want to be used in a try-with-resource statement	2.22.3.0
55	KIP-346: Improve LogCleaner behavior on error	2.1
56	KIP-345: Introduce static membership protocol to reduce consumer rebalances	2.4.0 (WIP), partially available in 2.3.0
374: Add '--help' option to all available Kafka CLI commands	2.2.0
56	KIP-372: Naming Repartition Topics for Joins and Grouping	57	KIP-342 Add support for custom SASL extensions in OAuthBearer authentication	2.1.0
5857	KIP-	371: Add a configuration to build custom SSL principal name	2.	2.0
58	KIP-369: Alternative Partitioner to Support "Always Round-Robin" Selection	2.4.0
59	KIP 368: Allow SASL Connections to Periodically Re-Authenticate	2.2	.0
60	KIP-339: Create a new IncrementalAlterConfigs API367 Introduce close(Duration) to Producer and AdminClient instead of close(long, TimeUnit)	2.32.0 0
61	KIP-	366: Make FunctionConversions deprecated	2.1.0
62	KIP-336: Consolidate ExtendedSerializer/Serializer and ExtendedDeserializer/Deserializer365: Materialized, Serialized, Joined, Consumed and Produced with implicit Serde	2.1.0
63	K IP-	361: Add Consumer Configuration to Disable Auto Topic Creation	2.	3.0
64	KIP-331 Add default implementation to close() and configure() for Serializer, Deserializer and Serde360: Improve handling of unknown producer	2.34.0 (WIP)
65	KIP-330: Add retentionPeriod in SessionBytesStoreSupplier359: Verify leader epoch in produce requests	2.14.0 (WIP)
66	KIP-328358: Ability to suppress updates for KTablesMigrate Streams API to Duration instead of long ms times	2.1.0 (partially implemented) / 2.3.0 (WIP)
67	KIP-357: Add support to list ACLs per principal	2.1.0
68	KIP-356: Add withCachingDisabled() to StoreBuilder	67	KIP-324: Add method to get metrics() in AdminClient	2.1.0
69	KIP-	354: Add a Maximum Log Compaction Lag	2.	3.0
6970	KIP-321: Update TopologyDescription to better represent Source and Sink Nodes353: Improve Kafka Streams Timestamp Synchronization	2.1.0
7071	KIP-320: Allow fetchers to detect and handle log truncation352: Distinguish URPs caused by reassignment	2.14.0 (partially implemented) / 2.2WIP)
72	KIP-351: Add --under-min-isr option to describe topics command	2.3.0
73	KIP-319: Replace segments with segmentInterval in WindowBytesStoreSupplier346: Improve LogCleaner behavior on error	2.1.0
7274	KIP-313: Add KStream.flatTransform and KStream.flatTransformValues 345: Introduce static membership protocol to reduce consumer rebalances	2.24.0 (partially implemented)/ WIP), partially available in 2.3.0
75	KIP-312 Add Overloaded StreamsBuilder Build Method to Accept java.util.Properties342 Add support for custom SASL extensions in OAuthBearer authentication	2.1.0
7476	KIP-	341: Update Sticky Assignor's User Data Protocol	2.	3.0
7577	KIP-307340: Allow to define custom processor names with KStreams DSLkafka-reassign-partitions.sh and kafka-log-dirs.sh to take admin client property file	2.31.0 (partial)
78	KIP-306: Configuration for Delaying Response to Failed Authentication339: Create a new IncrementalAlterConfigs API	2.13.00
7779	KIP-	338 Support to exclude the internal topics in kafka-topics.sh command	2.	1.0
80	KIP-303: Add Dynamic Routing in Streams Sink336: Consolidate ExtendedSerializer/Serializer and ExtendedDeserializer/Deserializer	2.01.0
81	KIP-	332: Update AclCommand to use AdminClient API	2.1.0
8082	KIP-300: Add Windowed KTable API in StreamsBuilder331 Add default implementation to close() and configure() for Serializer, Deserializer and Serde	2.43.0
8183	KIP-298330: Error Handling Add retentionPeriod in ConnectSessionBytesStoreSupplier	2.01.0
8284	KIP-297: Externalizing Secrets for Connect Configurations328: Ability to suppress updates for KTables	2.0.0
83	KIP-295 Add Streams Configuration Allowing for Optional Topology Optimization	2.0.0
84	KIP-294 - Enable TLS hostname verification by default	2.0.0
1.0 (partially implemented) / 2.3.0 (WIP)
85	KIP-292324: Add transformValuesmethod to get metrics() method to KTablein AdminClient	2.01.0
86	KIP-	322: Return new error code for DeleteTopics API when topic deletion disabled.	2.	1.0
87	KIP-289: Improve the default group id behavior in KafkaConsumer321: Update TopologyDescription to better represent Source and Sink Nodes	2.21.0
88	KIP-	320: Allow fetchers to detect and handle log truncation	2.1.0 (partially implemented) / 2.2	.0
89	KIP-284: Set default retention ms for Streams repartition topics to Long.MAX_VALUE319: Replace segments with segmentInterval in WindowBytesStoreSupplier	2.01.0
90	KIP-283: Efficient Memory Usage for Down-Conversion313: Add KStream.flatTransform and KStream.flatTransformValues	2.2.0 (partially implemented) / 2.3. 2.0. 0
91	KIP-282: Add the listener name to the authentication context312 Add Overloaded StreamsBuilder Build Method to Accept java.util.Properties	2.01.0
92	KIP-	308: Support dynamic update of max.connections.per.ip/max.connections.per.ip.overrides	2.1	.0
93	KIP-	307: Allow to define custom processor names with KStreams DSL	2.	3.0 (partial)
94	KIP-278 - Add version option to Kafka's commands306: Configuration for Delaying Response to Failed Authentication	2.01.0
95	KIP-	305: Add Connect primitive number converters	2.0.0
96	KIP-	303: Add Dynamic Routing in Streams Sink	2.0.0
97	KIP-	302 - Enable Kafka clients to use all DNS resolved IP addresses	2.	1.0
98	KIP-272300: Add API version tag to broker's RequestsPerSec metricWindowed KTable API in StreamsBuilder	2.04.0
99	KIP-270 - A Scala Wrapper Library for Kafka Streams298: Error Handling in Connect	2.0.0
100	KIP-	297: Externalizing Secrets for Connect Configurations	2.0.0
101	KIP-	295 Add Streams Configuration Allowing for Optional Topology Optimization	2.0.0
102	KIP-266: Fix consumer indefinite blocking behavior294 - Enable TLS hostname verification by default	2.0.0
103	KIP- 265: Make Windowed Serde to public APIs 291: Separating controller connections and requests from the data plane	Accepted2.0.0
104	KIP-	292: Add	transformValues() method to KTable	2.0.0
105	KIP-258: Allow to Store Record Timestamps in RocksDB290: Support for Prefixed ACLs	2.30.0 (partially implemented)
106	KIP-	289: Improve the default group id behavior in KafkaConsumer	2.	2.0
107	KIP-	285: Connect Rest Extension Plugin	2.0.0
108	KIP-	284: Set default retention ms for Streams repartition topics to Long.MAX_VALUE	2.0.0
109	KIP-	283: Efficient Memory Usage for Down-Conversion	2.0.0
110	KIP-	282: Add	the listener name to the authentication context	2.0	.0
111	KIP-	281: ConsumerPerformance: Increase Polling Loop Timeout and Make It Reachable by the End User	2.0.0
112	KIP-	279: Fix log divergence between leader and follower after fast leader fail over	2.0.0
113	KIP-	278 - Add version option to Kafka's commands	2.0	.0
114	KIP	-277 - Fine Grained ACL for CreateTopics API	2.0	.0
115	KIP-238: Expose Kafka cluster ID in Connect REST API276 - Add StreamsConfig prefix for different consumers	2.01.1.0
116	KIP-237: More Controller Health 274: Kafka Streams Skipped Records Metrics	2.0.0
117	KIP-235: Add DNS alias support for secured connection272: Add API version tag to broker's RequestsPerSec metric	2.10.0
118	KIP	-270 - A Scala Wrapper Library for Kafka Streams	2.0	.0
119	KIP-	268: Simplify Kafka Streams Rebalance Metadata Upgrade	2.	0.0
120	KIP-229: DeleteGroups API267: Add Processor Unit Test Support to Kafka Streams Test Utils	2.01.1.0
121	KIP-	266: Fix consumer indefinite blocking behavior	2.0	.0
122	KIP-226 - Dynamic Broker Configuration265: Make Windowed Serde to public APIs	2.01.1.0
123	KIP-225 - Use tags for consumer “records.lag” metrics261: Add Single Value Fetch in Window Stores	2.01.1.0
124	KIP-	258: Allow to Store Record Timestamps in RocksDB	2.3.0 (partially implemented)
125	KIP-223 - Add per-topic min lead and per-partition lead metrics to KafkaConsumer257 - Configurable Quota Management	2.0.0
126	KIP-	255: OAuth Authentication via SASL/OAUTHBEARER	2.0.0
127	KIP-221: Enhance DSL with Connecting Topic Creation and Repartition Hint251: Allow timestamp manipulation in Processor API	2.40.0 (WIP)
128	KIP-220249: Add AdminClient into Kafka Streams' ClientSupplierDelegation Token Operations to KafkaAdminClient	2.01.1.0
129	KIP-219 - Improve quota communication247: Add public test utils for Kafka Streams	1.12.0.0
130	KIP-218: Make KafkaFuture.Function java 8 lambda compatible245: Use Properties instead of StreamsConfig in KafkaStreams constructor	2.01.1.0
131	KIP-	244: Add	Record Header support to Kafka Streams Processor API	2.0	.0
132	KIP-214: Add zookeeper.max.in.flight.requests config to the broker243: Make ProducerConfig and ConsumerConfig constructors public	1.1.0
133	KIP-	239 Add queryableStoreName() to GlobalKTable	1.1.0
134	KIP-212: Enforce set of legal characters for connector names238: Expose Kafka cluster ID in Connect REST API	1.1.0
135	KIP-211: Revise Expiration Semantics of Consumer Group Offsets237: More Controller Health Metrics	2.10.0
136	KIP-	235: Add DNS alias support for secured connection	2	.1.0
137	KIP-208: Add SSL support to Kafka Connect REST interface233: Simplify StreamsBuilder#addGlobalStore	1.1.0
138	KIP-	231: Improve the Required ACL of ListGroups API	2.	1.0
139	KIP-	229: DeleteGroups API	1	.1.0
140	KIP-205: Add all() and range() API to ReadOnlyWindowStore-227 - Introduce Incremental FetchRequests to Increase Partition Scalability	1.1.0
141	KIP-204 : Adding records deletion operation to the new Admin Client API-226 - Dynamic Broker Configuration	1.1.0
142	KIP-203: Add toLowerCase support to sasl.kerberos.principal.to.local rule 225 - Use tags for consumer “records.lag” metrics	1.1.0
143	KIP-202: Move merge() from StreamsBuilder to KStream224: Add configuration parameter `retries` to Streams API	1.01.0
144	KIP-198: Remove ZK dependency from Streams Reset Tool-223 - Add per-topic min lead and per-partition lead metrics to KafkaConsumer	21.0.0
145	KIP-197 Connect REST API should include the connector type when describing a connector222 - Add Consumer Group operations to Admin API	21.0.0
146	KIP-196: Add metrics to Kafka Connect framework221: Enhance DSL with Connecting Topic Creation and Repartition Hint	2.4.0 (WIP)1.0.0
147	KIP-195220: AdminClient.createPartitionsAdd AdminClient into Kafka Streams' ClientSupplier	1.01.0
148	KIP-192 : Provide cleaner semantics when idempotence is enabled219 - Improve quota communication	21.0.0
149	KIP-191218: KafkaConsumer.subscribe() overload that takes just PatternMake KafkaFuture.Function java 8 lambda compatible	1.01.0
150	KIP-190: Handle client-ids consistently between clients and brokers215: Add topic regex support for Connect sinks	1.01.0
151	KIP-189: Improve principal builder interface and add support for SASL214: Add zookeeper.max.in.flight.requests config to the broker	1.01.0
152	KIP-	213 Support non-key joining in KTable	2.4.0 (WIP)
153	KIP-187 - Add cumulative count metric for all Kafka rate metrics212: Enforce set of legal characters for connector names	1.01.0
154	KIP-186: Increase offsets retention default to 7 days211: Revise Expiration Semantics of Consumer Group Offsets	2.01.0
155	KIP-183 - Change PreferredReplicaLeaderElectionCommand to use AdminClient210 - Provide for custom error handling when Kafka Streams fails to produce	1.12.2.0
156	KIP-182: Reduce Streams DSL overloads and allow easier use of custom storage engines208: Add SSL support to Kafka Connect REST interface	1.01.0
157	KIP-180: Add a broker metric specifying the number of consumer group rebalances in progress207: Offsets returned by ListOffsetsResponse should be monotonically increasing even during a partition leader change	2.21.1.0
158	KIP-	206: Add support for UUID serialization and deserialization	2.1	.0
159	KIP-	205: Add all() and range() API to ReadOnlyWindowStore	1.1	.0
160	KIP-175: Additional '--describe' views for ConsumerGroupCommand204 : Adding records deletion operation to the new Admin Client API	1.1.0
161	KIP-174 - Deprecate and remove internal converter configs in WorkerConfig203: Add toLowerCase support to sasl.kerberos.principal.to.local rule	1.12.0.0
162	KIP-173: Add prefix to StreamsConfig to enable setting default internal topic configs202: Move merge() from StreamsBuilder to KStream	1.0.0
163	KIP-171 - Extend Consumer Group Reset Offset for Stream Application198: Remove ZK dependency from Streams Reset Tool	1.10.0
164	KIP-168: Add GlobalTopicCount and GlobalPartitionCount metric per cluster197 Connect REST API should include the connector type when describing a connector	1.0.0
165	KIP-167196: Add interface for the state store restoration processmetrics to Kafka Connect framework	1.0.0
166	KIP-164 - Add UnderMinIsrPartitionCount and per-partition UnderMinIsr metrics195: AdminClient.createPartitions	1.0.0
167	KIP-	192 : Provide cleaner semantics when idempotence is enabled	1.0.0
168	KIP-162: Enable topic deletion by default191: KafkaConsumer.subscribe() overload that takes just Pattern	1.0.0
169	KIP-161: streams deserialization exception handlers190: Handle client-ids consistently between clients and brokers	1.0.0
170	KIP-160: Augment KStream.print(), KStream.writeAsText() to allow users pass in extra parameters in the printed string189: Improve principal builder interface and add support for SASL	1.1.0.0
171	KIP-	188 - Add	new metrics to support health checks	1.0.0
172	KIP-187 -	Add cumulative count metric for all Kafka rate metrics	1.	0.0
173	KIP-	186: Increase offsets retention default to 7 days	2	.0.0
174	KIP-154 Add Kafka Connect configuration properties for creating internal topics-183 - Change PreferredReplicaLeaderElectionCommand to use AdminClient	2.20.11.0.0
175	KIP-153: Include only client traffic in BytesOutPerSec metric182: Reduce Streams DSL overloads and allow easier use of custom storage engines	1.0.11.0.0
176	KIP-152 - Improve diagnostics for SASL authentication failures180: Add a broker metric specifying the number of consumer group rebalances in progress	1.01.0
177	KIP-151 Expose Connector type in REST API177: Consumer perf tool should count rebalance time	1.0.11.0.0
178	KIP-	176: Remove deprecated new-consumer option for tools	2.	0.0
179	KIP-149: Enabling key access in ValueTransformer, ValueMapper, and ValueJoiner175: Additional '--describe' views for ConsumerGroupCommand	1.1.0 (partially implemented) (WIP for 2.4.0)
180	KIP-146 - Classloading Isolation in Connect174 - Deprecate and remove internal converter configs in WorkerConfig	2.0.11.0.0
181	KIP-145 - Expose Record Headers in Kafka Connect173: Add prefix to StreamsConfig to enable setting default internal topic configs	1.10.0
182	KIP-144: Exponential backoff for broker reconnect attempts171 - Extend Consumer Group Reset Offset for Stream Application	1.1.00.11.0.0
183	KIP-143: Controller Health Metrics168: Add GlobalTopicCount and GlobalPartitionCount metric per cluster	1.0.11.0.0
184	KIP-140167: Add administrative RPCs for adding, deleting, and listing ACLsinterface for the state store restoration process	10.11.0.0
185	KIP- 138: Change punctuate semantics 164 - Add UnderMinIsrPartitionCount and per-partition UnderMinIsr metrics	1.0.0
186	KIP-	163: Lower the Minimum Required ACL Permission of OffsetFetch	1	.0.0
187	KIP-136: Add Listener name to SelectorMetrics tags162: Enable topic deletion by default	10.11.0.0
188	KIP-134: Delay initial consumer group rebalance161: streams deserialization exception handlers	1.0.11.0.0
189	KIP-133: Describe and Alter Configs Admin APIs160: Augment KStream.print(), KStream.writeAsText() to allow users pass in extra parameters in the printed string	1.0.11.0.0
190	KIP-130: Expose states of active tasks to KafkaStreams public API-157 - Add consumer config options to streams reset tool	1.0.0
191	KIP-	156 Add option "dry run" to Streams application reset tool	0.11.0.0
192	KIP-155 -	Add	range scan for windowed state stores	0.11.0.0
193	KIP-126 - Allow KafkaProducer to split and resend oversized batches.154 Add Kafka Connect configuration properties for creating internal topics	0.11.0.0
194	KIP-124 - Request rate quotas153: Include only client traffic in BytesOutPerSec metric	0.11.0.0
195	KIP-123: Allow per stream/table timestamp extractor-152 - Improve diagnostics for SASL authentication failures	1.0.11.0.0
196	KIP-122: Add Reset Consumer Group Offsets tooling151 Expose Connector type in REST API	0.11.0.0
197	KIP-121: Add KStream peek method-150 - Kafka-Streams Cogroup	2.4.0 (WIP)0.11.0.0
198	KIP-120: Cleanup Kafka Streams builder API149: Enabling key access in ValueTransformer, ValueMapper, and ValueJoiner	1.1.0 (partially implemented) (WIP for 2.4.0)
199	KIP-119: Drop Support for Scala 2.10 in Kafka 0.11-146 - Classloading Isolation in Connect	0.11.0.0
200	KIP-118: Drop Support for Java 7145 - Expose Record Headers in Kafka Connect	1.12.0.0
201	KIP-117: Add a public AdminClient API for Kafka admin operations144: Exponential backoff for broker reconnect attempts	0.11.0.0
202	KIP-115: Enforce offsets.topic.replication.factor upon __consumer_offsets auto topic creation143: Controller Health Metrics	0.11.0.0
203	KIP-114: KTable state stores and improved semantics140: Add administrative RPCs for adding, deleting, and listing ACLs	0.11.0.0
204	KIP-113: Support replicas movement between log directories138: Change punctuate semantics	1.10.0
205	KIP-112: Handle disk failure for JBOD137: Enhance TopicCommand --describe to show topics marked for deletion	0.111.0.0
206	KIP-	136: Add	Listener name to SelectorMetrics tags	0.11.0	.0
207	KIP-109: Old Consumer Deprecation134: Delay initial consumer group rebalance	0.11.0.0
208	KIP-108: Create Topic Policy133: Describe and Alter Configs Admin APIs	0.1011.20.0
209	KIP-	130: Expose states of active tasks to KafkaStreams public API	1	.0.0
210	KIP-106 - Change Default unclean.leader.election.enabled from True to False129: Streams Exactly-Once Semantics	0.11.0.0
211	KIP-105: Addition of Record Level for Sensors128: Add ByteArrayConverter for Kafka Connect	0.1011.20.0
212	KIP-104: Granular Sensors for Streams 126 - Allow KafkaProducer to split and resend oversized batches.	0.1011.20.0
213	KIP-103: Separation of Internal and External traffic-124 - Request rate quotas	0.1011.20.0
214	KIP-102 - Add close with timeout for consumers123: Allow per stream/table timestamp extractor	0.1011.20.0
215	KIP-101 - Alter Replication Protocol to use Leader Epoch rather than High Watermark for Truncation122: Add Reset Consumer Group Offsets tooling	0.11.0.0
216	KIP-100 - Relax Type constraints in Kafka Streams API121: Add KStream peek method	0. 10 11. 2 0.0
217	KIP-99: Add Global Tables to 120: Cleanup Kafka Streams builder API	1.0.10.2.0
218	KIP-98 - Exactly Once Delivery and Transactional Messaging119: Drop Support for Scala 2.10 in Kafka 0.11	0.11.0.0
219	KIP-97: Improved Kafka Client RPC Compatibility Policy118: Drop Support for Java 7	2.00.10.2.0
220	KIP-96 - Add per partition metrics for in-sync and assigned replica count117: Add a public AdminClient API for Kafka admin operations	0.1011.20.0
221	KIP-94 Session Windows115: Enforce offsets.topic.replication.factor upon __consumer_offsets auto topic creation	0.1011.20.0
222	KIP-93: Improve invalid timestamp handling in Kafka Streams114: KTable state stores and improved semantics	0.1011.20.0
223	KIP-92 - Add per partition lag metrics to KafkaConsumer113: Support replicas movement between log directories	1.1.0.10.2.0
224	KIP-91 Provide Intuitive User Timeouts in The Producer112: Handle disk failure for JBOD	1.02.1.0
225	KIP-	110: Add Codec for ZStandard Compression	2.1.	0
226	KIP-89: Allow sink connectors to decouple flush and offset commit109: Old Consumer Deprecation	0.1011.20.0
227	KIP-88: OffsetFetch Protocol Update108: Create Topic Policy	0.10.2.0
228	KIP-86: Configurable SASL callback handlers107: Add deleteRecordsBefore() API in AdminClient	0.112.0.0
229	KIP -85: Dynamic JAAS configuration for Kafka clients -106 - Change Default unclean.leader.election.enabled from True to False	0.1011.20.0
230	KIP-84: Support SASL SCRAM mechanisms105: Addition of Record Level for Sensors	0.10.2.0
231	KIP-82 - Add Record Headers104: Granular Sensors for Streams	0.1110.02.0
232	KIP-81: Bound Fetch memory usage in the consumer103: Separation of Internal and External traffic	0.10.2.02.4.0 (WIP)
233	KIP-79 - ListOffsetRequest/ListOffsetResponse v1 and add timestamp search methods to the new consumer102 - Add close with timeout for consumers	0.10.12.0
234	KIP-78: Cluster Id101 - Alter Replication Protocol to use Leader Epoch rather than High Watermark for Truncation	0.1011.10.0
235	KIP-77: Improve -100 - Relax Type constraints in Kafka Streams Join SemanticsAPI	0.10.2.0
236	KIP-75 - Add per-connector Converters99: Add Global Tables to Kafka Streams	0.10.12.0
237	KIP-74: Add Fetch Response Size Limit in Bytes98 - Exactly Once Delivery and Transactional Messaging	0.1011.10.0
238	KIP-73: Replication Quotas97: Improved Kafka Client RPC Compatibility Policy	0.10.12.0
239	KIP-72: Allow putting a bound on memory consumed by Incoming request -96 - Add per partition metrics for in-sync and assigned replica count	0.10.21.0.0
240	KIP-71: Enable log compaction and deletion to co-exist94 Session Windows	0.10.12.0
241	KIP-70: Revise Partition Assignment Semantics on New Consumer's Subscription Change93: Improve invalid timestamp handling in Kafka Streams	0.10.12.0
242	KIP-67: Queryable state for Kafka Streams-92 - Add per partition lag metrics to KafkaConsumer	0.10.12.0
243	KIP-66: Single Message Transforms for Kafka Connect91 Provide Intuitive User Timeouts in The Producer	2.1.0.10.2.0 / 0.11.0.0
244	KIP-65: Expose timestamps to Connect-90 - Remove zkClient dependency from Streams	0.10.12.0
245	KIP-63: Unify store and downstream caching in streams89: Allow sink connectors to decouple flush and offset commit	0.10.12.0
246	KIP-62: Allow consumer to send heartbeats from a background thread88: OffsetFetch Protocol Update	0.10.12.0
247	KIP-60 - Make Java client classloading more flexible86: Configurable SASL callback handlers	2.0.0.10.1.0
248	KIP-58 - Make Log Compaction Point Configurable85: Dynamic JAAS configuration for Kafka clients	0.10.12.0
249	KIP-57 - Interoperable LZ4 Framing84: Support SASL SCRAM mechanisms	0.10.02.0
250	KIP-56: Allow cross origin HTTP requests on all HTTP methods82 - Add Record Headers	0.1011.0.0
251	KIP-55: Secure Quotas for Authenticated Users81: Bound Fetch memory usage in the consumer	2.4.0 (WIP)0.10.1.0
252	KIP-54: Sticky Partition Assignment Strategy79 - ListOffsetRequest/ListOffsetResponse v1 and add timestamp search methods to the new consumer	0.1110.01.0
253	KIP-52: Connector Control APIs78: Cluster Id	0.10.01.0
254	KIP-51 - List Connectors REST API77: Improve Kafka Streams Join Semantics	0.10.02.0
255	KIP-75 - 50 - Move Authorizer to o.a.k.common packageAdd per-connector Converters	0.10.1.0
256	KIP-48 Delegation token support for Kafka74: Add Fetch Response Size Limit in Bytes	0.101.1.0
257	KIP-45 - Standardize all client sequence interaction on j.u.Collection.73: Replication Quotas	0.10.01.0
258	KIP-43: Kafka SASL enhancements72: Allow putting a bound on memory consumed by Incoming request	10.10.0.0
259	KIP-42: Add Producer and Consumer Interceptors71: Enable log compaction and deletion to co-exist	0.10.01.0
260	KIP-41: Consumer Max Records70: Revise Partition Assignment Semantics on New Consumer's Subscription Change	0.10.01.0
261	KIP-40: ListGroups and DescribeGroup67: Queryable state for Kafka Streams	0.910.01.0
262	KIP-38: ZooKeeper Authentication66: Single Message Transforms for Kafka Connect	0.9.10.2.0 / 0.11.0.0
263	KIP-36 - Rack aware replica assignment65: Expose timestamps to Connect	0.10.01.0
264	KIP-35 - Retrieving protocol version63: Unify store and downstream caching in streams	0.10.01.0
265	KIP-33 - Add a time based log index62: Allow consumer to send heartbeats from a background thread	0.10.1.0
266	KIP-32 - Add timestamps to Kafka message60 - Make Java client classloading more flexible	0.10.01.0
267	KIP-31 - Move to relative offsets in compressed message sets58 - Make Log Compaction Point Configurable	0.10.01.0
268	KIP-28 - Add a processor client57 - Interoperable LZ4 Framing	0.10.0.0
269	KIP-26 - Add Kafka Connect framework for data import/export56: Allow cross origin HTTP requests on all HTTP methods	0.910.0.0
270	KIP-25 - System test improvements55: Secure Quotas for Authenticated Users	0.910.01.0
271	KIP-22 - Expose a Partitioner interface in the new producer54: Sticky Partition Assignment Strategy	0.911.0.0
272	KIP-21 - Dynamic Configuration52: Connector Control APIs	0.910.0.0 (WIP)
273	KIP-20 Enable log preallocate to improve consume performance under windows and some old Linux file system-51 - List Connectors REST API	0.910.0.0
274	KIP-19 - Add a request timeout to NetworkClient48 Delegation token support for Kafka	1.10.9.0.0
275	KIP-16 - Automated Replica Lag Tuning45 - Standardize all client sequence interaction on j.u.Collection.	0.910.0.0
276	KIP-15 - Add a close method with a timeout in the producer43: Kafka SASL enhancements	0.910.0.0
277	KIP-13 - Quota Design42: Add Producer and Consumer Interceptors	0.910.0.0
278	KIP-12 - Kafka Sasl/Kerberos and SSL implementation41: Consumer Max Records	0.910.0.0
279	KIP-11 - Kafka Authorizer design40: ListGroups and DescribeGroup	0.9.0.0
280	KIP-8 - Add a flush method to the producer API38: ZooKeeper Authentication	0.9.0.0
281	KIP-4 - Metadata Protocol Changes36 - Rack aware replica assignment	0.10.0.0
282	KIP-4 - Command line and centralized administrative operations35 - Retrieving protocol version	0.910.0.0, 0
283	KIP-33 - Add a time based log index	0.10.1.0
284	KIP-32 - Add timestamps to Kafka message	0.10.0.0
285	KIP-31 - Move to relative offsets in compressed message sets	, 0.10.10.0
283286	KIP-3 - Mirror Maker Enhancement28 - Add a processor client	0.910.0.0
284287	KIP-2 - Refactor brokers to allow listening on multiple ports and IPs26 - Add Kafka Connect framework for data import/export	0.9.0.0
285288	KIP-1 - Remove support of request.required.acks25 - System test improvements	0.9.0.0

...

289	KIP-22 - Expose a Partitioner interface in the new producer	0.9.0.0
290	KIP-21 - Dynamic Configuration	0.9.0.0 (WIP)
291	KIP-20 Enable log preallocate to improve consume performance under windows and some old Linux file system	0.9.0.0
292	KIP-19 - Add a request timeout to NetworkClient	0.9.0.0
293	KIP-16 - Automated Replica Lag Tuning	0.9.0.0
294	KIP-15 - Add a close method with a timeout in the producer	0.9.0.0
295	KIP-13 - Quota Design	0.9.0.0
296	KIP-12 - Kafka Sasl/Kerberos and SSL implementation	0.9.0.0
297	KIP-11 - Kafka Authorizer design	0.9.0.0
298	KIP-8 - Add a flush method to the producer API	0.9.0.0
299	KIP-4 - Metadata Protocol Changes	0.10.0.0
300	KIP-4 - Command line and centralized administrative operations	0.9.0.0, 0.10.0.0, 0.10.1.0
301	KIP-3 - Mirror Maker Enhancement	0.9.0.0
302	KIP-2 - Refactor brokers to allow listening on multiple ports and IPs	0.9.0.0
303	KIP-1 - Remove support of request.required.acks	0.9.0.0

KIPs under discussion

Please insert new rows in sorted order (ascending by KIP number). Please move the adopted/accepted KIPs to the "Adopted KIPs" table above.

KIP	Comment
KIP-59: Proposal for a kafka broker command	Sent emails to Dev discussion group. Work tracked under KAFKA-3663.
KIP-125: ZookeeperConsumerConnector to KafkaConsumer Migration and Rollback
KIP-131 - Add access to OffsetStorageReader from SourceConnector
KIP-135 : Send of null key to a compacted topic should throw non-retriable error back to user
KIP 141 - ProducerRecord & SourceRecord: Add timestamp constructors
KIP-142: Add ListTopicsRequest to efficiently list all the topics in a cluster
KIP-148: Add a connect timeout for client
KIP-158: Kafka Connect should allow source connectors to set topic-specific settings for new topics
KIP-159: Introducing Rich functions to Streams
KIP-166 - Add a tool to make amounts of replicas and leaders on brokers balanced
KIP-169 - Lag-Aware Partition Assignment Strategy
KIP-178: Size-based log directory selection strategy
KIP-185: Make exactly once in order delivery the default producer setting
KIP-193: Add SchemaBuilder.from(Schema)
KIP-199: Add Kafka Connect offset tool
KIP-201: Rationalising Policy interfaces
KIP-209: C onnection String Support
KIP-216: IQ should throw different exceptions for different errors
KIP-217: Expose a timeout to allow an expired ZK session to be re-created
KIP-228 Negative record timestamp support	Voting in progress
KIP-234: add support for getting topic defaults from AdminClient
KIP-236: Interruptible Partition Reassignment	Discussion
KIP-240: AdminClient.listReassignments() AdminClient.describeReassignments()
KIP-242: Mask password in Kafka Connect Rest API response
KIP-250 Add Support for Quorum-based Producer Acknowledgment
KIP-252 - Extend ACLs to allow filtering based on ip ranges and subnets
KIP-253: Support in-order message delivery with partition expansion	Discussion
KIP-254: JsonConverter Exception Handeling
KIP-259: Improve Streams DSL Timestamp Propagation Semantics
KIP-260: add primary join operation for Stream-Stream join (WIP)	Draft
KIP-264: Add a consumer metric to record raw fetch size	Voting in progress
KIP-271: Add NetworkClient redirector	Discussion
KIP-273: Kafka to support using ETCD beside Zookeeper	Discussion
KIP-275 - Indicate "isClosing" in the SinkTaskContext	Voting in progress
KIP-280: Enhanced log compaction	Discussion
KIP-293 Add new metrics for consumer/replication fetch requests	Voting in progress
KIP-296: Add connector level configurability for producer/consumer client configs	Discussion
KIP-301: Schema Inferencing for JsonConverter	Discussion
KIP-304: Connect runtime mode improvements for container platforms	Discussion
KIP-309: Add toUpperCase support to sasl.kerberos.principal.to.local rule	Discussion
KIP-314: KTable to GlobalKTable Bi-directional Join	Discussion
KIP-315: Stream Join Sticky Assignor	Discussion
KIP-316: Command-line overrides for ConnectDistributed worker properties	Discussion
KIP-317: Add end-to-end data encryption functionality to Apache Kafka	Discussion
KIP-325: Extend Consumer Group Command to Show Beginning Offsets	Voting in Progress345
KIP-326: Schedulable KTable as Graph source	Discussion
KIP-333: Add faster mode of rebalancing	Discussion
KIP-334 - Include partitions in exceptions raised during consumer record deserialization/validation
KIP-335: Consider configurations for KafkaStreams	Discussion
KIP-347: Enable batching in FindCoordinatorRequest	Discussion
KIP-348 Eliminate null from SourceTask#poll()
KIP-350: Allow kafka-topics.sh to take brokerid as parameter to show partitions associated with it
KIP-356: Add KafkaConsumer fetch-error-rate and fetch-error-total metrics	Discussion
KIP-360: Improve handling of unknown producer	Discussion
K IP-362: Support Dynamic Session Window	Discussion
KIP-363: Allow performance tools to print final results to output file	Discussion
KIP-370: Remove Orphan Partitions	Discussion
KIP-373: Allow users to create delegation tokens for other users	Discussion
KIP-375: Kafka Clients - make Metadata#TOPIC_EXPIRY_MS configurable	Discussion
KIP-378: Enable Dependency Injection for Kafka Streams handlers	Discussion
KIP-381: Connect: Tell about records that had their offsets flushed in callback	Voting in progress (restarted 18th January 2019, due to no votes in first attempt)
KIP-383: Pluggable interface for SSL Factory	Voting in progress
KIP-384: Add config for incompatible changes to persistent metadata	Discussion
KIP-385: Avoid throwing away prefetched data	Discussion
KIP-387: Fair Message Consumption Across Partitions in KafkaConsumer	Discussion
KIP-388: Add observer interface to record request and response	Discussion
KIP-390: Allow fine-grained configuration for compression	Discussion, JIRA exists with pull-request
KIP-391: Allow Producing with Offsets for Cluster Replication	Discussion, JIRA exists with pull-request
KIP-392: Allow consumers to fetch from closest replica	Discussion
KIP-395: Encypt-then-MAC Delegation token metadata
KIP-397: Add methods to override fetch offsets based on timestamp	Discussion
KIP-398: Support reading trust store from classpath	Discussion
KIP-399: Extend ProductionExceptionHandler to cover serialization exceptions	Discussion
KIP-400: Improve exit status in case of errors in ConsoleProducer	Discussion
KIP-403: Increase ProducerPerformance precision by using nanoTime	Draft
KIP-405: Kafka Tiered Storage	Discussion
KIP-406: GlobalStreamThread should honor custom offset policy.	Discussion
KIP-407: Kafka Connect support override worker kafka api configuration with connector configuration that post by rest api
KIP-408: Add asynchronous processing to Kafka Streams	Discussion
KIP-409: Allow creating under-replicated topics and partitions
KIP-410: Add metric for request handler thread pool utilization by request type	Discussion
KIP-416: Notify SourceTask of ACK'd offsets, metadata	Discussion
KIP-418: A method-chaining way to branch KStream

Please insert new rows in sorted order (ascending by KIP number).

416: Notify SourceTask of ACK'd offsets, metadata

KIP	Comment
KIP-500: Replace ZooKeeper with a Self-Managed Metadata Quorum	KIP-499: Create a controller RPC for changing configurations
KIP-59: Proposal for a kafka broker command	Sent emails to Dev discussion group. Work tracked under KAFKA-3663.
KIP-125: ZookeeperConsumerConnector to KafkaConsumer Migration and Rollback	KIP-131 - Add access to OffsetStorageReader from SourceConnector	KIP-135 : Send of null key to a compacted topic should throw non-retriable error back to user	KIP 141 - ProducerRecord & SourceRecord: Add timestamp constructors	KIP-142: Add ListTopicsRequest to efficiently list all the topics in a cluster	KIP-148: Add a connect timeout for client	KIP-158: Kafka Connect should allow source connectors to set topic-specific settings for new topics	KIP-159: Introducing Rich functions to Streams	KIP-166 - Add a tool to make amounts of replicas and leaders on brokers balanced	KIP-169 - Lag-Aware Partition Assignment Strategy	KIP-178: Size-based log directory selection strategy	KIP-185: Make exactly once in order delivery the default producer setting	KIP-193: Add SchemaBuilder.from(Schema)	KIP-199: Add Kafka Connect offset tool	KIP-201: Rationalising Policy interfaces	KIP-209: C onnection String Support	KIP-216: IQ should throw different exceptions for different errors	KIP-217: Expose a timeout to allow an expired ZK session to be re-created
KIP-228 Negative record timestamp support	Voting in progress
KIP-234: add support for getting topic defaults from AdminClient
KIP-236: Interruptible Partition Reassignment	Discussion
KIP-240: AdminClient.listReassignments() AdminClient.describeReassignments()	KIP-242: Mask password in Kafka Connect Rest API response	KIP-250 Add Support for Quorum-based Producer Acknowledgment	KIP-252 - Extend ACLs to allow filtering based on ip ranges and subnets
KIP-253: Support in-order message delivery with partition expansion	Discussion
KIP-254: JsonConverter Exception Handeling	KIP-259: Improve Streams DSL Timestamp Propagation Semantics
KIP-260: add primary join operation for Stream-Stream join (WIP)	Draft
KIP-264: Add a consumer metric to record raw fetch size	Voting in progress
KIP-271: Add NetworkClient redirector	Discussion
KIP-273: Kafka to support using ETCD beside Zookeeper	Discussion
KIP-275 - Indicate "isClosing" in the SinkTaskContext	Voting in progress
KIP-280: Enhanced log compaction	Discussion
KIP-291: Separating controller connections and requests from the data plane	Accepted
KIP-293 Add new metrics for consumer/replication fetch requests	Voting in progress
KIP-296: Add connector level configurability for producer/consumer client configs	Discussion
KIP-301: Schema Inferencing for JsonConverter	Discussion
KIP-304: Connect runtime mode improvements for container platforms	Discussion
KIP-314: KTable to GlobalKTable Bi-directional Join	Discussion
KIP-315: Stream Join Sticky Assignor	Discussion
KIP-316: Command-line overrides for ConnectDistributed worker properties	Discussion
KIP-317: Add end-to-end data encryption functionality to Apache Kafka	Discussion
KIP-325: Extend Consumer Group Command to Show Beginning Offsets	Voting in Progress345
KIP-326: Schedulable KTable as Graph source	Discussion
KIP-333: Add faster mode of rebalancing	Discussion
KIP-334 - Include partitions in exceptions raised during consumer record deserialization/validation
KIP-335: Consider configurations for KafkaStreams	Discussion
KIP-347: Enable batching in FindCoordinatorRequest	Discussion
KIP-348 Eliminate null from SourceTask#poll()	KIP-350: Allow kafka-topics.sh to take brokerid as parameter to show partitions associated with it
KIP-356: Add KafkaConsumer fetch-error-rate and fetch-error-total metrics	Discussion
KIP-360: Improve handling of unknown producer	Discussion
K IP-362: Support Dynamic Session Window	Discussion
KIP-363: Allow performance tools to print final results to output file	Discussion
KIP-369: Alternative Partitioner to Support "Always Round-Robin" Selection	Accepted
KIP-370: Remove Orphan Partitions	Discussion
KIP-373: Allow users to create delegation tokens for other users	Discussion
KIP-375: Kafka Clients - make Metadata#TOPIC_EXPIRY_MS configurable	Discussion
KIP-378: Enable Dependency Injection for Kafka Streams handlers	Discussion
KIP-379: Multiple Consumer Group Management	Accepted
KIP-381: Connect: Tell about records that had their offsets flushed in callback	Voting in progress (restarted 18th January 2019, due to no votes in first attempt)
KIP-383: Pluggable interface for SSL Factory	Voting in progress
KIP-384: Add config for incompatible changes to persistent metadata	Discussion
KIP-385: Avoid throwing away prefetched data	Discussion
KIP-387: Fair Message Consumption Across Partitions in KafkaConsumer	Discussion
KIP-388: Add observer interface to record request and response	Discussion
KIP-389: Introduce a configurable consumer group size limit	Accepted
KIP-390: Allow fine-grained configuration for compression	Discussion, JIRA exists with pull-request
KIP-419: Safely notify Kafka Connect SourceTask is stopped	Voting in progress, JIRA exists with pull request
KIP-422: Add support for client quota configuration in the Kafka Admin Client391: Allow Producing with Offsets for Cluster Replication	Discussion, JIRA exists with pull-request
KIP-392423: Allow consumers to fetch from closest replicaAdd JoinReason to Consumer Join Group Protocol	Discussion
KIP-395: Encypt-then-MAC Delegation token metadata	KIP-396: Add Commit/List Offsets Operations to AdminClient	424: Allow suppression of intermediate events based on wall clock time	Discussion
KIP-397: Add methods to override fetch offsets based on timestamp426: Persist Broker Id to Zookeeper	Discussion
KIP-398431: Support reading trust store from classpath	Discussion
KIP-399: Extend ProductionExceptionHandler to cover serialization exceptions	Discussion
of printing additional ConsumerRecord fields in DefaultMessageFormatter	Voting in progress, JIRA exists with pull-request
KIP-434: Add Replica Fetcher and Log Cleaner Count Metrics KIP-400: Improve exit status in case of errors in ConsoleProducer	Discussion
KIP-401: TransformerSupplier/ProcessorSupplier StateStore connecting435: Internal Partition Reassignment Batching	DiscussionVoting in progress
KIP-403: Increase ProducerPerformance precision by using nanoTime437: Custom replacement for MaskField SMT	Voting in progress, JIRA exists with pull-requestDraft
KIP-405: Kafka Tiered Storage438: Expose task, connector IDs in Connect API	Discussion
KIP-406: GlobalStreamThread should honor custom offset policy.439: Cleanup built-in Store interfaces	Discussion
KIP-407441: Kafka Connect support override worker kafka api configuration with connector configuration that post by rest apiSmooth Scaling Out for Kafka Streams	Discussion
KIP-408: Add asynchronous processing to 444: Augment metrics for Kafka Streams	DiscussionKIP-409: Allow creating under-replicated topics and partitions
KIP-410447: Add metric for request handler thread pool utilization by request typeProducer scalability for exactly once semantics	Discussion
KIP-	448: Add State Stores Unit Test Support to Kafka Streams Test Utils	Discussion
KIP-450: Sliding Window Aggregations in the DSL	Discussion
KIP-452: Tool to view cluster status418: A method-chaining way to branch KStream	Discussion, JIRA exists with pull-request
KIP-419: Safely notify Kafka Connect SourceTask is stopped457: Add DISCONNECTED status to Kafka Streams	Discussion Voting in progress, JIRA exists with pull request
KIP-421: Support resolving externalized secrets in AbstractConfig 459: Improve KafkaStreams#close	DiscussionAccepted
KIP-422: Add support for client quota configuration in the Kafka Admin Client	Discussion, JIRA exists with pull-request
KIP-423: Add JoinReason to Consumer Join Group Protocol	Discussion
KIP-424: Allow suppression of intermediate events based on wall clock time	Discussion
KIP-426: Persist Broker Id to Zookeeper	Discussion
KIP-431: Support of printing additional ConsumerRecord fields in DefaultMessageFormatter	Voting in progress, JIRA exists with pull-request
KIP-434: Add Replica Fetcher and Log Cleaner Count Metrics	Discussion
KIP-435: Internal Partition Reassignment Batching	Discussion
KIP-437: Custom replacement for MaskField SMT	Voting in progress, JIRA exists with pull-request
KIP-438: Expose task, connector IDs in Connect API	Discussion
KIP-439: Cleanup built-in Store interfaces	Discussion
KIP-440: Extend Connect Converter to support headers	Voting in progress
KIP-441: Smooth Scaling Out for Kafka Streams	Discussion
KIP-444: Augment metrics for Kafka Streams	Discussion
KIP-448: Add State Stores Unit Test Support to Kafka Streams Test Utils	Discussion
KIP-450: Sliding Window Aggregations in the DSL	Discussion
KIP-452: Tool to view cluster status	Discussion, JIRA exists
KIP-457: Add DISCONNECTED status to Kafka Streams	Discussion
KIP-459: Improve KafkaStreams#close	Discussion
KIP-463: Auto-configure non-default Serdes passed alongside the TopologyBuilder	Under discussion
KIP-466: Add support for List<T> serialization and deserialization	Voting in progress
KIP-468: Avoid decompression of record when validate record at server in the scene of inPlaceAssignment .	Under discussion
KIP-470: TopologyTestDriver test input and output usability improvements	Under discussion
KIP-471: Expose RocksDB Metrics in Kafka Streams	Accepted
KIP-473: Enable KafkaLog4JAppender to use SASL Authentication Callback Handlers	Under Discussion
KIP-474: To deprecate WindowStore#put(key, value)	Accepted
KIP-475: New Metrics to Measure Number of Tasks on a Connector	Accepted
KIP-477: Add PATCH method for connector config in Connect REST API	Under Discussion
KIP-478 - Strongly typed Processor API	Under Discussion
KIP-479: Add Materialized to Join	Under Discussion
KIP-480: Sticky Partitioner	Accepted
KIP-481: SerDe Improvements for Connect Decimal type in JSON	Under Discussion
KIP-482: Optional fields in the Kafka Protocol
463: Auto-configure non-default Serdes passed alongside the TopologyBuilder	Under discussion
KIP-466: Add support for List<T> serialization and deserialization	Voting in progress
KIP-468: Avoid decompression of record when validate record at server in the scene of inPlaceAssignment .	Under discussion
KIP-470: TopologyTestDriver test input and output usability improvements	Under discussion
KIP-473: Enable KafkaLog4JAppender to use SASL Authentication Callback Handlers	Under Discussion
KIP-477: Add PATCH method for connector config in Connect REST API	Under Discussion
KIP-478 - Strongly typed Processor API	Under Discussion
KIP-481: SerDe Improvements for Connect Decimal type in JSON	Under Discussion
KIP-486: Support custom way to load KeyStore and TrustStore	Under Discussion
KIP-487: Automatic Topic Creation on Producer	Under Discussion
KIP-489: Kafka Consumer Record Latency Metric	Under Discussion
KIP-490: New metric to count offsets expired without being consumed by a consumer group	Under discussion
KIP-491: Preferred Leader Deprioritized List (Temporary Blacklist)	Under discussion
KIP-494: Connect REST Endpoint to get Transformations (SMTs)
KIP-495: Dynamically Adjust Log Levels in Connect	Sent mail to dev discussion group.
KIP-498: Add client-side configuration for maximum response size to protect against OOM	Sent emails to Dev discussion group. Work tracked under KAFKA-4090.
KIP-499 - Unify connection name flag for command line tool	Under discussion
KIP-499: Create a controller RPC for changing configurations
KIP-500: Replace ZooKeeper with a Self-Managed Metadata Quorum
KIP-502: Connect SinkTask.put(...) to specify ArrayList<SinkRecord> in Signature
KIP-505: Add new public method to only update assignment metadata in consumer	Under discussion
KIP-506: Allow setting SCRAM password via Admin interface	Under discussion
KIP-507: Securing Internal Connect REST Endpoints	Under discussion
KIP-508: Make Suppression State Queriable	Under discussion
KIP-509: Rebalance and restart Producers	Under discussion
KIP-510: Metrics library upgrade	Under discussion
KIP-511: Collect and Expose Client's Name and Version in the Brokers
KIP-512: Adding headers to RecordMetaData	Sent mail to dev discussion group
KIP-513: Distinguish between Key and Value serdes in scala wrapper library for kafka streams
KIP-514:Add a bounded flush() API to Kafka Producer
KIP-515: Reorganize checkpoint system in log cleaner to per partition
KIP-516: Topic Identifiers & Topic Deletion State Improvements	Under discussion
KIP-517: Add consumer metric indicating time between poll calls	Under discussion
KIP-518: Allow listing consumer groups per state	Under discussion
KIP-519: Make SSL context/engine configuration extensible	Under discussion
KIP-521: Enable redirection of Connect's log4j messages to a file by default	Under discussion
KIP-522: Update BrokerApiVersionsCommand to use AdminClient	Draft
KIP-523: Add KStream#toTable to the Streams DSL	Under discussion
KIP-525 - Return topic metadata and configs in CreateTopics response
KIP-487: Automatic Topic Creation on Producer	Under Discussion
KIP-489: Kafka Consumer Record Latency Metric	Under Discussion
KIP-490: New metric to count offsets expired without being consumed by a consumer group	Under discussion
KIP-491: Preferred Leader Deprioritized List (Temporary Blacklist)	Under discussion
KIP-498: Add client-side configuration for maximum response size to protect against OOM	Sent emails to Dev discussion group. Work tracked under KAFKA-4090.
KIP-499 - Unify connection name flag for command line tool	Under discussion

Dormant/inactive KIPs

...

KIP	Comment
KIP-6 - New reassignment partition logic for rebalancing	Needs more detail
KIP-10 - Running Producer, Consumers and Brokers on Mesos
KIP-14 - Tools standardization
KIP-17 - Add HighwaterMarkOffset to OffsetFetchResponse
KIP-23 - Add JSON/CSV output and looping options to ConsumerGroupCommand
KIP-27 - Conditional Publish
KIP-30 - Allow for brokers to have plug-able consensus and meta data storage sub systems
KIP-37 - Add Namespaces to Kafka
KIP-39: Pinning controller to broker
KIP-44 - Allow Kafka to have a customized security protocol
KIP-46 - Self Healing
KIP-47 - Add timestamp-based log deletion policy
KIP-49 - Fair Partition Assignment Strategy
KIP-53 - Add custom policies for reconnect attempts to NetworkdClient
KIP-59: Proposal for a kafka broker command
KIP-64 -Allow underlying distributed filesystem to take over replication depending on configuration
KIP-68 Add a consumed log retention before log retention
KIP-69 - Kafka Schema Registry	Draft
KIP-76 Enable getting password from executable rather than passing as plaintext in config files
KIP-87 - Add Compaction Tombstone Flag	Possibly displaced by KIP-82
KIP-95: Incremental Batch Processing for Kafka Streams
KIP-269: Substitution Within Configuration Values
KIP-349: Priorities for Source Topics	Functionality can be realized with existing API although at a lower level.
KIP-399: Extend ProductionExceptionHandler to cover serialization exceptions