Page History

...

KIP round-up

Next KIP Number: 477526

Use this number as the identifier for your KIP and increment this value.

...

Please insert new rows in sorted order (descending by KIP number).

345: Introduce static membership protocol to reduce consumer rebalancesKIP-429: Kafka Consumer Incremental Rebalance Protocol460: Admin Leader Election RPC454: Expansion of the ConnectClusterState interface3446: Add changelog topic configuration to KTable suppress445: In-memory Session Store3428: Add in-memory window store425: Add some Log4J Kafka Appender Properties for Producing to Secured Brokers420: Add Single Value Fetch in Session Stores2417: Allow JmxTool to connect to a secured RMI port412: Extend Admin API to support dvynamic application log levels4 (WIP)411 Make default Kafka Connect worker task client IDs distinct34380: Detect outdated control requests and bounced brokers using broker generation235377: TopicCommand to use AdminClient238372: Naming Repartition Topics for Joins and Grouping12.1365: Materialized, Serialized, Joined, Consumed and Produced with implicit Serde1KIP361: Add Consumer Configuration to Disable Auto Topic Creation357 support to list ACLs per principal1351: Add --under-min-isr option to describe topics command3341: Update Sticky Assignor's User Data Protocol3332: Update AclCommand to use AdminClient API331 Add default implementation to close() and configure() for Serializer, Deserializer and Serde3330: Add retentionPeriod in SessionBytesStoreSupplier1-328: Ability to suppress updates for KTables1.0 (partially implemented) / .3 (WIP)305: Add Connect primitive number converters0276 - Add StreamsConfig prefix for different consumers0274: Kafka Streams Skipped Records Metrics270 - A Scala Wrapper Library for Kafka Streams0268: Simplify Kafka Streams Rebalance Metadata Upgrade0267: Add Processor Unit Test Support to Kafka Streams Test Utils0266: Fix consumer indefinite blocking behavior265: Make Windowed Serde to public APIs-261: Add Single Value Fetch in Window Stores0257 - Configurable Quota Management251: Allow timestamp manipulation in Processor API-249: Add Delegation Token Operations to KafkaAdminClient245: Use Properties instead of StreamsConfig in KafkaStreams constructor243: Make ProducerConfig and ConsumerConfig constructors public1.1238: Expose Kafka cluster ID in Connect REST API1.1237: More Controller Health Metrics233: Simplify StreamsBuilder#addGlobalStore1.1231: Improve the Required ACL of ListGroups API1-229: DeleteGroups API1.1227 - Introduce Incremental FetchRequests to Increase Partition Scalability1.1224 configuration parameter `retries` to Streams API1.1223 - Add per-topic min lead and per-partition lead metrics to KafkaConsumer219 - Improve quota communication214: Add zookeeper.max.in.flight.requests config to the broker1.1.0213 Support non-key joining in KTable4 (WIP)212: Enforce set of legal characters for connector names1.1198: Remove ZK dependency from Streams Reset Tool.0196: Add metrics to Kafka Connect framework1.0176: Remove deprecated new-consumer option for tools155174 - Deprecate and remove internal converter configs in WorkerConfig0164 - Add UnderMinIsrPartitionCount and per-partition UnderMinIsr metrics.0163: Lower the Minimum Required ACL Permission of OffsetFetch0157 - Add consumer config options to streams reset tool156 Add option "dry run" to Streams application reset tool0.11155 - Add range scan for windowed state stores0.11137: Enhance TopicCommand --describe to show topics marked for deletion0.11.-130: Expose states of active tasks to KafkaStreams public API0124 - Request rate quotas0.11.-120: Cleanup Kafka Streams builder API119: Drop Support for Scala 2.10 in Kafka 0.11-118: Drop Support for Java 72110: Add Codec for ZStandard Compression2.1.099: Add Global Tables to Kafka Streams0.10.279 - ListOffsetRequest/ListOffsetResponse v1 and add timestamp search methods to the new consumer0.10.

	KIP (please keep this sorted by KIP number)	Release
1	KIP-	500: Replace ZooKeeper with a Self-Managed Metadata Quorum
2	KIP-482: The Kafka Protocol should Support Optional Tagged Fields	2.4.0 (WIP), partially available in 2.3.0	2		2.4.0 (WIP)
3	KIP-504 - 354: Add a Maximum Log Compaction LagAdd new Java Authorizer Interface	2.34.0 (WIP)
4	KIP-465: Add Consolidated Connector Endpoint to Connect REST API503: Add metric for number of topics marked for deletion	2.34.0 (WIP)
5	KIP-464: Defaults for AdminClient#createTopic497: Add inter-broker API to alter ISR	2.4.0 (WIP)
6	KIP-462: Use local thread id for KStreams496: Administrative API to delete consumer offsets	2.34.0 (WIP)
7	KIP-461: Improve Replica Fetcher behavior at handling partition failure488: Clean up Sum,Count,Total Metrics	2.34.0
8	KIP-	484: Expose metrics for group and transaction metadata loading duration	2.4.0 (WIP)
9	KIP-458: Connector Client Config Override Policy480: Sticky Partitioner	2.34.0
10	KIP-	479: Add Materialized to Join	2.	4.0(WIP)
11	KIP-453476: Add close() method to RocksDBConfigSetterJava AdminClient Interface	2.34.0
12	KIP-449: Add connector contexts to log messages in Connect workers 475: New Metrics to Measure Number of Tasks on a Connector	2.34.0 (WIP)
13	KIP-	474: To deprecate WindowStore#put(key, value)	2.4.0 (WIP)
14	KIP-	471: Expose RocksDB Metrics in Kafka Streams	2.	4.0 (WIP)
15	KIP-443: Return to default segment.ms and segment.index.bytes in Streams repartition topics467: Augment ProduceResponse error messaging for specific culprit records	2.34.0 (WIP)
16	KIP-442: Return to default max poll interval in Streams465: Add Consolidated Connector Endpoint to Connect REST API	2.3.0
17	KIP-436: Add a metric indicating start time464: Defaults for AdminClient#createTopic	2.34.0
18	KIP-430 - Return Authorized Operations in Describe Responses462: Use local thread id for KStreams	2.3.0
19	KIP-	461: Improve Replica Fetcher behavior at handling partition failure	2.3.0
20	KIP-427: Add AtMinIsr topic partition category (new metric & TopicCommand option)460: Admin Leader Election RPC	2.34.0
21	KIP-	458: Connector Client Config Override Policy	2.3.0
22	KIP-421: Support resolving externalized secrets in AbstractConfig 455: Create an Administrative API for Replica Reassignment	2.34.0 (WIP)
23	KIP-	454: Expansion of the ConnectClusterState interface	2.	3.0
24	KIP-	453: Add close() method to RocksDBConfigSetter	2.3.0
25	KIP-415: Incremental Cooperative Rebalancing in Kafka Connect449: Add connector contexts to log messages in Connect workers	2.3.0
26	KIP-414: Expose Embedded ClientIds in Kafka Streams446: Add changelog topic configuration to KTable suppress	2.24.0 (WIP)
27	KIP-	445: In-memory Session Store	2.	3.0
28	KIP-	443:	Return to default segment.ms and segment.index.bytes in Streams repartition topics	2.3.0
29	KIP-402: Improve fairness in SocketServer processors442: Return to default max poll interval in Streams	2.2.0 (partially implemented) / 2.3.0
30	KIP-394: Require member.id for initial join group request440: Extend Connect Converter to support headers	2.24.0 (WIP)
31	KIP-393: Time windowed serde to properly deserialize changelog input topic436: Add a metric indicating start time	2.23.0
32	KIP-386: Standardize on Min/Avg/Max metrics' default value434: Add Replica Fetcher and Log Cleaner Count Metrics	2.24.0 (WIP)
33	KIP-430 - Return Authorized Operations in Describe Responses	2.3.0
34	KIP-429: Kafka Consumer Incremental Rebalance Protocol-382: MirrorMaker 2.0	2.4.0 (WIP)
35	KIP-	428: Add in-memory window store	2.	3.0
36	KIP-	427: Add AtMinIsr topic partition category (new metric & TopicCommand option)	2.	3.0
3637	KIP-376: Implement AutoClosable on appropriate classes that want to be used in a try-with-resource statement425: Add some Log4J Kafka Appender Properties for Producing to Secured Brokers	2.23.0
3738	KIP-374: Add '--help' option to all available Kafka CLI commands421: Support resolving externalized secrets in AbstractConfig	2.23.0
39	KIP-	420: Add Single Value Fetch in Session Stores	2.	2.0
3940	KIP-371: Add a configuration to build custom SSL principal name417: Allow JmxTool to connect to a secured RMI port	2.23.0
4041	KIP 368: Allow SASL Connections to Periodically Re-Authenticate-415: Incremental Cooperative Rebalancing in Kafka Connect	2.23.0
4142	KIP-367 Introduce close(Duration) to Producer and AdminClient instead of close(long, TimeUnit)	2.2.0	42	KIP-366: Make FunctionConversions deprecated	414: Expose Embedded ClientIds in Kafka Streams	2.2	.0
43	KIP-	412: Extend Admin API to support dynamic application log levels	2.	4.0 (WIP)
44	KIP-	411: Make default Kafka Connect worker task client IDs distinct	2.3.0
45	KIP-359: Verify leader epoch in produce requests402: Improve fairness in SocketServer processors	2.42.0 (WIP)partially implemented) / 2.3.0
46	KIP-358: Migrate Streams API to Duration instead of long ms times401: TransformerSupplier/ProcessorSupplier StateStore connecting	2.14.0 (WIP)
47	KIP-	396: Add	Commit/List Offsets Operations to AdminClient	2.	4.0 (WIP)
48	KIP-356: Add withCachingDisabled() to StoreBuilder394: Require member.id for initial join group request	2.12.0
49	KIP-353: Improve Kafka Streams Timestamp Synchronization393: Time windowed serde to properly deserialize changelog input topic	2.12.0
50	KIP-	389: Introduce a configurable consumer group size limit	2.	2.0
51	KIP-346386: Improve LogCleaner behavior on errorStandardize on Min/Avg/Max metrics' default value	2.12.0
52	KIP-342 Add support for custom SASL extensions in OAuthBearer authentication382: MirrorMaker 2.0	2.14.0
53	KIP-	379: Multiple Consumer Group Management	2.	4.0 (WIP)
54	KIP-340: Allow kafka-reassign-partitions.sh and kafka-log-dirs.sh to take admin client property file380: Detect outdated control requests and bounced brokers using broker generation	2.22.1.0
55	KIP-339: Create a new IncrementalAlterConfigs API377: TopicCommand to use AdminClient	2.32.0 0
56	KIP-338 Support to exclude the internal topics in kafka-topics.sh command376: Implement AutoClosable on appropriate classes that want to be used in a try-with-resource statement	2.12.0
57	KIP-336: Consolidate ExtendedSerializer/Serializer and ExtendedDeserializer/Deserializer374: Add '--help' option to all available Kafka CLI commands	2.12.0
58	KIP-	372: Naming Repartition Topics for Joins and Grouping	2.1.0
59	KIP-	371: Add a configuration to build custom SSL principal name	2.	2.0
60	KIP-	369: Alternative Partitioner to Support "Always Round-Robin" Selection	2.	4.0
61	KIP	368: Allow SASL Connections to Periodically Re-Authenticate	2.	2	.0
62	KIP-324: Add method to get metrics() in AdminClient367 Introduce close(Duration) to Producer and AdminClient instead of close(long, TimeUnit)	2.12.0
63	KIP-322: Return new error code for DeleteTopics API when topic deletion disabled.366: Make FunctionConversions deprecated	2.1.0
64	KIP-321: Update TopologyDescription to better represent Source and Sink Nodes365: Materialized, Serialized, Joined, Consumed and Produced with implicit Serde	2.1.0
65	KIPK IP-320: Allow fetchers to detect and handle log truncation361: Add Consumer Configuration to Disable Auto Topic Creation	2.32.1.0 (partially implemented) / 2.2.0
66	KIP-319: Replace segments with segmentInterval in WindowBytesStoreSupplier360: Improve handling of unknown producer	2.14.0 (WIP)
67	KIP-313: Add KStream.flatTransform and KStream.flatTransformValues 359: Verify leader epoch in produce requests	2.24.0 (partially implemented)/ 2.3.0WIP)
68	KIP-312 Add Overloaded StreamsBuilder Build Method to Accept java.util.Properties358: Migrate Streams API to Duration instead of long ms times	2.1.0
69	KIP-308: Support dynamic update of max.connections.per.ip/max.connections.per.ip.overrides357: Add support to list ACLs per principal	2.1.0
70	KIP-307: Allow to define custom processor names with KStreams DSL356: Add withCachingDisabled() to StoreBuilder	2.31.0 (partial)
71	KIP-306: Configuration for Delaying Response to Failed Authentication354: Add a Maximum Log Compaction Lag	2.13.0
72	KIP-	353: Improve Kafka Streams Timestamp Synchronization	2.	1.0
73	KIP-303: Add Dynamic Routing in Streams Sink352: Distinguish URPs caused by reassignment	2.04.0 (WIP)
74	KIP-302 - Enable Kafka clients to use all DNS resolved IP addresses-351: Add --under-min-isr option to describe topics command	2.13.0
75	KIP-300: Add Windowed KTable API in StreamsBuilder346: Improve LogCleaner behavior on error	2.4.01
76	KIP-298: Error Handling in Connect345: Introduce static membership protocol to reduce consumer rebalances	2.4.0 (WIP), partially available in 2.3.0
77	KIP-297: Externalizing Secrets for Connect Configurations342 Add support for custom SASL extensions in OAuthBearer authentication	2.01.0
78	KIP-295 Add Streams Configuration Allowing for Optional Topology Optimization341: Update Sticky Assignor's User Data Protocol	2.03.0
79	KIP-294 - Enable TLS hostname verification by default-340: Allow kafka-reassign-partitions.sh and kafka-log-dirs.sh to take admin client property file	2.01.0
80	KIP-292: Add transformValues() method to KTable339: Create a new IncrementalAlterConfigs API	2.03.00
81	KIP-290: Support for Prefixed ACLs338 Support to exclude the internal topics in kafka-topics.sh command	2.01.0
82	KIP-289: Improve the default group id behavior in KafkaConsumer336: Consolidate ExtendedSerializer/Serializer and ExtendedDeserializer/Deserializer	2.21.0
83	KIP-285: Connect Rest Extension Plugin332: Update AclCommand to use AdminClient API	2.01.0
84	KIP-284: Set default retention ms for Streams repartition topics to Long.MAX_VALUE331 Add default implementation to close() and configure() for Serializer, Deserializer and Serde	2.03.0
85	KIP-283: Efficient Memory Usage for Down-Conversion330: Add retentionPeriod in SessionBytesStoreSupplier	2.01.0
86	KIP-282: Add the listener name to the authentication context328: Ability to suppress updates for KTables	2.1.0 (partially implemented) / 2.3.0 (WIP)2.0.0
87	KIP-281: ConsumerPerformance: Increase Polling Loop Timeout and Make It Reachable by the End User324: Add method to get metrics() in AdminClient	2.01.0
88	KIP-279: Fix log divergence between leader and follower after fast leader fail over322: Return new error code for DeleteTopics API when topic deletion disabled.	2.01.0
89	KIP-278 - Add version option to Kafka's commands321: Update TopologyDescription to better represent Source and Sink Nodes	2.01.0
90	KIP-277 - Fine Grained ACL for CreateTopics API320: Allow fetchers to detect and handle log truncation	2.1.0 (partially implemented) / 2.2.2.0.0
91	KIP-	319: Replace segments with segmentInterval in WindowBytesStoreSupplier	2.	1.0
92	KIP-	313: Add KStream.flatTransform and KStream.flatTransformValues	2.2.0 (partially implemented) / 2.3.0
93	KIP-272: Add API version tag to broker's RequestsPerSec metric312 Add Overloaded StreamsBuilder Build Method to Accept java.util.Properties	2.01.0
94	KIP-	308: Support dynamic update of max.connections.per.ip/max.connections.per.ip.overrides	2.	1.0
95	KIP-	307: Allow to define custom processor names with KStreams DSL	2.	3.0 (partial)
96	KIP-	306: Configuration for Delaying Response to Failed Authentication	2.	1.0
97	KIP-	305: Add Connect primitive number converters	2.0.0
98	KIP-	303: Add Dynamic Routing in Streams Sink	2.0.0
99	KIP	-302 - Enable Kafka clients to use all DNS resolved IP addresses	2.	1.0
100	KIP-258: Allow to Store Record Timestamps in RocksDB300: Add Windowed KTable API in StreamsBuilder	2.34.0 (partially implemented)
101	KIP-	298: Error Handling in Connect	2.0.0
102	KIP-255: OAuth Authentication via SASL/OAUTHBEARER297: Externalizing Secrets for Connect Configurations	2.0.0
103	KIP-	295 Add Streams Configuration Allowing for Optional Topology Optimization	2.0.0
104	KIP	-294 - Enable TLS hostname verification by default	2.0.0
105	KIP- 247: Add public test utils for Kafka Streams 291: Separating controller connections and requests from the data plane	Accepted1.1.0
106	KIP-	292: Add transformValues() method to KTable	2.0.0
107	KIP-244: Add Record Header support to Kafka Streams Processor API290: Support for Prefixed ACLs	2.0.0
108	KIP-	289: Improve the default group id behavior in KafkaConsumer	2.2	.0
109	KIP-239 Add queryableStoreName() to GlobalKTable285: Connect Rest Extension Plugin	2.01.1.0
110	KIP-	284: Set default retention ms for Streams repartition topics to Long.MAX_VALUE	2.0	.0
111	KIP-	283: Efficient Memory Usage for Down-Conversion	2.0.0
112	KIP-235282: Add DNS alias support for secured connectionthe listener name to the authentication context	2.10.0
113	KIP-	281: ConsumerPerformance: Increase Polling Loop Timeout and Make It Reachable by the End User	2.0	.0
114	KIP-	279: Fix log divergence between leader and follower after fast leader fail over	2.	0.0
115	KIP	-278 - Add version option to Kafka's commands	2.0	.0
116	KIP-	277 - Fine Grained ACL for CreateTopics API	2.0	.0
117	KIP-226 - Dynamic Broker Configuration276 - Add StreamsConfig prefix for different consumers	2.01.1.0
118	KIP-225 - Use tags for consumer “records.lag” metrics274: Kafka Streams Skipped Records Metrics	2.01.1.0
119	KIP-	272: Add	API version tag to broker's RequestsPerSec metric	2.0	.0
120	KIP-	270 - A Scala Wrapper Library for Kafka Streams	2.0.0
121	KIP-222 - Add Consumer Group operations to Admin API268: Simplify Kafka Streams Rebalance Metadata Upgrade	2.0.0
122	KIP-220267: Add AdminClient into Processor Unit Test Support to Kafka Streams ' ClientSupplierTest Utils	12.10.0
123	KIP-	266: Fix consumer indefinite blocking behavior	2.0.0
124	KIP-218265: Make KafkaFuture.Function java 8 lambda compatibleWindowed Serde to public APIs	2.01.1.0
125	KIP-215261: Add topic regex support for Connect sinksSingle Value Fetch in Window Stores	2.01.1.0
126	KIP-	258: Allow to Store Record Timestamps in RocksDB	2.3.0 (partially implemented)
127	KIP-	257 - Configurable Quota Management	2.	0.0
128	KIP-	255: OAuth Authentication via SASL/OAUTHBEARER	2.0	.0
129	KIP-211: Revise Expiration Semantics of Consumer Group Offsets251: Allow timestamp manipulation in Processor API	2.10.0
130	KIP-210 - Provide for custom error handling when Kafka Streams fails to produce249: Add Delegation Token Operations to KafkaAdminClient	2.01.1.0
131	KIP-208247: Add SSL support to Kafka Connect REST interfacepublic test utils for Kafka Streams	1.1.0
132	KIP-207: Offsets returned by ListOffsetsResponse should be monotonically increasing even during a partition leader change245: Use Properties instead of StreamsConfig in KafkaStreams constructor	2.20.0
133	KIP-206244: Add support for UUID serialization and deserializationRecord Header support to Kafka Streams Processor API	2.10.0
134	KIP-205: Add all() and range() API to ReadOnlyWindowStore243: Make ProducerConfig and ConsumerConfig constructors public	1.1.0
135	KIP-204 : Adding records deletion operation to the new Admin Client API239 Add queryableStoreName() to GlobalKTable	1.1.0
136	KIP-203: Add toLowerCase support to sasl.kerberos.principal.to.local rule 238: Expose Kafka cluster ID in Connect REST API	1.1.0
137	KIP-202: Move merge() from StreamsBuilder to KStream237: More Controller Health Metrics	21.0.0
138	KIP-	235: Add DNS alias support for secured connection	2.	1.0
139	KIP-197 Connect REST API should include the connector type when describing a connector233: Simplify StreamsBuilder#addGlobalStore	1.01.0
140	KIP-	231: Improve the Required ACL of ListGroups API	2.1	.0
141	KIP-195: AdminClient.createPartitions229: DeleteGroups API	1.01.0
142	KIP-192 : Provide cleaner semantics when idempotence is enabled-227 - Introduce Incremental FetchRequests to Increase Partition Scalability	1.01.0
143	KIP-191: KafkaConsumer.subscribe() overload that takes just Pattern226 - Dynamic Broker Configuration	1.01.0
144	KIP-190: Handle client-ids consistently between clients and brokers225 - Use tags for consumer “records.lag” metrics	1.01.0
145	KIP-189: Improve principal builder interface and add support for SASL224: Add configuration parameter `retries` to Streams API	1.01.0
146	KIP-188 223 - Add new per-topic min lead and per-partition lead metrics to support health checksKafkaConsumer	12.0.0
147	KIP-187 222 - Add cumulative count metric for all Kafka rate metricsConsumer Group operations to Admin API	21.0.0
148	KIP-186: Increase offsets retention default to 7 days221: Enhance DSL with Connecting Topic Creation and Repartition Hint	2.04.0 (WIP)
149	KIP-183 - Change PreferredReplicaLeaderElectionCommand to use AdminClient220: Add AdminClient into Kafka Streams' ClientSupplier	1.12.2.0
150	KIP-182: Reduce Streams DSL overloads and allow easier use of custom storage engines-219 - Improve quota communication	21.0.0
151	KIP-180: Add a broker metric specifying the number of consumer group rebalances in progress218: Make KafkaFuture.Function java 8 lambda compatible	1.1.0
152	KIP-177: Consumer perf tool should count rebalance time215: Add topic regex support for Connect sinks	1.01.0
153	KIP-	2.0.0	154	KIP-175: Additional '--describe' views for ConsumerGroupCommand 214: Add zookeeper.max.in.flight.requests config to the broker	1.1.0
154	KIP-	213 Support non-key joining in KTable	2.	4.0 (WIP)
156155	KIP-173: Add prefix to StreamsConfig to enable setting default internal topic configs212: Enforce set of legal characters for connector names	1.01.0
157156	KIP-171 - Extend Consumer Group Reset Offset for Stream Application211: Revise Expiration Semantics of Consumer Group Offsets	21.1.0
158157	KIP-168: Add GlobalTopicCount and GlobalPartitionCount metric per cluster210 - Provide for custom error handling when Kafka Streams fails to produce	1.01.0
159158	KIP-167208: Add interface for the state store restoration processSSL support to Kafka Connect REST interface	1.1.0
159	KIP-207: Offsets returned by ListOffsetsResponse should be monotonically increasing even during a partition leader change	2.21.0.0
160	KIP-	206: Add support for UUID serialization and deserialization	2.	1.0
161	KIP-	205: Add all() and range() API to ReadOnlyWindowStore	1.	1.0
162	KIP-162204 : Enable topic deletion by defaultAdding records deletion operation to the new Admin Client API	1.01.0
163	KIP-161: streams deserialization exception handlers	1.0.0	203: Add toLowerCase support to sasl.kerberos.principal.to.local rule	1.1.0
164	KIP-202: Move merge() from StreamsBuilder to KStream	164	KIP-160: Augment KStream.print(), KStream.writeAsText() to allow users pass in extra parameters in the printed string	1.0.0
165	KIP-	198: Remove ZK dependency from Streams Reset Tool	1.0.0
166	KIP-	197 Connect REST API should include the connector type when describing a connector	1	.0.0
167	KIP-	196: Add metrics to Kafka Connect framework	1	.0.0
168	KIP-154 Add Kafka Connect configuration properties for creating internal topics195: AdminClient.createPartitions	1.0.11.0.0
169	KIP-153: Include only client traffic in BytesOutPerSec metric192 : Provide cleaner semantics when idempotence is enabled	10.11.0.0
170	KIP-152 - Improve diagnostics for SASL authentication failures191: KafkaConsumer.subscribe() overload that takes just Pattern	1.0.0
171	KIP-151 Expose Connector type in REST API-190: Handle client-ids consistently between clients and brokers	10.11.0.0
172	KIP-150 - Kafka-Streams Cogroup189: Improve principal builder interface and add support for SASL	1.0.02.4.0 (WIP)
173	KIP-149: Enabling key access in ValueTransformer, ValueMapper, and ValueJoiner188 - Add new metrics to support health checks	1.1.0 (partially implemented) (WIP for 2.4.0)
174	KIP-146 - Classloading Isolation in Connect187 - Add cumulative count metric for all Kafka rate metrics	10.11.0.0
175	KIP-145 - Expose Record Headers in Kafka Connect186: Increase offsets retention default to 7 days	2.01.1.0
176	KIP-144: Exponential backoff for broker reconnect attempts-183 - Change PreferredReplicaLeaderElectionCommand to use AdminClient	2.20.11.0.0
177	KIP-143: Controller Health Metrics182: Reduce Streams DSL overloads and allow easier use of custom storage engines	1.0.11.0.0
178	KIP-140: Add administrative RPCs for adding, deleting, and listing ACLs180: Add a broker metric specifying the number of consumer group rebalances in progress	1.1.00.11.0.0
179	KIP-138: Change punctuate semantics177: Consumer perf tool should count rebalance time	1.0.0
180	KIP-	176: Remove deprecated new-consumer option for tools	2.	0.0
181	KIP-136: Add Listener name to SelectorMetrics tags175: Additional '--describe' views for ConsumerGroupCommand	1.1.00.11.0.0
182	KIP-134: Delay initial consumer group rebalance174 - Deprecate and remove internal converter configs in WorkerConfig	20.11.0.0
183	KIP-133: Describe and Alter Configs Admin APIs173: Add prefix to StreamsConfig to enable setting default internal topic configs	1.0.00.11.0.0
184	KIP	-171 - Extend Consumer Group Reset Offset for Stream Application	1.	1.0
185	KIP-129: Streams Exactly-Once Semantics168: Add GlobalTopicCount and GlobalPartitionCount metric per cluster	1.0.11.0.0
186	KIP-128167: Add ByteArrayConverter for Kafka Connectinterface for the state store restoration process	10.11.0.0
187	KIP- 126 - Allow KafkaProducer to split and resend oversized batches. 164 - Add UnderMinIsrPartitionCount and per-partition UnderMinIsr metrics	10.11.0.0
188	KIP-	163: Lower the Minimum Required ACL Permission of OffsetFetch	1.	0.0
189	KIP-123: Allow per stream/table timestamp extractor162: Enable topic deletion by default	10.11.0.0
190	KIP-122: Add Reset Consumer Group Offsets tooling161: streams deserialization exception handlers	10.11.0.0
191	KIP-121: Add KStream peek method160: Augment KStream.print(), KStream.writeAsText() to allow users pass in extra parameters in the printed string	1.0.11.0.0
192	KIP	-157 - Add consumer config options to streams reset tool	1.0.0
193	KIP-	156 Add option "dry run" to Streams application reset tool	0.11.0.0
194	KIP	-155 - Add range scan for windowed state stores	0.11	.0.0
195	KIP-117: Add a public AdminClient API for Kafka admin operations154 Add Kafka Connect configuration properties for creating internal topics	0.11.0.0
196	KIP-115: Enforce offsets.topic.replication.factor upon __consumer_offsets auto topic creation153: Include only client traffic in BytesOutPerSec metric	0.11.0.0
197	KIP-114: KTable state stores and improved semantics-152 - Improve diagnostics for SASL authentication failures	10.11.0.0
198	KIP-113: Support replicas movement between log directories151 Expose Connector type in REST API	0.11.01.1.0
199	KIP-112: Handle disk failure for JBOD-150 - Kafka-Streams Cogroup	2.4.0 (WIP)1.0.0
200	KIP-	149: Enabling key access in ValueTransformer, ValueMapper, and ValueJoiner	1.1.0 (partially implemented) (WIP for 2.4.0)
201	KIP-109: Old Consumer Deprecation-146 - Classloading Isolation in Connect	0.11.0.0
202	KIP-108: Create Topic Policy-145 - Expose Record Headers in Kafka Connect	1.1.0.10.2.0
203	KIP-107: Add deleteRecordsBefore() API in AdminClient144: Exponential backoff for broker reconnect attempts	0.11.0.0
204	KIP-106 - Change Default unclean.leader.election.enabled from True to False143: Controller Health Metrics	0.11.0.0
205	KIP-105: Addition of Record Level for Sensors140: Add administrative RPCs for adding, deleting, and listing ACLs	0.1011.20.0
206	KIP-104: Granular Sensors for Streams 138: Change punctuate semantics	1.00.10.2.0
207	KIP-103: Separation of Internal and External traffic137: Enhance TopicCommand --describe to show topics marked for deletion	0.1011.20.0
208	KIP-102 - Add close with timeout for consumers136: Add Listener name to SelectorMetrics tags	0.1011.20.0
209	KIP-101 - Alter Replication Protocol to use Leader Epoch rather than High Watermark for Truncation134: Delay initial consumer group rebalance	0.11.0.0
210	KIP-100 - Relax Type constraints in Kafka Streams API133: Describe and Alter Configs Admin APIs	0.1011.20.0
211	KIP-	130: Expose states of active tasks to KafkaStreams public API	1.0	.0
212	KIP-98 129: Streams Exactly- Exactly Once Delivery and Transactional MessagingSemantics	0.11.0.0
213	KIP-97128: Improved Kafka Client RPC Compatibility PolicyAdd ByteArrayConverter for Kafka Connect	0.1011.20.0
214	KIP-96 - Add per partition metrics for in-sync and assigned replica count126 - Allow KafkaProducer to split and resend oversized batches.	0.1011.20.0
215	KIP-94 Session Windows-124 - Request rate quotas	0.1011.20.0
216	KIP-93: Improve invalid timestamp handling in Kafka Streams123: Allow per stream/table timestamp extractor	0.1011.20.0
217	KIP-92 - Add per partition lag metrics to KafkaConsumer122: Add Reset Consumer Group Offsets tooling	0.1011.20.0
218	KIP-91 Provide Intuitive User Timeouts in The Producer121: Add KStream peek method	0.11.0 2.1 .0
219	KIP-90 - Remove zkClient dependency from Streams120: Cleanup Kafka Streams builder API	1.0.0.10.2.0
220	KIP-89: Allow sink connectors to decouple flush and offset commit119: Drop Support for Scala 2.10 in Kafka 0.11	0.1011.20.0
221	KIP-88: OffsetFetch Protocol Update118: Drop Support for Java 7	2.00.10.2.0
222	KIP-86: Configurable SASL callback handlers117: Add a public AdminClient API for Kafka admin operations	0.112.0.0
223	KIP-85: Dynamic JAAS configuration for Kafka clients115: Enforce offsets.topic.replication.factor upon __consumer_offsets auto topic creation	0.1011.20.0
224	KIP-84: Support SASL SCRAM mechanisms114: KTable state stores and improved semantics	0.1011.20.0
225	KIP-82 - Add Record Headers113: Support replicas movement between log directories	1.1.00.11.0.0
226	KIP-81: Bound Fetch memory usage in the consumer112: Handle disk failure for JBOD	1.0.02.4.0 (WIP)
227	KIP-	110: Add Codec for ZStandard Compression	2.	1.0
228	KIP-78: Cluster Id109: Old Consumer Deprecation	0.1011.10.0
229	KIP-77: Improve Kafka Streams Join Semantics108: Create Topic Policy	0.10.2.0
230	KIP-75 - Add per-connector Converters107: Add deleteRecordsBefore() API in AdminClient	0.1011.10.0
231	KIP- 74: Add Fetch Response Size Limit in Bytes 106 - Change Default unclean.leader.election.enabled from True to False	0.1011.10.0
232	KIP-73: Replication Quotas105: Addition of Record Level for Sensors	0.10.12.0
233	KIP-72: Allow putting a bound on memory consumed by Incoming request 104: Granular Sensors for Streams	0.10.21.0.0
234	KIP-71: Enable log compaction and deletion to co-exist103: Separation of Internal and External traffic	0.10.12.0
235	KIP-70: Revise Partition Assignment Semantics on New Consumer's Subscription Change102 - Add close with timeout for consumers	0.10.12.0
236	KIP-67: Queryable state for Kafka Streams101 - Alter Replication Protocol to use Leader Epoch rather than High Watermark for Truncation	0.1011.10.0
237	KIP-66: Single Message Transforms for Kafka Connect100 - Relax Type constraints in Kafka Streams API	0.10.2.0 / 0.11.0.0
238	KIP-65: Expose timestamps to Connect99: Add Global Tables to Kafka Streams	0.10.12.0
239	KIP-63: Unify store and downstream caching in streams98 - Exactly Once Delivery and Transactional Messaging	0.1011.10.0
240	KIP-62: Allow consumer to send heartbeats from a background thread97: Improved Kafka Client RPC Compatibility Policy	0.10.12.0
241	KIP-60 - Make Java client classloading more flexible-96 - Add per partition metrics for in-sync and assigned replica count	0.10.12.0
242	KIP-58 - Make Log Compaction Point Configurable94 Session Windows	0.10.12.0
243	KIP-57 - Interoperable LZ4 Framing93: Improve invalid timestamp handling in Kafka Streams	0.10.02.0
244	KIP-56: Allow cross origin HTTP requests on all HTTP methods92 - Add per partition lag metrics to KafkaConsumer	0.10.02.0
245	KIP-55: Secure Quotas for Authenticated Users91 Provide Intuitive User Timeouts in The Producer	20.10.1.0
246	KIP-54: Sticky Partition Assignment Strategy90 - Remove zkClient dependency from Streams	0.1110.02.0
247	KIP-52: Connector Control APIs89: Allow sink connectors to decouple flush and offset commit	0.10.02.0
248	KIP-51 - List Connectors REST API88: OffsetFetch Protocol Update	0.10.02.0
249	KIP-86: Configurable SASL callback handlers	2.0.050 - Move Authorizer to o.a.k.common package0.10.1.0
250	KIP-48 Delegation token support 85: Dynamic JAAS configuration for Kafka clients	10.10.12.0
251	KIP-45 - Standardize all client sequence interaction on j.u.Collection.84: Support SASL SCRAM mechanisms	0.10.02.0
252	KIP-43: Kafka SASL enhancements-82 - Add Record Headers	0.1011.0.0
253	KIP-42: Add Producer and Consumer Interceptors81: Bound Fetch memory usage in the consumer	2.4.0 (WIP)0.10.0.0
254	KIP-41: Consumer Max Records-79 - ListOffsetRequest/ListOffsetResponse v1 and add timestamp search methods to the new consumer	0.10.01.0
255	KIP-40: ListGroups and DescribeGroup78: Cluster Id	0.910.01.0
256	KIP-38: ZooKeeper Authentication77: Improve Kafka Streams Join Semantics	0.910.02.0
257	KIP-36 - Rack aware replica assignment75 - Add per-connector Converters	0.10.01.0
258	KIP-35 - Retrieving protocol version74: Add Fetch Response Size Limit in Bytes	0.10.01.0
259	KIP-33 - Add a time based log index73: Replication Quotas	0.10.1.0
260	KIP-32 - Add timestamps to Kafka message72: Allow putting a bound on memory consumed by Incoming request	10.10.0.0
261	KIP-31 - Move to relative offsets in compressed message sets71: Enable log compaction and deletion to co-exist	0.10.01.0
262	KIP-28 - Add a processor client70: Revise Partition Assignment Semantics on New Consumer's Subscription Change	0.10.01.0
263	KIP-26 - Add Kafka Connect framework for data import/export67: Queryable state for Kafka Streams	0.910.01.0
264	KIP-25 - System test improvements66: Single Message Transforms for Kafka Connect	0.910.2.0 / 0.11.0.0
265	KIP-22 - Expose a Partitioner interface in the new producer65: Expose timestamps to Connect	0.910.01.0
266	KIP-21 - Dynamic Configuration63: Unify store and downstream caching in streams	0.910.01.0 (WIP)
267	KIP-20 Enable log preallocate to improve consume performance under windows and some old Linux file system62: Allow consumer to send heartbeats from a background thread	0.910.01.0
268	KIP-19 - Add a request timeout to NetworkClient60 - Make Java client classloading more flexible	0.910.01.0
269	KIP-16 - Automated Replica Lag Tuning58 - Make Log Compaction Point Configurable	0.910.01.0
270	KIP-15 - Add a close method with a timeout in the producer57 - Interoperable LZ4 Framing	0.910.0.0
271	KIP-13 - Quota Design56: Allow cross origin HTTP requests on all HTTP methods	0.910.0.0
272	KIP-12 - Kafka Sasl/Kerberos and SSL implementation55: Secure Quotas for Authenticated Users	0.910.01.0
273	KIP-11 - Kafka Authorizer design54: Sticky Partition Assignment Strategy	0.911.0.0
274	KIP-8 - Add a flush method to the producer API52: Connector Control APIs	0.100.9.0.0
275	KIP-4 - Metadata Protocol Changes51 - List Connectors REST API	0.10.0.0
276	KIP-48 Delegation token support for Kafka	1.1.0
277	KIP-4 - Command line and centralized administrative operations45 - Standardize all client sequence interaction on j.u.Collection.	0.910.0.0,
278	KIP-43: Kafka SASL enhancements	0.10.0.0
279	KIP-42: Add Producer and Consumer Interceptors	, 0.10.10.0
277280	KIP-3 - Mirror Maker Enhancement41: Consumer Max Records	0.910.0.0
278281	KIP-2 - Refactor brokers to allow listening on multiple ports and IPs40: ListGroups and DescribeGroup	0.9.0.0
279282	KIP-1 - Remove support of request.required.acks38: ZooKeeper Authentication	0.9.0.0

...

283	KIP-36 - Rack aware replica assignment	0.10.0.0
284	KIP-35 - Retrieving protocol version	0.10.0.0
285	KIP-33 - Add a time based log index	0.10.1.0
286	KIP-32 - Add timestamps to Kafka message	0.10.0.0
287	KIP-31 - Move to relative offsets in compressed message sets	0.10.0.0
288	KIP-28 - Add a processor client	0.10.0.0
289	KIP-26 - Add Kafka Connect framework for data import/export	0.9.0.0
290	KIP-25 - System test improvements	0.9.0.0
291	KIP-22 - Expose a Partitioner interface in the new producer	0.9.0.0
292	KIP-21 - Dynamic Configuration	0.9.0.0 (WIP)
293	KIP-20 Enable log preallocate to improve consume performance under windows and some old Linux file system	0.9.0.0
294	KIP-19 - Add a request timeout to NetworkClient	0.9.0.0
295	KIP-16 - Automated Replica Lag Tuning	0.9.0.0
296	KIP-15 - Add a close method with a timeout in the producer	0.9.0.0
297	KIP-13 - Quota Design	0.9.0.0
298	KIP-12 - Kafka Sasl/Kerberos and SSL implementation	0.9.0.0
299	KIP-11 - Kafka Authorizer design	0.9.0.0
300	KIP-8 - Add a flush method to the producer API	0.9.0.0
301	KIP-4 - Metadata Protocol Changes	0.10.0.0
302	KIP-4 - Command line and centralized administrative operations	0.9.0.0, 0.10.0.0, 0.10.1.0
303	KIP-3 - Mirror Maker Enhancement	0.9.0.0
304	KIP-2 - Refactor brokers to allow listening on multiple ports and IPs	0.9.0.0
305	KIP-1 - Remove support of request.required.acks	0.9.0.0

KIPs under discussion

Please insert new rows in sorted order (ascending by KIP number). Please move the adopted/accepted KIPs to the "Adopted KIPs" table above.

KIP	Comment
KIP-59: Proposal for a kafka broker command	Sent emails to Dev discussion group. Work tracked under KAFKA-3663.
KIP-125: ZookeeperConsumerConnector to KafkaConsumer Migration and Rollback
KIP-131 - Add access to OffsetStorageReader from SourceConnector
KIP-135 : Send of null key to a compacted topic should throw non-retriable error back to user
KIP 141 - ProducerRecord & SourceRecord: Add timestamp constructors
KIP-142: Add ListTopicsRequest to efficiently list all the topics in a cluster
KIP-148: Add a connect timeout for client
KIP-158: Kafka Connect should allow source connectors to set topic-specific settings for new topics
KIP-159: Introducing Rich functions to Streams
KIP-166 - Add a tool to make amounts of replicas and leaders on brokers balanced
KIP-169 - Lag-Aware Partition Assignment Strategy
KIP-178: Size-based log directory selection strategy
KIP-185: Make exactly once in order delivery the default producer setting
KIP-193: Add SchemaBuilder.from(Schema)
KIP-199: Add Kafka Connect offset tool
KIP-201: Rationalising Policy interfaces
KIP-209: C onnection String Support
KIP-216: IQ should throw different exceptions for different errors
KIP-217: Expose a timeout to allow an expired ZK session to be re-created
KIP-228 Negative record timestamp support	Voting in progress
KIP-234: add support for getting topic defaults from AdminClient
KIP-236: Interruptible Partition Reassignment	Discussion
KIP-240: AdminClient.listReassignments() AdminClient.describeReassignments()
KIP-242: Mask password in Kafka Connect Rest API response
KIP-250 Add Support for Quorum-based Producer Acknowledgment
KIP-252 - Extend ACLs to allow filtering based on ip ranges and subnets
KIP-253: Support in-order message delivery with partition expansion	Discussion
KIP-254: JsonConverter Exception Handeling
KIP-259: Improve Streams DSL Timestamp Propagation Semantics
KIP-260: add primary join operation for Stream-Stream join (WIP)	Draft
KIP-264: Add a consumer metric to record raw fetch size	Voting in progress
KIP-271: Add NetworkClient redirector	Discussion
KIP-273: Kafka to support using ETCD beside Zookeeper	Discussion
KIP-275 - Indicate "isClosing" in the SinkTaskContext	Voting in progress
KIP-280: Enhanced log compaction	Discussion
KIP-293 Add new metrics for consumer/replication fetch requests	Voting in progress
KIP-296: Add connector level configurability for producer/consumer client configs	Discussion
KIP-301: Schema Inferencing for JsonConverter	Discussion
KIP-304: Connect runtime mode improvements for container platforms	Discussion
KIP-309: Add toUpperCase support to sasl.kerberos.principal.to.local rule	Discussion
KIP-314: KTable to GlobalKTable Bi-directional Join	Discussion
KIP-315: Stream Join Sticky Assignor	Discussion
KIP-316: Command-line overrides for ConnectDistributed worker properties	Discussion
KIP-317: Add end-to-end data encryption functionality to Apache Kafka	Discussion
KIP-325: Extend Consumer Group Command to Show Beginning Offsets	Voting in Progress345
KIP-326: Schedulable KTable as Graph source	Discussion
KIP-333: Add faster mode of rebalancing	Discussion
KIP-334 - Include partitions in exceptions raised during consumer record deserialization/validation
KIP-335: Consider configurations for KafkaStreams	Discussion
KIP-347: Enable batching in FindCoordinatorRequest	Discussion
KIP-348 Eliminate null from SourceTask#poll()
KIP-350: Allow kafka-topics.sh to take brokerid as parameter to show partitions associated with it
KIP-356: Add KafkaConsumer fetch-error-rate and fetch-error-total metrics	Discussion
KIP-360: Improve handling of unknown producer	Discussion
K IP-362: Support Dynamic Session Window	Discussion
KIP-363: Allow performance tools to print final results to output file	Discussion
KIP-370: Remove Orphan Partitions	Discussion
KIP-373: Allow users to create delegation tokens for other users	Discussion
KIP-375: Kafka Clients - make Metadata#TOPIC_EXPIRY_MS configurable	Discussion
KIP-378: Enable Dependency Injection for Kafka Streams handlers	Discussion
KIP-381: Connect: Tell about records that had their offsets flushed in callback	Voting in progress (restarted 18th January 2019, due to no votes in first attempt)
KIP-383: Pluggable interface for SSL Factory	Voting in progress
KIP-384: Add config for incompatible changes to persistent metadata	Discussion
KIP-385: Avoid throwing away prefetched data	Discussion
KIP-387: Fair Message Consumption Across Partitions in KafkaConsumer	Discussion
KIP-388: Add observer interface to record request and response	Discussion
KIP-390: Allow fine-grained configuration for compression	Discussion, JIRA exists with pull-request
KIP-391: Allow Producing with Offsets for Cluster Replication	Discussion, JIRA exists with pull-request
KIP-392: Allow consumers to fetch from closest replica	Discussion
KIP-395: Encypt-then-MAC Delegation token metadata
KIP-397: Add methods to override fetch offsets based on timestamp	Discussion
KIP-398: Support reading trust store from classpath	Discussion
KIP-399: Extend ProductionExceptionHandler to cover serialization exceptions	Discussion
KIP-400: Improve exit status in case of errors in ConsoleProducer	Discussion
KIP-403: Increase ProducerPerformance precision by using nanoTime	Draft
KIP-405: Kafka Tiered Storage	Discussion
KIP-406: GlobalStreamThread should honor custom offset policy.	Discussion
KIP-407: Kafka Connect support override worker kafka api configuration with connector configuration that post by rest api
KIP-408: Add asynchronous processing to Kafka Streams	Discussion
KIP-409: Allow creating under-replicated topics and partitions
KIP-410: Add metric for request handler thread pool utilization by request type	Discussion
KIP-416: Notify SourceTask of ACK'd offsets, metadata	Discussion
KIP-418: A method-chaining way to branch KStream	Discussion, JIRA exists with pull-request
KIP-419: Safely notify Kafka Connect SourceTask is stopped	Voting in progress, JIRA exists with pull request
KIP-422: Add support for client quota configuration in the Kafka Admin Client	Discussion, JIRA exists with pull-request
KIP-423: Add JoinReason to Consumer Join Group Protocol	Discussion
KIP-424: Allow suppression of intermediate events based on wall clock time	Discussion
KIP-426: Persist Broker Id to Zookeeper	Discussion
KIP-431: Support of printing additional ConsumerRecord fields in DefaultMessageFormatter	Voting in progress, JIRA exists with pull-request
KIP-435: Internal Partition Reassignment Batching	Discussion
KIP-437: Custom replacement for MaskField SMT	Voting in progress, JIRA exists with pull-request
KIP-438: Expose task, connector IDs in Connect API	Discussion
KIP-439: Cleanup built-in Store interfaces	Discussion
KIP-441: Smooth Scaling Out for Kafka Streams	Discussion
KIP-444: Augment metrics for Kafka Streams	Discussion
KIP-447: Producer scalability for exactly once semantics	Discussion
KIP-448: Add State Stores Unit Test Support to Kafka Streams Test Utils	Discussion
KIP-450: Sliding Window Aggregations in the DSL	Discussion
KIP-452: Tool to view cluster status	Discussion, JIRA exists
KIP-457: Add DISCONNECTED status to Kafka Streams	Discussion
KIP-459: Improve KafkaStreams#close	Discussion
KIP-463: Auto-configure non-default Serdes passed alongside the TopologyBuilder	Under discussion
KIP-466: Add support for List<T> serialization and deserialization	Voting in progress
KIP-468: Avoid decompression of record when validate record at server in the scene of inPlaceAssignment .	Under discussion
KIP-470: TopologyTestDriver test input and output usability improvements	Under discussion
KIP-473: Enable KafkaLog4JAppender to use SASL Authentication Callback Handlers	Under Discussion
KIP-477: Add PATCH method for connector config in Connect REST API	Under Discussion
KIP-478 - Strongly typed Processor API	Under Discussion
KIP-481: SerDe Improvements for Connect Decimal type in JSON	Under Discussion
KIP-486: Support custom way to load KeyStore and TrustStore	Under Discussion
KIP-487: Automatic Topic Creation on Producer	Under Discussion
KIP-489: Kafka Consumer Record Latency Metric	Under Discussion
KIP-490: New metric to count offsets expired without being consumed by a consumer group	Under discussion
KIP-491: Preferred Leader Deprioritized List (Temporary Blacklist)	Under discussion
KIP-494: Connect REST Endpoint to get Transformations (SMTs)
KIP-495: Dynamically Adjust Log Levels in Connect	Sent mail to dev discussion group.
KIP-498: Add client-side configuration for maximum response size to protect against OOM	Sent emails to Dev discussion group. Work tracked under KAFKA-4090.
KIP-499 - Unify connection name flag for command line tool	Under discussion
KIP-499: Create a controller RPC for changing configurations
KIP-502: Connect SinkTask.put(...) to specify ArrayList<SinkRecord> in Signature
KIP-505: Add new public method to only update assignment metadata in consumer	Under discussion
KIP-506: Allow setting SCRAM password via Admin interface	Under discussion
KIP-507: Securing Internal Connect REST Endpoints	Under discussion
KIP-508: Make Suppression State Queriable	Under discussion
KIP-509: Rebalance and restart Producers	Under discussion
KIP-510: Metrics library upgrade	Under discussion
KIP-511: Collect and Expose Client's Name and Version in the Brokers
KIP-512: Adding headers to RecordMetaData	Sent mail to dev discussion group
KIP-513: Distinguish between Key and Value serdes in scala wrapper library for kafka streams
KIP-514:Add a bounded flush() API to Kafka Producer
KIP-515: Reorganize checkpoint system in log cleaner to per partition
KIP-516: Topic Identifiers & Topic Deletion State Improvements	Under discussion
KIP-517: Add consumer metric indicating time between poll calls	Under discussion
KIP-518: Allow listing consumer groups per state	Under discussion
KIP-519: Make SSL context/engine configuration extensible	Under discussion
KIP-521: Enable redirection of Connect's log4j messages to a file by default	Under discussion
KIP-522: Update BrokerApiVersionsCommand to use AdminClient	Draft
KIP-523: Add KStream#toTable to the Streams DSL	Under discussion
KIP-525 - Return topic metadata and configs in CreateTopics response	Under discussion

Please insert new rows in sorted order (by KIP number).

KIP	Comment
KIP-59: Proposal for a kafka broker command	Sent emails to Dev discussion group. Work tracked under KAFKA-3663.
KIP-125: ZookeeperConsumerConnector to KafkaConsumer Migration and Rollback	KIP-131 - Add access to OffsetStorageReader from SourceConnector	KIP-135 : Send of null key to a compacted topic should throw non-retriable error back to user	KIP 141 - ProducerRecord & SourceRecord: Add timestamp constructors	KIP-142: Add ListTopicsRequest to efficiently list all the topics in a cluster	KIP-148: Add a connect timeout for client	KIP-158: Kafka Connect should allow source connectors to set topic-specific settings for new topics	KIP-159: Introducing Rich functions to Streams	KIP-166 - Add a tool to make amounts of replicas and leaders on brokers balanced	KIP-169 - Lag-Aware Partition Assignment Strategy	KIP-178: Size-based log directory selection strategy	KIP-185: Make exactly once in order delivery the default producer setting	KIP-193: Add SchemaBuilder.from(Schema)	KIP-199: Add Kafka Connect offset tool	KIP-201: Rationalising Policy interfaces	KIP-209: C onnection String Support	KIP-216: IQ should throw different exceptions for different errors	KIP-217: Expose a timeout to allow an expired ZK session to be re-created
KIP-221: Enhance KStream with Connecting Topic Creation and Repartition Hint	Discussion
KIP-228 Negative record timestamp support	Voting in progress
KIP-234: add support for getting topic defaults from AdminClient
KIP-236: Interruptible Partition Reassignment	Discussion
KIP-240: AdminClient.listReassignments() AdminClient.describeReassignments()	KIP-242: Mask password in Kafka Connect Rest API response	KIP-250 Add Support for Quorum-based Producer Acknowledgment	KIP-252 - Extend ACLs to allow filtering based on ip ranges and subnets
KIP-253: Support in-order message delivery with partition expansion	Discussion
KIP-254: JsonConverter Exception Handeling	KIP-259: Improve Streams DSL Timestamp Propagation Semantics
KIP-260: add primary join operation for Stream-Stream join (WIP)	Draft
KIP-264: Add a consumer metric to record raw fetch size	Voting in progress
KIP-271: Add NetworkClient redirector	Discussion
KIP-273: Kafka to support using ETCD beside Zookeeper	Discussion
KIP-275 - Indicate "isClosing" in the SinkTaskContext	Voting in progress
KIP-280: Enhanced log compaction	Discussion
KIP-291: Separating controller connections and requests from the data plane	Accepted
KIP-293 Add new metrics for consumer/replication fetch requests	Voting in progress
KIP-296: Add connector level configurability for producer/consumer client configs	Discussion
KIP-301: Schema Inferencing for JsonConverter	Discussion
KIP-304: Connect runtime mode improvements for container platforms	Discussion
KIP-314: KTable to GlobalKTable Bi-directional Join	Discussion
KIP-315: Stream Join Sticky Assignor	Discussion
KIP-316: Command-line overrides for ConnectDistributed worker properties	Discussion
KIP-317: Add end-to-end data encryption functionality to Apache Kafka	Discussion
KIP-325: Extend Consumer Group Command to Show Beginning Offsets	Voting in Progress345
KIP-326: Schedulable KTable as Graph source	Discussion
KIP-333: Add faster mode of rebalancing	Discussion
KIP-334 - Include partitions in exceptions raised during consumer record deserialization/validation
KIP-335: Consider configurations for KafkaStreams	Discussion
KIP-347: Enable batching in FindCoordinatorRequest	Discussion
KIP-348 Eliminate null from SourceTask#poll()	KIP-350: Allow kafka-topics.sh to take brokerid as parameter to show partitions associated with it
KIP-356: Add KafkaConsumer fetch-error-rate and fetch-error-total metrics	Discussion
KIP-360: Improve handling of unknown producer	Discussion
K IP-362: Support Dynamic Session Window	Discussion
KIP-363: Allow performance tools to print final results to output file	Discussion
KIP-369: Alternative Partitioner to Support "Always Round-Robin" Selection	Accepted
KIP-370: Remove Orphan Partitions	Discussion
KIP-373: Allow users to create delegation tokens for other users	Discussion
KIP-375: Kafka Clients - make Metadata#TOPIC_EXPIRY_MS configurable	Discussion
KIP-378: Enable Dependency Injection for Kafka Streams handlers	Discussion
KIP-379: Multiple Consumer Group Management	Accepted
KIP-381: Connect: Tell about records that had their offsets flushed in callback	Voting in progress (restarted 18th January 2019, due to no votes in first attempt)
KIP-383: Pluggable interface for SSL Factory	Voting in progress
KIP-384: Add config for incompatible changes to persistent metadata	Discussion
KIP-385: Avoid throwing away prefetched data	Discussion
KIP-387: Fair Message Consumption Across Partitions in KafkaConsumer	Discussion
KIP-388: Add observer interface to record request and response	Discussion
KIP-389: Introduce a configurable consumer group size limit	Accepted
KIP-390: Allow fine-grained configuration for compression	Discussion, JIRA exists with pull-request
KIP-391: Allow Producing with Offsets for Cluster Replication	Discussion, JIRA exists with pull-request
KIP-392: Allow consumers to fetch from closest replica	Discussion
KIP-395: Encypt-then-MAC Delegation token metadata
KIP-396: Add Commit/List Offsets Operations to AdminClient	Discussion
KIP-397: Add methods to override fetch offsets based on timestamp	Discussion
KIP-398: Support reading trust store from classpath	Discussion
KIP-399: Extend ProductionExceptionHandler to cover serialization exceptions	Discussion
KIP-400: Improve exit status in case of errors in ConsoleProducer	Discussion
KIP-401: TransformerSupplier/ProcessorSupplier StateStore connecting	Voting in progress
KIP-403: Increase ProducerPerformance precision by using nanoTime	Draft
KIP-405: Kafka Tiered Storage	Discussion
KIP-406: GlobalStreamThread should honor custom offset policy.	Discussion
KIP-407: Kafka Connect support override worker kafka api configuration with connector configuration that post by rest api
KIP-408: Add asynchronous processing to Kafka Streams	Discussion
KIP-409: Allow creating under-replicated topics and partitions
KIP-410: Add metric for request handler thread pool utilization by request type	Discussion
KIP-416: Notify SourceTask of ACK'd offsets, metadata	Discussion
KIP-418: A method-chaining way to branch KStream	Discussion, JIRA exists with pull-request
KIP-419: Safely notify Kafka Connect SourceTask is stopped	Voting in progress, JIRA exists with pull request
KIP-421: Support resolving externalized secrets in AbstractConfig	Accepted
KIP-422: Add support for client quota configuration in the Kafka Admin Client	Discussion, JIRA exists with pull-request
KIP-423: Add JoinReason to Consumer Join Group Protocol	Discussion
KIP-424: Allow suppression of intermediate events based on wall clock time	Discussion
KIP-426: Persist Broker Id to Zookeeper	Discussion
KIP-431: Support of printing additional ConsumerRecord fields in DefaultMessageFormatter	Voting in progress, JIRA exists with pull-request
KIP-434: Add Replica Fetcher and Log Cleaner Count Metrics	Discussion
KIP-435: Incremental Partition Reassignment	Discussion
KIP-437: Custom replacement for MaskField SMT	Voting in progress, JIRA exists with pull-request
KIP-438: Expose task, connector IDs in Connect API	Discussion
KIP-439: Cleanup built-in Store interfaces	Discussion
KIP-440: Extend Connect Converter to support headers	Voting in progress
KIP-444: Augment metrics for Kafka Streams	Discussion
KIP-448: Add State Stores Unit Test Support to Kafka Streams Test Utils	Discussion
KIP-450: Sliding Window Aggregations in the DSL	Discussion
KIP-452: Tool to view cluster status	Discussion, JIRA exists
KIP-455: Create an Administrative API for Replica Reassignment	Discussion
KIP-456: Helper classes to make it simpler to write test logic with TopologyTestDriver	Discussion
KIP-457: Add DISCONNECTED status to Kafka Streams	Discussion
KIP-459: Improve KafkaStreams#close	Discussion
KIP-463: Auto-configure non-default Serdes passed alongside the TopologyBuilder	Under discussion
KIP-468: Avoid decompression of record when validate record at server in the scene of inPlaceAssignment .	Under discussion
KIP-470: TopologyTestDriver test input and output usability improvements	Under discussion
KIP-471: Expose RocksDB Metrics in Kafka Streams	Under discussion
KIP-466: Add support for List<T> serialization and deserialization	Under Discussion
KIP-473: Enable KafkaLog4JAppender to use SASL Authentication Callback Handlers	Under Discussion
KIP-474: To deprecate WindowStore#put(key, value)	Under Discussion
KIP-475: New Metric to Measure Number of Tasks on a Connector	Under Discussion
KIP-476: Add Java AdminClient Interface	Under Discussion

Dormant/inactive KIPs

Please insert new rows in sorted order (ascending by KIP number).

KIP	Comment
KIP-6 - New reassignment partition logic for rebalancing	Needs more detail
KIP-10 - Running Producer, Consumers and Brokers on Mesos
KIP-14 - Tools standardization
KIP-17 - Add HighwaterMarkOffset to OffsetFetchResponse
KIP-23 - Add JSON/CSV output and looping options to ConsumerGroupCommand
KIP-27 - Conditional Publish
KIP-30 - Allow for brokers to have plug-able consensus and meta data storage sub systems
KIP-37 - Add Namespaces to Kafka
KIP-39: Pinning controller to broker
KIP-44 - Allow Kafka to have a customized security protocol
KIP-46 - Self Healing
KIP-47 - Add timestamp-based log deletion policy
KIP-49 - Fair Partition Assignment Strategy
KIP-53 - Add custom policies for reconnect attempts to NetworkdClient
KIP-59: Proposal for a kafka broker command
KIP-64 -Allow underlying distributed filesystem to take over replication depending on configuration
KIP-68 Add a consumed log retention before log retention
KIP-69 - Kafka Schema Registry	Draft
KIP-76 Enable getting password from executable rather than passing as plaintext in config files
KIP-87 - Add Compaction Tombstone Flag	Possibly displaced by KIP-82
KIP-95: Incremental Batch Processing for Kafka Streams
KIP-269: Substitution Within Configuration Values
KIP-349: Priorities for Source Topics	Functionality can be realized with existing API although at a lower level.
KIP-399: Extend ProductionExceptionHandler to cover serialization exceptions