Page History

...

Click
Create from template
templateName 54329345
templateId 54329345
title KIP-NEXT: Insert Title Here
buttonLabel Create KIP
. Take the next available KIP number and give your proposal a descriptive heading. e.g. "KIP 42: Allow Infinite Retention With Bounded Disk Usage".
Fill in the sections as described above
Start a [DISCUSS] thread on the Apache mailing list. Please ensure that the subject of the thread is of the format [DISCUSS] KIP-{your KIP number} {your KIP heading} The and the body contains a link to your new KIP. The discussion should happen on the mailing list, not on the wiki, since the wiki comment system doesn't work well for larger discussions. In the process of the discussion you may update the proposal. You should let people know the changes you are making. When you feel you have a finalized proposal
Once the proposal is finalized call a [VOTE] to have the proposal adopted. These proposals are more serious than code changes and more serious even than release votes. The criteria for acceptance is lazy majority. The vote should remain open for at least 72 hours.
Please update the KIP wiki page, and the index below, to reflect the current stage of the KIP after a vote. This acts as the permanent record indicating the result of the KIP (e.g., Accepted or Rejected). Also report the result of the KIP vote to the voting thread on the mailing list so the conclusion is clear.

KIP round-up

Next KIP Number: 477529

Use this number as the identifier for your KIP and increment this value.

...

Please insert new rows in sorted order (descending by KIP number).

429 Consumer Incremental Rebalance Protocol458: Connector Client Config Override Policy3446 changelog topic configuration to KTable suppress443 Return to default segment.ms and segment.index.bytes in Streams repartition topics3442: Return to default max poll interval in Streams3436: Add a metric indicating start time3428 in-memory window store427: Add AtMinIsr topic partition category (new metric & TopicCommand option)3415: Incremental Cooperative Rebalancing in Kafka Connect3412: Extend Admin API to support dvynamic application log levels4 (WIP)372: Naming Repartition Topics for Joins and Grouping1 368: Allow SASL Connections to Periodically Re-Authenticate2365: Materialized, Serialized, Joined, Consumed and Produced with implicit Serde1KIP361: Add Consumer Configuration to Disable Auto Topic Creation358 Migrate Streams API to Duration instead of long ms times12.1-321: Update TopologyDescription to better represent Source and Sink Nodes1319: Replace segments with segmentInterval in WindowBytesStoreSupplier308: Support dynamic update of max.connections.per.ip/max.connections.per.ip.overrides182285: Connect Rest Extension Plugin.0282: Add the listener name to the authentication context0279: Fix log divergence between leader and follower after fast leader fail over0274: Kafka Streams Skipped Records Metrics0268: Simplify Kafka Streams Rebalance Metadata Upgrade2.0.267: Add Processor Unit Test Support to Kafka Streams Test Utils0261: Add Single Value Fetch in Window Stores0251: Allow timestamp manipulation in Processor API0249 Delegation Token Operations to KafkaAdminClient0247: Add public test utils for Kafka Streams1.1245: Use Properties instead of StreamsConfig in KafkaStreams constructor243: Make ProducerConfig and ConsumerConfig constructors public1.1238: Expose Kafka cluster ID in Connect REST API1.1237: More Controller Health Metrics229: DeleteGroups API1.1227 - Introduce Incremental FetchRequests to Increase Partition Scalability1.1226 - Dynamic Broker Configuration1.1224: Add configuration parameter `retries` to Streams API1.1223 - Add per-topic min lead and per-partition lead metrics to KafkaConsumer219 - Improve quota communication218: Make KafkaFuture.Function java 8 lambda compatible1.1210 - Provide for custom error handling when Kafka Streams fails to produce1.1.0207: Offsets returned by ListOffsetsResponse should be monotonically increasing even during a partition leader change2.2206: Add support for UUID serialization and deserialization1202: Move merge() from StreamsBuilder to KStream1192 : Provide cleaner semantics when idempotence is enabled1.0190: Handle client-ids consistently between clients and brokers1.0KIP-176: Remove deprecated new-consumer option for tools156171 - Extend Consumer Group Reset Offset for Stream Application137: Enhance TopicCommand --describe to show topics marked for deletion0.11-130: Expose states of active tasks to KafkaStreams public API0124 - Request rate quotas0.11-120: Cleanup Kafka Streams builder API119: Drop Support for Scala 2.10 in Kafka 0.11-118: Drop Support for Java 7299: Add Global Tables to Kafka Streams0.10.20.10

	KIP (please keep this sorted by KIP number)	Release
1	KIP-500: Replace ZooKeeper with a Self-Managed Metadata Quorum
2	KIP-	482: The Kafka	Protocol should Support Optional Tagged Fields	2.4.0 (WIP)
23	KIP-504 - 354: Add a Maximum Log Compaction LagAdd new Java Authorizer Interface	2.34.0 (WIP)
34	KIP-465: Add Consolidated Connector Endpoint to Connect REST API503: Add metric for number of topics marked for deletion	2.34.0 (WIP)
45	KIP-464: Defaults for AdminClient#createTopic497: Add inter-broker API to alter ISR	2.4.0 (WIP)
56	KIP-462: Use local thread id for KStreams496: Administrative API to delete consumer offsets	2.3.0
6	KIP-461: Improve Replica Fetcher behavior at handling partition failure	2.3.0
4.0 (WIP)
7	KIP-460: Admin Leader Election RPC495: Dynamically Adjust Log Levels in Connect	2.4.0 (WIP)
8	KIP-	488: Clean up Sum,Count,Total Metrics	2.	4.0
9	KIP-454: Expansion of the ConnectClusterState interface484: Expose metrics for group and transaction metadata loading duration	2.34.0 (WIP)
10	KIP-453: Add close() method to RocksDBConfigSetter481: SerDe Improvements for Connect Decimal type in JSON	2.34.0 (WIP)
11	KIP-449: Add connector contexts to log messages in Connect workers 480: Sticky Partitioner	2.34.0
12	KIP-	479: Add	Materialized to Join	2.4.0(WIP)
13	KIP-445: In-memory Session Store476: Add Java AdminClient Interface	2.34.0
14	KIP-	475:	New Metrics to Measure Number of Tasks on a Connector	2.	4.0 (WIP)
15	KIP-	474: To deprecate WindowStore#put(key, value)	2.	4.0 (WIP)
16	KIP-	471: Expose RocksDB Metrics in Kafka Streams	2.	4.0 (WIP)
17	KIP-430 - Return Authorized Operations in Describe Responses467: Augment ProduceResponse error messaging for specific culprit records	2.34.0 (WIP)
18	KIP-	465: Add	Consolidated Connector Endpoint to Connect REST API	2.3.0
19	KIP-	464: Defaults for AdminClient#createTopic	2.	4.0
20	KIP-425: Add some Log4J Kafka Appender Properties for Producing to Secured Brokers462: Use local thread id for KStreams	2.3.0
21	KIP-421: Support resolving externalized secrets in AbstractConfig 461: Improve Replica Fetcher behavior at handling partition failure	2.3.0
22	KIP-420: Add Single Value Fetch in Session Stores460: Admin Leader Election RPC	2.24.0
23	KIP-417: Allow JmxTool to connect to a secured RMI port458: Connector Client Config Override Policy	2.3.0
24	KIP-	455: Create an Administrative API for Replica Reassignment	2.	4.0 (WIP)
25	KIP-414: Expose Embedded ClientIds in Kafka Streams454: Expansion of the ConnectClusterState interface	2.23.0
26	KIP-	453: Add close() method to RocksDBConfigSetter	2.	3.0
27	KIP-411: Make default Kafka Connect worker task client IDs distinct449: Add connector contexts to log messages in Connect workers	2.3.0
28	KIP-402: Improve fairness in SocketServer processors446: Add changelog topic configuration to KTable suppress	2.24.0 (partially implemented) / 2.3.0WIP)
29	KIP-394: Require member.id for initial join group request445: In-memory Session Store	2.23.0
30	KIP- 393 443: Time windowed serde to properly deserialize changelog input topic Return to default segment.ms and segment.index.bytes in Streams repartition topics	2.23.0
31	KIP-386: Standardize on Min/Avg/Max metrics' default value442: Return to default max poll interval in Streams	2.23.0
32	KIP-382: MirrorMaker 2.0440: Extend Connect Converter to support headers	2.4.0 (WIP)
33	KIP-380: Detect outdated control requests and bounced brokers using broker generation436: Add a metric indicating start time	2.23.0
34	KIP-377: TopicCommand to use AdminClient434: Add Replica Fetcher and Log Cleaner Count Metrics	2.24.0 (WIP)
35	KIP-376: Implement AutoClosable on appropriate classes that want to be used in a try-with-resource statement430 - Return Authorized Operations in Describe Responses	2.23.0
36	KIP-374: Add '--help' option to all available Kafka CLI commands429: Kafka Consumer Incremental Rebalance Protocol	2.24.0 (WIP)
37	KIP-	428: Add in-memory window store	2.	3.0
38	KIP-371: Add a configuration to build custom SSL principal name427: Add AtMinIsr topic partition category (new metric & TopicCommand option)	2.23.0
39	KIP	-425: Add some Log4J Kafka Appender Properties for Producing to Secured Brokers	2.	3.0
40	KIP-367 Introduce close(Duration) to Producer and AdminClient instead of close(long, TimeUnit)421: Support resolving externalized secrets in AbstractConfig	2.3.2.2.0
41	KIP-366: Make FunctionConversions deprecated420: Add Single Value Fetch in Session Stores	2.12.0
42	KIP-	417: Allow JmxTool to connect to a secured RMI port	2.	3.0
43	KIP-	415: Incremental Cooperative Rebalancing in Kafka Connect	2.3.0
44	KIP-359: Verify leader epoch in produce requests414: Expose Embedded ClientIds in Kafka Streams	2.42.0 (WIP)
45	KIP-	412:	Extend Admin API to support dynamic application log levels	2.	4.0 (WIP)
46	KIP- 357: Add support to list ACLs per principal 411: Make default Kafka Connect worker task client IDs distinct	2.13.0
47	KIP-356: Add withCachingDisabled() to StoreBuilder402: Improve fairness in SocketServer processors	2.2.0 (partially implemented) / 2.32.1.0
48	KIP-353: Improve Kafka Streams Timestamp Synchronization401: TransformerSupplier/ProcessorSupplier StateStore connecting	2.14.0 (WIP)
49	KIP-351396: Add --under-min-isr option to describe topics commandCommit/List Offsets Operations to AdminClient	2.34.0 (WIP)
50	KIP-346: Improve LogCleaner behavior on error	2.1
51	KIP-342 Add support for custom SASL extensions in OAuthBearer authentication	2.1.0
52	KIP-341: Update Sticky Assignor's User Data Protocol	2.3.0
53	KIP-340: Allow kafka-reassign-partitions.sh and kafka-log-dirs.sh to take admin client property file	2.1.0
54	KIP-339: Create a new IncrementalAlterConfigs API	2.3.0
55	KIP-338 Support to exclude the internal topics in kafka-topics.sh command	2.1.0
56	KIP-336: Consolidate ExtendedSerializer/Serializer and ExtendedDeserializer/Deserializer	2.1.0
57	KIP-332: Update AclCommand to use AdminClient API	2.1.0
394: Require member.id for initial join group request	2.2.0
51	KIP-393: Time windowed serde to properly deserialize changelog input topic	2.2.0
52	KIP-389: Introduce a configurable consumer group size limit	2.2.0
53	KIP-386: Standardize on Min/Avg/Max metrics' default value	2.2.0
54	KIP-382: MirrorMaker 2.0	2.4.0
55	KIP-379: Multiple Consumer Group Management	2.4.0 (WIP)
56	KIP-380: Detect outdated control requests and bounced brokers using broker generation	2.2.0
57	KIP-377: TopicCommand to use AdminClient	2.2.0
58	KIP-376: Implement AutoClosable on appropriate classes that want to be used in a try-with-resource statement	2.2	58	KIP-331 Add default implementation to close() and configure() for Serializer, Deserializer and Serde	2.3.0
59	KIP-330374: Add retentionPeriod in SessionBytesStoreSupplier'--help' option to all available Kafka CLI commands	2.12.0
60	KIP-328: Ability to suppress updates for KTables372: Naming Repartition Topics for Joins and Grouping	2.1.0 (partially implemented) / 2.3.0 (WIP)
61	KIP-371: Add a configuration to build custom SSL principal name	2.2	61	KIP-324: Add method to get metrics() in AdminClient	.0
62	KIP-322: Return new error code for DeleteTopics API when topic deletion disabled.369: Alternative Partitioner to Support "Always Round-Robin" Selection	2.14.0
63	KIP	368: Allow SASL Connections to Periodically Re-Authenticate	2.	2.0
64	KIP-320: Allow fetchers to detect and handle log truncation367 Introduce close(Duration) to Producer and AdminClient instead of close(long, TimeUnit)	2.1.0 (partially implemented) / 2.2.0
65	KIP-	366: Make FunctionConversions deprecated	2.1.0
66	KIP-313: Add KStream.flatTransform and KStream.flatTransformValues 365: Materialized, Serialized, Joined, Consumed and Produced with implicit Serde	2.1 2.2.0 (partially implemented) / 2.3.0
67	KIPK IP-312 Add Overloaded StreamsBuilder Build Method to Accept java.util.Properties361: Add Consumer Configuration to Disable Auto Topic Creation	2.13.0
68	KIP-	360: Improve handling of unknown producer	2.	4.0 (WIP)
69	KIP-307: Allow to define custom processor names with KStreams DSL359: Verify leader epoch in produce requests	2.34.0 (partialWIP)
70	KIP-306: Configuration for Delaying Response to Failed Authentication358: Migrate Streams API to Duration instead of long ms times	2.1.0
71	KIP-305357: Add Connect primitive number converterssupport to list ACLs per principal	2.01.0
72	KIP-303356: Add Dynamic Routing in Streams SinkwithCachingDisabled() to StoreBuilder	2.01.0
73	KIP-302 - Enable Kafka clients to use all DNS resolved IP addresses354: Add a Maximum Log Compaction Lag	2.13.0
74	KIP-300: Add Windowed KTable API in StreamsBuilder353: Improve Kafka Streams Timestamp Synchronization	2.41.0
75	KIP-298: Error Handling in Connect352: Distinguish URPs caused by reassignment	2.04.0 (WIP)
76	KIP-297: Externalizing Secrets for Connect Configurations351: Add --under-min-isr option to describe topics command	2.03.0
77	KIP-295 Add Streams Configuration Allowing for Optional Topology Optimization346: Improve LogCleaner behavior on error	2.0.01
78	KIP-294 - Enable TLS hostname verification by default345: Introduce static membership protocol to reduce consumer rebalances	2.04.0	79	KIP-292: Add transformValues() method to KTable	2.0(WIP), partially available in 2.3.0
8079	KIP-290: Support for Prefixed ACLs342 Add support for custom SASL extensions in OAuthBearer authentication	2.01.0
8180	KIP-289: Improve the default group id behavior in KafkaConsumer341: Update Sticky Assignor's User Data Protocol	2.23.0
81	KIP-	340: Allow kafka-reassign-partitions.sh and kafka-log-dirs.sh to take admin client property file	2.1.0
82	KIP-339: Create a new IncrementalAlterConfigs API	2.3.0
83	KIP-284: Set default retention ms for Streams repartition topics to Long.MAX_VALUE338 Support to exclude the internal topics in kafka-topics.sh command	2.01.0
84	KIP-283: Efficient Memory Usage for Down-Conversion336: Consolidate ExtendedSerializer/Serializer and ExtendedDeserializer/Deserializer	2.01.0
85	KIP-	332: Update AclCommand to use AdminClient API	2.	1.0
86	KIP-281: ConsumerPerformance: Increase Polling Loop Timeout and Make It Reachable by the End User331 Add default implementation to close() and configure() for Serializer, Deserializer and Serde	2.03.0
87	KIP-	330: Add retentionPeriod in SessionBytesStoreSupplier	2.	1.0
88	KIP-278 - Add version option to Kafka's commands328: Ability to suppress updates for KTables	2.1.0 (partially implemented) / 2.3.0 (WIP)2.0.0
89	KIP-277 - Fine Grained ACL for CreateTopics API324: Add method to get metrics() in AdminClient	2.01.0
90	KIP-276 - Add StreamsConfig prefix for different consumers322: Return new error code for DeleteTopics API when topic deletion disabled.	2.01.0
91	KIP-	321: Update TopologyDescription to better represent Source and Sink Nodes	2.	1.0
92	KIP-272: Add API version tag to broker's RequestsPerSec metric320: Allow fetchers to detect and handle log truncation	2.1.0 (partially implemented) / 2.2.2.0.0
93	KIP-270 - A Scala Wrapper Library for Kafka Streams319: Replace segments with segmentInterval in WindowBytesStoreSupplier	2.01.0
94	KIP-	313: Add KStream.flatTransform and KStream.flatTransformValues	2.2.0 (partially implemented) / 2.3.	0
95	KIP-	312 Add Overloaded StreamsBuilder Build Method to Accept java.util.Properties	2.	1.0
96	KIP-266: Fix consumer indefinite blocking behavior309: Add toUpperCase support to sasl.kerberos.principal.to.local rule	2.04.0
97	KIP-265: Make Windowed Serde to public APIs308: Support dynamic update of max.connections.per.ip/max.connections.per.ip.overrides	2.01.0
98	KIP-	307: Allow to define custom processor names with KStreams DSL	2.	3.0 (partial)
99	KIP-258: Allow to Store Record Timestamps in RocksDB306: Configuration for Delaying Response to Failed Authentication	2.31.0 (partially implemented)
100	KIP-257 - Configurable Quota Management305: Add Connect primitive number converters	2.0.0
101	KIP-255: OAuth Authentication via SASL/OAUTHBEARER303: Add Dynamic Routing in Streams Sink	2.0.0
102	KIP-	302 - Enable Kafka clients to use all DNS resolved IP addresses	2.	1.0
103	KIP-	300: Add	Windowed KTable API in StreamsBuilder	2.	4.0
104	KIP-	298: Error Handling in Connect	2.0	.0
105	KIP-	297: Externalizing Secrets for Connect Configurations	2.0.0
106	KIP-244: Add Record Header support to Kafka Streams Processor API295 Add Streams Configuration Allowing for Optional Topology Optimization	2.0.0
107	KIP-	294 - Enable TLS hostname verification by default	2.0	.0
108	KIP- 239 Add queryableStoreName() to GlobalKTable 291: Separating controller connections and requests from the data plane	Accepted1.1.0
109	KIP-	292: Add transformValues() method to KTable	2.0	.0
110	KIP-	290: Support for Prefixed ACLs	2.0.0
111	KIP-235: Add DNS alias support for secured connection289: Improve the default group id behavior in KafkaConsumer	2.12.0
112	KIP-233: Simplify StreamsBuilder#addGlobalStore285: Connect Rest Extension Plugin	2.01.1.0
113	KIP-231: Improve the Required ACL of ListGroups API284: Set default retention ms for Streams repartition topics to Long.MAX_VALUE	2.10.0
114	KIP-	283: Efficient Memory Usage for Down-Conversion	2.0	.0
115	KIP-	282: Add the listener name to the authentication context	2.0	.0
116	KIP-	281: ConsumerPerformance: Increase Polling Loop Timeout and Make It Reachable by the End User	2.0	.0
117	KIP-225 - Use tags for consumer “records.lag” metrics279: Fix log divergence between leader and follower after fast leader fail over	2.01.1.0
118	KIP-	278 - Add version option to Kafka's commands	2.0	.0
119	KIP-	277 - Fine Grained ACL for CreateTopics API	2.0.0
120	KIP-222 276 - Add Consumer Group operations to Admin APIStreamsConfig prefix for different consumers	2.0.0
121	KIP-220274: Add AdminClient into Kafka Streams ' ClientSupplierSkipped Records Metrics	2.01.1.0
122	KIP-	272: Add API version tag to broker's RequestsPerSec metric	2.0.0
123	KIP-	270 - A Scala Wrapper Library for Kafka Streams	2.0	.0
124	KIP-215: Add topic regex support for Connect sinks268: Simplify Kafka Streams Rebalance Metadata Upgrade	2.01.1.0
125	KIP-214267: Add zookeeper.max.in.flight.requests config to the brokerProcessor Unit Test Support to Kafka Streams Test Utils	2.01.1.0
126	KIP-213 Support non-key joining in KTable266: Fix consumer indefinite blocking behavior	2.40.0 (WIP)
127	KIP-212: Enforce set of legal characters for connector names265: Make Windowed Serde to public APIs	2.01.1.0
128	KIP-211: Revise Expiration Semantics of Consumer Group Offsets261: Add Single Value Fetch in Window Stores	2.10.0
129	KIP-	258: Allow to Store Record Timestamps in RocksDB	2.3.0 (partially implemented)
130	KIP-208: Add SSL support to Kafka Connect REST interface-257 - Configurable Quota Management	2.01.1.0
131	KIP-	255: OAuth Authentication via SASL/OAUTHBEARER	2.0	.0
132	KIP-	251: Allow timestamp manipulation in Processor API	2.	0.0
133	KIP-205249: Add all() and range() API to ReadOnlyWindowStoreDelegation Token Operations to KafkaAdminClient	2.01.1.0
134	KIP-204 : Adding records deletion operation to the new Admin Client API247: Add public test utils for Kafka Streams	1.1.0
135	KIP-245: Use Properties instead of StreamsConfig in KafkaStreams constructor	2.0203: Add toLowerCase support to sasl.kerberos.principal.to.local rule 1.1.0
136	KIP-	244: Add Record Header support to Kafka Streams Processor API	2	.0.0
137	KIP-198: Remove ZK dependency from Streams Reset Tool243: Make ProducerConfig and ConsumerConfig constructors public	1.01.0
138	KIP-197 Connect REST API should include the connector type when describing a connector239 Add queryableStoreName() to GlobalKTable	1.01.0
139	KIP-196238: Add metrics to Kafka Connect frameworkExpose Kafka cluster ID in Connect REST API	1.01.0
140	KIP-195: AdminClient.createPartitions237: More Controller Health Metrics	21.0.0
141	KIP-	235: Add DNS alias support for secured connection	2.1	.0
142	KIP-191: KafkaConsumer.subscribe() overload that takes just Pattern233: Simplify StreamsBuilder#addGlobalStore	1.01.0
143	KIP-	231: Improve the Required ACL of ListGroups API	2.1	.0
144	KIP-189: Improve principal builder interface and add support for SASL229: DeleteGroups API	1.01.0
145	KIP-188 - Add new metrics to support health checks	1.0.0
146	KIP-187 - Add cumulative count metric for all Kafka rate metrics	1.0.0
147	KIP-186: Increase offsets retention default to 7 days	2.0.0
148	KIP-183 - Change PreferredReplicaLeaderElectionCommand to use AdminClient	2.2.0
149	KIP-182: Reduce Streams DSL overloads and allow easier use of custom storage engines	1.0.0
150	KIP-180: Add a broker metric specifying the number of consumer group rebalances in progress	1.1.0
151	KIP-177: Consumer perf tool should count rebalance time	1.0.0
227 - Introduce Incremental FetchRequests to Increase Partition Scalability	1.1.0
146	KIP-226 - Dynamic Broker Configuration	1.1.0
147	KIP-225 - Use tags for consumer “records.lag” metrics	1.1.0
148	KIP-224: Add configuration parameter `retries` to Streams API	1.1.0
149	KIP-223 - Add per-topic min lead and per-partition lead metrics to KafkaConsumer	2.0.0
150	KIP-222 - Add Consumer Group operations to Admin API	2.0.0
151	KIP-221: Enhance DSL with Connecting Topic Creation and Repartition Hint	2.4.0 (WIP)
152	KIP-220: Add AdminClient into Kafka Streams' ClientSupplier	1.1.0
153	KIP-219 - Improve quota communication	152		2.0.0
153154	KIP-175: Additional '--describe' views for ConsumerGroupCommand218: Make KafkaFuture.Function java 8 lambda compatible	1.1.0
154155	KIP-174 - Deprecate and remove internal converter configs in WorkerConfig215: Add topic regex support for Connect sinks	1.12.0.0
155156	KIP-173214: Add prefix to StreamsConfig to enable setting default internal topic configszookeeper.max.in.flight.requests config to the broker	1.01.0
157	KIP-	1.1.0
157	KIP-168: Add GlobalTopicCount and GlobalPartitionCount metric per cluster	1.0.0
158	KIP-167: Add interface for the state store restoration process	1.0.0
159	KIP-164 - Add UnderMinIsrPartitionCount and per-partition UnderMinIsr metrics	1.0.0
160	KIP-163: Lower the Minimum Required ACL Permission of OffsetFetch	1.0.0
161	KIP-162: Enable topic deletion by default	1.0.0
162	KIP-161: streams deserialization exception handlers	1.0.0
163	KIP-160: Augment KStream.print(), KStream.writeAsText() to allow users pass in extra parameters in the printed string	1.0.0
164	KIP-157 - Add consumer config options to streams reset tool	1.0.0
165	KIP-156 Add option "dry run" to Streams application reset tool	0.11.0.0
166	KIP-155 - Add range scan for windowed state stores	0.11.0.0
167	KIP-154 Add Kafka Connect configuration properties for creating internal topics	0.11.0.0
168	KIP-153: Include only client traffic in BytesOutPerSec metric	0.11.0.0
213 Support non-key joining in KTable	2.4.0 (WIP)
158	KIP-212: Enforce set of legal characters for connector names	1.1.0
159	KIP-211: Revise Expiration Semantics of Consumer Group Offsets	2.1.0
160	KIP-210 - Provide for custom error handling when Kafka Streams fails to produce	1.1.0
161	KIP-208: Add SSL support to Kafka Connect REST interface	1.1.0
162	KIP-207: Offsets returned by ListOffsetsResponse should be monotonically increasing even during a partition leader change	2.2.0
163	KIP-206: Add support for UUID serialization and deserialization	2.1.0
164	KIP-205: Add all() and range() API to ReadOnlyWindowStore	1.1.0
165	KIP-204 : Adding records deletion operation to the new Admin Client API	1.1.0
166	KIP-203: Add toLowerCase support to sasl.kerberos.principal.to.local rule	1.1.0
167	KIP-202: Move merge() from StreamsBuilder to KStream	1.0.0
168	KIP-198: Remove ZK dependency from Streams Reset Tool	1.0.0
169	KIP-197 Connect REST API should include the connector type when describing a connector	1.0.0
170	KIP-196: Add metrics to Kafka Connect framework	1.0.0
171	KIP-195: AdminClient.createPartitions	169	KIP-152 - Improve diagnostics for SASL authentication failures	1.0.0
170172	KIP-151 Expose Connector type in REST API192 : Provide cleaner semantics when idempotence is enabled	1.0.11.0.0
171173	KIP-150 - Kafka-Streams Cogroup	2.4.0 (WIP)
172	KIP-149: Enabling key access in ValueTransformer, ValueMapper, and ValueJoiner	1.1.0 (partially implemented) (WIP for 2.4.0)
191: KafkaConsumer.subscribe() overload that takes just Pattern	1.0.0
174	KIP-190: Handle client-ids consistently between clients and brokers	1.0.0
175	KIP-189: Improve principal builder interface and add support for SASL	1.0.0
176	KIP-188 - Add new metrics to support health checks	1	173	KIP-146 - Classloading Isolation in Connect	0.11.0.0
174177	KIP-145 - Expose Record Headers in Kafka Connect187 - Add cumulative count metric for all Kafka rate metrics	1.10.0
175178	KIP-144: Exponential backoff for broker reconnect attempts186: Increase offsets retention default to 7 days	20.11.0.0
176179	KIP-143: Controller Health Metrics183 - Change PreferredReplicaLeaderElectionCommand to use AdminClient	2.20.11.0.0
177180	KIP-140: Add administrative RPCs for adding, deleting, and listing ACLs	0.11.0.0	182: Reduce Streams DSL overloads and allow easier use of custom storage engines	1.0.0
181	KIP-180: Add a broker metric specifying the number of consumer group rebalances in progress	1.1.0
182	KIP-177: Consumer perf tool should count rebalance time	178	KIP-138: Change punctuate semantics	1.0.0
179183	KIP-	176: Remove deprecated new-consumer option for tools	2	.0.0
180184	KIP-136: Add Listener name to SelectorMetrics tags175: Additional '--describe' views for ConsumerGroupCommand	1.10.11.0.0
181185	KIP-134: Delay initial consumer group rebalance174 - Deprecate and remove internal converter configs in WorkerConfig	20.11.0.0
182186	KIP-133: Describe and Alter Configs Admin APIs173: Add prefix to StreamsConfig to enable setting default internal topic configs	1.0.11.0.0
183187	KIP	-171 - Extend Consumer Group Reset Offset for Stream Application	1.	1.0
184188	KIP-129: Streams Exactly-Once Semantics168: Add GlobalTopicCount and GlobalPartitionCount metric per cluster	10.11.0.0
185189	KIP-128167: Add ByteArrayConverter for Kafka Connectinterface for the state store restoration process	10.11.0.0
186190	KIP- 126 - Allow KafkaProducer to split and resend oversized batches. 164 - Add UnderMinIsrPartitionCount and per-partition UnderMinIsr metrics	1.0.11.0.0
187191	KIP-	163: Lower the Minimum Required ACL Permission of OffsetFetch	1	.0.0
188192	KIP-123: Allow per stream/table timestamp extractor162: Enable topic deletion by default	10.11.0.0
189193	KIP-122: Add Reset Consumer Group Offsets tooling161: streams deserialization exception handlers	1.0.11.0.0
190194	KIP-121: Add KStream peek method160: Augment KStream.print(), KStream.writeAsText() to allow users pass in extra parameters in the printed string	10.11.0.0
191195	KIP	-157 - Add consumer config options to streams reset tool	1.0.0
192196	KIP-	156 Add option "dry run" to Streams application reset tool	0.11.0.0
193197	KIP	-155 - Add range scan for windowed state stores	0.11	.0.0
194198	KIP-117: Add a public AdminClient API for Kafka admin operations154 Add Kafka Connect configuration properties for creating internal topics	0.11.0.0
195199	KIP-115: Enforce offsets.topic.replication.factor upon __consumer_offsets auto topic creation153: Include only client traffic in BytesOutPerSec metric	0.11.0.0
196200	KIP-152 - Improve diagnostics for SASL authentication failures	1.0.0
201	KIP-151 Expose Connector type in REST API114: KTable state stores and improved semantics	0.11.0.0
197202	KIP-113: Support replicas movement between log directories	1.1.0
198	KIP-112: Handle disk failure for JBOD	1.0.0
199	KIP-110: Add Codec for ZStandard Compression	2.1.0
-150 - Kafka-Streams Cogroup	2.4.0 (WIP)
203	KIP-149: Enabling key access in ValueTransformer, ValueMapper, and ValueJoiner	1.1.0 (partially implemented) (WIP for 2.4.0)
204	KIP-146 - Classloading Isolation in Connect	200	KIP-109: Old Consumer Deprecation	0.11.0.0
201205	KIP-108: Create Topic Policy	0.10.2.0	-145 - Expose Record Headers in Kafka Connect	1.1.0
206202	KIP-107: Add deleteRecordsBefore() API in AdminClient144: Exponential backoff for broker reconnect attempts	0.11.0.0
203207	KIP-106 - Change Default unclean.leader.election.enabled from True to False143: Controller Health Metrics	0.11.0.0
204208	KIP-105: Addition of Record Level for Sensors140: Add administrative RPCs for adding, deleting, and listing ACLs	0.1011.20.0
205209	KIP-104: Granular Sensors for Streams 138: Change punctuate semantics	1.00.10.2.0
206210	KIP-103: Separation of Internal and External traffic137: Enhance TopicCommand --describe to show topics marked for deletion	0.1011.20.0
207211	KIP-102 - Add close with timeout for consumers136: Add Listener name to SelectorMetrics tags	0.1011.20.0
208212	KIP-101 - Alter Replication Protocol to use Leader Epoch rather than High Watermark for Truncation134: Delay initial consumer group rebalance	0.11.0.0
209213	KIP-100 - Relax Type constraints in Kafka Streams API133: Describe and Alter Configs Admin APIs	0.1011.20.0
210214	KIP-	130: Expose states of active tasks to KafkaStreams public API	1.0	.0
211215	KIP-98 129: Streams Exactly- Exactly Once Delivery and Transactional MessagingSemantics	0.11.0.0
212216	KIP-97128: Improved Kafka Client RPC Compatibility PolicyAdd ByteArrayConverter for Kafka Connect	0.1011.20.0
213217	KIP-96 - Add per partition metrics for in-sync and assigned replica count126 - Allow KafkaProducer to split and resend oversized batches.	0.1011.20.0
214218	KIP-94 Session Windows-124 - Request rate quotas	0.1011.20.0
215219	KIP-93: Improve invalid timestamp handling in Kafka Streams123: Allow per stream/table timestamp extractor	0.1011.20.0
216220	KIP-92 - Add per partition lag metrics to KafkaConsumer122: Add Reset Consumer Group Offsets tooling	0.1011.20.0
217221	KIP-91 Provide Intuitive User Timeouts in The Producer121: Add KStream peek method	0.11.0 2.1 .0
218222	KIP-90 - Remove zkClient dependency from Streams	0.10.2.0	120: Cleanup Kafka Streams builder API	1.0.0
223219	KIP-89: Allow sink connectors to decouple flush and offset commit	0.10.2.0
220	KIP-88: OffsetFetch Protocol Update	0.10.2.0
119: Drop Support for Scala 2.10 in Kafka 0.11	0.11.0.0
224	KIP-118: Drop Support for Java 7	221	KIP-86: Configurable SASL callback handlers	2.0.0
222225	KIP-85: Dynamic JAAS configuration 117: Add a public AdminClient API for Kafka clientsadmin operations	0.1011.20.0
223226	KIP-84: Support SASL SCRAM mechanisms115: Enforce offsets.topic.replication.factor upon __consumer_offsets auto topic creation	0.1011.20.0
224227	KIP-82 - Add Record Headers114: KTable state stores and improved semantics	0.11.0.0
225228	KIP-81: Bound Fetch memory usage in the consumer	2.4.0 (WIP)
226	KIP-79 - ListOffsetRequest/ListOffsetResponse v1 and add timestamp search methods to the new consumer	0.10.1.0
113: Support replicas movement between log directories	1.1.0
229	KIP-112: Handle disk failure for JBOD	1.0.0
230	KIP-110: Add Codec for ZStandard Compression	2	227	KIP-78: Cluster Id	.1.0
228231	KIP-77: Improve Kafka Streams Join Semantics109: Old Consumer Deprecation	0.1011.20.0
229232	KIP-75 - Add per-connector Converters108: Create Topic Policy	0.10.12.0
230233	KIP-74107: Add Fetch Response Size Limit in BytesdeleteRecordsBefore() API in AdminClient	0.1011.10.0
231234	KIP -73: Replication Quotas -106 - Change Default unclean.leader.election.enabled from True to False	0.1011.10.0
232235	KIP-72: Allow putting a bound on memory consumed by Incoming request 105: Addition of Record Level for Sensors	0.10.21.0.0
233236	KIP-71: Enable log compaction and deletion to co-exist104: Granular Sensors for Streams	0.10.12.0
234237	KIP-70: Revise Partition Assignment Semantics on New Consumer's Subscription Change103: Separation of Internal and External traffic	0.10.12.0
235238	KIP-67: Queryable state for Kafka Streams-102 - Add close with timeout for consumers	0.10.12.0
236239	KIP-66: Single Message Transforms for Kafka Connect101 - Alter Replication Protocol to use Leader Epoch rather than High Watermark for Truncation	0.1011.20.0
240	KIP-100 - Relax Type constraints in Kafka Streams API	/ 0.1110.02.0
237241	KIP-65: Expose timestamps to Connect99: Add Global Tables to Kafka Streams	0.10.12.0
238242	KIP-63: Unify store and downstream caching in streams98 - Exactly Once Delivery and Transactional Messaging	0.1011.10.0
239243	KIP-62: Allow consumer to send heartbeats from a background thread97: Improved Kafka Client RPC Compatibility Policy	0.10.12.0
240244	KIP-60 - Make Java client classloading more flexible96 - Add per partition metrics for in-sync and assigned replica count	0.10.12.0
241245	KIP-58 - Make Log Compaction Point Configurable94 Session Windows	0.10.12.0
242246	KIP-57 - Interoperable LZ4 Framing93: Improve invalid timestamp handling in Kafka Streams	0.10.02.0
243247	KIP-56: Allow cross origin HTTP requests on all HTTP methods92 - Add per partition lag metrics to KafkaConsumer	0.10.02.0
244248	KIP-55: Secure Quotas for Authenticated Users91 Provide Intuitive User Timeouts in The Producer	20.10.1.0
245249	KIP-54: Sticky Partition Assignment Strategy90 - Remove zkClient dependency from Streams	0.1110.02.0
246250	KIP-52: Connector Control APIs89: Allow sink connectors to decouple flush and offset commit	0.10.02.0
247251	KIP-51 - List Connectors REST API88: OffsetFetch Protocol Update	0.10.02.0
248252	KIP-86: Configurable SASL callback handlers	2.050 - Move Authorizer to o.a.k.common package0.10.1.0
249253	KIP-48 Delegation token support for Kafka	1.1.0	250	KIP-45 - Standardize all client sequence interaction on j.u.Collection.85: Dynamic JAAS configuration for Kafka clients	0.10.02.0
251254	KIP-4384: Kafka Support SASL enhancementsSCRAM mechanisms	0.10.02.0
252255	KIP-42: Add Producer and Consumer Interceptors82 - Add Record Headers	0.1011.0.0
253256	KIP-41: Consumer Max Records	0.10.0.0
254	KIP-40: ListGroups and DescribeGroup	0.9.0.0
255	KIP-38: ZooKeeper Authentication	0.9.0.0
81: Bound Fetch memory usage in the consumer	2.4.0 (WIP)
257	KIP-79 - ListOffsetRequest/ListOffsetResponse v1 and add timestamp search methods to the new consumer	0.10.1.0
258	KIP-78: Cluster Id	0.10.1.0
259	KIP-77: Improve Kafka Streams Join Semantics	256	KIP-36 - Rack aware replica assignment	0.10.02.0
257260	KIP-75 - 35 - Retrieving protocol versionAdd per-connector Converters	0.10.01.0
258261	KIP-33 - Add a time based log index74: Add Fetch Response Size Limit in Bytes	0.10.1.0
259262	KIP-32 - Add timestamps to Kafka message73: Replication Quotas	0.10.01.0
260263	KIP-31 - Move to relative offsets in compressed message sets72: Allow putting a bound on memory consumed by Incoming request	1.0.10.0.0
261264	KIP-28 - Add a processor client71: Enable log compaction and deletion to co-exist	0.10.01.0
262265	KIP-26 - Add Kafka Connect framework for data import/export70: Revise Partition Assignment Semantics on New Consumer's Subscription Change	0.910.01.0
263266	KIP-25 - System test improvements67: Queryable state for Kafka Streams	0.910.01.0
264267	KIP-22 - Expose a Partitioner interface in the new producer66: Single Message Transforms for Kafka Connect	0.10.2.0 / 0.110.9.0.0
265268	KIP-21 - Dynamic Configuration65: Expose timestamps to Connect	0.910.01.0 (WIP)
266269	KIP-20 Enable log preallocate to improve consume performance under windows and some old Linux file system63: Unify store and downstream caching in streams	0.910.01.0
267270	KIP-19 - Add a request timeout to NetworkClient62: Allow consumer to send heartbeats from a background thread	0.910.01.0
268271	KIP-16 - Automated Replica Lag Tuning60 - Make Java client classloading more flexible	0.910.01.0
269272	KIP-15 - Add a close method with a timeout in the producer58 - Make Log Compaction Point Configurable	0.910.01.0
270273	KIP-13 - Quota Design57 - Interoperable LZ4 Framing	0.910.0.0
271274	KIP-12 - Kafka Sasl/Kerberos and SSL implementation56: Allow cross origin HTTP requests on all HTTP methods	0.910.0.0
272275	KIP-11 - Kafka Authorizer design55: Secure Quotas for Authenticated Users	0.910.01.0
273276	KIP-8 - Add a flush method to the producer API54: Sticky Partition Assignment Strategy	0.911.0.0
274277	KIP-4 - Metadata Protocol Changes52: Connector Control APIs	0.10.0.0
275278	KIP-4 - Command line and centralized administrative operations51 - List Connectors REST API	0.910.0.0,
279	KIP-48 Delegation token support for Kafka	1.1.0
280	KIP-45 - Standardize all client sequence interaction on j.u.Collection.	0.10.0.0
281	KIP-43: Kafka SASL enhancements	, 0.10.10.0
276282	KIP-3 - Mirror Maker Enhancement42: Add Producer and Consumer Interceptors	0.910.0.0
277283	KIP-2 - Refactor brokers to allow listening on multiple ports and IPs41: Consumer Max Records	0.910.0.0
278284	KIP-1 - Remove support of request.required.acks40: ListGroups and DescribeGroup	0.9.0.0

...

285	KIP-38: ZooKeeper Authentication	0.9.0.0
286	KIP-36 - Rack aware replica assignment	0.10.0.0
287	KIP-35 - Retrieving protocol version	0.10.0.0
288	KIP-33 - Add a time based log index	0.10.1.0
289	KIP-32 - Add timestamps to Kafka message	0.10.0.0
290	KIP-31 - Move to relative offsets in compressed message sets	0.10.0.0
291	KIP-28 - Add a processor client	0.10.0.0
292	KIP-26 - Add Kafka Connect framework for data import/export	0.9.0.0
293	KIP-25 - System test improvements	0.9.0.0
294	KIP-22 - Expose a Partitioner interface in the new producer	0.9.0.0
295	KIP-21 - Dynamic Configuration	0.9.0.0 (WIP)
296	KIP-20 Enable log preallocate to improve consume performance under windows and some old Linux file system	0.9.0.0
297	KIP-19 - Add a request timeout to NetworkClient	0.9.0.0
298	KIP-16 - Automated Replica Lag Tuning	0.9.0.0
299	KIP-15 - Add a close method with a timeout in the producer	0.9.0.0
300	KIP-13 - Quota Design	0.9.0.0
301	KIP-12 - Kafka Sasl/Kerberos and SSL implementation	0.9.0.0
302	KIP-11 - Kafka Authorizer design	0.9.0.0
303	KIP-8 - Add a flush method to the producer API	0.9.0.0
304	KIP-4 - Metadata Protocol Changes	0.10.0.0
305	KIP-4 - Command line and centralized administrative operations	0.9.0.0, 0.10.0.0, 0.10.1.0
306	KIP-3 - Mirror Maker Enhancement	0.9.0.0
307	KIP-2 - Refactor brokers to allow listening on multiple ports and IPs	0.9.0.0
308	KIP-1 - Remove support of request.required.acks	0.9.0.0

KIPs under discussion

Please insert new rows in sorted order (ascending by KIP number). Please move the adopted/accepted KIPs to the "Adopted KIPs" table above.

KIP	Comment
KIP-59: Proposal for a kafka broker command	Sent emails to Dev discussion group. Work tracked under KAFKA-3663.
KIP-125: ZookeeperConsumerConnector to KafkaConsumer Migration and Rollback
KIP-131 - Add access to OffsetStorageReader from SourceConnector
KIP-135 : Send of null key to a compacted topic should throw non-retriable error back to user
KIP 141 - ProducerRecord & SourceRecord: Add timestamp constructors
KIP-142: Add ListTopicsRequest to efficiently list all the topics in a cluster
KIP-148: Add a connect timeout for client
KIP-158: Kafka Connect should allow source connectors to set topic-specific settings for new topics
KIP-159: Introducing Rich functions to Streams
KIP-166 - Add a tool to make amounts of replicas and leaders on brokers balanced
KIP-169 - Lag-Aware Partition Assignment Strategy
KIP-178: Size-based log directory selection strategy
KIP-185: Make exactly once in order delivery the default producer setting
KIP-193: Add SchemaBuilder.from(Schema)
KIP-199: Add Kafka Connect offset tool
KIP-201: Rationalising Policy interfaces
KIP-209: C onnection String Support
KIP-216: IQ should throw different exceptions for different errors
KIP-217: Expose a timeout to allow an expired ZK session to be re-created
KIP-228 Negative record timestamp support	Voting in progress
KIP-234: add support for getting topic defaults from AdminClient
KIP-236: Interruptible Partition Reassignment	Discussion
KIP-240: AdminClient.listReassignments() AdminClient.describeReassignments()
KIP-242: Mask password in Kafka Connect Rest API response
KIP-250 Add Support for Quorum-based Producer Acknowledgment
KIP-252 - Extend ACLs to allow filtering based on ip ranges and subnets
KIP-253: Support in-order message delivery with partition expansion	Discussion
KIP-254: JsonConverter Exception Handeling
KIP-259: Improve Streams DSL Timestamp Propagation Semantics
KIP-260: add primary join operation for Stream-Stream join (WIP)	Draft
KIP-264: Add a consumer metric to record raw fetch size	Voting in progress
KIP-271: Add NetworkClient redirector	Discussion
KIP-273: Kafka to support using ETCD beside Zookeeper	Discussion
KIP-275 - Indicate "isClosing" in the SinkTaskContext	Voting in progress
KIP-280: Enhanced log compaction	Discussion
KIP-293 Add new metrics for consumer/replication fetch requests	Voting in progress
KIP-296: Add connector level configurability for producer/consumer client configs	Discussion
KIP-301: Schema Inferencing for JsonConverter	Discussion
KIP-304: Connect runtime mode improvements for container platforms	Discussion
KIP-314: KTable to GlobalKTable Bi-directional Join	Discussion
KIP-315: Stream Join Sticky Assignor	Discussion
KIP-316: Command-line overrides for ConnectDistributed worker properties	Discussion
KIP-317: Add end-to-end data encryption functionality to Apache Kafka	Discussion
KIP-325: Extend Consumer Group Command to Show Beginning Offsets	Voting in Progress345
KIP-326: Schedulable KTable as Graph source	Discussion
KIP-333: Add faster mode of rebalancing	Discussion
KIP-334 - Include partitions in exceptions raised during consumer record deserialization/validation
KIP-335: Consider configurations for KafkaStreams	Discussion
KIP-347: Enable batching in FindCoordinatorRequest	Discussion
KIP-348 Eliminate null from SourceTask#poll()
KIP-350: Allow kafka-topics.sh to take brokerid as parameter to show partitions associated with it
KIP-356: Add KafkaConsumer fetch-error-rate and fetch-error-total metrics	Discussion
KIP-360: Improve handling of unknown producer	Discussion
K IP-362: Support Dynamic Session Window	Discussion
KIP-363: Allow performance tools to print final results to output file	Discussion
KIP-370: Remove Orphan Partitions	Discussion
KIP-373: Allow users to create delegation tokens for other users	Discussion
KIP-375: Kafka Clients - make Metadata#TOPIC_EXPIRY_MS configurable	Discussion
KIP-378: Enable Dependency Injection for Kafka Streams handlers	Discussion
KIP-381: Connect: Tell about records that had their offsets flushed in callback	Voting in progress (restarted 18th January 2019, due to no votes in first attempt)
KIP-383: Pluggable interface for SSL Factory	Voting in progress
KIP-384: Add config for incompatible changes to persistent metadata	Discussion
KIP-385: Avoid throwing away prefetched data	Discussion
KIP-387: Fair Message Consumption Across Partitions in KafkaConsumer	Discussion
KIP-388: Add observer interface to record request and response	Discussion
KIP-390: Allow fine-grained configuration for compression	Discussion, JIRA exists with pull-request
KIP-391: Allow Producing with Offsets for Cluster Replication	Discussion, JIRA exists with pull-request
KIP-392: Allow consumers to fetch from closest replica	Discussion
KIP-395: Encypt-then-MAC Delegation token metadata
KIP-397: Add methods to override fetch offsets based on timestamp	Discussion
KIP-398: Support reading trust store from classpath	Discussion
KIP-399: Extend ProductionExceptionHandler to cover serialization exceptions	Discussion
KIP-400: Improve exit status in case of errors in ConsoleProducer	Discussion
KIP-403: Increase ProducerPerformance precision by using nanoTime	Draft
KIP-405: Kafka Tiered Storage	Discussion
KIP-406: GlobalStreamThread should honor custom offset policy.	Discussion
KIP-407: Kafka Connect support override worker kafka api configuration with connector configuration that post by rest api
KIP-408: Add asynchronous processing to Kafka Streams	Discussion
KIP-409: Allow creating under-replicated topics and partitions
KIP-410: Add metric for request handler thread pool utilization by request type	Discussion
KIP-416: Notify SourceTask of ACK'd offsets, metadata	Discussion
KIP-418: A method-chaining way to branch KStream	Discussion, JIRA exists with pull-request
KIP-419: Safely notify Kafka Connect SourceTask is stopped	Voting in progress, JIRA exists with pull request
KIP-422: Add support for client quota configuration in the Kafka Admin Client	Discussion, JIRA exists with pull-request
KIP-423: Add JoinReason to Consumer Join Group Protocol	Discussion
KIP-424: Allow suppression of intermediate events based on wall clock time	Discussion
KIP-426: Persist Broker Id to Zookeeper	Discussion
KIP-431: Support of printing additional ConsumerRecord fields in DefaultMessageFormatter	Voting in progress, JIRA exists with pull-request
KIP-435: Internal Partition Reassignment Batching	Discussion
KIP-437: Custom replacement for MaskField SMT	Voting in progress

Please insert new rows in sorted order (by KIP number).

407 Kafka Connect support override worker kafka api configuration with connector configuration that post by rest api

KIP	Comment
KIP-59: Proposal for a kafka broker command	Sent emails to Dev discussion group. Work tracked under KAFKA-3663.
KIP-125: ZookeeperConsumerConnector to KafkaConsumer Migration and Rollback	KIP-131 - Add access to OffsetStorageReader from SourceConnector	KIP-135 : Send of null key to a compacted topic should throw non-retriable error back to user	KIP 141 - ProducerRecord & SourceRecord: Add timestamp constructors	KIP-142: Add ListTopicsRequest to efficiently list all the topics in a cluster	KIP-148: Add a connect timeout for client	KIP-158: Kafka Connect should allow source connectors to set topic-specific settings for new topics	KIP-159: Introducing Rich functions to Streams	KIP-166 - Add a tool to make amounts of replicas and leaders on brokers balanced	KIP-169 - Lag-Aware Partition Assignment Strategy	KIP-178: Size-based log directory selection strategy	KIP-185: Make exactly once in order delivery the default producer setting	KIP-193: Add SchemaBuilder.from(Schema)	KIP-199: Add Kafka Connect offset tool	KIP-201: Rationalising Policy interfaces	KIP-209: C onnection String Support	KIP-216: IQ should throw different exceptions for different errors	KIP-217: Expose a timeout to allow an expired ZK session to be re-created
KIP-221: Enhance KStream with Connecting Topic Creation and Repartition Hint	Discussion
KIP-228 Negative record timestamp support	Voting in progress
KIP-234: add support for getting topic defaults from AdminClient
KIP-236: Interruptible Partition Reassignment	Discussion
KIP-240: AdminClient.listReassignments() AdminClient.describeReassignments()	KIP-242: Mask password in Kafka Connect Rest API response	KIP-250 Add Support for Quorum-based Producer Acknowledgment	KIP-252 - Extend ACLs to allow filtering based on ip ranges and subnets
KIP-253: Support in-order message delivery with partition expansion	Discussion
KIP-254: JsonConverter Exception Handeling	KIP-259: Improve Streams DSL Timestamp Propagation Semantics
KIP-260: add primary join operation for Stream-Stream join (WIP)	Draft
KIP-264: Add a consumer metric to record raw fetch size	Voting in progress
KIP-271: Add NetworkClient redirector	Discussion
KIP-273: Kafka to support using ETCD beside Zookeeper	Discussion
KIP-275 - Indicate "isClosing" in the SinkTaskContext	Voting in progress
KIP-280: Enhanced log compaction	Discussion
KIP-291: Separating controller connections and requests from the data plane	Accepted
KIP-293 Add new metrics for consumer/replication fetch requests	Voting in progress
KIP-296: Add connector level configurability for producer/consumer client configs	Discussion
KIP-301: Schema Inferencing for JsonConverter	Discussion
KIP-304: Connect runtime mode improvements for container platforms	Discussion
KIP-314: KTable to GlobalKTable Bi-directional Join	Discussion
KIP-315: Stream Join Sticky Assignor	Discussion
KIP-316: Command-line overrides for ConnectDistributed worker properties	Discussion
KIP-317: Add end-to-end data encryption functionality to Apache Kafka	Discussion
KIP-325: Extend Consumer Group Command to Show Beginning Offsets	Voting in Progress345
KIP-326: Schedulable KTable as Graph source	Discussion
KIP-333: Add faster mode of rebalancing	Discussion
KIP-334 - Include partitions in exceptions raised during consumer record deserialization/validation
KIP-335: Consider configurations for KafkaStreams	Discussion
KIP-345: Introduce static membership protocol to reduce consumer rebalances	Accepted
KIP-347: Enable batching in FindCoordinatorRequest	Discussion
KIP-348 Eliminate null from SourceTask#poll()	KIP-350: Allow kafka-topics.sh to take brokerid as parameter to show partitions associated with it
KIP-356: Add KafkaConsumer fetch-error-rate and fetch-error-total metrics	Discussion
KIP-360: Improve handling of unknown producer	Discussion
K IP-362: Support Dynamic Session Window	Discussion
KIP-363: Allow performance tools to print final results to output file	Discussion
KIP-369: Alternative Partitioner to Support "Always Round-Robin" Selection	Accepted
KIP-370: Remove Orphan Partitions	Discussion
KIP-373: Allow users to create delegation tokens for other users	Discussion
KIP-375: Kafka Clients - make Metadata#TOPIC_EXPIRY_MS configurable	Discussion
KIP-378: Enable Dependency Injection for Kafka Streams handlers	Discussion
KIP-379: Multiple Consumer Group Management	Accepted
KIP-381: Connect: Tell about records that had their offsets flushed in callback	Voting in progress (restarted 18th January 2019, due to no votes in first attempt)
KIP-383: Pluggable interface for SSL Factory	Voting in progress
KIP-384: Add config for incompatible changes to persistent metadata	Discussion
KIP-385: Avoid throwing away prefetched data	Discussion
KIP-387: Fair Message Consumption Across Partitions in KafkaConsumer	Discussion
KIP-388: Add observer interface to record request and response	Discussion
KIP-389: Introduce a configurable consumer group size limit	Accepted
KIP-390: Allow fine-grained configuration for compression	Discussion, JIRA exists with pull-request
KIP-391: Allow Producing with Offsets for Cluster Replication	Discussion, JIRA exists with pull-request
KIP-392: Allow consumers to fetch from closest replica438: Expose task, connector IDs in Connect API	Discussion
KIP-395: Encypt-then-MAC Delegation token metadata439: Cleanup built-in Store interfaces	Discussion
KIP-396: Add Commit/List Offsets Operations to AdminClient441: Smooth Scaling Out for Kafka Streams	Discussion
KIP-397: Add methods to override fetch offsets based on timestamp444: Augment metrics for Kafka Streams	Discussion
KIP-398: Support reading trust store from classpath447: Producer scalability for exactly once semantics	Discussion
KIP-399: Extend ProductionExceptionHandler to cover serialization exceptions448: Add State Stores Unit Test Support to Kafka Streams Test Utils	Discussion
KIP-400: Improve exit status in case of errors in ConsoleProducer450: Sliding Window Aggregations in the DSL	Discussion
KIP-401: TransformerSupplier/ProcessorSupplier StateStore connecting452: Tool to view cluster status	Discussion, JIRA existsVoting in progress
KIP-403: Increase ProducerPerformance precision by using nanoTime457: Add DISCONNECTED status to Kafka Streams	Discussion Draft
KIP-405: Kafka Tiered Storage459: Improve KafkaStreams#close	Discussion
KIP-406: GlobalStreamThread should honor custom offset policy.463: Auto-configure non-default Serdes passed alongside the TopologyBuilder	Under discussionDiscussion
KIP-	466:
KIP-408: Add asynchronous processing to Kafka Streams	Discussion
KIP-409: Allow creating under-replicated topics and partitions
Add support for List<T> serialization and deserialization	Voting in progress
KIP-468: Avoid decompression of record when validate record at server in the scene of inPlaceAssignment .	Under discussion
KIP-470: TopologyTestDriver test input and output usability improvements	Voting in progress
KIP-473: Enable KafkaLog4JAppender to use SASL Authentication Callback Handlers	Under Discussion
KIP-477: Add PATCH method for connector config in Connect REST API	Under Discussion
KIP-478 - Strongly typed Processor API	Under Discussion
KIP-486: Support custom way to load KeyStore and TrustStore	Under Discussion
KIP-487: Automatic Topic Creation on Producer	Under Discussion
KIP-489: Kafka Consumer Record Latency Metric	Under Discussion
KIP-490: New metric to count offsets expired without being consumed by a consumer group	Under discussion
KIP-491: Preferred Leader Deprioritized List (Temporary Blacklist)	Under discussion
KIP-494: Connect REST Endpoint to get Transformations (SMTs)
KIP-498: Add client-side configuration for maximum response size to protect against OOM	Sent emails to Dev discussion group. Work tracked under KAFKA-4090.
KIP-499 - Unify connection name flag for command line tool	Under discussion
KIP-499: Create a controller RPC for changing configurations
KIP-502: Connect SinkTask.put(...) to specify ArrayList<SinkRecord> in Signature
KIP-505: Add new public method to only update assignment metadata in consumer	Under discussion
KIP-506: Allow setting SCRAM password via Admin interface	Under discussion
KIP-507: Securing Internal Connect REST Endpoints	Voting in progress, draft available
KIP-508: Make Suppression State Queriable	Under discussion
KIP-509: Rebalance and restart Producers	Under discussion
KIP-510: Metrics library upgrade	Under discussion
KIP-511: Collect and Expose Client's Name and Version in the Brokers
KIP-512: Adding headers to RecordMetaData	Sent mail to dev discussion group
KIP-513: Distinguish between Key and Value serdes in scala wrapper library for kafka streams
KIP-514:Add a bounded flush() API to Kafka Producer
KIP-515: Reorganize checkpoint system in log cleaner to per partition
KIP-516: Topic Identifiers & Topic Deletion State Improvements	Under discussion
KIP-517: Add consumer metrics to observe user poll behavior	Under discussion
KIP-518: Allow listing consumer groups per state	Under discussion
KIP-519: Make SSL context/engine configuration extensible	Under discussion
KIP-521: Enable redirection of Connect's log4j messages to a file by default	Under discussion
KIP-522: Update BrokerApiVersionsCommand to use AdminClient	Draft
KIP-523: Add KStream#toTable to the Streams DSL	Under discussion
KIP-525 - Return topic metadata and configs in CreateTopics response	Under discussion
KIP-526: Reduce Producer Metadata Lookups for Large Number of Topics	Under discussion
KIP-527: Add NullSerde to Serdes	Under discussion
KIP-528: Deprecate PartitionGrouper configuration and interface	Under discussion
KIP-410: Add metric for request handler thread pool utilization by request type	Discussion
KIP-416: Notify SourceTask of ACK'd offsets, metadata	Discussion
KIP-418: A method-chaining way to branch KStream	Discussion, JIRA exists with pull-request
KIP-419: Safely notify Kafka Connect SourceTask is stopped	Voting in progress, JIRA exists with pull request
KIP-421: Support resolving externalized secrets in AbstractConfig	Accepted
KIP-422: Add support for client quota configuration in the Kafka Admin Client	Discussion, JIRA exists with pull-request
KIP-423: Add JoinReason to Consumer Join Group Protocol	Discussion
KIP-424: Allow suppression of intermediate events based on wall clock time	Discussion
KIP-426: Persist Broker Id to Zookeeper	Discussion
KIP-431: Support of printing additional ConsumerRecord fields in DefaultMessageFormatter	Voting in progress, JIRA exists with pull-request
KIP-434: Add Replica Fetcher and Log Cleaner Count Metrics	Discussion
KIP-435: Incremental Partition Reassignment	Discussion
KIP-437: Custom replacement for MaskField SMT	Voting in progress, JIRA exists with pull-request
KIP-438: Expose task, connector IDs in Connect API	Discussion
KIP-439: Cleanup built-in Store interfaces	Discussion
KIP-440: Extend Connect Converter to support headers	Voting in progress
KIP-444: Augment metrics for Kafka Streams	Discussion
KIP-448: Add State Stores Unit Test Support to Kafka Streams Test Utils	Discussion
KIP-450: Sliding Window Aggregations in the DSL	Discussion
KIP-452: Tool to view cluster status	Discussion, JIRA exists
KIP-455: Create an Administrative API for Replica Reassignment	Discussion
KIP-456: Helper classes to make it simpler to write test logic with TopologyTestDriver	Discussion
KIP-457: Add DISCONNECTED status to Kafka Streams	Discussion
KIP-459: Improve KafkaStreams#close	Discussion
KIP-463: Auto-configure non-default Serdes passed alongside the TopologyBuilder	Under discussion
KIP-468: Avoid decompression of record when validate record at server in the scene of inPlaceAssignment .	Under discussion
KIP-470: TopologyTestDriver test input and output usability improvements	Under discussion
KIP-471: Expose RocksDB Metrics in Kafka Streams	Under discussion
KIP-472: Add header to RecordContext/ProducerRecord	Under Discussion
KIP-466: Add support for List<T> serialization and deserialization	Under Discussion
KIP-473: Enable KafkaLog4JAppender to use SASL Authentication Callback Handlers	Under Discussion
KIP-474: To deprecate WindowStore#put(key, value)	Under Discussion
KIP-475: New Metric to Measure Number of Tasks on a Connector	Under Discussion
KIP-476: Add Java AdminClient Interface	Under Discussion

Dormant/inactive KIPs

Please insert new rows in sorted order (ascending by KIP number).

KIP	Comment
KIP-6 - New reassignment partition logic for rebalancing	Needs more detail
KIP-10 - Running Producer, Consumers and Brokers on Mesos
KIP-14 - Tools standardization
KIP-17 - Add HighwaterMarkOffset to OffsetFetchResponse
KIP-23 - Add JSON/CSV output and looping options to ConsumerGroupCommand
KIP-27 - Conditional Publish
KIP-30 - Allow for brokers to have plug-able consensus and meta data storage sub systems
KIP-37 - Add Namespaces to Kafka
KIP-39: Pinning controller to broker
KIP-44 - Allow Kafka to have a customized security protocol
KIP-46 - Self Healing
KIP-47 - Add timestamp-based log deletion policy
KIP-49 - Fair Partition Assignment Strategy
KIP-53 - Add custom policies for reconnect attempts to NetworkdClient
KIP-59: Proposal for a kafka broker command
KIP-64 -Allow underlying distributed filesystem to take over replication depending on configuration
KIP-68 Add a consumed log retention before log retention
KIP-69 - Kafka Schema Registry	Draft
KIP-76 Enable getting password from executable rather than passing as plaintext in config files
KIP-87 - Add Compaction Tombstone Flag	Possibly displaced by KIP-82
KIP-95: Incremental Batch Processing for Kafka Streams
KIP-269: Substitution Within Configuration Values
KIP-349: Priorities for Source Topics	Functionality can be realized with existing API although at a lower level.
KIP-399: Extend ProductionExceptionHandler to cover serialization exceptions