Log in
Skip to sidebar
Skip to main content
Linked Applications
Loading…
Apache Software Foundation
Spaces
Hit enter to search
Help
Online Help
Keyboard Shortcuts
Feed Builder
What’s new
What’s new
Available Gadgets
About Confluence
Log in
Apache Kafka
Pages
Blog
Space shortcuts
Retrospectives
Child pages
Kafka Streams
Kafka Streams KIP Overview
Browse pages
Configure
Space tools
View Page
A
t
tachments (0)
Page History
Page Information
View in Hierarchy
View Source
Delete comments
Export to PDF
Export to Word
Copy Page Tree
Pages
…
Index
Kafka Streams
Kafka Streams KIP Overview
Page Information
Title:
Kafka Streams KIP Overview
Author:
Matthias J. Sax
Jan 15, 2020
Last Changed by:
Matthias J. Sax
Jul 29, 2024
Tiny Link:
(useful for email)
https://cwiki.apache.org/confluence/x/9oqvC
Export As:
Word
·
PDF
Incoming Links
Apache Kafka (1)
Page:
Kafka Streams
Hierarchy
Parent Page
Page:
Kafka Streams
Labels
There are no labels assigned to this page.
Recent Changes
Time
Editor
Jul 29, 2024 20:35
Matthias J. Sax
View Changes
Jul 19, 2024 20:55
Matthias J. Sax
View Changes
Jul 12, 2024 18:50
Matthias J. Sax
View Changes
Mar 31, 2024 10:00
Matthias J. Sax
View Changes
Feb 28, 2024 22:53
Matthias J. Sax
View Page History
Outgoing Links
External Links (35)
https://cwiki.apache.org/confluence/display/KAFKA/KIP-466%3…
https://cwiki.apache.org/confluence/display/KAFKA/KIP-744%3…
https://cwiki.apache.org/confluence/display/KAFKA/KIP-472%3…
https://cwiki.apache.org/confluence/display/KAFKA/KIP-732%3…
https://cwiki.apache.org/confluence/display/KAFKA/KIP-985%3…
https://cwiki.apache.org/confluence/display/KAFKA/KIP-67%3A…
https://cwiki.apache.org/confluence/display/KAFKA/KIP-149%3…
https://cwiki.apache.org/confluence/display/KAFKA/KIP-741%3…
https://cwiki.apache.org/confluence/display/KAFKA/KIP-695%3…
https://cwiki.apache.org/confluence/display/KAFKA/KIP-345%3…
https://cwiki.apache.org/confluence/pages/viewpage.action?p…
https://cwiki.apache.org/confluence/display/KAFKA/KIP-62%3A…
https://cwiki.apache.org/confluence/x/KZvkCw
https://cwiki.apache.org/confluence/display/KAFKA/KIP-165%3…
https://cwiki.apache.org/confluence/display/KAFKA/KIP-992%3…
https://cwiki.apache.org/confluence/display/KAFKA/KIP-245%3…
https://cwiki.apache.org/confluence/pages/viewpage.action?p…
https://cwiki.apache.org/confluence/pages/viewpage.action?p…
https://cwiki.apache.org/confluence/pages/viewpage.action?p…
https://cwiki.apache.org/confluence/pages/viewpage.action?p…
https://cwiki.apache.org/confluence/pages/viewpage.action?p…
https://cwiki.apache.org/confluence/display/KAFKA/KIP-71%3A…
https://cwiki.apache.org/confluence/display/KAFKA/KIP-715%3…
https://cwiki.apache.org/confluence/display/KAFKA/KIP-295%3…
https://cwiki.apache.org/confluence/display/KAFKA/KIP-312%3…
https://cwiki.apache.org/confluence/display/KAFKA/KIP-689%3…
https://cwiki.apache.org/confluence/display/KAFKA/KIP-393%3…
https://cwiki.apache.org/confluence/display/KAFKA/KIP-904%3…
https://cwiki.apache.org/confluence/display/KAFKA/KIP-613%3…
https://cwiki.apache.org/confluence/display/KAFKA/KIP-743%3…
https://cwiki.apache.org/confluence/display/KAFKA/KIP-292%3…
https://cwiki.apache.org/confluence/display/KAFKA/KIP-733%3…
https://cwiki.apache.org/confluence/display/KAFKA/KIP-616%3…
https://cwiki.apache.org/confluence/display/KAFKA/KIP-364%3…
https://cwiki.apache.org/confluence/display/KAFKA/KIP-622%3…
Apache Kafka (157)
Page:
KIP-259: Improve Streams DSL Timestamp Propagation Semantics
Page:
KIP-478 - Strongly typed Processor API
Page:
Kafka Streams
Page:
KIP-442: Return to default max poll interval in Streams
Page:
KIP-94 Session Windows
Page:
KIP-446: Add changelog topic configuration to KTable suppress
Page:
KIP-663: API to Start and Shut Down Stream Threads
Page:
KIP-714: Client metrics and observability
Page:
KIP-182: Reduce Streams DSL overloads and allow easier use of custom storage engines
Page:
KIP-221: Enhance DSL with Connecting Topic Creation and Repartition Hint
Page:
KIP-93: Improve invalid timestamp handling in Kafka Streams
Page:
KIP 156 Add option "dry run" to Streams application reset tool
Page:
KIP-366: Make FunctionConversions deprecated
Page:
KIP-206: Add support for UUID serialization and deserialization
Page:
KIP-104: Granular Sensors for Streams
Page:
KIP-906: Tools migration guidelines
Page:
KIP-591: Add Kafka Streams config to set default state store
Page:
KIP-268: Simplify Kafka Streams Rebalance Metadata Upgrade
Page:
KIP-989: Improved StateStore Iterator metrics for detecting leaks
Page:
KIP-77: Improve Kafka Streams Join Semantics
Page:
KIP-138: Change punctuate semantics
Page:
KIP-756: Move StreamsResetter tool outside of core
Page:
KIP-244: Add Record Header support to Kafka Streams Processor API
Page:
KIP-659: Improve TimeWindowedDeserializer and TimeWindowedSerde to handle window size
Page:
KIP-528: Deprecate PartitionGrouper configuration and interface
Page:
KIP-205: Add all() and range() API to ReadOnlyWindowStore
Page:
KIP-666: Add Instant-based methods to ReadOnlySessionStore
Page:
KIP-319: Replace segments with segmentInterval in WindowBytesStoreSupplier
Page:
KIP-134: Delay initial consumer group rebalance
Page:
KIP-303: Add Dynamic Routing in Streams Sink
Page:
KIP-358: Migrate Streams API to Duration instead of long ms times
Page:
KIP-353: Improve Kafka Streams Timestamp Synchronization
Page:
KIP-356: Add withCachingDisabled() to StoreBuilder
Page:
KIP-869: Improve Streams State Restoration Visibility
Page:
KIP-132: Augment KStream.print to allow extra parameters in the printed string
Page:
KIP-844: Transactional State Stores
Page:
KIP-941: Range queries to accept null lower and upper bounds
Page:
KIP-763: Range queries with open endpoints
Page:
KIP-372: Naming Repartition Topics for Joins and Grouping
Page:
KIP 155 - Add range scan for windowed state stores
Page:
KIP-820: Extend KStream process with new Processor API
Page:
KIP-571: Add option to force remove members in StreamsResetter
Page:
KIP-462: Use local thread id for KStreams
Page:
KIP-28 - Add a processor client
Page:
KIP-825: introduce a new API to control when aggregated results are produced
Page:
KIP-274: Kafka Streams Skipped Records Metrics
Page:
KIP 130: Expose states of active tasks to KafkaStreams public API
Page:
KIP-813: Shareable State Stores
Page:
KIP-443: Return to default segment.ms and segment.index.bytes in Streams repartition topics
Page:
KIP-962: Relax non-null key requirement in Kafka Streams
Page:
KIP-167: Add interface for the state store restoration process
Page:
KIP-399: Extend ProductionExceptionHandler to cover serialization exceptions
Page:
KIP-530: Consider renaming 'UsePreviousTimeOnInvalidTimeStamp' class to 'UsePartitionTimeOnInvalidTimeStamp'
Page:
KIP-95: Incremental Batch Processing for Kafka Streams
Page:
KIP-479: Add StreamJoined config object to Join
Page:
KIP-276 Add StreamsConfig prefix for different consumers
Page:
KIP-32 - Add timestamps to Kafka message
Page:
KIP-418: A method-chaining way to branch KStream
Page:
KIP-471: Expose RocksDB Metrics in Kafka Streams
Page:
KIP-657: Add Customized Kafka Streams Logo
Page:
KIP-527: Add VoidSerde to Serdes
Page:
KIP-224: Add configuration parameter `retries` to Streams API
Page:
KIP-453: Add close() method to RocksDBConfigSetter
Page:
KIP-450: Sliding Window Aggregations in the DSL
Page:
KIP-202 Move merge() from StreamsBuilder to KStream
Page:
KIP-889: Versioned State Stores
Page:
KIP-708: Rack aware StandbyTask assignment for Kafka Streams
Page:
KIP-447: Producer scalability for exactly once semantics
Page:
KIP-161: streams deserialization exception handlers
Page:
KIP-572: Improve timeouts and retries in Kafka Streams
Page:
KIP-451: Make TopologyTestDriver output iterable
Page:
KIP-884: Add config to configure KafkaClientSupplier in Kafka Streams
Page:
KIP-313: Add KStream.flatTransform and KStream.flatTransformValues
Page:
KIP-210 - Provide for custom error handling when Kafka Streams fails to produce
Page:
KIP-247: Add public test utils for Kafka Streams
Page:
KIP-173: Add prefix to StreamsConfig to enable setting default internal topic configs
Page:
KIP-614: Add Prefix Scan support for State Stores
Page:
KIP-100 - Relax Type constraints in Kafka Streams API
Page:
KIP-811: Add config repartition.purge.interval.ms to Kafka Streams
Page:
KIP-925: Rack aware task assignment in Kafka Streams
Page:
KIP-445: In-memory Session Store
Page:
KIP-907: Add Boolean Serde to public interface
Page:
KIP-960: Support single-key_single-timestamp interactive queries (IQv2) for versioned state stores
Page:
KIP-914: DSL Processor Semantics for Versioned Stores
Page:
KIP 230: Name Windowing Joins
Page:
KIP-150 - Kafka-Streams Cogroup
Page:
KIP-365: Materialized, Serialized, Joined, Consumed and Produced with implicit Serde
Page:
KIP-99: Add Global Tables to Kafka Streams
Page:
KIP-594: Expose output topic names from TopologyTestDriver
Page:
KIP-680: TopologyTestDriver should not require a Properties argument
Page:
KIP-470: TopologyTestDriver test input and output usability improvements
Page:
KIP-775: Custom partitioners in foreign key joins
Page:
KIP-662: Throw Exception when Source Topics of a Streams App are Deleted
Page:
KIP-331 Add default implementation to close() and configure() for Serializer, Deserializer and Serde
Page:
KIP-121: Add KStream peek method
Page:
KIP-63: Unify store and downstream caching in streams
Page:
KIP-761: Add Total Blocked Time Metric to Streams
Page:
KIP-796: Interactive Query v2
Page:
KIP-414: Expose Embedded ClientIds in Kafka Streams
Page:
KIP-428: Add in-memory window store
Page:
KIP-265: Make Windowed Serde to public APIs
Page:
KIP-648: Renaming getter method for Interactive Queries
Page:
KIP-485: Make topic optional when using through() operations in DSL
Page:
KIP-617: Allow Kafka Streams State Stores to be iterated backwards
Page:
KIP-267: Add Processor Unit Test Support to Kafka Streams Test Utils
Page:
KIP-376: Implement AutoClosable on appropriate classes that want to be used in a try-with-resource statement
Page:
KIP-116: Add State Store Checkpoint Interval Configuration
Page:
KIP-378: Enable Dependency Injection for Kafka Streams handlers
Page:
KIP-97: Improved Kafka Client RPC Compatibility Policy
Page:
KIP-330: Add retentionPeriod in SessionBytesStoreSupplier
Page:
KIP-444: Augment metrics for Kafka Streams
Page:
KIP-783: Add TaskId field to StreamsException
Page:
KIP-220: Add AdminClient into Kafka Streams' ClientSupplier
Page:
KIP-535: Allow state stores to serve stale reads during rebalance
Page:
KIP-954: expand default DSL store configuration to custom types
Page:
KIP-557: Add emit on change support for Kafka Streams
Page:
KIP-160: Augment KStream.print(), KStream.writeAsText() to allow users pass in extra parameters in the printed string
Page:
KIP-213 Support non-key joining in KTable
Page:
KIP 157 - Add consumer config options to streams reset tool
Page:
KIP-923: Add A Grace Period to Stream Table Join
Page:
KIP-198: Remove ZK dependency from Streams Reset Tool
Page:
KIP-865: Support --bootstrap-server in kafka-streams-application-reset
Page:
KIP-239 Add queryableStoreName() to GlobalKTable
Page:
KIP-429: Kafka Consumer Incremental Rebalance Protocol
Page:
KIP-114: KTable state stores and improved semantics
Page:
KIP-968: Support single-key_multi-timestamp interactive queries (IQv2) for versioned state stores
Page:
KIP-633: Deprecate 24-hour Default Grace Period for Windowed Operations in Streams
Page:
KIP-120: Cleanup Kafka Streams builder API
Page:
KIP-328: Ability to suppress updates for KTables
Page:
KIP-270 - A Scala Wrapper Library for Kafka Streams
Page:
KIP-988: Streams Standby Update Listener
Page:
KIP-990: Capability to PAUSE Tasks on DeserializationException
Page:
KIP-671: Introduce Kafka Streams Specific Uncaught Exception Handler
Page:
KIP-251: Allow timestamp manipulation in Processor API
Page:
KIP-262: Metadata should include number of state stores for task
Page:
KIP-806: Add session and window query over kv-store in IQv2
Page:
KIP-924: customizable task assignment for Streams
Page:
KIP-307: Allow to define custom processor names with KStreams DSL
Page:
KIP-892: Transactional Semantics for StateStores
Page:
KIP-90 - Remove zkClient dependency from Streams
Page:
KIP-791: Add Record Metadata to State Store Context
Page:
KIP-258: Allow to Store Record Timestamps in RocksDB
Page:
KIP-324: Add method to get metrics() in AdminClient
Page:
KIP-805: Add range and scan query over kv-store in IQv2
Page:
KIP-626: Rename StreamsConfig config variable name
Page:
KIP-441: Smooth Scaling Out for Kafka Streams
Page:
KIP-129: Streams Exactly-Once Semantics
Page:
KIP-321: Update TopologyDescription to better represent Source and Sink Nodes
Page:
KIP-420: Add Single Value Fetch in Session Stores
Page:
KIP-607: Add Metrics to Kafka Streams to Report Properties of RocksDB
Page:
KIP-261: Add Single Value Fetch in Window Stores
Page:
KIP-456: Helper classes to make it simpler to write test logic with TopologyTestDriver
Page:
KIP-562: Allow fetching a key from a single partition rather than iterating over all the stores on an instance
Page:
KIP-284: Set default retention ms for Streams repartition topics to Long.MAX_VALUE
Page:
KIP-696: Update Streams FSM to clarify ERROR state meaning
Page:
KIP-171 - Extend Consumer Group Reset Offset for Stream Application
Page:
KIP-862: Self-join optimization for stream-stream joins
Overview
Content Tools
Apps
{"serverDuration": 251, "requestCorrelationId": "c39246e3779a480e"}