...

Milestone 2: Performance and Usability Improvements (Sept. 30th, 2024 -  Beta Version together with – Flink 2.0 release, Beta Version):

This phase prioritizes performance optimizations and user experience enhancements, aiming to deliver a complete disaggregated state management system integrated with asynchronous SQL operators by the target date. This milestone introduces several key functionalities:

• Local Disk Caching (FLIP-429): Leverage local disks as a secondary cache to improve performance.
• TM State Ownership and Faster Checkpointing (FLIP-432): Enhance state management for Task Managers
• Disaggregated State Metrics (FLIP-431): Introduce disaggregated-state-related metrics.
• SQL Operator Compatibility: Enable SQL async operator integration.

Milestone 3: Production Ready Readiness and Further Improvements Stability (Dec. 31st, 2024 – Flink 2.1 release, Prod-Ready):

Milestone 3 prioritizes stability and production readiness, aiming to deliver a reliable disaggregated state management system by the end of the year, coinciding with the Flink 2.1 release

...

. Key areas of focus during this phase include:

• Stability Improvements
• DataStream User Migration/Integration Tooling
• Remote Compaction (FLIP-430)

Rejected Alternatives

Appendix: How to run the PoC

...