Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • Stability Improvements
  • DataStream User Migration/Integration Tooling
  • Remote Compaction (FLIP-430)


Notably, the disaggregated state backend can also work with synchronous state access APIs (existing operators). However, this approach might lead to suboptimal performance due to blocking operations. To fully utilize the capability of disaggregated states, we strongly encourage users to use async state APIs.

SQL stateful operators will be reworked to provide async state access in Flink 2.0 to provide a complete end-to-end user experience.

DataStream users need to rewrite the stateful operators in a call-back way as demonstrated in the example. We will try to provide tools later to facilitate migration.


Rejected Alternatives


Appendix: How to run the PoC

...