Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • Re-scaling on unaligned checkpoints (need to use savepoint in MVP)
  • Incremental checkpointing to not writing write the same buffer multiple times (when the job is backpressured)
  • Advanced triggers for unaligned checkpoints such as timeouts on alignment or meeting the maximum threshold of checkpoint sizes
  • Support for concurrent checkpoints
  • Incremental loading and processing of state
  • No additional memory to load channel state: ideally, existing network buffers should be reused
  • Reduced number of files: single file could be reused for several checkpoints

...