DUE TO SPAM, SIGN-UP IS DISABLED. Goto Selfserve wiki signup and request an account.
Status
Current state: Accepted
| Discussion thread |
|---|
...
...
| |||||||||
| Release |
Current state: AcceptedReleased: <Flink Version>
Please keep the discussion on the mailing list rather than commenting on the wiki (wiki discussions get unwieldy fast).
...
The adaptive optimization of StreamGraph mechanism is mainly divided into two parts:
Incremental JobGraph Generation and Scheduling Based on ItIncremental JobGraph Generation and Scheduling Based on It
Currently, Flink converts the StreamGraph into a JobGraph before job execution, creating a fixed execution plan, which limits the job's ability to adjust the StreamGraph dynamically during runtime. Therefore, we plan to introduce a new mechanism that incrementally generates JobGraph and schedules tasks based on it. In this new mechanism, the timing of JobVertex generation in JobGraph will be flexibly determined by Flink at runtime.
...