...
| Discussion thread | https://lists.apache.org/thread/gy7sm7qrf7yrv1rl5f4vtk5fo463ts33 | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Vote thread | https://lists.apache.org/thread/l64ykk3n8c2gc40gjbowt0ozs0x0jmqm | ||||||||
| JIRA |
| ||||||||
| Release | -1.20 |
Motivation
Following the implementation of FLIP-301, the introduction of Hybrid Shuffle with Remote Storage capabilities has represented a major milestone in cloud-native environments. This development allows for storing the shuffle data to remote storage systems, significantly reducing the risk of insufficient space failures for the large-scale jobs.
...