...
In addition, the current configuration option `table.exec.hive.infer-source-parallelism` acts not only as a switch to enable or disable hive source parallelism inference but also as a prefix for other configuration options (e.g. `table.exec.hive.infer-source-parallelism.max`). This practice does not conform to the standards of YAML specifications. Besides, with the introduction of `table.exec.hive.infer-source-parallelism.mode`
, we can disable parallelism inference by specifying InferMode.NONE, thus substituting the function of `table.exec.hive.infer-source-parallelism`
. Therefore, we plan to mark `table.exec.hive.infer-source-parallelism`
as Deprecated in this FLIP. Before this configuration option is completely phased out, `table.exec.hive.infer-source-parallelism`
will still serve as the main switch to enable or disable parallelism inference.
The temporary coexistence logic of the two configuration options is as follows:
Inference Mode Relationship Table | |||
---|---|---|---|
`table.exec.hive.infer-source-parallelism` | `table.exec.hive.infer-source-parallelism.mode` | ||
DYNAMIC | STATIC | NONE | |
true | dynamic parallelsim inference | static parallelism inference | disabled |
false | disabled | disabled | disabled |
Behavior Change
After introducing this FLIP, the behavior changes are as follows:
...