DUE TO SPAM, SIGN-UP IS DISABLED. Goto Selfserve wiki signup and request an account.
Important Information
Flink 1.12.0 has been released.
Features
List of features announced by contributors and committers that are likely to be ready for the feature freeze:
Runtime
| Feature Name | Proposed by | Note |
|---|---|---|
| K8s: Support user-specified pod templates | Canbin Zheng | |
| K8s: Support built-in init-Container | Canbin Zheng | |
| Support accessing secured services via K8s secrets | Canbin Zheng | |
| K8s: Support configuring replica of JobManager Deployment in ZooKeeper HA | Canbin Zheng | |
| K8s: Support to configure limit for CPU requirement | Canbin Zheng | |
FLINK-16430 - Getting issue details... STATUS | Andrey Zagrebin, Zhu Zhu, Till Rohrmann | |
| Reactive-scaling mode | Till Rohrmann | |
| FLIP-138: Declarative Resource management | Chesnay Schepler, Till Rohrmann | |
FLINK-17075 - Getting issue details... STATUS | Chesnay Schepler, Till Rohrmann | |
FLINK-11127 - Getting issue details... STATUS | Robert Metzger, Till Rohrmann | |
FLINK-16866 - Getting issue details... STATUS | Robert Metzger, Till Rohrmann | |
FLINK-15679 - Getting issue details... STATUS | Yangze Guo, Xintong Song, Till Rohrmann | |
| FLIP-76: Unaligned Checkpoints (improvements and follow ups) | Arvid Heise / Zhijiang Wang / Piotr Nowojski | |
FLINK-18736 - Getting issue details... STATUS | Piotr Nowojski | |
| Sub-second end-to-end exactly-once latencies | Piotr Nowojski / Roman Khachatryan | FLIP/Jira issue pending |
| FLIP-135 Approximate Task-Local Recovery | Yuan Mei | Milestone One |
| FLIP-141: Intra-Slot Managed Memory Sharing | Xintong Song | |
FLINK-18620 - Getting issue details... STATUS | Xintong Song | |
Runtime: various resource manager improvements. | Xintong Song, Canbin Zheng, Till Rohrmann |
FLINK-17273
-
Getting issue details...
STATUS
|
FLINK-18971 - Getting issue details... STATUS | Yangze Guo | |
k8s: Support native k8s for sql client, python client and scala shell | Yang Wang, Canbin Zheng |
FLINK-17480
-
Getting issue details...
STATUS
|
FLINK-12884 - Getting issue details... STATUS | Yang Wang, Shengyang Sha | |
FLINK-15981 - Getting issue details... STATUS | Zhijiang Wang | |
| Improve the performance of batch shuffle | Stephan Ewen, Zhijiang Wang, Yingjie Cao |
Core APIs (DataStream/DataSet)
| Feature Name | Proposed by | Note |
|---|---|---|
| FLIP-131: Consolidate the user-facing Dataflow SDKs/APIs (and deprecate the DataSet API) | Aljoscha | |
FLINK-19033 - Getting issue details... STATUS | Dawid | |
| FLIP-134: Batch execution for the DataStream API | Klou / Dawid / Aljoscha | FLIP/Jira issue pending |
| FLIP-140: Introduce batch-style execution for bounded keyed streams | Dawid |
Connector APIs
| Feature Name | Proposed by | Note |
|---|---|---|
| Unified Sink Interface | Guowei / Yun | FLIP/Jira issue pending |
| Extend StreamingFileSink to handle the “small file problem” | Jingsong / Yun Gao | FLIP/Jira issue pending |
FLINK-18323 - Getting issue details... STATUS | Becket Qin | |
| FLIP-33: Standardize Connector Metrics | Becket Qin | |
| Hybrid Source to support switch over between sources in the same job. | Xiaofeng Jiang | |
| Connector Testing Framework | Qingsheng Ren | |
FLINK-17688 - Getting issue details... STATUS EFO for Kinesis Consumer | Tzu-Li (Gordon) Tai, Danny Cranmer, Roland | |
FLINK-18858 - Getting issue details... STATUS Table API support for Kinesis Connector | Waldemar Hummer, Alexander Alexandrov, Danny Cranmer |
Table API/SQL
| Feature Name | Proposed by | Note |
|---|---|---|
Table/SQL: FLINK-13191 - Getting issue details... STATUS | Timo Walther | |
| Table/SQL: FLIP-129: Refactor Descriptor API | Jark Wu | |
| Table/SQL: FLIP-132: Temporal Table DDL and Temporal Table Join | Leonard Xu | |
| Table/SQL: Compiling multi-input operator to reduce unnecessary shuffle | Godfrey He | |
| Table/SQL: FLIP-145: Support SQL windowing table-valued function | Jark & Danny | |
| Table/SQL: Hive query compatibility | Rui Li | FLIP/Jira issue pending |
| Table/SQL: CREATE FUNCTION USING JAR | Jark Wu | FLIP/Jira issue pending |
| Table/SQL: FLIP-136: Improve interoperability between DataStream and Table API | Timo Walther | |
| Table/SQL: FLIP-107: Handling of metadata in SQL connectors | Timo Walther | |
| FLIP-36: Support Interactive Programming in Flink | Xuannan Su |
PyFlink
| Feature Name | Proposed by | Note |
|---|---|---|
| PyFlink: Improve the usabilities for PyFlink | Jincheng Sun | FLIP-133 |
PyFlink: PyFlink Table API DSL | Jincheng Sun | FLINK-19091 - Getting issue details... STATUS |
PyFlink: FLINK-18761 - Getting issue details... STATUS | Jincheng Sun | FLIP-130 |
| PyFlink: Support Pandas UDAF in batch GroupBy aggregation | Jincheng Sun | FLIP-137 |
| PyFlink: PyFlink Table API UDAF | Jincheng Sun | FLIP-139: General Python User-Defined Aggregate Function Support on Table API |
| PyFlink: Support running pyflink jobs on kubernetes | Jincheng Sun | FLINK-17480 - Getting issue details... STATUS |