2023-03-01 Minutes of the bi-weekly meeting of Apache Linkis
1. The latest version of Apache Linkis is synchronized. -- Wang Heping
(1) About 1/3 of the features have been received, welcome to continue to receive
(2) 1.3.2 In the regression test
2. Apache Linkis 1.3.2 Progress synchronization.
(1) linkis hadoop multi-version support code has been integrated
(2) spark runs json for ETL function to add linkis data source
support. The code has been combined and the release note document
needs to be sorted out
(3) The engine parameter management code has been integrated
3. Apache Linkis version 1.3.3 led and discussed requirements. -- Guo
Fei, Huang Dingqi, Guo Shupei, Xia Chen
(1) The dependency of hadoop, hive, and spark is reduced. Compilation
and installation failures caused by cluster environment (apache, cdh,
and hdp) and basic engine version problems (hadoop/hive/spark) during
installation of new users are reduced. Functions are being developed
(2) hadoop, hive, spark and other components are compiled and modified
to higher versions by default to solve security-related problems. The
development has been completed and the code has been submitted
(3) Doris and Impala engine plug-in
-- Doris plug-in is under development;
-- Impala Because there is no suitable client jar package available
except jdbc through official channels, and introducing thrift protocol
files will require a lot of work to confirm open source protocols, so
it will not be pushed forward for the time being. If anyone knows
other ways of calling Impala, please contact us
(4) The high-availability function of the entrance has been developed
and the code has been submitted
(5) About 20 unassociated issiue need to be processed in 1.3.3, and we
welcome you to claim it
4. Apache Linkis community operation progress synchronization. -- Li Wen
5. Other discussions
(1) Discuss the version number. Is it feasible to change the second as
the feature version and the third as the repair version? -- Xu Ling,
Wang Heping
Big feature modifies second, small feature modifies third
(2) Discussion on version features: Upgrade the spring gateway to the
latest version of 3.x, cooperate with the upgrade of spring and spring
boot-- Wang Heping
(3) When new users try, whether to remove the restriction of
invitation code?Brother Peace coordinates the cloud environment server
6. The moderator of the next regular meeting (2023/03/15) -- Jie Longping