ComponentRuntime DependenciesPackage CI

Puppet Deployment

Smoke Test

Smoke Test CI

Smoke Test RequirementsOther notes on installation, migration and operation
AlluxioHDFS(tick)(tick)(tick)(tick)

Ambari-(tick)(tick)(tick)(tick)

If the deployment gets stuck on `ambari-server setup` and PostgreSQL seems to be suspended during deactivating on Rocky Linux 8, running `sudo systemctl daemon-reload` from other terminal may resume the process. See BIGTOP-3553 and https://bugs.centos.org/view.php?id=17461#c38582

Deployment issues on Ubuntu-22.04: BIGTOP-3898.

FlinkHDFS, YARN(tick)(tick)(tick)(tick)

GPDB-(tick)(tick)(tick)

(tick)

  • At least 2 nodes (master and primary)

HBaseHDFS, Zookeeper(tick)(tick)(tick)(tick)

HDFS/HCFS(Zookeeper if HA enabled)(tick)(tick)(tick)(tick)
  • At least 3 nodes of testing cluster is required for node failing test to be passed
  • Allow sshkeys and have ssh support on the hosts

HiveHDFS, YARN(tick)(tick)(tick)(tick)

KafkaZookeeper(tick)(tick)(tick)(tick)

KibanaElasticsearch(tick)(tick)(tick)(tick)

LivyHDFS, YARN, Spark(tick)(tick)(tick)(tick)

MapReduceHDFS, YARN(tick)(tick)(tick)(tick)

Oozie-(tick)(tick)(tick)(tick)


PhoenixHDFS, HBase, Zookeeper(tick)(tick)(tick)(tick)

Solr CloudZookeeper(tick)(tick)(tick)(tick)

SparkHDFS, YARN(tick)(tick)(tick)(tick)

TezHDFS, YARN, Hive(tick)(tick)(tick)(tick)

YARNHDFS(tick)(tick)(tick)(tick)

In HA mode, you may have to specify the "yarn.resourcemanager.webapp.address.$rm-id" property in yarn-site.xml explicitly. Otherwise you may come across NPE when running YARN application, reported as YARN-8056.

YCSB-(tick)(tick)(tick)(tick)

ZeppelinHDFS, YARN, Spark, Hive(tick)(tick)(tick)(tick)

Zookeeper-(tick)(tick)(tick)(tick)

Platform X Arch CI Coverage Report


x86_64AARCH64PPC64LE

Package CISmoke Test CIPackage CISmoke Test CIPackage CISmoke Test CI
CentOS 7(tick)(tick)(tick)(tick)(tick)

(tick)

Rocky Linux 8

(for x86_64 and aarch64 only)

(tick)(tick)(tick)(tick)--

Fedora 36

(tick)(tick)(tick)(tick)(tick)(tick)

Debian 10

(tick)(tick)(tick)(tick)(tick)(tick)
Debian 11(tick)(tick)(tick)(tick)(tick)(tick)
Ubuntu 20.04(tick)(tick)(tick)(tick)(tick)(tick)
Ubuntu 22.04(tick)(tick)(tick)(tick)(tick)(tick)

Smoke Tests issues:

  • There're still some deployment issues for Alluxio and GPDB on Arm64 and PPC64le Fedora 36.
  • The python dependency issues on Ubuntu-22.04, which caused the smoke tests of  Ambari, gpdb, Hive, Ycsb and Zeppelin to fail on Ubuntu-22.04.

It's going to be addressed in the 3.2.1 release and the corresponding Jiras(BIGTOP-3896; BIGTOP-3897; BIGTOP-3898) were created to track them.

Package CI Status

Smoke Test CI Status

  • No labels