Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

ComponentRuntime DependenciesPackage CI

Puppet Deployment

Smoke Test

Smoke Test CI

Smoke Test RequirementsOther notes on installation, migration and operation
AlluxioHDFS(tick)(tick)(tick)(tick)

Ambari-(tick)(tick)(tick)(tick)

If the deployment gets stuck on `ambari-server setup` and PostgreSQL seems to be suspended during deactivating on Rocky Linux 8, running `sudo systemctl daemon-reload` from other terminal may resume the process. See BIGTOP-3553 and https://bugs.centos.org/view.php?id=17461#c38582

FlinkHDFS, YARN(tick)(tick)(tick)(tick)

GPDB-(tick)(tick)(tick)

(tick)

  • At least 2 nodes (master and primary)

HBaseHDFS, Zookeeper(tick)(tick)(tick)(tick)

HDFS/HCFS(Zookeeper if HA enabled)(tick)(tick)(tick)(tick)
  • At least 3 nodes of testing cluster is required for node failing test to be passed
  • Allow sshkeys and have ssh support on the hosts

HiveHDFS, YARN(tick)(tick)(tick)(tick)

KafkaZookeeper(tick)(tick)(tick)(tick)

KibanaElasticsearch(tick)(tick)(tick)(tick)

LivyHDFS, YARN, Spark(tick)(tick)(tick)(tick)

MapReduceHDFS, YARN(tick)(tick)(tick)(tick)

Oozie-(tick)(tick)(tick)(tick)


PhoenixHDFS, HBase, Zookeeper(tick)(tick)(tick)(tick)

Solr CloudZookeeper(tick)(tick)(tick)(tick)

SparkHDFS, YARN(tick)(tick)(tick)(tick)

TezHDFS, YARN, Hive(tick)(tick)(tick)(tick)

YARNHDFS(tick)(tick)(tick)(tick)

In HA mode, you may have to specify the "yarn.resourcemanager.webapp.address.$rm-id" property in yarn-site.xml explicitly. Otherwise you may come across NPE when running YARN application, reported as YARN-8056.

YCSB-(tick)(tick)(tick)(tick)

ZeppelinHDFS, YARN, Spark, Hive(tick)(tick)(tick)(tick)

Zookeeper-(tick)(tick)(tick)(tick)

...

  • There're still some deployment issues for Alluxio and GPDB on Arm64 and PPC64le Fedora 36. (BIGTOP-3896)
  • There're test timeout issuedsfor Oozie. (BIGTOP-3980)

Package CI Status

...