...
Component | Runtime Dependencies | Package CI | Puppet Deployment | Smoke Test | Smoke Test CI | Smoke Test Requirements | Other notes on installation, migration and operation | |
---|---|---|---|---|---|---|---|---|
Alluxio | HDFS | |||||||
Ambari | - | If the deployment gets stuck on `ambari-server setup` and PostgreSQL seems to be suspended during deactivating on Rocky Linux 8, running `sudo systemctl daemon-reload` from other terminal may resume the process. See BIGTOP-3553 and https://bugs.centos.org/view.php?id=17461#c38582. | ||||||
Flink | HDFS, YARN | |||||||
GPDB | - |
| ||||||
HBase | HDFS, Zookeeper | |||||||
HDFS/HCFS | (Zookeeper if HA enabled) |
| ||||||
Hive | HDFS, YARN | |||||||
Kafka | Zookeeper | |||||||
Kibana | Elasticsearch | |||||||
Livy | HDFS, YARN, Spark | |||||||
MapReduce | HDFS, YARN | |||||||
Oozie | - | |||||||
Phoenix | HDFS, HBase, Zookeeper | |||||||
Solr Cloud | Zookeeper | |||||||
Spark | HDFS, YARN | |||||||
Tez | HDFS, YARN, Hive | |||||||
YARN | HDFS | In HA mode, you may have to specify the "yarn.resourcemanager.webapp.address.$rm-id" property in yarn-site.xml explicitly. Otherwise you may come across NPE when running YARN application, reported as YARN-8056. | ||||||
YCSB | - | |||||||
Zeppelin | HDFS, YARN, Spark, Hive | |||||||
Zookeeper | - |
Platform X Arch CI Coverage Report
x86_64 | AARCH64 | PPC64LE | ||||
---|---|---|---|---|---|---|
Package CI | Smoke Test CI | Package CI | Smoke Test CI | Package CI | Smoke Test CI | |
CentOS 7 | - | - | ||||
Rocky Linux 8(for x86_64 and aarch64 only) | - | - | ||||
Fedora 36 | ||||||
Debian 10 | - | - | ||||
Debian 11 | ||||||
Ubuntu 1020.04 | ||||||
Ubuntu 22.04 |
Smoke Tests issues:
- There're still some deployment issues for Alluxio and GPDB on Arm64 and PPC64le Fedora 36. (BIGTOP-3896)
- There're test timeout issuedsfor Oozie. (BIGTOP-3980)
Package CI Status
- https://ci.bigtop.apache.org/job/Bigtop-3.2.1-x86_64/
- https://ci.bigtop.apache.org/job/Bigtop-3.2.1-aarch64/
- https://ci.bigtop.apache.org/job/Bigtop-3.2.1-ppc64le/