Component | Runtime Dependencies | Package CI | Puppet Deployment | Smoke Test | Smoke Test CI | Smoke Test Requirements | Other notes on installation, migration and operation |
---|---|---|---|---|---|---|---|
Alluxio | HDFS | ||||||
Ambari | - | If the deployment gets stuck on `ambari-server setup` and PostgreSQL seems to be suspended during deactivating on Rocky Linux 8, running `sudo systemctl daemon-reload` from other terminal may resume the process. See BIGTOP-3553 and https://bugs.centos.org/view.php?id=17461#c38582. | |||||
Elasticsearch | - | ||||||
Flink | HDFS, YARN | ||||||
GPDB | - |
| |||||
HBase | HDFS, Zookeeper | ||||||
HDFS/HCFS | (Zookeeper if HA enabled) |
| |||||
Hive | HDFS, YARN | ||||||
Kafka | Zookeeper | ||||||
Kibana | Elasticsearch | ||||||
Livy | HDFS, YARN, Spark | ||||||
Logstash | - | ||||||
MapReduce | HDFS, YARN | ||||||
Oozie | - | ||||||
Phoenix | HDFS, HBase, Zookeeper | ||||||
Solr Cloud | Zookeeper | ||||||
Spark | HDFS, YARN | ||||||
Sqoop | - | ||||||
Tez | HDFS, YARN, Hive | ||||||
YARN | HDFS | In HA mode, you may have to specify the "yarn.resourcemanager.webapp.address.$rm-id" property in yarn-site.xml explicitly.Otherwise you may come across NPE when running YARN application, reported as YARN-8056. | |||||
YCSB | - | ||||||
Zeppelin | HDFS, YARN, Spark, Hive | ||||||
Zookeeper | - |
Platform X Arch CI Coverage Report
x86_64 | AARCH64 | PPC64LE | ||||
---|---|---|---|---|---|---|
Package CI | Smoke Test CI | Package CI | Smoke Test CI | Package CI | Smoke Test CI | |
CentOS 7 | ||||||
Rocky Linux 8 (for x86_64 and aarch64 only) | - | - | ||||
Fedora 35 | ||||||
Debian 10 | ||||||
Debian 11 | ||||||
Ubuntu 18.04 | ||||||
Ubuntu 20.04 |