Apache Kylin : Analytical Data Warehouse for Big Data
Welcome to Kylin Wiki.
- Created by Xiaoxiang Yu, last modified on Jan 20, 2021
Step
Expand source
$ cd $KYLIN_HOME ### 1. Prepare specific jars for CDH6 $ mkdir -p bin/hadoop3_jars/cdh6 $ cp commons-configuration-1.10.jar lib/ $ cp hive-exec-1.21.2.3.1.0.0-78.jar bin/hadoop3_jars/cdh6 $ cp stax2-api-3.1.4.jar bin/hadoop3_jars/cdh6 ### 2. Prepare mysql driver $ mkdir ext $ cp mysql-connector-java-5.1.40.jar ext/ ### 3. Start kylin instance $ sh bin/kylin.sh start Retrieving hadoop conf dir... KYLIN_HOME is set to /root/xiaoxiang.yu/release-candidate/xxyu/apache-kylin-4.0.0-SNAPSHOT-bin WARNING: log4j.properties is not found. HADOOP_CONF_DIR may be incomplete. WARNING: log4j.properties is not found. HADOOP_CONF_DIR may be incomplete. WARNING: log4j.properties is not found. HADOOP_CONF_DIR may be incomplete. Retrieving hive dependency... Retrieving hadoop conf dir... Retrieving Spark dependency... Start replacing hadoop jars under /root/xiaoxiang.yu/release-candidate/xxyu/apache-kylin-4.0.0-SNAPSHOT-bin/spark/jars. Find platform specific jars:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/../hadoop/client/hadoop-annotations-3.0.0-cdh6.2.0.jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/../hadoop/client/hadoop-common-3.0.0-cdh6.2.0.jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/../hadoop/client/hadoop-auth-3.0.0-cdh6.2.0.jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/../hadoop/hadoop-auth-3.0.0-cdh6.2.0.jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/../hadoop/hadoop-common-3.0.0-cdh6.2.0.jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/../hadoop/hadoop-annotations-3.0.0-cdh6.2.0.jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/../hadoop-hdfs/hadoop-hdfs-client.jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/../hadoop-hdfs/hadoop-hdfs-native-client.jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/../hadoop-hdfs/hadoop-hdfs-httpfs.jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/../hadoop-hdfs/hadoop-hdfs-client-3.0.0-cdh6.2.0.jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/../hadoop-hdfs/hadoop-hdfs-3.0.0-cdh6.2.0.jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/../hadoop-hdfs/hadoop-hdfs-httpfs-3.0.0-cdh6.2.0.jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/../hadoop-hdfs/hadoop-hdfs-native-client-3.0.0-cdh6.2.0.jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-client-shuffle-3.0.0-cdh6.2.0.jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-client-app-3.0.0-cdh6.2.0.jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-client-jobclient-3.0.0-cdh6.2.0.jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-client-common-3.0.0-cdh6.2.0.jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-client-core-3.0.0-cdh6.2.0.jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/../hadoop-yarn/hadoop-yarn-server-web-proxy-3.0.0-cdh6.2.0.jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/../hadoop-yarn/hadoop-yarn-common-3.0.0-cdh6.2.0.jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/../hadoop-yarn/hadoop-yarn-server-common-3.0.0-cdh6.2.0.jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/../hadoop-yarn/hadoop-yarn-client-3.0.0-cdh6.2.0.jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/../hadoop-yarn/hadoop-yarn-api-3.0.0-cdh6.2.0.jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/../../jars/htrace-core4-4.2.0-incubating.jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/../../jars/htrace-core4-4.1.0-incubating.jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/../../jars/re2j-1.1.jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/../../jars/woodstox-core-asl-4.4.1.jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/../../jars/commons-configuration2-2.1.jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/../../jars/woodstox-core-5.1.0.jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/../../jars/commons-configuration2-2.1.1.jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/../../jars/re2j-1.0.jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/../../jars/woodstox-core-5.0.3.jar, will replace with these jars under /root/xiaoxiang.yu/release-candidate/xxyu/apache-kylin-4.0.0-SNAPSHOT-bin/spark/jars. -rw-r--r-- 1 root root 362679 Jan 20 03:04 /root/xiaoxiang.yu/release-candidate/xxyu/apache-kylin-4.0.0-SNAPSHOT-bin/bin/hadoop3_jars/cdh6/commons-configuration-1.10.jar -rw-r--r-- 1 root root 11498129 Jan 20 03:03 /root/xiaoxiang.yu/release-candidate/xxyu/apache-kylin-4.0.0-SNAPSHOT-bin/bin/hadoop3_jars/cdh6/hive-exec-1.21.2.3.1.0.0-78.jar -rw-r--r-- 1 root root 161867 Jan 20 03:04 /root/xiaoxiang.yu/release-candidate/xxyu/apache-kylin-4.0.0-SNAPSHOT-bin/bin/hadoop3_jars/cdh6/stax2-api-3.1.4.jar Replace jars under SPARK_HOME/jars finished. Done hadoop jars replacement under /root/xiaoxiang.yu/release-candidate/xxyu/apache-kylin-4.0.0-SNAPSHOT-bin/spark/jars. Start to check whether we need to migrate acl tables Not HBase metadata. Skip check. A new Kylin instance is started by root. To stop it, run 'kylin.sh stop' Check the log at /root/xiaoxiang.yu/release-candidate/xxyu/apache-kylin-4.0.0-SNAPSHOT-bin/logs/kylin.log Web UI is at http://cdh-1.kylin.org:7070/kylin
Required jars
- stax2-api-3.1.4.jar
- https://repo1.maven.org/maven2/commons-configuration/commons-configuration/1.10/commons-configuration-1.10.jar
Overview
Content Tools
ThemeBuilder
Apps
- No labels
Bring OLAP Back to Big Data!