Apache Kylin : Analytical Data Warehouse for Big Data

Page tree

Welcome to Kylin Wiki.

Currently, Kylin use Log4j 1.2 as logger library. 

Logger Configuration File

File NameAffect ScopeComment

kylin-server-log4j.properties

Kylin Instance, Sparder Driver

kylin-tools-log4j.properties

Kylin CLI

kylin-driver-log4j.properties

Driver Logger of Query and Cubing
kylin-driver-log4j-default.propertiesDriver Using default 
org.apache.log4j.ConsoleAppender

kylin-executor-log4j.properties

Executor Logger of Query and Cubing
kylin-executor-log4j-default.propertiesExecutorUsing default 
org.apache.log4j.ConsoleAppender

Logger Directory

PathTypeLog From
$KYLIN_HOME/logs/kylin.logLocal
  1. Output of Kylin's Logger(Log4j.12)
  2. Output of Driver of Sparder
$KYLIN_HOME/logs/kylin.outLocalstderr of Kylin Instance
$KYLIN_HOME/logs/spark/xxx.logLocalDriver of Cubing Job (if SparkDriverHdfsAppender is disabled)

${WORKING-DIR}/${project_name}/spark_logs/driver/${step_id}/execute_output.json.timestamp.log

HDFSDriver of Cubing Job (if SparkDriverHdfsAppender is enabled)
${WORKING-DIR}/${project_name}/spark_logs/executor/yyyy-mm-dd/${job_id}/${step_id}/executor-x.logHDFSExecutor of Cubing Job (if SparkExecutorHdfsAppender is enabled)
${WORKING-DIR}/_sparder_logs/executor/yyyy-mm-dd/${job_id}/${step_id}/executor-x.logHDFSExecutor of Query Job (if SparkExecutorHdfsAppender is enabled)
  • No labels