Page History

...

With a read-write separation deployment, we can spearate build and query computation workload(mostly the yarn resourece). In the current implementation, HDFS of query cluster is  is not exclusive to the read query cluster only, because build because build cluster will read data from query cluster('s HDFS) when merging segments.

Architecture of Read-Write Separation

...

Note

1. Kylin 4.0 uses the Yarn resources on build cluster to build cube data and then write the cube data back to the HDFS on query cluster directly.
2. Build jobs read the Hive data sources which are on build cluster.
3. When executing pushdown query, Kylin 4.0 reads the Hive data from build cluster.

...