Apache Kylin : Analytical Data Warehouse for Big Data

Page tree

Welcome to Kylin Wiki.

reference issue KYLIN-5948 - Getting issue details... STATUS


01 Background

To enhance the performance of detail data and ad-hoc queries, the internal table feature is designed.
The internal table manage user's data directly in inner storage, where Kylin actively controls the data storage format and data organization to specifically improve query performance.

02 Dev Design

What needs to be done is as follows:
1. Define the internal table metadata
2. implement internal table catalog
3. implement create table, update table, delete table, truncate table functions etc.
4. implement load data into internal table function
5. Support partition, bucket feature
6. Support config table properties such as primaryKey, orderByKey
7. Integrate apache gluten as native engine 
8. Support gluten-mergetree as default storage type

03 Roadmap TODOs

1. Support cache pre-loading
2. Support more partition type

  • No labels