Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

For Catalog, we don’t need to introduce any new method. But we should highlight that the  Catalog support create createing dynamic table represents a streaming-batch unified a  physical storage,  which can provide full historical data and or incremental changelog, so developers need to override the getFactory method to find the DynamicTableFactory for planner to compile a query.

...

  1. Metadata: This includes the table's schema, options, definition query, freshness and refresh job information.
  2. Data: This corresponds to a specific streaming-batch unified storage that holds the current table's data, which can provide full historical data and or incremental changelog. 
  3. Background Refresh Job: This job ensures the production and updating of data in either a continuous or full refresh way.

...