Versions Compared


  • This line was added.
  • This line was removed.
  • Formatting was changed.


Type that determines how data will be laid out as file and stored, inside a def~table.

#todo verifyImage Added

Following table summarizes the trade-offs between these two dataset table types

Trade-offdef~copy-on-write (COW)def~merge-on-read (MOR)
Data LatencyHigherLower
Update cost (I/O)Higher (rewrite entire def~table parquet)Lower (append to `delta log`)
Write AmplificationHigherLower (depending on compaction strategy to the def~table parquet)
Query/Read AmplificationLower/ZeroHigher (merging base and deltas on the fly)

Related concepts

  1. def~commit
  2. Commit List
  3. def~merge-on-read (MOR)
  4. def~copy-on-write (COW)
  5. def~timeline-instant

Status (draft)