...

{
  "org.apache.paimon.avro.generated.record": {
    "_VERSION": 1,
    "_KIND": 0,
    "_PARTITION": "\u0000\u0000\u0000\u0001\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000p\u0000\u0000\u0000\u0000\u0000\u0000",
    "_BUCKET": 0,
    "_TYPE": "DELETION_VECTORS",
    "_FILE_NAME": "index-32f16270-5a81-4e5e-9f93-0e096b8b58d3-0",
    "_FILE_SIZE": x,
    "_ROW_COUNT": count of the map,
    "_DELETEDELETION_INDEXVECTORS_RANGES": "binary Map<String, Pair<Integer, Integer>>", key is the fileName, value is <start offset of the serialized bitmap in Index file, size of the serialized bitmap>
  }
}

...

• First, record a const magic number by an int.
• Then, record serialized bitmap.

e.g:

Image RemovedImage Added

3. Write

3.1. Overview

...

1. Impact on file meta: Currently, the stats (min, max, null count) in file meta are already unreliable, so no special handling will be performed for this aspect.
2. ...

Public Interfaces

How to use

a new conf:

deletion-vectors.enabled: control whether to enable deletion vectors mode: write deletion vectors index and read using it without merge.

...