Iceberg Integration
- Advanced Snapshot Managementmanagement
- Support for Branches & Tags
- Support for Positional Deletes
- support
- DML (update/delete/merge)
- Support for COW & MOR modes
- Vectorised Reads & Writes
- Support for queries with Partition clause
- Support for LOAD DATA queries
- LOAD DATA statements support
- Partition-level operations support
- Improved statistics (column stats support)
- Maintenance (Major compaction)Better Statistics Management
Hive ACID
- Use sequences for TXN_ID generation (performance)
- Read-only transactions optimization
- Zero-wait readers
- Optimistic and Pessimistic concurrency control
- Lockless reads
...
Compaction
- Rebalance compaction (Hive ACID)
- Compaction requests prioritization (compaction pooling) Iceberg compaction (Major)
Hive Metastore
- API optimization (performance)
- Dynamic leader election
- HMS support for Thrift over HTTP
- JWT authentication for Thrift over HTTP
- HMS metadata summary
...