Backlog

ReleaseTagFeaturesExit criteria
TODOTODO
  • HDFS to Ozone upgrade
  • Load Balancer Deployments for S3 gateway
  • Using NFS gateway from HDFS for Ozone
  • Truncate support
  • Rolling upgrades
  • Run Ozone tests with multiple SCM
  • This will allow HDFS clusters to upgrade to Ozone without data copies.
  • Native CSI support (ozone specific daemon)
  • Security is on by default, TDE, and Security testing with different applications.
  • Test and Document different load balancers that can with S3 gateway.
  • Test with NFS client

Upcoming Releases

ReleaseTagFeaturesExit criteria
1.5.0

Indiana Dunes



1.3.1

?


Critical bugs fixed found in 1.3.0 all landed

Past Releases

Ozone releases can be downloaded from https://ozone.apache.org/downloads/


ReleaseTagFeaturesExit criteria

1.4.0

Hot Springs

  • Ozone Snapshot feature
  • Erasure Coding - V2 support (offline resconstruction)
  • Container balancer support for Erasure Coding
  • Heat map support, more diagnose info on Recon
  • Certificate auto rotation
  • SCM Decommission support
  • OM Decommission improvement
  • New symmetric key based block/container token implementation
  • Quota on FSO bucket support

1.3.0

Grand Canyon

RELEASED

  • Erasure Coding - V1 support (Online reconstruction support)
  • Container balancer
  • Limit number of rocksdb instances to 1 per disk on high-density datanodes
  • Ozone S3 Multi-tenancy Support
  • S3 Grpc improvements for metadata path
  • Filesystem Optimized and Object Store bucket layout types

1.2.0

Glacier

RELEASED

  • SCM HA support for fresh installations
  • Non-rolling upgrade and downgrade support
  • Optimized filesystem (prefix) support for fresh installations
  • Transparent data encryption for S3 buckets

1.1.0

Everglades

RELEASED

  • Volume/Bucket Quota Support
  • ofs/o3fs performance improvements with Teragen and Spark
  • Ozone FS namespace

1.0.0

Denali

RELEASED

  • Security Phase II
  • HA support for Ozone Manager
  • OFS (HDDS-2665), new scheme:  ofs://om/volume/bucket/key
  • Ozone Filesystem performance improvement (HDDS-2939)
  • Ozone support security enabled Hadoop 2.x
  • S3 volume/bucket mapping changes and bind mounted buckets (HDDS-3385)
  • Hadoop 2.7 support / remove of Isolated class loader (HDDS-3458)
  • Recon / Recon UI improvements (new management / debug screens)
  • Support upgrading / persist current versions metadata
  • Support MR jobs with the new scheme
  • Support fast directory list with 1 billion keys and deep hierarchy
  • Testing integrations with other projects
    • Hive LLAP
    • Impala
    • Spark (TPC-DS)
0.5.0

Crater Lake

RELEASED

  • Stability improvements
  • Performance and Scale
  • High Availability
  • Topology awareness.
  • Management Console
  • Disk Scanner
  • Centralized Management
  • UI updates to SCM and OM.
  • Decommissioning
  • Long-running tests based on Apache NIFI, Hive, and Spark.
  • Able to handle 1 Billion objects.
  • GDPR Right to Erasure
  • Network Topology awareness for block placement.
  • Recon Server V1
  • Disk scanner and ability to detect block corruptions.
  • Hadoop Configurations are hard to manage, make it easy for ozone.
  • Support Decommission.
0.4.1

Biscayne

RELEASED

  • Stability improvements
  • Ozone Native ACL support
  • First class K8s support
  • Support Native ACLs in Ozone.
  • Ozone becomes K8s aware.
0.4.0

Badlands

RELEASED

Security
  • Hadoop Delegation Tokens and Block Tokens supported for Ozone.
  • Transparent Data Encryption (TDE) Support - Allows data blocks to be encrypted-at-rest.
  • Kerberos support for Ozone.
  • Certificate Infrastructure for Ozone  - Tokens use PKI instead of shared secrets.
  • to communication secured via mutual TLS.
  • Ability secure ozone cluster that works with Yarn, Hive, and Spark.
  • Helm/ support to deploy Ozone clusters on K8s.
  • Support S3 Authentication Mechanisms like - S3 v4 Authentication protocol.
  • S3 Gateway supports upload.
  • Support S3A file system
  • Support for Tracing and Profiling for all Ozone components.
  • Audit Support - including Audit Parser tools.
  • Apache Ranger Support in Ozone.
0.3.0

Arches

RELEASED

S3 Protocol head
  • Create an S3 protocol head that can work with Ozone.
  • Ingest via S3 protocol head, process data via Ozone FS.
  • Support a minimally complete S3 API set.
  • Make sure that AWS CLI and AWS Java SDK works correctly against the protocol head
  • Large Scale and complete testing of Application Stack. YARN, Hive, and Spark.
0.2.1

Acadia

RELEASED

Basic Ozone functionality 

  • Ozone FS
  • Command Shell
  • Java SDK.
  • Be able to create ozone volumes, buckets, and Keys.
  • Create a large number of keys. Millions of keys tested.
  • Write large single key – 50GBs +
  • Support Ozone REST and RPC protocols.
  • User facing documentation
  • Ship Java client Libraries for Ozone supporting both RPC and REST.
  • Meet Apache Release criteria.
  • Make sure YARN, Hive, and Spark applications can work against Ozone FS.

These release names are based on US national parks, and for every minor release, we also move to the next letter for the release code name.





  • No labels