Flink 1.14 Burndown (blockers and critical bugs): https://issues.apache.org/jira/secure/RapidBoard.jspa?rapidView=468

Test stability issues (all versions): https://issues.apache.org/jira/issues/?filter=12343317

Sync meeting

The sync meeting is happening every second Tuesday starting on the 8th of June at 9am CET / 4pm CST.

Everyone can join as a silent listener.

Timeline

Feature Freeze
(warning) Monday, 16th of August, end of business CEST.
(has been moved in the bi-weekly on the 20th of July)

Release
Mid September

Highlight features

  • ML
  • Table API (Sources, Sink, Schema Inference)
  • Common source metrics (for new sources)

please feel free to add/suggest.

Features

List of features announced by contributors and committers that are likely to be ready for the feature freeze:n

NOTICE: It's preferred if only new features end up there and not all bugs/tasks separately, so that the page is not over bloated. Of course, unless fixing a bug is a really big or important one equivalent to implementing a completely new feature. A good rule of thumb would be that each entry in the page could (but does not have to) be later on included in a release blog post.

Legend:

symbolmeaningcomment
(tick)(tick)done donewell documented and cross-team tested
(tick)done
(green star)will make it
(star)in danger
(red star)very unlikely
(minus)won't make it
(question)state unclear
(blue star)independentas the artefact could be released independent of Apache Flink


Summary:

17th of August
(tick)31(green star)0(star)1(red star)0(minus)5(question)0(blue star)1∑38
24th of August(tick)(tick)10(tick)23(green star)(star)(red star)(minus)5(question)(blue star)∑38
31st of August(tick)(tick)
19
(tick)
14







7th of September

(tick)(tick)27

(tick)
6







(info) As we are entering the stabilisation phase we also want to track documentation and testing efforts. As someone who is responsible for a feature please link the corresponding issues or/and PRs.

Runtime
Feature NameResponsibleNoteStateUpdatedDocumentationCross-Team Testing

FLINK-21924 - Getting issue details... STATUS

MVP(tick)(tick)2021-07-21

FLINK-21926 - Getting issue details... STATUS

FLINK-23743 - Getting issue details... STATUS

FLINK-2491 - Getting issue details... STATUS


(tick)2021-07-29Not needed

FLINK-23831 - Getting issue details... STATUS

FLINK-21110 - Getting issue details... STATUS


(tick)(tick)2021-08-17Not needed (it is performance optimization)

Not needed

FLINK-22672 - Getting issue details... STATUS

Unclear about merge with other efforts.(tick)(tick)2021-08-17Not neededNot needed

FLINK-22684 - Getting issue details... STATUS


(tick)(tick)2021-07-21Documentation PRNot needed

FLINK-21352 - Getting issue details... STATUS


(minus)2021-08-13

FLINK-23451 - Getting issue details... STATUS


(tick)2021-07-29

Documentation PR
FLINK-23458 - Getting issue details... STATUS

FLINK-23456 - Getting issue details... STATUS

  FLINK-16428 - Getting issue details... STATUS



(tick)(tick)2021-07-21Settings documentedNot needed

FLINK-14482 - Getting issue details... STATUS

We need to complete the RocksDB version bump up to keep pace to other projects, also see KAFKA-8897(tick)(tick)2021-07-30Not neededNot needed

FLINK-21648 - Getting issue details... STATUS

Won't make it(minus)2021-07-21

Connectors
Feature NameResponsibleNoteStateUpdatedDocumentationCross-Team Testing

FLINK-11838 - Getting issue details... STATUS

Not in Flink 1.14(minus)2021-07-21

FLINK-22902 - Getting issue details... STATUS


(tick)(tick)2021-08-16

FLINK-23664 - Getting issue details... STATUS

FLINK-23814 - Getting issue details... STATUS

FLINK-18578 - Getting issue details... STATUS


(minus)2021-07-29

FLINK-19554 - Getting issue details... STATUS

Needs JUnit 5 support(tick)(tick)2021-08-16Documentation PRNot needed

FLINK-23652 - Getting issue details... STATUS

Arvid Heise
(tick)(tick)2021-08-16

FLINK-23817 - Getting issue details... STATUS

FLINK-23816 - Getting issue details... STATUS

FLINK-22668 - Getting issue details... STATUS

Thomas Weise
(tick)(tick)2021-08-16

FLINK-22791 - Getting issue details... STATUS

FLINK-20731 - Getting issue details... STATUS

Yufan Sheng
(tick)2021-08-18

FLINK-23864 - Getting issue details... STATUS

FLINK-23969 - Getting issue details... STATUS

API
Feature NameResponsibleNoteStateUpdatedDocumentationCross-Team Testing

FLINK-22700 - Getting issue details... STATUS


(tick)(tick)2021-07-21Not neededNot needed
SQL
Feature NameResponsibleNoteStateUpdatedDocumentationCross-Team Testing

FLINK-21634 - Getting issue details... STATUS


(minus)2021-07-29

FLINK-21454 - Getting issue details... STATUS

MVP released in 1.13(tick)2021-07-29

FLINK-22673 - Getting issue details... STATUS

FLINK-23825 - Getting issue details... STATUS

FLINK-20374 - Getting issue details... STATUS

"ChangeLog Upsert Disordering in Flink SQL" should be fixed.(tick)(tick)2021-07-21

Not Needed

FLINK-23835 - Getting issue details... STATUS

FLINK-23007 - Getting issue details... STATUS

Caizhi Jingsong Lee
(tick)(tick)2021-07-21Not NeededNot Needed

FLINK-19604 - Getting issue details... STATUS

Partially finished in Release 1.13, finish the rest of the work(tick)2021-08-17

FLINK-23055 - Getting issue details... STATUS

FLINK-23287 - Getting issue details... STATUS

FLINK-23582 - Getting issue details... STATUS

FLINK-23750 - Getting issue details... STATUS

FLINK-23747 - Getting issue details... STATUS

FLINK-23748 - Getting issue details... STATUS

FLINK-23749 - Getting issue details... STATUS

FLINK-23751 - Getting issue details... STATUS

FLINK-20435 - Getting issue details... STATUS

Partially finished in Release 1.13, finish the rest of the work(tick)(tick)2021-07-21Not neededNot needed

FLINK-21091 - Getting issue details... STATUS

Partially finished in Release 1.13, finish the rest of the work(tick)(tick)2021-07-21Not neededNot needed

FLINK-14437 - Getting issue details... STATUS


(tick)(tick)2021-07-21Not neededNot needed

FLINK-18840 - Getting issue details... STATUS

FLIP-136(tick)(tick)2021-07-29Documentation PRNot needed

FLINK-22914 - Getting issue details... STATUS


(tick)(tick)2021-08-17Not needed

FLINK-23850 - Getting issue details... STATUS

FLINK-23062 - Getting issue details... STATUS  


(tick)(tick)2021-07-29

FLINK-23116 - Getting issue details... STATUS

Not needed

FLINK-20897 - Getting issue details... STATUS


(tick)(tick)2021-07-29

FLINK-23832 - Getting issue details... STATUS

FLINK-23834 - Getting issue details... STATUS

API/Python
Feature NameResponsibleNoteStateUpdatedDocumentationCross-Team Testing

FLINK-22865 - Getting issue details... STATUS


(tick)(tick)2021-07-21Not neededNot needed (This is an optimization which should already be covered in the existing UT/IT cases)

FLINK-22862 - Getting issue details... STATUS


(tick)(tick)2021-07-21Documentation PR

FLINK-23820 - Getting issue details... STATUS

FLINK-22913 - Getting issue details... STATUS


(tick)(tick)2021-08-16

FLINK-23754 - Getting issue details... STATUS

FLINK-22911 - Getting issue details... STATUS


(tick)(tick)2021-07-29Documentation PR

FLINK-23824 - Getting issue details... STATUS

FLINK-21222 - Getting issue details... STATUS


(tick)2021-07-29Documentation PR

FLINK-23821 - Getting issue details... STATUS

FLINK-22912 - Getting issue details... STATUS


(tick)(tick)2021-07-29Documentation PR FLINK-23822 - Getting issue details... STATUS

FLINK-22871 - Getting issue details... STATUS


(tick)(tick)2021-07-29Documentation PR

FLINK-23823 - Getting issue details... STATUS

FLINK-22519 - Getting issue details... STATUS


(tick)(tick)2021-08-16

FLINK-23818 - Getting issue details... STATUS

FLINK-23819 - Getting issue details... STATUS

Machine Learning

Feature Name

ResponsibleNoteStateUpdatedDocumentationCross-Team Testing

FLINK-22915 - Getting issue details... STATUS

FLIP-173 has been proposed and needs some attention.
Independent of Flink releases.
(blue star)2021-07-21

Status / Follow-ups

2021-09-07

No special items to discuss, asides from going through the Kanban board.

2021-08-31

  • Branch `release-1.14` has been cut, and RC0 has been created.
    • For PRs meant for 1.14, please merge to both master/release-1.14 branches, and set fix-versions to both 1.14.0/1.15.0.
    • For PRs merged recently (since last weekend), please double-check if they appear in all expected branches.

2021-08-24

  • Docs & Tests
    • Status check
    • Please start progressing the documents early
    • Get cross-team testing tickets assigned
      • Release managers will try reaching out to people this week
      • Can still pick-up voluntarily
  • Branch cutting time

2021-08-17

  • Exceptions after feature freeze?
  • Update wiki page
    • Feature state
    • Documentation
    • Cross-Team Testing
  • Documentation
    • Blocks cross-team feature tests
  • Cross-Team Testing
    • Add description about how the feature should be tested
    • Voluntarily pick-up for 1 week, look for assignees for unassigned tasks afterwards
  • Build Stability
  • Pushing towards stabilization
    • Report issues with FixVersion 1.14.0 and proper Priority - everyone
    • Try to find assignees for Blocker and Critical issues - release managers
      • Blocker: immediately
      • Critical: on syncs
    • Keep monitoring the build stability - release managers
  • Syncs
    • Agenda
      • Discussion items (if any)
      • Go through all blockers (maybe not in-progress doc & test issues)
      • Go through unassigned critical issues
    • Schedule: once per week?
  • Release branch & RC0
    • How do we decide the branch is stabilized?
    • Timeline based: 1 week?

2021-08-03

Release blockers (2)

IssueComponentAssigneeNote

FLINK-23221 - Getting issue details... STATUS

flink-docker


Downgrade to Critical

FLINK-23560 - Getting issue details... STATUS

BenchmarksCause founded, fixing

Test instabilities (198)

  • Despite the increment in number of tickets, the overall build stability is improving
  • New issues are being taken care of
  • Old issues are left open for observation
Most Frequent Unassigned IssueComponentResponsibilityNote

FLINK-23575 - Getting issue details... STATUS

Runtime / TaskDawid WysakowiczError stack shows some mailbox problem

FLINK-23351 - Getting issue details... STATUS

API / DataStream

FLINK-23493 - Getting issue details... STATUS

API / Python

FLINK-22382 - Getting issue details... STATUS

Runtime / Coordination

Discussion Items

  • State changes
    • FLINK-23007, FLINK-21091, FLINK-22911 to (tick)
    • FLINK-22672, FLINK-22914, FLINK-19554 to (green star)
    • FLIP-187, FLINK-21352, FLINK-14482 to (star)
    • FLINK-18578, FLINK-21634 to (minus)
  • We should urge to push things either to (tick) or (minus) and heavily focus on (green star)
  • Confirm feature freeze date
  • Cross team tests
  • Highlight features follow-up

2021-07-20

Release blockers (2)

IssueComponentAssigneeNote

FLINK-23329 - Getting issue details... STATUS

Build systemvote in progress

Test instabilities (184)

Most Frequent Unassigned IssueComponentResponsibilityNote

FLINK-22198 - Getting issue details... STATUS

Kafka

Discussion Items

  • 2 weeks left before feature freeze
    • do we want to postpone it? when do we want to have the actual freeze?
  • Build Stability
    • nightly runs started passing! or failing with 1/2 failures, which is a nice change
  • What are the highlight features/improvements?

2021-07-06

Release blockers (2)

IssueComponentAssigneeNote

FLINK-22416 - Getting issue details... STATUS

Connectors/Kafka

API/Table

OperatorCoordinator


FLINK-22443 - Getting issue details... STATUS

Table SQL / Runtime@Caizhi Weng

Test instabilities (184)

Most Frequent Unassigned IssueComponentResponsibilityNote

FLINK-22971 - Getting issue details... STATUS
FLINK-22386 - Getting issue details... STATUS

InfrastructurePR in review

FLINK-22457 - Getting issue details... STATUS FLINK-22085 - Getting issue details... STATUS

Connectors / Kafka

FLINK-22662 - Getting issue details... STATUS FLINK-22195 - Getting issue details... STATUS

Deployment / YARN

Discussion Items

  • 4 weeks left before feature freeze
    • Update status of the tickets
    • 36 Features listed, 2 closed, 8 in progress, which makes it 26 open.
  • Build Stability
    • New instabilities emerging
    • Some frequent instabilities are from old branches
    • Criterion for closing outdated tickets

2021-06-22

Release blockers (6)

IssueComponentAssigneeNote

FLINK-22416 - Getting issue details... STATUS

Connectors/Kafka

API/Table

OperatorCoordinator

Qingsheng Ren

FLINK-22735 - Getting issue details... STATUS

Connectors/Hive

FLINK-22890 - Getting issue details... STATUS

Connectors/Hive

DataStream/F27/Idleness


FLINK-23001 - Getting issue details... STATUS

Scala, Build system, avro glue schema registry

FLINK-22904 - Getting issue details... STATUS

BenchmarksProbably fixed, need to gather a few more results

FLINK-23025 - Getting issue details... STATUS

API/TableShenkgai Feng

Recent test instabilities (178)

Most Frequent Unassigned IssueComponentResponsibility

FLINK-22971 - Getting issue details... STATUS
FLINK-22386 - Getting issue details... STATUS

InfrastructureJohannes Moser

FLINK-22890 - Getting issue details... STATUS

Connectors/Hive

DataStream/F27/Idleness


FLINK-22085 - Getting issue details... STATUS

Connectors/Kafka

FLINK-22416 - Getting issue details... STATUS

FLINK-22198 - Getting issue details... STATUS

+ few other

Connectors/Kafka

API/Table

OperatorCoordinator


FLINK-23052 - Getting issue details... STATUS

Infrastructure

Discussion Items

  • Time Plan follow up (User ML thread, Dev ML thread)
  • Build Stability follow up
    • 174
  • Criteria for merging PRs
    • Strictly forbidden merging with "unrelated" CI failures?

2021-06-08

Release blockers (6)

IssueComponentAssigneeNote

FLINK-22818 - Getting issue details... STATUS

Runtime / Checkpointing

FLINK-22067 - Getting issue details... STATUS

API / State ProcessorPR in review

FLINK-22416 - Getting issue details... STATUS

Connectors / Kafka

FLINK-22735 - Getting issue details... STATUS

Connectors / Hive

FLINK-22815 - Getting issue details... STATUS

Runtime / CheckpointingPR in review

FLINK-22904 - Getting issue details... STATUS

Benchmarks

Recent test instabilities (187)

Most Frequent Unassigned IssueComponentResponsibility

FLINK-22457 - Getting issue details... STATUS

Connectors / Kafka

FLINK-22198 - Getting issue details... STATUS

Connectors / Kafka

FLINK-20329 - Getting issue details... STATUS

Connectors / ElasticSearch

Discussion Items

  • Time Plan
  • Build Stability
    • Almost no success nightly build on master.
    • Recent successes: 06-02, 04-15, 02-17
  • Documentation
  • Release advertising

  • No labels

7 Comments

  1. Bi-weekly 8th of June

    Time Plan:

    • Users seem to extend release duration
    • Biased by Users who have their own fork
    • Vanilla Flink Users are not heard (yet)
    • Maybe we should create less pain for users to upgrade in general

    Build stability:

    • 187 issues
    • What can we do to reduce the test instabilities (last release cycle tens of issues, currently ~200, nightly has not been stable for a long time)
    • What is the pattern? (a lot of time outs, a lot of failures in tests)
    • Push to get the number down in the next two weeks > Release managers try to get assignees on the instabilities
    • Teams monitor components (e.g. as part weekly backlog grooming) > React swiftly when new things are reported

    Documentation & Release advertising


    Further topcis

    • Freeze for feature list (maybe in two weeks in the next bi-weekly)


  2. Discussed topics:

    Release Blockers

    Test instabilities

    Time plan

    • The group agreed to keep it as it is.
    • Johannes Moser will distill relevant information from the thread and update the mailing list.

    Criteria for merging PRs

    • Forbid merging with unrelated CI failures
    • Raise importance of docker cache to re-inforce this.

    Dependencies

    • Have a look at the outdated ones within your components.



  3. Bi-weekly 20th of July

    2 weeks left before feature freeze
    do we want to postpone it? when do we want to have the actual freeze?

    • Dong Lin Feedback for FLIP 173, wondering if someone else has any comments.
      Will be added to the Flink ML repo, isn't affected by the feature freeze.
      Johannes Moser , tries to get someone to give feedback.
    • Piotr Nowojski , small hick-up with FLIP-147. needs to implement some smaller things.
      1 or 2 weeks would help, isn't required to delay the feature, hard to say how much this would increase the chance to get it into 1.14, anything else.
    • Timo Walther , FLIP-163, could work in two weeks, having another week would be a safer option. Vacation get review capacity.


    Team updates:

    • Piotr Nowojski
      • Buffer adjustment, voting in this week. Implementation has started. Could be freezed to have more resources for FLIP-147
      • General incremental checkpoints, nor sure if it will be done
      • Support clarified after discussion today
    • Xintong Song
      • Fine Grained would be fine
      • GCS won't happen in 1.14
    • Yun Gao
      • FLIP-147 like Piotr said
      • Scheduler performance for large scale jobs
    • Yun Tang
      • Might need more time to figure out stuff for RocksDB
      • Discussion with Till start today
    • Martijn Visser
      • KafkaSink expected to be done for 1.14
      • Draft PR for Connector Metrics
    • Jark Wu
      • Hive Remaining for 1.14.
      • ALTER TABLE might not make it
      • SQL Client, remaining task is a small effort, next week done
      • Java Code Splitter, two subtasks remaining
      • TVF actively working on that.
      • Serialization and Deserialization merged next week.
    • Jiangjie Qin
      • Workaround for CDC rejecting checkpoint can be removed
      • Unified testing framework, will be missing 1.14.
    • Timo Walther
      • FLIP-129 might be tough,
      • Remaining things tight but doable.
    • Dian Fu
      • Joe will reach out


    Build Stability

    • nightly runs started passing! or failing with 1/2 failures, which is a nice change
    • Green build for nightly runs
    • FLINK-22198 - Getting issue details... STATUS  - Johannes Moser  tries to find someone for this ticket


    What are the highlight features/improvements?

    • Meetup in early August by Xintong.
    • Joe add a section to this page.
    • Ideas
      • ML
      • Table API (Sources, Sink, Schema Inference)
      • Log based checkpoints (although in danger)
        • Time critical tasks are planned
        • Extra time would be also helpful here
      • Maybe shift more resources to FLIP-183
    • Push feature freeze to around 17th of August
  4. Bi-weekly 3rd of August

    Features in danger

    • In Danger (5)
      • FLIP-147: Support Checkpoints After Tasks Finished
      • FLIP-158: Generalized incremental checkpoints
      • FLIP-183: Dynamic buffer size adjustment
      • FLINK-11482: Bump up rocksdb version
      • FLIP-33: Standardize connector metrics
    • Won't Make It (4)
      • FLIP-151: Incremental snapshots for heap-based state backend
      • FLINK-11838: Create RecoverableWriter for GCS
      • FLINK-18578: Add rejecting checkpoint logic in source
      • FLINK-21634: ALTER TABLE statement enhancement

    Feature freeze date

    No objection against the previously decided feature freeze date: August 16th.

    Cross-team test

    • Please create task tickets for testing your new features
      • Priority: Blocker
      • Label: release-testing
      • Fix-Version: 1.14.0
    • Example:  FLINK-22134 - Getting issue details... STATUS

    Highlight feature

    Stephan Ewen and Johannes Moser will discuss this offline.

    Blockers

    • FLINK-23221 - Docker image vulnerability
      • No quick solution
      • Downgrade to Critical and wait for available upstream base images
    • FLINK-23560 - Performance regression on 29.07.2021
      • Cause has been found, should be fixed soon
    • Another performance regression is observed and being looked into. Ticket will be opened soon.

    Build Stability

    • Build stability is in general improving
    • FLINK-23575 - UnalignedCheckpointRescaleITCase.shouldRescaleUnalignedCheckpoint fails with AsynchronousException
    • FLINK-23351 - FileReadingWatermarkITCase.testWatermarkEmissionWithChaining fails with "too few watermarks emitted"
    • FLINK-23493 - python tests hang
    • FLINK-22382 - ProcessFailureCancelingITCase.testCancelingOnProcessFailure
  5. 2021-08-17

    Exceptions after feature freeze?

    • FLIP-147 two PRs left (Yun Gao)
      • One PR that has been accepted yesterday, was blocked on CI
      • One ITCase
      • Start discussion on Mailing List and if there are no objections
    • Two Kafka related PRs under review (Arvid Heise)
      • Minor, Quality of life improvements, Additional metrics, setting serialisation schema, optional and independent.
      • Open discussion thread tomorrow

    Update wiki page (Feature state, Documentation, Cross-Team Testing)

    • Will change notion of the state to also include testing and documentation, will be done by Johannes Moser.
    • Please fill in documentation and testing columns to see if we collected all the tickets.
    • Purpose of testing tickets purpose is cross team testing.
    • Shouldn't assign the own team.
    • Clean up tickets by removing sub-tasks that won't make it to 1.14. and move it to another ticket. Johannes Moserwill follow up on this.

    Documentation (Blocks cross-team feature tests)

    • Documentation should be labeled as blockers.
    • Link documentation PRs on the wiki page.

    Cross-Team Testing

    • Add description about how the feature should be tested
    • Voluntarily pick-up for 1 week, look for assignees for unassigned tasks afterwards

    Build Stability

    • Last week build stability is awful.
    • Significantly affects efficiency.
    • Look into stability issues and pick some.

    Pushing towards stabilization

    • Report issues with FixVersion 1.14.0 and proper Priority - everyone
    • Try to find assignees for Blocker and Critical issues - release managers
      • Blocker: immediately
      • Critical: on syncs
    • Keep monitoring the build stability - release managers

    Syncs

    • Agenda
      • Discussion items (if any)
      • Go through all blockers (maybe not in-progress doc & test issues)
      • Go through unassigned critical issues
    • Schedule: once per week?
    • Might be more work for the release managers, but should be fine.

    Release branch & RC0

    • How do we decide the branch is stabilised
    • Timeline based: 1 week
    • Let's see next week
  6. Docs & Tests

    Status check

    (warning) Please start progressing the documentation tickets eary early

    • Get cross-team testing tickets assigned
    • Release managers will reaching out to people this week
    • Please pick-up voluntarily


    Branch cutting time

    Blockers

    • In progress
      • FLINK-22198: Once agreement is reached it can be merged within two days.
      • FLINK-23493: Update: Shouldn't be a release blocker. Keep it as a blocker until we know what the problem is.
      • FLINK-23556: PR open, we need a reviewer. Jark Wucan have a look.
      • FLINK-23829: PR open and already under review. Will be merged today or tomorrow
    • Todo
      • FLINK-22387: Caused by FLINK 22198
      • FLINK:22998: Problem by metrics reporter, Arvid Heisetaking care of that. Fix within days.
      • FLINK-23776: Re-opened since yesterday. Later this week
      • FLINK-23828: Qingsheng Renis investigating this release, more logs. PR created.
      • FLINK-23848: PR for this one. Will be reviewed and merged today. Won't be a blocker after that.
      • FLINK-23862: There is a PR, which is under review. Will be merged later this week.
      • FLINK-23896: PR is open. Should be fixed soon.
      • FLINK-23913: Ververica Runtime team will assign someone today.

    Branch cutting time > RC0

    • RC0 this weekend, which allows us to have 3 more days of merging fixes. > Silent agreement
    • Xintong Song will send an email once the branch is done.
    • Once we branched of 1.14 fixes need to go into both branches.

    Critical

    • FLINK-20427: Stephan Ewenand Till Rohrmannwill sync offline
    • FLINK-20928: Qingsheng Renwill look into this
    • FLINK-22702: Will be assigned to Qingsheng Renfor now. He will ask for help, when required.
    • FLINK-23468: Haven't yet looked at it.
    • FLINK-23525: Most likely caused by 23913
    • FLINK-23527: We'd like to include it. Documentation related. Stephan Ewenwrites it and Piotr Nowojskireviews it.
    • FLINK-23668: Umbrella ticket with a lot of subtasks in progress/done
    • FLINK-23778: Leave it for now
  7. Weekly Stabilisation Sync 31st of August

    Blocker

    • All is looking good

    Documentation

    • 23582 might raise a blocker
    • Look for an assignee for 23916

    Cross-team testing

    • Push to in-progress

    RC0 is ready

    • Share it with users to gather some test data.