Reporting metrics

This graph shows main steps of dataflow worker intialization and metrics reporting.

Streaming and Batch workers actually differ, but common patterns present.

Warning: node ExecutionStateRegistry, port extractUpdates unrecognized

Fetching side inputs

Warning: flat edge between adjacent nodes one of which has a record shape - replace records with HTML-like labels Edge StreamingKeyedWorkItemSideInputDoFnRunner -> OtherDoFns Error: lost StreamingKeyedWorkItemSideInputDoFnRunner OtherDoFns edge Error: lost OtherDoFns StreamingKeyedWorkItemSideInputDoFnRunner edge

Handling workitems

  • No labels