Status

Current state: Discussion

Discussion Thread: here

JIRA:

Please keep the discussion on the mailing list rather than commenting on the wiki (wiki discussions get unwieldy fast).

Motivation

KIP-770 introduced a new config called input.buffer.max.bytes and also a corresponding task level metric. While implementing the KIP, it was noticed that a similar metric to track the cache size in bytes at a task level is missing and would be a good addition. This KIP aims to introduce the same.

Proposed Changes

Add a new metric called cache-size-bytes-total. This would be a task level metric to track the cache size in bytes accumulated by this task.

Public Interfaces

• Adding new metric called cache-size-bytes-total .
  • type = stream-task-metrics
  • thread-id = [thread ID]
  • task-id = [task ID]

  • The recording level for all metrics will be DEBUG

  • Description: The cache size in bytes accumulated by this task.

Compatibility, Deprecation, and Migration Plan

• None. Since this is a net new metric.

Rejected Alternatives

• None