This Confluence has been LDAP enabled, if you are an ASF Committer, please use your LDAP Credentials to login. Any problems file an INFRA jira ticket please.

Child pages
  • KIP-338 Support to exclude the internal topics in kafka-topics.sh command
Skip to end of metadata
Go to start of metadata

This page is meant as a template for writing a KIP. To create a KIP choose Tools->Copy on this page and modify with your content and replace the heading with the next KIP number and a description of your issue. Replace anything in italics with your own description.

Status

Current stateAccepted (2.1.0)

Discussion threadthread voting

JIRA: KAFKA-7139 - Getting issue details... STATUS

Released: 2.1.0

Please keep the discussion on the mailing list rather than commenting on the wiki (wiki discussions get unwieldy fast).

Motivation

Usually we have no interest in internal topics when using the kafka-topics.sh command . However, the kafka-topics.sh can't exclude the internal topics simply. We have to write the regular to exclude the internal topics. This kip tries to add a flag "exclude-internal" to kafka-topics.sh. If user set the flag, all internal topics will be excluded by the following commands - "list" and "describe"

Proposed Changes && Public Interfaces

KIP-338 plan to add a new option to kafka-topics.sh to enable/disable kafka-topics.sh to show the information of internal topics. The new option is called as "exclude-internal". Assume we have a internal topic "__consumer_offsets" and a user topic "testTopic".

The following command will show both topics.

$ kafka-topics.sh --zookeeper localhost:2181 --list

The following command will show the "testTopic" only.

$ kafka-topics.sh --zookeeper localhost:2181 --list --exclude-internal

The explanation of "exclude-internal" is "exclude internal topics when running list or describe command". 

Compatibility, Deprecation, and Migration Plan

  • No compatibility issue since the default value of exclude-internal is false.

Rejected Alternatives

None

  • No labels