Current state: Accepted
Discussion thread: here
Please keep the discussion on the mailing list rather than commenting on the wiki (wiki discussions get unwieldy fast).
There is presently no way in Kafka Streams to provide default configs for the internal topics that are created. Anyone that wants to provide topic configs can only do it via the StateStoreSupplier API, which is cumbersome and only applies to changelog topics. This will usually result in having to create the topics first (which involves resolving the generated name), and/or changing the configuration after the topics have been created.
We should provide a prefix that can be used when creating a StreamsConfig. The prefix will mark these configs as Topic Configs and should be applied at the time any internal topics are created.
We will add the following field and method to StreamsConfig
We will add the field and method described above to StreamsConfig. At topic creation time we will extract all properties from StreamsConfig that have the TOPIC_PREFIX and use these as the default configs when creating any internal topics. Any configs that are currently provided, i.e., via a StateStoreSupplier, will override any of the defaults that have been set in StreamsConfig.
Compatibility, Deprecation, and Migration Plan
Adding each individual topic config to StreamsConfig. We already have these params duplicated elsewhere.