DUE TO SPAM, SIGN-UP IS DISABLED. Goto Selfserve wiki signup and request an account.
...
With the upcoming release of 4.0, we have an opportunity to revisit the constraints and defaults for various Kafka configurations. Each of the proposed change to configuration(s) in this KIP has a specific motivation list next to it.
Public Interfaces
Note that the implementation of this KIP is split across major versions 4.0 and 5.0.
| # | Configuration name | Default Value | Diff in constraints (only lists the modified constraints) | Target release version |
|---|---|---|---|---|
| 1 | segment.ms / log.roll.ms | Unchanged: 7 days | Previous: min = 1 ms New: min = 1 min. | 5.0 |
| 2 | segment.bytes / log.segment.bytes | Unchanged: | Previous: New: | 4.0 |
| 3 | num.recovery.threads.per.data.dir | Previous: 1 New: 2 | Unchanged | 4.0 |
| 4 | segment.index.bytes / log.index.size.max.bytes | Unchanged: 10 MB | Previous: New: | 5.0 |
| 5 | linger.ms | Previous: 0 New: 5 | Unchanged | 4.0 |
| 6 | max.compaction.lag.ms / log.cleaner.max.compaction.lag.ms | Unchanged: | Previous: New: | 5.0 |
| 7 | message.timestamp.after.max.ms / log.message.timestamp.after.max.ms | Previous: New: | Unchanged | 4.0 |
| 9 | remote.log.manager.copier.thread.pool.size | Previous: -1 New: 10 | Current: (-1, 1, 2, ...) New: (1, 2, ...) | 4.0 |
| 10 | remote.log.manager.expiration.thread.pool.size | Previous: -1 | Current: (-1, 1, 2, ...) | 4.0 |
| 11 | remote.log.manager.thread.pool.size | Previous: 10 | Unchanged | 4.0 |
Proposed Changes
Please refer to the table above for an overview of the proposed changes. The changes to defaults and new constraints will be applied for both, the broker level configs and corresponding topic level configs. Sometimes there is a slight difference in naming for the same property at broker level and topic level. As an example, log.cleaner.max.compaction.lag.ms is the broker level config and max.compaction.lag.ms is the corresponding topic level config.
...