...
The message header format for magic byte=1, now looks like -
1 byte magic | 1 byte compression-attributes | 4 byte CRC32 of the payload |
...
Config parameter | Description | Default |
|---|---|---|
compression.codec | Controls the compression codec to be used by the producer. O means no compression. 1 means GZIP compression. 2 means Snappy compression (0: No compression, 1: GZIP compression, 2: Snappy compression, 3: LZ4 compression) | 0 |
compressed.topics | comma separated list of topics for which compression should be enabled. This doesn't mean anything when compression.codec = 0 | empty |
| compression.topics=empty | compression.topics="topicA,topicB" |
compression.codec=0 | All topics are uncompressed since compression is disabled | All topics are uncompressed since compression is disabled |
compression.codec=1 | All topics are compressed | Only the topics topicA and topicB are compressed |
Compression codecs supported
Currently, only GZIP, Snappy and Snappy LZ4 compression codecs are supported.