Child pages
  • Compression

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

The message header format for magic byte=1, now looks like -

1 byte magic

1 byte compression-attributes

4 byte CRC32 of the payload

...

Config parameter

Description

Default

compression.codec

Controls the compression codec to be used by the producer. O means no compression. 1 means GZIP compression. 2 means Snappy compression (0: No compression, 1: GZIP compression, 2: Snappy compression, 3: LZ4 compression)

0

compressed.topics

comma separated list of topics for which compression should be enabled. This doesn't mean anything when compression.codec = 0

empty

 

compression.topics=empty

compression.topics="topicA,topicB"

compression.codec=0

All topics are uncompressed since compression is disabled

All topics are uncompressed since compression is disabled

compression.codec=1

All topics are compressed

Only the topics topicA and topicB are compressed

Compression codecs supported

Currently, only GZIP, Snappy and Snappy LZ4 compression codecs are supported.