Child pages
  • Wire Format
Skip to end of metadata
Go to start of metadata

Requests Wire Format

Request Header

REQUEST_LENGTH: length in bytes of the entire request (excluding this field)

REQUEST_TYPE:

PRODUCE

0

FETCH

1

MULTIFETCH

2

MULTIPRODUCE

3

OFFSETS

4

TOPIC_LENGTH: length in bytes of the TOPIC name

TOPIC: the name of topic

PARTITION: the partition number to act on

PRODUCE Request

MESSAGES_LENGTH: length in bytes of the MESSAGES section

MESSAGES: collection of MESSAGEs

MESSAGE

LENGTH: Length in bytes of the message (excluding this field)

MAGIC: Magic Value
  0 : (no compression codec attribute)
  1 : (compression codec attribute)

COMPRESSION: (only for MAGIC = 1)

  0 : no compression

  1 : gzip

  2 : snappy

Further details: Compression

CHECKSUM: CRC32 checksum of the payload

PAYLOAD: Variable number of bytes

FETCH Request

LENGTH: the length in bytes of the request (excluding this field)

OFFSET: offset of MESSAGE to start fetching from

MAX_SIZE: Maximum size of MESSAGE(s) to receive

OFFSETS Request

TIME: timestamp of the offsets before this time (ms)
special values:
-1 : latest
-2 : earliest

MAX NUMBER of OFFSETS: the maximum number of offsets to retrieve

Responses Wire Format

Response Header

PRODUCE Response

None

FETCH Response

0 or more MESSAGEs

OFFSETS Response

Number of OFFSETS: the count of offsets contained in the response

OFFSET: Offset of a MESSAGE (64 bits)

  • No labels

1 Comment

  1. Anonymous

    I just wanted to comment on your blog and say I really enjoyed reading your blog here. It was very informative and I also digg the way you write! Keep it up and I'll be back soon to find out more mate.best Android tablet