Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Kafka Version: 0.7.x, 0.8.x, 0.9.x, 0.10.x, 0.11.x
Maintainers: Magnus Edenhill

...

Kafka Version: 0.8.x, 0.9.x, 0.10.x, 0.11.x

Maintainers: Confluent

License: Apache 2.0

 

-------------

Pure Python implementation with full protocol support. Consumer and Producer implementations included, GZIP, LZ4, and Snappy compression supported.

http://github.com/dpkp/kafka-python


Kafka Version: 0.8.x, 0.9.x, 0.10.x

Maintainer: Dana Powers
License: Apache 2.0

 

-------------

Python driver with full protocol support, Pythonic API, and managed balanced consumer implementation. GZIP and Snappy compression supported.
https://github.com/Parsely/pykafka
Kafka Version: 0.8.x,0.9.x,0.10.x
Maintainer: Parse.ly
License: Apache v22.0

 

-------------

Protocol support for Kafka 0.7 in Python. GZip and Snappy compression supported

Kafka Version: 0.7.x

Maintainer: David Arthur
License: Apache v.2.0

https://github.com/mumrah/kafka-python/tree/0.7

-------------

Also:
https://github.com/dsully/pykafka

 

Kafka Version: 0.7.x

Maintainer:: Dan Sulley, LinkedIn
License: Apache 2.0

-------------

Python client from Disqus:
https://github.com/getsamsa/samsa

 

Kafka Version: 0.7.x

Maintainer:: Keith Bourgoin, Parse.ly
License: Apache 2.0

-------------

Python client from Urban Airship: https://github.com/urbanairship/pykafkap

 

Kafka Version: 0.7.x

-------------

Python client from Datadog: https://github.com/datadog/brod
(Producer, Simple Consumer, ZK-Consumer)

 

Kafka Version: 0.7.x

-------------

...

The Golang bindings provides a high-level Producer and Consumer with support for the balanced consumer groups of Apache Kafka 0.9 and above.

Kafka Version: 0.8.x, 0.9.x,  0.10.x, 0.11.x+

Maintainer: Confluent

License: Apache v2.0

...

erlkafka is a kafka client written in erlang

https://github.com/milindparikh/erlkafka.git


Kafka Version0.7.x

Maintainer: Milind Parikh
*License: BSD, LGPL

Also:
https://github.com/wooga/kafka-erlang

 

.NET

-------------

A fully featured .NET client for Apache Kafka based on librdkafka (a fork of rdkafka-dotnet).

Kafka Version: 0.8.x - , 0.9.x, 0.10.x, 0.11.x

MaintainerConfluent Inc. (original author Andreas Heider)

License: Apache 2.0

https://github.com/confluentinc/confluent-kafka-dotnet

 

-------------

Pure C# client with full protocol support.  Includes consumer, producer,

lower level components and gzip support (no snappy)


Kafka Version: 0.8.x

Maintainer: James Roland 

License: Apache 2.0

https://github.com/Jroland/kafka-net

 

-------------

This is a .NET implementation of a client for Kafka using C# for Kafka 0.8. It provides for an implementation that covers most basic functionalities to include a simple Producer and Consumer.

Kafka Version: 0.8.x

Maintainer: ExactTarget

License: Apache 2.0

https://github.com/ExactTargetDev/kafka-net


-------------

.Net implementation of the Apache Kafka Protocol that provides basic functionality through Producer/Consumer classes. The project also offers balanced consumer implementation. The project is a fork from ExactTarget's Kafka-net Client.

 

Kafka Version: 0.8.x, 0.9.x

MaintainerMicrosoft

License: Apache 2.0

https://github.com/Microsoft/Kafkanet

 

-------------

C# client, asynchronous, all 3 compressions supported (read and write), tracks leader partition changes transparently, long time in production.

 

Kafka Version: 0.8.x

MaintainerVadim Chekan
License: Apache-2.0
https://github.com/ntent-ad/kafka4net

 

-------------

kafka-sharp - "High Performance" .NET Kafka Driver

 

Kafka Version: 0.8.x

MaintainerCriteo

License: Apache 2.0

https://github.com/criteo/kafka-sharp

 

-------------

 

Clojure

kafunk - ------------

Fast kafka api for JVM languages implemented in clojure.

 Fully-featured, native F# client which works on .NET Core

Kafka Version:  00.8.x, 0.9.x, 0.10.x

Maintainer:  https://githubJet.com/gerritjvv

License: Apache 2.0

https://github.com/gerritjvv/kafka-fastjet/kafunk

 

-------------

 

Clojure

-------------

Fast kafka api for JVM languages implemented in clojure.Wrapper to the Java API for interacting with Kafka


 

Kafka Version: 0.8.x

Maintainerhttps://github.com/pinglesgerritjvv

License: Apache 2.0

https://github.com/pinglesgerritjvv/cljkafka-kafka/ fast

 


-------------

Kafka clojure client libraryWrapper to the Java API for interacting with Kafka


 

Kafka Version: 0.8.x

MaintainerPierre-Yves Ritschardhttps://github.com/pingles

License: MIT
Apache 2.0

https://github.com/pingles/clj-kafka/ 

 

-------------

Kafka clojure client library


 

Kafka Version: 0.8.x

MaintainerPierre-Yves Ritschard

License: MIT

CodeDocumentation

-------------

 

Ruby

-------------

ruby-kafka - A pure Ruby client library for the Kafka distributed log system.Kafka distributed log system.


Kafka Version: 0.9.x, 0.10.x, 0.11.x

MaintainerZendeskDaniel Schierbeck

Licence: Apache 2.0

https://github.com/zendesk/ruby-kafka

 

-------------

Karafka - Framework used to simplify Apache Kafka based Ruby and Rails applications development. Karafka provides higher abstraction layers, including Capistrano, Docker and Heroku support. Based on ruby-kafka.

 

Kafka Version: 0.9.x, 0.10.x, 0.11.x

MaintainerZendeskDaniel SchierbeckMaciej Mensfeld
Licence
: Apache 2.0MIT

https://github.com/zendeskkarafka/ruby-kafkakarafka

 

-------------

Karafka - Framework used to simplify Apache Kafka based Ruby applications development.Racecar – A simple framework for writing Kafka consumers in Ruby that integrates nicely with Rails. Based on ruby-kafka. 

 

Kafka Version: 0.99.x, 0.10.x, 0.1011.x

MaintainerMaciej MensfeldZendesk / Daniel Schierbeck

Licence: MITApache 2.0

https://github.com/karafkazendesk/karafkaracecar

-------------

Racecar – DeliveryBoy – A simple framework for writing Kafka consumers in Ruby that integrates nicely with Railsway to publish messages to Kafka from Ruby applications. Based on ruby-kafka. 

Kafka Version: 0.9.x, 0.10.x, 0.11.x

MaintainerZendesk / Daniel Schierbeck

Licence: Apache 2.0

https://github.com/zendesk/racecar delivery_boy

-------------

JRuby wrapper for producers and consumers of the existing API

 

Kafka Version: 0.8.x

Maintainer: Joseph Lawson
License: Apache 2.0

https://github.com/joekiller/jruby-kafka

 

-------------

[Unmaintained] Pure Ruby, Consumer and Producer implementations included, GZIP and Snappy compression supported. Ruby 1.9.3 and up (CI runs MRI 2.0, JRuby and Rubinius).


Kafka Version: 0.8.x

Maintainer: Bob Potter
License: MIT

https://github.com/bpot/poseidon

 

-------------

https://github.com/acrosa/kafka-rb

 

Kafka Version: 0.7.x

Maintainer: Alejandro Crosa
License:: Apache 2.0

-------------

Event machine client:
https://github.com/groupme/em-kafka

 

Kafka Version: 0.7.x

-------------

JRuby Event stream processor
https://github.com/wooga/kafkaesque

 

Kafka Version: 0.7.x

-------------

 

 

Node.js

-------------

The node-rdkafka library is a high-performance NodeJS client for Apache Kafka that wraps the native librdkafka library. All the complexity of balancing writes across partitions and managing (possibly ever-changing) brokers should be encapsulated in the library.

https://github.com/Blizzard/node-rdkafka

Kafka Version: 0.9, 0.10

Node.js >= 4

Maintainer: Blizzard.com

License: MIT

 

 

-------------

Kafka-Node is a NodeJS client with Zookeeper integration

 

Kafka Version: 0.8.x

Maintainersohu.com

License: MIT

https://github.com/SOHU-Co/kafka-node/

 

-------------

Kafka-node is a pure JavaScript implementation for NodeJS Server with Vagrant and Docker support.


Kafka Version: 0.8.x

Maintainerwurstmeister
License: Apache 2.0

https://github.com/wurstmeister/node-kafka-0.8-plus

 

-------------

Node-kafka is a node.js wrapper for the C library librdkafka

 

Kafka Version: 0.8.x

Maintainer: Sutoiku

License: MIT

https://github.com/sutoiku/node-kafka

 

-------------

kafka-java-bridge is a Nodejs wrapper for the JAVA high level kafka 0.8. consumer API

 

Kafka Version: 0.8.x

Maintainer: LivePersonInc

License: MIT

https://www.npmjs.com/package/kafka-java-bridge

https://github.com/LivePersonInc/kafka-java-bridge

 

-------------

Low-level protocol support in node.js.

https://github.com/cainus/Prozess
https://npmjs.org/package/prozess

 

Kafka Version: 0.7.x

Maintainers: 
Gregg Caines
Eric lee
License: MIT

 

-------------

Alternate node client from Tagged
https://github.com/marcuswestin/node-kafka

Also:
https://github.com/dannycoates/franz-kafka

 

Kafka Version: 0.7.x

-------------

 

...

https://github.com/dspeterson/dory


Kafka Version: 0.8.8.x, 0.9.x, 0.10.x, 0.11.x

Maintainer:  Dave Peterson
License: Apache v.2.0

-------------

...

https://github.com/miniway/kafka-clj

 

Kafka Version: 0.7.x

 

Swift

-------------

Pure Swift implementation of Producer + Simple and High-Level Consumer

 

Kafka Version: 0.9.x

MaintainerKellan Cummings, Luke Lau
License: MIT

 

Client Libraries Previously Supported

...