You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 39 Next »

Some of the Applications/Organizations Using Apache Curator

Application/Organization

URL

Description

Netflix

http://www.netflix.com/

The originator of Curator, it is used heavily in the company for leader selection, locks, sequence generation, among many other things.

Maginatics

http://maginatics.com/

 

CxEngage

http://www.cxengage.com/

Making heaving use of Curator and some ported recipes in Clojure in our product, CxEngage

Bazaarvoice

http://www.bazaarvoice.com/

Currently powering feature flagging system as well as SOA infrastructure.

eBay

http://www.eBay.com

Built a locking solution that can give out locks at the rate of 10k locks per second. Uses Exhibitor to manage the ZK cluster.

OpenSCG

http://www.OpenSCG.com

 

Storm

http://storm-project.net/

Distributed and fault-tolerant realtime computation: stream processing, continuous computation, distributed RPC, and more.

Druid

https://github.com/metamx/druid/

Metamarkets Druid Data Store.

Fuse Fabric

http://fuse.fusesource.org/fabric/

Distributed configuration, management and provisioning service

Galaxy

http://puniverse.github.io/galaxy/index.html

Galaxy is a high-performance in-memory data-grid (IMDG) that can serve as a basis for building distributed applications that require fine-tuned control over data placement and/or custom distributed data-structures.

Apache Drill

http://incubator.apache.org/drill/

Apache Drill provides low latency ad-hoc queries to many different data sources, including nested data. Inspired by Google's Dremel, Drill is designed to scale to 10,000 servers and query petabytes of data in seconds.

General Electric

https://github.com/GeneralElectric/snowizard-discovery

Snowizard Discovery - A Dropwizard bundle that can be used to register a Dropwizard service into Zookeeper upon startup. Connectivity to Zookeeper is provided by Netflix's Curator library and its built in Service Discovery framework.

Apache Oozie

http://oozie.apache.org

Apache Oozie is a scalable system for managing and scheduling workflows that run different types of Hadoop jobs (such as MapReduce, Pig, Hive and Sqoop) as well as system specific jobs (such as Java programs and shell scripts). It uses Curator’s service discovery and distributed locks for coordinating it’s active-active High Availability.

Apache Sparkhttp://spark.apache.org

Apache Spark is a fast and general engine for large-scale data processing. Uses Curator for leader elections, etc.

Wix

http://www.wix.com

Uses Curator for all Zookeeper access from Java, particularly for service discovery and reliable connection/watcher lifecycle.

Spring XDhttp://projects.spring.io/spring-xdUnified, distributed, and extensible system for data ingestion. Uses Curator's Service Discovery recipe.
Tachyonhttp://tachyon-project.org/Use Curator's LeaderSelector.
Apache Flumehttp://flume.apache.org/Dynamic configuration from Zookeeper watcher.
Dealer.comhttp://www.dealer.com/Uses Curator for configuration.
Nirmatahttp://nirmataoss.github.io/workflow/Nirmata Workflow is based on Curator.
Apache Hivehttps://hive.apache.org/Used for various ZooKeeper accesses.
Yahoo Kafka Managerhttps://github.com/yahoo/kafka-managerA tool for managing Apache Kafka.
Apache Airavatahttps://airavata.apache.org/A software framework for executing and managing computational jobs and workflows on distributed computing resources.

Plus, many others not listed here!

  • No labels