Some of the Applications/Organizations Using Apache Curator
The originator of Curator, it is used heavily in the company for leader selection, locks, sequence generation, among many other things.
Making heaving use of Curator and some ported recipes in Clojure in our product, CxEngage
Currently powering feature flagging system as well as SOA infrastructure.
Built a locking solution that can give out locks at the rate of 10k locks per second. Uses Exhibitor to manage the ZK cluster.
Distributed and fault-tolerant realtime computation: stream processing, continuous computation, distributed RPC, and more.
Metamarkets Druid Data Store.
Distributed configuration, management and provisioning service
Galaxy is a high-performance in-memory data-grid (IMDG) that can serve as a basis for building distributed applications that require fine-tuned control over data placement and/or custom distributed data-structures.
Apache Drill provides low latency ad-hoc queries to many different data sources, including nested data. Inspired by Google's Dremel, Drill is designed to scale to 10,000 servers and query petabytes of data in seconds.
Snowizard Discovery - A Dropwizard bundle that can be used to register a Dropwizard service into Zookeeper upon startup. Connectivity to Zookeeper is provided by Netflix's Curator library and its built in Service Discovery framework.
Apache Oozie is a scalable system for managing and scheduling workflows that run different types of Hadoop jobs (such as MapReduce, Pig, Hive and Sqoop) as well as system specific jobs (such as Java programs and shell scripts). It uses Curator’s service discovery and distributed locks for coordinating it’s active-active High Availability.
Apache Spark is a fast and general engine for large-scale data processing. Uses Curator for leader elections, etc.
Uses Curator for all Zookeeper access from Java, particularly for service discovery and reliable connection/watcher lifecycle.
|Spring XD||http://projects.spring.io/spring-xd||Unified, distributed, and extensible system for data ingestion. Uses Curator's Service Discovery recipe.|
|Tachyon||http://tachyon-project.org/||Use Curator's LeaderSelector.|
|Apache Flume||http://flume.apache.org/||Dynamic configuration from Zookeeper watcher.|
|Dealer.com||http://www.dealer.com/||Uses Curator for configuration.|
|Nirmata||http://nirmataoss.github.io/workflow/||Nirmata Workflow is based on Curator.|
|Apache Hive||https://hive.apache.org/||Used for various ZooKeeper accesses.|
|Yahoo Kafka Manager||https://github.com/yahoo/kafka-manager||A tool for managing Apache Kafka.|
|Apache Airavata||https://airavata.apache.org/||A software framework for executing and managing computational jobs and workflows on distributed computing resources.|
|Apache Zeppelin||https://zeppelin.incubator.apache.org/||A web-based notebook that enables interactive data analytics.|
|Flipkart||https://github.com/flipkart-incubator/ranger||A service discovery system that uses Curator.|
|Apache James Mailbox||http://james.apache.org/mailbox/||Uses Zookeeper and Curator Framework for generating distributed unique ID's.|
Open-source Internet of Things middleware platform based on widely adopted and trusted components: Akka, Netty, Zookeeper, Curator, Spring Framework, Avro, Thrift, and others.
|Apache Flink||https://flink.apache.org||Streaming dataflow engine that provides data distribution, communication, and fault tolerance for distributed computations over data streams.|
|Spring Statemachine||http://projects.spring.io/spring-statemachine||A framework for application developers to use state machine concepts with Spring applications.|
|Spring Cloud Zookkeper||http://cloud.spring.io/spring-cloud-zookeeper/||Provides Apache Zookeeper integrations for Spring Boot apps through autoconfiguration.|
|Apache Kylin||http://kylin.apache.org||An open source Distributed Analytics Engine. Uses Curator and its recipes.|
|Apache Ignite||https://ignite.apache.org||In-Memory Data Fabric. The ZooKeeper module uses Curator recipes.|
|Apache Atlas||http://atlas.incubator.apache.org||Data Governance and Metadata framework for Hadoop. Uses Curator for leaders/latches.|
|Apache Solr||http://lucene.apache.org/solr/||Uses Curator in DelegationTokenKerberosFilter|
|Hubspot Singularity||https://github.com/HubSpot/Singularity||Mesos scheduler.|
|Hazelcast||https://github.com/hazelcast/hazelcast-zookeeper/||The Hazelcast Discovery Plugin for Apache ZooKeeper uses Curator|
|Apache Fluo||https://fluo.apache.org||Apache Fluo™ lets users make incremental updates to large data sets stored in Apache Accumulo|
linkerd is a transparent service mesh, designed to make modern applications safe and sane by transparently adding service discovery, load balancing, failure handling, instrumentation, and routing to all inter-service communication.
|Pravega||http://pravega.io||Pravega provides a new storage abstraction - a stream - for continuous and unbounded data.|
|Apache Distributedlog||http://distributedlog.incubator.apache.org||A high-throughput, low-latency replicated log service, offering durability, replication and strong consistency as essentials for building reliable real-time applications. Uses Curator's testing module.|
|Yahoo Vespa||http://vespa.ai||The open big data serving engine: Store, search, rank and organize big data at user serving time.|
|Mesos Marathon||https://mesosphere.github.io/marathon/||Marathon is a production-grade container orchestration platform for Mesosphere’s Datacenter Operating System (DC/OS) and Apache Mesos.|
|Alibab Dubbo||https://github.com/alibaba/dubbo||High-performance, java based, open source RPC framework|
|Apache Heron||https://apache.github.io/incubator-heron/||A realtime, distributed, fault-tolerant stream processing engine from Twitter|
Plus, many others not listed here!