Page tree
Skip to end of metadata
Go to start of metadata

myriad-0.2.0-incubating-rc1 

Major Features

    • Deployment of Resource Manager and Node Manager via Docker
    • Enhanced distribution of YARN binaries to Mesos Nodes at Runtime
      • Distribute the JVM Binaries
      • Distribute configuration files
      • Support REST endpoints for distributing configuration and binaries instead of relying on external source
    • Bugfixes
      • Better cgroup support and documentation
      • Better dynamic resource allocation support

JIRAs

 Full list of JIRAs fixed in version 0.2.0

Caveats

 

  1. Myriad has a compile dependency of Hadoop 2.6.x and Hadoop 2.7.x and Mesos > 0.27.0 version. It was well tested against these versions. However, binary compatibility against other Hadoop/Mesos versions is not guaranteed.
  2. The /api/cluster/flexup and /api/cluster/flexdown REST end points support "constraints" parameter. However, the web UI does not yet support specifying this parameter.
  3. Currently YARN cgroups aren't supported when using Docker to run the Node Managers

Other Important Milestones

  • One new contributor.
  • New inquiries on the mailing list about Myriad.

myriad-0.1.0-incubating

Major Features

  • Deployment of a Hadoop YARN cluster as a Mesos framework

  • Static resource allocation using REST APIs to expand/contract a Hadoop YARN cluster

  • Dynamic resource allocation to expand/contract a Hadoop YARN cluster

  • High Availability, with discoverability, restartability, and state recovery

  • Ability to distribute Hadoop YARN binaries to Mesos nodes at runtime

  • Provisioning of auxiliary Hadoop services like the Job History Server

  • Support for constraints based node manager placement

  • Management GUI for monitoring and scaling Hadoop YARN clusters
  • Configurable Node Manager ports
  • API to shutdown Myriad
  • Documentation!

JIRAs

Full list of JIRAs fixed in version 0.1.0

Caveats

  1. Myriad has a compile dependency on Hadoop 2.7.0 and Mesos 0.24.1 versions. It was well tested against these versions. However, binary compatibility against other Hadoop/Mesos versions is not guaranteed.
  2. The /api/cluster/flexup and /api/cluster/flexdown REST end points support "constraints" parameter. However, the web UI does not yet support specifying this parameter.
  3. MYRIAD-153: Place holder tasks not getting cleaned up. A work around if this problem is hit is to restart the zero profile NM using flex down and flex up APIs.

Other Important Milestones

 

  • No labels