myriad-0.4.0-incubating
Major Features
- Apache Mesos support 1.8.x (updated from 1.5.x old version)
- UI Updated
JIRAs
Full list of JIRAs fixed in version 0.4.0
myriad-0.3.0-incubating
Major Features
- Apache Mesos support 1.5.x (updated from 0.28.0 old version)
- Full development environment or testbed based on Vagrant (libvirt) and Ansible with two flavors:
- Plain Apache Mesos
- Mesosphere DC/OS community
JIRAs
Full list of JIRAs fixed in version 0.3.0
myriad-0.2.0-incubating
Major Features
- Deployment of Resource Manager and Node Manager via Docker
- Enhanced distribution of YARN binaries to Mesos Nodes at Runtime
- Distribute the JVM Binaries
- Distribute configuration files
- Support REST endpoints for distributing configuration and binaries instead of relying on external source
- Bugfixes
- Better cgroup support and documentation
- Better dynamic resource allocation support
JIRAs
Full list of JIRAs fixed in version 0.2.0
Caveats
- Myriad has a compile dependency of Hadoop 2.6.x and Hadoop 2.7.x and Mesos > 0.27.0 version. It was well tested against these versions. However, binary compatibility against other Hadoop/Mesos versions is not guaranteed.
- The /api/cluster/flexup and /api/cluster/flexdown REST end points support "constraints" parameter. However, the web UI does not yet support specifying this parameter.
- Currently YARN cgroups aren't supported when using Docker to run the Node Managers
Other Important Milestones
- One new contributor.
- New inquiries on the mailing list about Myriad.
myriad-0.1.0-incubating
Major Features
Deployment of a Hadoop YARN cluster as a Mesos framework
Static resource allocation using REST APIs to expand/contract a Hadoop YARN cluster
Dynamic resource allocation to expand/contract a Hadoop YARN cluster
High Availability, with discoverability, restartability, and state recovery
Ability to distribute Hadoop YARN binaries to Mesos nodes at runtime
Provisioning of auxiliary Hadoop services like the Job History Server
Support for constraints based node manager placement
- Management GUI for monitoring and scaling Hadoop YARN clusters
- Configurable Node Manager ports
- API to shutdown Myriad
- Documentation!
JIRAs
Full list of JIRAs fixed in version 0.1.0
Caveats
- Myriad has a compile dependency on Hadoop 2.7.0 and Mesos 0.24.1 versions. It was well tested against these versions. However, binary compatibility against other Hadoop/Mesos versions is not guaranteed.
- The /api/cluster/flexup and /api/cluster/flexdown REST end points support "constraints" parameter. However, the web UI does not yet support specifying this parameter.
- MYRIAD-153: Place holder tasks not getting cleaned up. A work around if this problem is hit is to restart the zero profile NM using flex down and flex up APIs.
Other Important Milestones
- Myriad code base donated to ASF from eBay/PayPal
- Code migrated to ASF git repository (git://git.apache.org/incubator-myriad.git)
- Issues migrated to JIRA (https://issues.apache.org/jira/browse/MYRIAD)
- Documentation on Wiki (cwiki.apache.org/confluence/display/MYRIAD/)
- Podling Website (myriad.incubator.apache.org)
- Two new committers/PPMC members voted in