Awesome
Myriad
Myriad is a mesos framework designed for scaling YARN clusters on Mesos. Myriad can expand or shrink one or more YARN clusters in response to events as per configured rules and policies.
The name Myriad means, countless or extremely great number. In context of the project, it allows one to expand overall resources managed by Mesos, even when the cluster under mesos management runs other cluster managers like YARN.
Please note: Myriad is a work in progress, and should not be used in production at this point.
Getting started
- How Myriad works
- Developing Myriad
- Local vagrant setup guide
- Myriad REST API
- Auto-scaling YARN clusters
- Mesos, YARN and cgroups
Roadmap
Myriad is a work in progress, please keep checking this section for updates.
- Support multiple clusters
- Custom Executor for managing NodeManager
- Support multi-tenancy for node-managers
- Support unique constraint to let only one node-manager run on a slave
- Configuration store for storing rules and policies for clusters managed by Myriad
- NodeManager Profiles for each cluster
- High Availability mode for framework
- Framework checkpointing
- Framework re-conciliation