Myriad is a Mesos framework designed for scaling a YARN cluster on Mesos. Myriad can expand or shrink the resources managed by a YARN cluster in response to events as per configured rules and policies.
The name Myriad means, countless or extremely great number. In context of the project, it allows one to expand overall resources managed by Mesos, even when the cluster under Mesos management runs other cluster managers like YARN.
Please note: Myriad is not yet production ready. However, the project is rapidly progressing with some very useful features.
If you are an admin/developer interested to try out Myriad, please clone the git repo and use phase1 branch.
- How Myriad works
- Developing Myriad
- Local vagrant setup guide
- Myriad REST API
- Myriad Dashboard Development
- Distribution of Node Manager Binaries
- Fine Grained Scaling
- Deploying the Myriad Resource-Manger using Docker
- Mesos, YARN and cgroups
Please keep checking this section for updates.
- NodeManager Profiles
- Scale up/down Node Managers via REST API/Web UI
- Framework re-conciliation & HA
- ResourceManager failover/discovery using Marathon/Mesos-DNS
- Fine-grained scaling
- Remote distribution of NodeManager binaries
- Framework checkpointing
- Launch Job History Server
- Constraints based Node Manager placement
- Support multi-tenancy for Node Managers
- Configuration store for storing rules and policies for clusters managed by Myriad