Production ready version of a distributed computing simulator (DCSim) based on WRENCHv2.2 and SimGridv3.34.
Allows to simulate freely selectable workflows of batch and streaming jobs on arbitrary computing platforms processing freely selectable (amounts of) data.
Thanks to performance updates in WRENCH and SimGrid the memory and computational requirements on executing resources for the simulator could be improved.
This version is used in the studies presented in https://indico.jlab.org/event/459/contributions/11490/.
What's Changed
- Extension the support for platforms consisting of arbitrary numbers of GRID storages and workers by @HerrHorizontal in #24
- Enable fluid model in file read by @HerrHorizontal in #47
- Additional features for the workload generation by @ArturAkh in #49 by @HerrHorizontal in #51
- Extend the sampling of job characteristics by @HerrHorizontal in #54
- Config and plot changes for exemplary scenarios by @HerrHorizontal in #56
- Enable simulation of scheduling and executing multi-core jobs by @HerrHorizontal in #57
- Enable dataset configuration by @rsreds in #53
- Rework simulator configuration to be completely steering-file based
- Update plotting and helper scripts
- Extended examples
- Minor bug fixes
New Contributors
Full Changelog: v0.2...v0.3
Contributors
ArturAkh, rsreds, and HerrHorizontal