This is the official mono repo containing all the scriptworker *scripts. As to November 2019, we have migrated all the workers, across all trees, to Kubernetes and Google Compute Cloud. Tagging along, we have also migrated all the individual scripts under the same roof in order to single source the shared configurations.
In a nutshell, we now user Docker-based scriptworkers scripts that perform various pieces of our automation. In order for deploying, we no longer rely on hiera or puppet but on Docker and SOPS.
The comprehensive list of workers that we have available is listed below. They are split in two large environments within the GCP: releng-nonprod and releng-prod.
The former holds all the dev workers. These are handy to use before submitting a PR or deployment to production in order to test things out. The environment holds rules for netflows as well in order to access the dev instances of our external resources.
The latter, releng-prod withhold two sets of workers. The level-3 workers which are the production ones. We use these workers to ship the real, production-ready releases, across our different products (Firefox, Thunderbird, Firefox for mobile related suite, etc). In the same environment we also have the level-1 workers which are used for staging releases. They co-exist here so that they are closer to production as possible.
Full documentation is available at https://scriptworker-scripts.readthedocs.io/en/latest/index.html.
Note: this is not a comprehensive list. We have added more scripts, more trust domains, and more pools since this list was compiled.
| Worker type | Deployment name |
|---|---|
| gecko-1-addon-dev | addon-dev-relengworker-firefoxci-gecko-1 |
| gecko-3-addon | addon-prod-relengworker-firefoxci-gecko-3 |
| gecko-1-addon | addon-prod-relengworker-firefoxci-gecko-1 |
| Worker type | Deployment name |
|---|---|
| gecko-1-balrog-dev | balrog-dev-relengworker-firefoxci-gecko-1 |
| gecko-3-balrog | balrog-prod-relengworker-firefoxci-gecko-3 |
| gecko-1-balrog | balrog-prod-relengworker-firefoxci-gecko-1 |
| comm-3-balrog | balrog-prod-relengworker-firefoxci-comm-3 |
| comm-1-balrog | balrog-prod-relengworker-firefoxci-comm-1 |
| Worker type | Deployment name |
|---|---|
| gecko-1-beetmover-dev | beetmover-dev-relengworker-firefoxci-gecko-1 |
| gecko-3-beetmover | beetmover-prod-relengworker-firefoxci-gecko-3 |
| gecko-1-beetmover | beetmover-prod-relengworker-firefoxci-gecko-1 |
| comm-3-beetmover | beetmover-prod-relengworker-firefoxci-comm-3 |
| appservices-3-beetmover | beetmover-prod-relengworker-firefoxci-applicationservices-3 |
| appservices-1-beetmover | beetmover-prod-relengworker-firefoxci-applicationservices-1 |
| mobile-3-beetmover | beetmover-prod-relengworker-firefoxci-mobile-3 |
| mobile-1-beetmover | beetmover-prod-relengworker-firefoxci-mobile-1 |
| Worker type | Deployment name |
|---|---|
| gecko-1-bouncer-dev | bouncer-dev-relengworker-firefoxci-gecko-1 |
| gecko-3-bouncer | bouncer-prod-relengworker-firefoxci-gecko-3 |
| gecko-1-bouncer | bouncer-prod-relengworker-firefoxci-gecko-1 |
| comm-3-bouncer | bouncer-prod-relengworker-firefoxci-comm-3 |
| Worker type | Deployment name |
|---|---|
| gecko-1-pushapk-dev | pushapk-dev-relengworker-firefoxci-gecko-1 |
| gecko-3-pushapk | pushapk-prod-relengworker-firefoxci-gecko-3 |
| gecko-1-pushapk | pushapk-prod-relengworker-firefoxci-gecko-1 |
| mobile-3-pushapk | pushapk-prod-relengworker-firefoxci-mobile-3 |
| mobile-1-pushapk | pushapk-prod-relengworker-firefoxci-mobile-1 |
| Worker type | Deployment name |
|---|---|
| gecko-1-pushflat-dev | pushflat-dev-relengworker-firefoxci-gecko-1 |
| gecko-3-pushflat | pushflat-prod-relengworker-firefoxci-gecko-3 |
| gecko-1-pushflat | pushflat-prod-relengworker-firefoxci-gecko-1 |
| Worker type | Deployment name |
|---|---|
| gecko-1-pushsnap-dev | pushsnap-dev-relengworker-firefoxci-gecko-1 |
| gecko-3-pushsnap | pushsnap-prod-relengworker-firefoxci-gecko-3 |
| gecko-1-pushsnap | pushsnap-prod-relengworker-firefoxci-gecko-1 |
| Worker type | Deployment name |
|---|---|
| gecko-1-shipit-dev | shipit-dev-relengworker-firefoxci-gecko-1 |
| gecko-3-shipit | shipit-prod-relengworker-firefoxci-gecko-3 |
| gecko-1-shipit | shipit-prod-relengworker-firefoxci-gecko-1 |
| comm-3-shipit | shipit-prod-relengworker-firefoxci-comm-3 |
| comm-1-shipit | shipit-prod-relengworker-firefoxci-comm-1 |
| Worker type | Deployment name |
|---|---|
| gecko-1-shipit-dev | shipit-dev-relengworker-firefoxci-gecko-1 |
| gecko-3-signing | signing-prod-relengworker-firefoxci-gecko-3 |
| gecko-t-signing | signing-prod-relengworker-firefoxci-gecko-t |
| mobile-3-signing | signing-prod-relengworker-firefoxci-mobile-3 |
| mobile-t-signing | signing-prod-relengworker-firefoxci-mobile-t |
| comm-3-signing | signing-prod-relengworker-firefoxci-comm-3 |
| comm-t-signing | signing-prod-relengworker-firefoxci-comm-t |
| appservices-3-signing | signing-prod-relengworker-firefoxci-applicationservices-3 |
| appservices-t-signing | signing-prod-relengworker-firefoxci-applicationservices-t |
| xpi-3-signing | signing-prod-relengworker-firefoxci-xpi-3-1 |
| xpi-t-signing | signing-prod-relengworker-firefoxci-xpi-t |
| xpi-t-signing-dev | signing-dev-relengworker-firefoxci-xpi-t-1 |
| Worker type | Deployment name |
|---|---|
| gecko-1-tree-dev | tree-dev-relengworker-firefoxci-gecko-1 |
| gecko-3-tree | tree-prod-relengworker-firefoxci-gecko-3 |
| gecko-1-tree | tree-prod-relengworker-firefoxci-gecko-1 |
| comm-3-tree | tree-prod-relengworker-firefoxci-comm-3 |
# from scriptworker-scripts/ ; this will run docker for py37 and py38 # for all *scripts to update all the dependencies via `pip-compile-multi` $ maintenance/pin.sh