Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CI: Add caching and cleanup all workflows #2114

Closed
wants to merge 121 commits into from
Closed
Changes from 1 commit
Commits
Show all changes
121 commits
Select commit Hold shift + click to select a range
b9fc895
Add restoring and saving caches to build-dev
sieniven Jun 23, 2023
2f8efb1
Resolve invalid expression
sieniven Jun 23, 2023
d6c2153
Fix pushing docker image step
sieniven Jun 23, 2023
6e63d77
Switch to release when building binaries
sieniven Jun 23, 2023
d696eae
Add build mode to cache key
sieniven Jun 23, 2023
3b15016
Remove caching to see if OOM persists
sieniven Jun 23, 2023
f8d9d75
Add caching into build dev workflow
sieniven Jun 24, 2023
019eab1
Amend cache actions
sieniven Jun 25, 2023
4ff53c3
Fix git ownership in containers
sieniven Jun 25, 2023
852b1bf
Fix dubious ownership
sieniven Jun 25, 2023
36ee0f5
Fixes to safe directory warnings
sieniven Jun 25, 2023
20e5b92
Add docker build workflow into build dev ci
sieniven Jun 25, 2023
fe8ceb9
Fixes to docker build pipeline
sieniven Jun 25, 2023
34176e9
Remove conditional expression for docker build pipeline
sieniven Jun 25, 2023
637025b
Change action to restore to prevent saving of cache in docker workflow
sieniven Jun 25, 2023
0f536ae
Debug
sieniven Jun 25, 2023
84afd63
Add sudo privleges
sieniven Jun 25, 2023
6f4535b
Revert changes
sieniven Jun 25, 2023
34c4b56
Refactor staging workflow
sieniven Jun 26, 2023
116ec07
Refactor to use matrices for stage release job def
sieniven Jun 26, 2023
a9aca28
Revert matrices for staging/creating release
sieniven Jun 26, 2023
47d63c0
Fix missing docker user
sieniven Jun 26, 2023
3e6c13e
Add matrix strategy to creating release workflow, separate win-x64
sieniven Jun 26, 2023
280a2f2
Add caching to all workflows
sieniven Jun 26, 2023
50fd8e0
Fix bugs
sieniven Jun 26, 2023
d63a00b
Add missing release flag
sieniven Jun 26, 2023
84d8dd0
Use docker build workflow and pull build directory caching
sieniven Jun 26, 2023
1fe7b6d
Use noarch dockerfile as default build
sieniven Jun 26, 2023
4c2c6c1
Fix git dir warnings
sieniven Jun 26, 2023
0a4692f
Fix env variables, bug in docker-deploy-build
sieniven Jun 26, 2023
f6ade80
Add pipeline to build at specified docker target build stage
sieniven Jun 26, 2023
e6f3e00
Merge branch 'master' into niven/cache-ci
sieniven Jun 26, 2023
ea85381
Add target for tests workflow
sieniven Jun 26, 2023
c2c45f3
Merge branches 'niven/cache-ci' and 'niven/cache-ci' of github.com:De…
sieniven Jun 26, 2023
6dfe2d5
Add git version
sieniven Jun 26, 2023
070bc20
Remove git version env variable
sieniven Jun 26, 2023
6c8ceb8
Fix build dev to build in builder container, create new docker build job
sieniven Jun 26, 2023
33755fd
Merge branch 'master' into niven/cache-ci
sieniven Jun 26, 2023
9f5cc5e
Fix naming
sieniven Jun 26, 2023
395f0f4
Fix format check error
sieniven Jun 26, 2023
3db3874
Add back dockerignore to prevent rebuilding image
sieniven Jun 26, 2023
80435e8
Merge branch 'niven/fix-fmt-check' of github.com:DeFiCh/ain into nive…
sieniven Jun 26, 2023
873824e
Fix rust lint workflow
sieniven Jun 26, 2023
abf7a76
Use docker build to build binaries in build dev
sieniven Jun 26, 2023
047ad82
Fix workflows to run natively
sieniven Jun 26, 2023
553ee6e
Fix proper sourcing of docker target image
sieniven Jun 26, 2023
735f56b
Fix sudo privileges
sieniven Jun 26, 2023
2ab3e6b
Merge branch 'master' into niven/cache-ci
sieniven Jun 26, 2023
e79893d
Fix rust test sudo privileges
sieniven Jun 26, 2023
6445bad
Fix bug in build staging workflow
sieniven Jun 26, 2023
0444b22
Fix build release
sieniven Jun 26, 2023
03f3b0f
Revert build release and staging create release workflow
sieniven Jun 26, 2023
1735704
Separate build image and deployment image
sieniven Jun 26, 2023
f085d3d
Fix typo
sieniven Jun 26, 2023
621fa94
Fix build dev workflow
sieniven Jun 26, 2023
934a631
Refactor signing of defi binaries package into make.sh
sieniven Jun 26, 2023
0b6f680
Refactor signing in build staging workflow
sieniven Jun 26, 2023
a645151
Refactor create release in build release workflow
sieniven Jun 26, 2023
a96a238
Use env variable in build release
sieniven Jun 26, 2023
2719b49
Fix bug
sieniven Jun 26, 2023
01b017d
Fix docker deploy build bug
sieniven Jun 26, 2023
1f3e50c
Move build directory into defi image
sieniven Jun 26, 2023
45093f4
Add conditional check
sieniven Jun 26, 2023
0eb59d7
Fix build staging
sieniven Jun 26, 2023
8c3380e
Fix mv to copy
sieniven Jun 26, 2023
b0b2e34
Implement docker build workflow into tests-sync
sieniven Jun 26, 2023
b079676
Fix sudo privileges when running docker on self hosted runner
sieniven Jun 26, 2023
294fc01
Add comments for TODOs in the future
sieniven Jun 26, 2023
bdd2f27
Fix error in incremental build with cached cpp build dir
sieniven Jun 26, 2023
2517c11
Fix bug in sign function
sieniven Jun 27, 2023
438c5c6
Fix sign bug
sieniven Jun 27, 2023
1235a51
Add packaging win x64 binaries with zip in make.sh
sieniven Jun 27, 2023
f9cda92
Fix release and staging workflows
sieniven Jun 27, 2023
5ee5f57
Merge branch 'master' into niven/cache-ci
sieniven Jun 27, 2023
1c6de4a
Merge branch 'master' into niven/cache-ci
prasannavl Jun 27, 2023
0a650b5
Merge branch 'master' of github.com:DeFiCh/ain into niven/cache-ci
sieniven Jun 27, 2023
5f16146
Disable caching on test sync
sieniven Jun 27, 2023
539b2f6
Implement ccache with CI
sieniven Jun 28, 2023
87d88bc
Enable cpp caching in all workflows
sieniven Jun 28, 2023
1287914
Add docker prune after docker build in test sync pipeline
sieniven Jun 28, 2023
1eaf8b0
Merge branch 'master' into niven/cache-ci
sieniven Jun 28, 2023
9ab479c
Fixes to ccache pipeline bugs
sieniven Jun 28, 2023
0a4449f
Resolve bug with docker ccache dir path
sieniven Jun 28, 2023
4cfeb07
Fixes to docker ccache directory path
sieniven Jun 28, 2023
562e8fd
Fix typo
sieniven Jun 28, 2023
b34656c
Fix typo
sieniven Jun 28, 2023
8208480
Fix dockerfile
sieniven Jun 28, 2023
866428d
Remove debugging logs, remove caching from test sync
sieniven Jun 28, 2023
3b3478c
Implement test workflows to use pre warmed container, caching in test
sieniven Jun 29, 2023
bdff8b9
Fix lint to use ain builder
sieniven Jun 29, 2023
3df65ba
Switch saving caches to test-ethlibs
sieniven Jun 29, 2023
ba49556
Fix line
sieniven Jun 29, 2023
fde74f0
Fix tests
sieniven Jun 29, 2023
272a2f7
Fix comments
sieniven Jun 29, 2023
1499540
Merge branch 'master' of github.com:DeFiCh/ain into niven/cache-ci
sieniven Jul 4, 2023
7005d0f
Remove sudo privileges in test sync
sieniven Jul 4, 2023
5134d84
fixes to docker build
sieniven Jul 4, 2023
9fc1cf3
Revert test sync to native build
sieniven Jul 4, 2023
d405008
Fix sync
sieniven Jul 4, 2023
23f76e8
Merge branch 'master' of github.com:DeFiCh/ain into niven/cache-ci
sieniven Jul 5, 2023
022f6b1
Remove comments in test sync
sieniven Jul 5, 2023
52bbdf7
Add multistage build pipeline for build dev
sieniven Jul 5, 2023
f411d76
Fixes to passing image name
sieniven Jul 5, 2023
141aa25
Fix image name
sieniven Jul 5, 2023
3fba40e
Remove logging
sieniven Jul 5, 2023
e01c6ed
Fix uploading win-x64 binaries
sieniven Jul 5, 2023
54cdb1f
Merge branch 'master' of github.com:DeFiCh/ain into niven/cache-ci
sieniven Jul 5, 2023
f8f8087
Get package env variables
sieniven Jul 5, 2023
542a17e
Clean up publishing artifacts
sieniven Jul 5, 2023
658426c
clean up make.sh
sieniven Jul 5, 2023
13e2cdf
Merge branch 'master' of github.com:DeFiCh/ain into niven/cache-ci
sieniven Jul 5, 2023
5af508c
Add logging to see which file changed
sieniven Jul 5, 2023
7a78420
Find file changes
sieniven Jul 5, 2023
8cbbc41
New dockerignore file for ci build dev for incremental builds
sieniven Jul 5, 2023
ca3ea9f
Log build dir in docker build
sieniven Jul 5, 2023
4e03fcc
Fix dockerignore
sieniven Jul 5, 2023
7a694f5
Clean up package type and build pipelines
sieniven Jul 5, 2023
75084f0
Merge branch 'master' of github.com:DeFiCh/ain into niven/cache-ci
sieniven Jul 5, 2023
061683d
Switch to removing gitignore as a safeguard only when caches hit
sieniven Jul 5, 2023
fd01ced
add logging
sieniven Jul 6, 2023
3309795
Fix naming
sieniven Jul 6, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Fix typo
sieniven committed Jun 26, 2023

Verified

This commit was signed with the committer’s verified signature.
sieniven Niven
commit f085d3d009517da907f53989e68228bd65b7280e
2 changes: 1 addition & 1 deletion make.sh
Original file line number Diff line number Diff line change
@@ -23,7 +23,7 @@ setup_vars() {
ROOT_DIR="$(_canonicalize "${_SCRIPT_DIR}")"

TARGET=${TARGET:-"$(get_default_target)"}
PACKAGE=${PACKAGE:""}
PACKAGE=${PACKAGE:-""}
DOCKERFILE=${DOCKERFILE:-"$(get_default_docker_file)"}

BUILD_DIR=${BUILD_DIR:-"./build"}