Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore: ci3 phase 1 #10042

Merged
merged 353 commits into from
Dec 19, 2024
Merged
Show file tree
Hide file tree
Changes from 22 commits
Commits
Show all changes
353 commits
Select commit Hold shift + click to select a range
4494a94
wip
charlielye Nov 28, 2024
ef201b0
wip
charlielye Nov 28, 2024
248e650
chore: ci3 fixes (#10280)
ludamad Nov 28, 2024
70729b0
wip
charlielye Nov 28, 2024
72ce45b
acir test cache flag
charlielye Nov 28, 2024
f086f68
spelling
charlielye Nov 28, 2024
9934732
fix
charlielye Nov 28, 2024
6a1dec5
wip
charlielye Nov 28, 2024
6435a79
wip
charlielye Nov 29, 2024
57b5a1b
hack around nargo race condition on dep dload
charlielye Nov 29, 2024
63a3b48
usage
charlielye Nov 29, 2024
a25868f
new bootstrap for noir-contracts - super parallel
charlielye Nov 29, 2024
932ca47
script for proto circuits
charlielye Nov 30, 2024
4fdb30f
clean
charlielye Dec 1, 2024
40c1476
noir-projects performance. full run 2m30s, cached run 13s
charlielye Dec 2, 2024
0d26129
formatting fixes
charlielye Dec 2, 2024
6bc4270
wrong about times. 8m20s full. public_base_rollup is slow.
charlielye Dec 2, 2024
da2e82f
build sim circuits.
charlielye Dec 2, 2024
856dda6
Always upload, if file doesn't already exist. noir-projects supports …
charlielye Dec 2, 2024
089b6a4
oops
charlielye Dec 2, 2024
ca402d1
fix
charlielye Dec 2, 2024
4d4f9d3
fix. skip avm test
charlielye Dec 2, 2024
ea10dc1
fix
charlielye Dec 2, 2024
01550fb
normalise yp test commands as unit tests. add test:e2e and test:compo…
charlielye Dec 2, 2024
e96b052
bootstrap_source script
charlielye Dec 3, 2024
08411f7
fix
charlielye Dec 3, 2024
e923114
fix
charlielye Dec 3, 2024
fe0dd9f
chore: ci2.5 => ci3 merge (#10349)
ludamad Dec 3, 2024
4130088
flatting ci3 paths. boxes test webkit and chrome.
charlielye Dec 3, 2024
0dd552c
bootstrap scripts handle cmds
charlielye Dec 4, 2024
c772122
fix
charlielye Dec 4, 2024
04218c6
fix flag stdout. colors to source. local and casing.
charlielye Dec 4, 2024
72084cc
tweaks. fixes. new ami. can grind e2e.
charlielye Dec 4, 2024
174ca88
denoise grind fix
charlielye Dec 4, 2024
ca60f4b
bring back browser test
charlielye Dec 4, 2024
b2d278f
browser is still a flake. dial back logging and polling from insane, …
charlielye Dec 4, 2024
6347c69
up_quick_start test cleanup
charlielye Dec 5, 2024
42baf70
expand and simplify acir tests.
charlielye Dec 6, 2024
9583e7b
denoiseable
charlielye Dec 6, 2024
8844d2b
acir sol tests
charlielye Dec 6, 2024
a272066
Merge branch 'cl/ci3-fake-base' into cl/ci3
charlielye Dec 7, 2024
596ee80
merge fix
charlielye Dec 7, 2024
3506a20
enable pipefail. source colors. color headers.
charlielye Dec 7, 2024
aa88de4
better call pattern. color tweak
charlielye Dec 7, 2024
d34a92b
Merge branch 'cl/ci3-fake-base' into cl/ci3
charlielye Dec 7, 2024
4dfeebb
fix
charlielye Dec 7, 2024
dae10e1
crs path fix in bb.js. tweaks to allow playing with omp again (nope).…
charlielye Dec 8, 2024
d06143d
fix
charlielye Dec 8, 2024
faca724
fix
charlielye Dec 8, 2024
bab9f70
fix compose log level. ec2-full cmd.
charlielye Dec 8, 2024
23c80eb
fix
charlielye Dec 8, 2024
249db48
fix noir-contracts function filter.
charlielye Dec 9, 2024
342ce4d
attach to container in test.sh to catch error
charlielye Dec 9, 2024
2d8e30a
reqres flakes.
charlielye Dec 9, 2024
84bb694
crs stuff
charlielye Dec 9, 2024
93fcdf2
instance name
charlielye Dec 9, 2024
cb5d0d9
yarn-project precommit hook
charlielye Dec 10, 2024
1186c29
Merge branch 'cl/ci3-fake-base' into cl/ci3
charlielye Dec 10, 2024
c685aaf
Merge remote-tracking branch 'origin/master' into cl/ci3
charlielye Dec 10, 2024
567b788
fix yarn.lock. color precommit
charlielye Dec 10, 2024
f65de36
precommit comment
charlielye Dec 10, 2024
43600ca
fix
charlielye Dec 10, 2024
da9b0b3
node crs read requested amount
charlielye Dec 10, 2024
bef986b
Merge remote-tracking branch 'origin/master' into cl/ci3
charlielye Dec 11, 2024
9d125f3
jest silent reporter. NO_SPOT var.
charlielye Dec 11, 2024
c811b79
Merge remote-tracking branch 'origin/master' into cl/ci3
charlielye Dec 11, 2024
4f54ca9
Revert "feat: unified create circuit from acir (#10440)"
charlielye Dec 11, 2024
8d76959
unbound fix
charlielye Dec 11, 2024
c6e6627
Merge remote-tracking branch 'origin/master' into cl/ci3
charlielye Dec 11, 2024
9b806b0
Merge remote-tracking branch 'origin/master' into cl/ci3
charlielye Dec 11, 2024
d9c6bb1
Reapply "feat: unified create circuit from acir (#10440)"
charlielye Dec 11, 2024
17a4350
ivc fix
charlielye Dec 12, 2024
94bbcdb
better err handling with dump_fail
charlielye Dec 12, 2024
0dea0a8
Merge remote-tracking branch 'origin/master' into cl/ci3
charlielye Dec 12, 2024
30b4af4
fix merge ci.yml
charlielye Dec 12, 2024
65d80fb
Merge remote-tracking branch 'origin/master' into cl/ci3
charlielye Dec 12, 2024
bb58eaa
Merge remote-tracking branch 'origin/master' into cl/ci3
charlielye Dec 12, 2024
d9c4a9b
keys are not base64 encoded, just hex. because of course.
charlielye Dec 12, 2024
43a6482
reverse hex for fields
charlielye Dec 12, 2024
21a110c
disable assertions in bb for now, as leads to avm failures. remove fl…
charlielye Dec 13, 2024
42525c0
install xxd. terminate use iid.
charlielye Dec 13, 2024
227cd2b
fix
charlielye Dec 13, 2024
28a2c1e
fix
charlielye Dec 13, 2024
a219704
region fix.
charlielye Dec 13, 2024
99537d7
tweak
charlielye Dec 13, 2024
12defc6
wip
charlielye Dec 13, 2024
71f8f7c
try tmpfs
charlielye Dec 14, 2024
1bd9942
change hash
charlielye Dec 14, 2024
dfd33ab
change hash
charlielye Dec 14, 2024
9cdbc3b
/tmp 1gb in-mem mount to spare disk io and start implementing limits
charlielye Dec 14, 2024
f3d3b77
cpp fast formatting in test. ability to run just e2e flakes with test…
charlielye Dec 15, 2024
14ffa20
formatting
charlielye Dec 15, 2024
7f67ffb
Merge remote-tracking branch 'origin/master' into cl/ci3
charlielye Dec 16, 2024
fd34615
limit noir-projects to 16 jobs for mem reasons. merge fix.
charlielye Dec 16, 2024
581ce2a
Merge branch 'master' into cl/ci3
charlielye Dec 16, 2024
73c56ba
Merge branch 'master' into cl/ci3
charlielye Dec 17, 2024
6d31b79
revert test timings.
charlielye Dec 17, 2024
f795f7d
align acir tests with master
charlielye Dec 17, 2024
5c61b25
clean
charlielye Dec 17, 2024
e3bb18f
Merge remote-tracking branch 'origin/master' into cl/ci3
charlielye Dec 17, 2024
dee6ba3
chore(ci): towards ci3 (#10751)
ludamad Dec 17, 2024
7f226d5
earthly syntax fix
ludamad Dec 17, 2024
25a3b59
Merge remote-tracking branch 'origin/master' into cl/ci3
ludamad Dec 17, 2024
720b6a6
fix
ludamad Dec 17, 2024
b76cf31
robustness
ludamad Dec 17, 2024
d0beea3
more sane build-pic prep
ludamad Dec 17, 2024
6493903
more sane build-pic prep
ludamad Dec 17, 2024
074e1b1
fix
ludamad Dec 17, 2024
58cfc23
fix
ludamad Dec 17, 2024
438ab54
better startup script
ludamad Dec 17, 2024
1564662
generate
ludamad Dec 17, 2024
2174e1f
Yarn
ludamad Dec 17, 2024
346c4f0
fix
ludamad Dec 17, 2024
d529df7
fix
ludamad Dec 17, 2024
6146775
ensure-tester
ludamad Dec 17, 2024
147de9c
files
ludamad Dec 17, 2024
4d94837
files
ludamad Dec 17, 2024
1a3ced8
S3_FORCE_UPLOAD
ludamad Dec 17, 2024
072bb7c
ensure-builder fix
ludamad Dec 17, 2024
d740eaf
start
ludamad Dec 17, 2024
0e70dfc
fix
ludamad Dec 17, 2024
0499b10
gogo
ludamad Dec 17, 2024
703d40a
fix
ludamad Dec 17, 2024
b51eb14
fix
ludamad Dec 17, 2024
22d63f4
fix
ludamad Dec 17, 2024
df2921c
fix
ludamad Dec 17, 2024
8f66e31
fix
ludamad Dec 17, 2024
71d41e1
gogo gadget bash error
ludamad Dec 17, 2024
b2dd35e
lets go
ludamad Dec 17, 2024
e103d90
fixes
ludamad Dec 17, 2024
33b8eac
input
ludamad Dec 17, 2024
7891605
input
ludamad Dec 17, 2024
865c086
update
ludamad Dec 17, 2024
103ef47
update
ludamad Dec 17, 2024
e968ecc
update
ludamad Dec 17, 2024
90e2298
update
ludamad Dec 17, 2024
f00bfbf
update
ludamad Dec 17, 2024
e3c745c
update
ludamad Dec 17, 2024
ec3f56c
run on tester lets go
ludamad Dec 17, 2024
8443da6
try again
ludamad Dec 18, 2024
5c5d5c5
update
ludamad Dec 18, 2024
59c766c
Update
ludamad Dec 18, 2024
6c09e24
fix
ludamad Dec 18, 2024
730daea
Updates
ludamad Dec 18, 2024
5cefc7d
less output
ludamad Dec 18, 2024
10fb290
less output
ludamad Dec 18, 2024
7c0077a
Update Earthfile
ludamad Dec 18, 2024
91b2334
scripty stuff
ludamad Dec 18, 2024
d169786
Merge remote-tracking branch 'origin/cl/ci3-fixes' into cl/ci3-fixes
ludamad Dec 18, 2024
b51e91d
fix
ludamad Dec 18, 2024
53be684
fix
ludamad Dec 18, 2024
d410ef8
Update ci-arm.yml
ludamad Dec 18, 2024
da1d8b2
fix
ludamad Dec 18, 2024
b71e455
Merge remote-tracking branch 'origin/cl/ci3-fixes' into cl/ci3-fixes
ludamad Dec 18, 2024
2d5b985
the wrapped run command
ludamad Dec 18, 2024
133a0e8
uploaded
ludamad Dec 18, 2024
59d818e
uploaded
ludamad Dec 18, 2024
d66c9b8
update
ludamad Dec 18, 2024
0f03299
fix
ludamad Dec 18, 2024
f7afbd2
fix acir bench syntax
ludamad Dec 18, 2024
6aca3e1
dont acir bench on e2e
ludamad Dec 18, 2024
6966eaf
less image time
ludamad Dec 18, 2024
8ec8192
dont run flakey e2e
ludamad Dec 18, 2024
0f37856
syntax
ludamad Dec 18, 2024
ddbfdc6
parallel fix
ludamad Dec 18, 2024
f9b469f
cpp full bootstrap deletes build dirs first.
charlielye Dec 18, 2024
742df9c
fill out set -eu
ludamad Dec 18, 2024
d919399
bootstrap -set eu
ludamad Dec 18, 2024
668f050
Make world state fail if no napi
ludamad Dec 18, 2024
7d2f6f1
try repair build
ludamad Dec 18, 2024
0350088
fix run_acir_tests.sh
ludamad Dec 18, 2024
e7d760b
Merge branch 'cl/ci3' into cl/ci3-fixes
ludamad Dec 18, 2024
b59fbce
update
ludamad Dec 18, 2024
a339fac
syntax fix
ludamad Dec 18, 2024
774b5ec
fix bench summary
ludamad Dec 18, 2024
bb115d1
start kind full test sooner
ludamad Dec 18, 2024
6a9455e
Merge remote-tracking branch 'origin/master' into cl/ci3-fixes
ludamad Dec 18, 2024
e2e2348
run network test with yarn test
ludamad Dec 18, 2024
ef89bf6
fast filter base images
ludamad Dec 18, 2024
61ab917
Undo skip
ludamad Dec 18, 2024
2a699bc
simplify yarn hash, add cache_ls helper
ludamad Dec 18, 2024
73bc990
just upload napi
ludamad Dec 18, 2024
5d706eb
ensure world state is uploaded
ludamad Dec 18, 2024
0088ee5
Fix kludge
ludamad Dec 18, 2024
f3760ad
state
ludamad Dec 18, 2024
0860dc3
Fix job name
ludamad Dec 18, 2024
d02cd1a
Fix cache delete
ludamad Dec 18, 2024
e4ba0d7
try again
ludamad Dec 18, 2024
feb51e5
now make it pass the cache hoop
ludamad Dec 18, 2024
8404fd3
lets go
ludamad Dec 18, 2024
4d55dc3
fix install parallel
ludamad Dec 18, 2024
7bd8163
update
ludamad Dec 18, 2024
575c29d
less restrictive ci.sh
ludamad Dec 18, 2024
7191a06
for build
ludamad Dec 18, 2024
14d37a1
fix ci.sh
ludamad Dec 18, 2024
a407edb
try downsizing testers
ludamad Dec 18, 2024
c6074a6
try e2e with standard github runner
ludamad Dec 18, 2024
6c578d9
try again
ludamad Dec 18, 2024
9dcb979
denoise
ludamad Dec 18, 2024
02eb782
update
ludamad Dec 18, 2024
a1542e7
try no exit spot
ludamad Dec 18, 2024
10aac00
retries
ludamad Dec 18, 2024
c019c77
retries
ludamad Dec 18, 2024
e4e58cf
fix
ludamad Dec 18, 2024
e8f7c30
fix
ludamad Dec 18, 2024
cc5f4c8
attach ebs
ludamad Dec 18, 2024
92bf320
update
ludamad Dec 18, 2024
a7b6263
resinstate maybe exit spot
ludamad Dec 18, 2024
9c81525
fix yarn project cache
ludamad Dec 18, 2024
cd1b7d7
bootstrap
ludamad Dec 18, 2024
b9b1f7e
update
ludamad Dec 18, 2024
8689755
cache fix
ludamad Dec 19, 2024
00e3953
install kludge
ludamad Dec 19, 2024
f843d06
fix
ludamad Dec 19, 2024
02c6a09
remove redundant 4epochs test
ludamad Dec 19, 2024
68f6ab6
simplify
ludamad Dec 19, 2024
01c43be
fix
ludamad Dec 19, 2024
4a4a14e
simplify more
ludamad Dec 19, 2024
d02477a
lets go
ludamad Dec 19, 2024
9839c73
simpler transfer tests
ludamad Dec 19, 2024
1e6d826
pare down network tests
ludamad Dec 19, 2024
8e469c6
less earthly nag
ludamad Dec 19, 2024
7bd8e81
Update
ludamad Dec 19, 2024
0782b44
hash
ludamad Dec 19, 2024
ed0085a
try it out
ludamad Dec 19, 2024
c63df90
more conditionality
ludamad Dec 19, 2024
c168db6
edge ci
ludamad Dec 19, 2024
686a46c
refactor vm tests
ludamad Dec 19, 2024
981aa4a
Docs selection of ci
ludamad Dec 19, 2024
45f2435
dont make GH runner token mandatory
ludamad Dec 19, 2024
3f50921
simplify workflows
ludamad Dec 19, 2024
4c8f79b
Merge remote-tracking branch 'origin/master' into cl/ci3-fixes
ludamad Dec 19, 2024
d99e789
-
ludamad Dec 19, 2024
0a23c38
update prover client fix
ludamad Dec 19, 2024
b5945d4
simplify docs
ludamad Dec 19, 2024
52ed4ea
quieter network
ludamad Dec 19, 2024
ef785f9
fix nargo
ludamad Dec 19, 2024
b91a45f
bring back earthly retries
ludamad Dec 19, 2024
d583d8f
sufferage
ludamad Dec 19, 2024
8608c1c
lets try again
ludamad Dec 19, 2024
d2a0e8a
flakefest
ludamad Dec 19, 2024
4a1d21d
use ref name for arm concurrency
ludamad Dec 19, 2024
0a5055a
lets try it again
ludamad Dec 19, 2024
1b96ea3
woopsy
ludamad Dec 19, 2024
835730a
arm fixes
ludamad Dec 19, 2024
c9461ef
changes
ludamad Dec 19, 2024
9462caa
fix
ludamad Dec 19, 2024
11f57f3
fix bench e2e
ludamad Dec 19, 2024
0832045
Merge remote-tracking branch 'origin/master' into cl/ci3
ludamad Dec 19, 2024
a2b56b6
Update ci.yml
ludamad Dec 19, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
21 changes: 21 additions & 0 deletions .github/workflows/ci3.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,21 @@
name: CI3

on:
push:
branches:
- main
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

main => master :)

pull_request:

jobs:
build:
runs-on: runner-01
container:
image: aztecprotocol/build:1.0
steps:
- name: Checkout code
uses: actions/checkout@v3

- name: Run bootstrap script
run: |
git config --global --add safe.directory /__w/aztec-packages/aztec-packages
CI=1 ./bootstrap.sh full
40 changes: 40 additions & 0 deletions barretenberg/acir_tests/bootstrap.sh
Original file line number Diff line number Diff line change
@@ -0,0 +1,40 @@
#!/bin/bash

cleanup() {
BG_PIDS=$(jobs -p)
if [[ -n "$BG_PIDS" ]]; then
kill $BG_PIDS 2>/dev/null
wait $BG_PIDS 2>/dev/null
fi
}
trap cleanup EXIT

if [ "${CI:-0}" -eq 1 ]; then
npx -y [email protected] install --with-deps
fi

(cd headless-test && yarn)
(cd browser-test-app && yarn && yarn build)

if [ "${CI:-0}" -eq 1 ]; then
COMPILE=1 ./run_acir_tests.sh

# Run UltraHonk recursive verification through bb.js on chrome testing multi-threaded browser support.
BROWSER=chrome THREAD_MODEL=mt ./run_acir_tests_browser.sh verify_honk_proof &
# Run UltraHonk recursive verification through bb.js on chrome testing single-threaded browser support.
BROWSER=chrome THREAD_MODEL=st ./run_acir_tests_browser.sh verify_honk_proof &
# Run ecdsa_secp256r1_3x through bb.js on node to check 256k support.
BIN=../ts/dest/node/main.js FLOW=prove_then_verify ./run_acir_tests.sh ecdsa_secp256r1_3x &
# Run a single arbitrary test not involving recursion through bb.js for UltraHonk
BIN=../ts/dest/node/main.js FLOW=prove_and_verify_ultra_honk ./run_acir_tests.sh 6_array assert_statement &
# Run the prove then verify flow for UltraHonk. This makes sure we have the same circuit for different witness inputs.
BIN=../ts/dest/node/main.js FLOW=prove_then_verify_ultra_honk ./run_acir_tests.sh 6_array assert_statement &
# Run a single arbitrary test not involving recursion through bb.js for MegaHonk
BIN=../ts/dest/node/main.js FLOW=prove_and_verify_mega_honk ./run_acir_tests.sh 6_array &
# Run fold_basic test through bb.js which runs ClientIVC on fold basic
BIN=../ts/dest/node/main.js FLOW=fold_and_verify_program ./run_acir_tests.sh fold_basic &
# Run 1_mul through bb.js build, all_cmds flow, to test all cli args.
BIN=../ts/dest/node/main.js FLOW=all_cmds ./run_acir_tests.sh 1_mul &

wait
fi
7,591 changes: 4,618 additions & 2,973 deletions barretenberg/acir_tests/browser-test-app/yarn.lock

Large diffs are not rendered by default.

2 changes: 1 addition & 1 deletion barretenberg/acir_tests/headless-test/package.json
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@
"dependencies": {
"chalk": "^5.3.0",
"commander": "^12.1.0",
"playwright": "^1.42.1",
"playwright": "^1.49.0",
"puppeteer": "^22.4.1"
},
"devDependencies": {
Expand Down
Loading
Loading