Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore(ci): recover from earthly bug with --no-cache, build images from registry #7462

Merged
merged 22 commits into from
Jul 15, 2024

Conversation

ludamad
Copy link
Collaborator

@ludamad ludamad commented Jul 12, 2024

This tries to get a handle on the cache bug by both not reading build images from inline cache, and restarting with --no-cache if there's a graph edge bug

  • rely on pushed build-images from registry instead of earthly inline cache
  • only notify on CI failure in slack if it master is failing on the rerun
  • pump up timeouts as now anything might run --no-cache
  • handle secrets in earthly-ci script, pass env vars in run_on_tester and run_on_builder
  • set up ARM CI like normal CI but with just one e2e test (fix a blocker for this with a permission kludge) including with reruns and notifying on second run
  • disable currently failing on ARM test 'should uniswap trade on L1 from L2 funds publicly'

Copy link
Collaborator

@AztecBot AztecBot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'C++ Benchmark'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 1.05.

Benchmark suite Current: 0eaa969 Previous: 403f4c0 Ratio
nativeClientIVCBench/Full/6 13516.417912999997 ms/iter 12420.894322999999 ms/iter 1.09
wasmClientIVCBench/Full/6 42429.245116 ms/iter 39886.975661000004 ms/iter 1.06

This comment was automatically generated by workflow using github-action-benchmark.

CC: @ludamad @codygunton

@ludamad ludamad requested a review from charlielye as a code owner July 12, 2024 16:34
@ludamad ludamad changed the title chore(ci): fix arm build, try for less CI pain chore(ci): recover from earthly bug with --no-cache, build images from registry Jul 12, 2024
@@ -22,58 +22,112 @@ env:
# kludge until we move away from runners
WAIT_FOR_RUNNERS: false
jobs:
setup:
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

refactored to be more like ci.yml

tester_ttl: 40
run: |
set -eux
cd ./yarn-project/end-to-end/
export FORCE_COLOR=1
export EARTHLY_BUILD_ARGS="${{ env.EARTHLY_BUILD_ARGS }}"
../../scripts/earthly-ci -P \
--secret AWS_ACCESS_KEY_ID=${{ secrets.AWS_ACCESS_KEY_ID }} \
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

moved the secret passing to earthly-ci

@ludamad ludamad enabled auto-merge (squash) July 12, 2024 18:53
Copy link
Contributor

@charlielye charlielye left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@ludamad ludamad merged commit 09299e3 into master Jul 15, 2024
100 of 101 checks passed
@ludamad ludamad deleted the fix/ci-arm-build branch July 15, 2024 14:26
spalladino added a commit that referenced this pull request Jul 22, 2024
In #7462 the aztec commenter github token was removed from the
bench-comment job in favor of loading secrets in the earthly-ci wrapper
script. However, the token was never injected into env, so the
bench-summary was silently failing due to invalid credentials.
spalladino added a commit that referenced this pull request Jul 22, 2024
In #7462 the aztec commenter github token was removed from the
bench-comment job in favor of loading secrets in the earthly-ci wrapper
script. However, the token was never injected into env, so the
bench-summary was silently failing due to invalid credentials.
spalladino added a commit that referenced this pull request Jul 22, 2024
In #7462 the aztec commenter github token was removed from the
bench-comment job in favor of loading secrets in the earthly-ci wrapper
script. However, the token was never injected into env, so the
bench-summary was silently failing due to invalid credentials.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants