Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CI] Add basic benchmarking job #55

Merged
merged 1 commit into from
Dec 15, 2021
Merged

[CI] Add basic benchmarking job #55

merged 1 commit into from
Dec 15, 2021

Conversation

huitseeker
Copy link
Contributor

@huitseeker huitseeker commented Dec 15, 2021

What

A CI job that runs cargo run --release --bin bench on each new commit and posts the results as a commit comment.

Why

See #54 : our current benchmarking capacities are bit-rotting a bit. Let's stop this.

Next steps

  • This is not the be-all end-all for benchmarks, and in fact, for the CI time this burns, I'd expect the "bench" executable to do more than it does today.
  • This simplistic UX bypasses all GIthub actions authorization issues, and should invite something more clever later (e.g. commenting directly on an open PR, which is a bit more complicated). See also https://github.com/nyurik/auto_pr_comments_from_forks

Tests

Please find a successful run of the bench on my fork here:
https://github.com/huitseeker/fastnft/actions/runs/1580740243

And a subsequent comment at the bottom of this commit:
https://github.com/huitseeker/fastnft/commit/ffad063381f8ec4be9ca40c76448d3f8ec106ae5

body="${body//$'\r'/'%0D'}"
echo ::set-output name=body::$body
- name: Create commit comment
uses: peter-evans/commit-comment@v1
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Comment explaining what this peter-evans magic is could be useful.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is just a github action creating a comment on the commit:
https://github.com/peter-evans/commit-comment

@huitseeker huitseeker merged commit 5799617 into MystenLabs:main Dec 15, 2021
- name: run benchmark
run: |
set -o pipefail
cargo run --release --bin bench 2>&1 | huniq | tee -a artifacts/bench_results.txt
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is 'cargo run --release --bin bench' working for you? Because it seems that there are some missing lock issues. Maybe we do not init the DB correctly.

mwtian pushed a commit that referenced this pull request Sep 12, 2022
[feature]: introduce a new component, the BlockWaiter. BlockWaiter will basically act as an aggregator and fetch the batches that correspond to a header by providing a certificate id.
mwtian pushed a commit to mwtian/sui that referenced this pull request Sep 29, 2022
[feature]: introduce a new component, the BlockWaiter. BlockWaiter will basically act as an aggregator and fetch the batches that correspond to a header by providing a certificate id.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants