Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

/cmd: Improved devx of benching many pallets simultaneously #6007

Merged
merged 11 commits into from
Oct 11, 2024

Conversation

mordamax
Copy link
Contributor

@mordamax mordamax commented Oct 10, 2024

Improved devx of running many pallets simultaneously

Changes to /cmd:

  • Replace (flip) --continue-on-fail with --fail-fast, but only for bench. This makes all pallets/runtimes run non-stop by default, as it was primary use-case during tests
  • The list of successful/failed pallets was hard to find within tons of logs, so decided to write only needed logs in a file, and output as a summary in the workflow and in the comment
  • Side fix: updated tasks_example to pallet_example_tasks to make compliant with standard naming
image
  • added command results to workflow summary:
image

@mordamax mordamax marked this pull request as ready for review October 10, 2024 21:23
@mordamax mordamax requested review from a team as code owners October 10, 2024 21:23
@mordamax mordamax changed the title /cmd: flip --continue-on-fail -> --fail-fast for bench /cmd: Improved devx of running many pallets simultaneously Oct 10, 2024
@mordamax mordamax added the R0-silent Changes should not be mentioned in any release notes label Oct 10, 2024
@mordamax mordamax changed the title /cmd: Improved devx of running many pallets simultaneously /cmd: Improved devx of benching many pallets simultaneously Oct 11, 2024
@mordamax mordamax enabled auto-merge October 11, 2024 16:14
@@ -19,51 +19,53 @@ In a PR run the actions through comment:

To regenerate all weights (however it will take long,
so don't do it unless you really need it), run the following command:

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is a great doc, is it properly linked and discover-able from the main CONTRIBUTING.md?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yep, there is a general link to /cmd commands-readme and from there to here

@mordamax mordamax added this pull request to the merge queue Oct 11, 2024
Merged via the queue into master with commit c0b7343 Oct 11, 2024
202 of 206 checks passed
@mordamax mordamax deleted the mak-flip-cmd-flag branch October 11, 2024 17:52
ordian added a commit that referenced this pull request Oct 14, 2024
* master:
  Fix storage expansion in pallet section (#6023)
  /cmd: Improved devx of benching many pallets simultaneously (#6007)
Zebedeusz pushed a commit that referenced this pull request Oct 14, 2024
### Improved devx of running many pallets simultaneously

Changes to /cmd:
- Replace (flip) `--continue-on-fail` with `--fail-fast`, but only for
`bench`. This makes all pallets/runtimes run non-stop by default, as it
was primary use-case during tests
- The list of successful/failed pallets was hard to find within tons of
logs, so decided to write only needed logs in a file, and output as a
summary in the workflow and in the comment
- Side fix: updated `tasks_example` to `pallet_example_tasks` to make
compliant with standard naming

<img width="1006" alt="image"
src="https://github.com/user-attachments/assets/14896041-7018-4a0d-92b7-4508e81913c2">

+ added command results to workflow summary:
<img width="1275" alt="image"
src="https://github.com/user-attachments/assets/b4a8afdb-dc9f-4ff9-9720-28a88956035f">

---------

Co-authored-by: GitHub Action <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
R0-silent Changes should not be mentioned in any release notes
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants