Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Addon A11y: Remove warnings API #30049

Merged
merged 7 commits into from
Dec 16, 2024
Merged

Addon A11y: Remove warnings API #30049

merged 7 commits into from
Dec 16, 2024

Conversation

kasperpeulen
Copy link
Contributor

@kasperpeulen kasperpeulen commented Dec 12, 2024

Closes #

What I did

Checklist for Contributors

Testing

The changes in this PR are covered in the following automated tests:

  • stories
  • unit tests
  • integration tests
  • end-to-end tests

Manual testing

This section is mandatory for all contributions. If you believe no manual test is necessary, please state so explicitly. Thanks!

Documentation

  • Add or update documentation reflecting your changes
  • If you are deprecating/removing a feature, make sure to update
    MIGRATION.MD

Checklist for Maintainers

  • When this PR is ready for testing, make sure to add ci:normal, ci:merged or ci:daily GH label to it to run a specific set of sandboxes. The particular set of sandboxes can be found in code/lib/cli-storybook/src/sandbox-templates.ts

  • Make sure this PR contains one of the labels below:

    Available labels
    • bug: Internal changes that fixes incorrect behavior.
    • maintenance: User-facing maintenance tasks.
    • dependencies: Upgrading (sometimes downgrading) dependencies.
    • build: Internal-facing build tooling & test updates. Will not show up in release changelog.
    • cleanup: Minor cleanup style change. Will not show up in release changelog.
    • documentation: Documentation only changes. Will not show up in release changelog.
    • feature request: Introducing a new feature.
    • BREAKING CHANGE: Changes that break compatibility in some way with current major version.
    • other: Changes that don't fit in the above categories.

🦋 Canary release

This PR does not have a canary release associated. You can request a canary release of this pull request by mentioning the @storybookjs/core team here.

core team members can create a canary release here or locally with gh workflow run --repo storybookjs/storybook canary-release-pr.yml --field pr=<PR_NUMBER>

name before after diff z %
createSize 0 B 0 B 0 B - -
generateSize 77.7 MB 77.7 MB 48 B 1.11 0%
initSize 136 MB 136 MB 48 B 1.11 0%
diffSize 58.4 MB 58.4 MB 0 B 1.11 0%
buildSize 7.24 MB 7.24 MB -46 B 0.9 0%
buildSbAddonsSize 1.88 MB 1.88 MB 0 B 0.9 0%
buildSbCommonSize 195 kB 195 kB 0 B - 0%
buildSbManagerSize 1.86 MB 1.86 MB 0 B 0.83 0%
buildSbPreviewSize 0 B 0 B 0 B - -
buildStaticSize 0 B 0 B 0 B - -
buildPrebuildSize 3.93 MB 3.93 MB 0 B 0.9 0%
buildPreviewSize 3.3 MB 3.3 MB -46 B 0.28 0%
testBuildSize 0 B 0 B 0 B - -
testBuildSbAddonsSize 0 B 0 B 0 B - -
testBuildSbCommonSize 0 B 0 B 0 B - -
testBuildSbManagerSize 0 B 0 B 0 B - -
testBuildSbPreviewSize 0 B 0 B 0 B - -
testBuildStaticSize 0 B 0 B 0 B - -
testBuildPrebuildSize 0 B 0 B 0 B - -
testBuildPreviewSize 0 B 0 B 0 B - -
name before after diff z %
createTime 8s 24.6s 16.6s 1.26 🔺67.4%
generateTime 20.2s 20.7s 521ms 0.27 2.5%
initTime 14.5s 14.1s -459ms -0.1 -3.2%
buildTime 11.9s 8.6s -3s -291ms -0.63 -38.2%
testBuildTime 0ms 0ms 0ms - -
devPreviewResponsive 5.6s 5.9s 264ms 1.3 4.5%
devManagerResponsive 4.1s 4.1s -24ms 0.67 -0.6%
devManagerHeaderVisible 748ms 575ms -173ms -0.22 -30.1%
devManagerIndexVisible 770ms 643ms -127ms 0 -19.8%
devStoryVisibleUncached 1.9s 1.7s -207ms -0.04 -11.6%
devStoryVisible 792ms 644ms -148ms -0.01 -23%
devAutodocsVisible 501ms 544ms 43ms 0.36 7.9%
devMDXVisible 578ms 659ms 81ms 1.61 🔺12.3%
buildManagerHeaderVisible 642ms 787ms 145ms 2.78 🔺18.4%
buildManagerIndexVisible 744ms 806ms 62ms 1.47 🔺7.7%
buildStoryVisible 603ms 652ms 49ms 1.66 🔺7.5%
buildAutodocsVisible 504ms 448ms -56ms -0.04 -12.5%
buildMDXVisible 475ms 478ms 3ms 0.37 0.6%

Greptile Summary

Based on the provided files and changes, I'll create a concise summary of this pull request:

Removes the warnings API from Storybook's accessibility addon, simplifying violation reporting to a binary pass/fail model instead of configurable warning levels.

  • Removed warning level configuration (minor, moderate, serious, critical) from a11y addon parameters
  • Modified violation reporting to use only warning/passed states instead of failed/warning/passed
  • Removed documentation and code snippets related to warning level configuration
  • Updated test cases to reflect simplified pass/fail accessibility checks
  • Changed Vitest standalone mode to fail on any violations rather than only non-warning violations

This is a breaking change that removes configurability in favor of stricter accessibility enforcement, requiring users to update their configurations that previously used warning levels.

💡 (5/5) You can turn off certain types of comments like style here!

Copy link
Contributor

@greptile-apps greptile-apps bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

6 file(s) reviewed, 3 comment(s)
Edit PR Review Bot Settings | Greptile

reporting.addReport({
type: 'a11y',
version: 1,
result: result,
status: hasErrors ? 'failed' : hasViolations ? 'warning' : 'passed',
status: hasViolations ? 'warning' : 'passed',
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

logic: this change means all violations will now show as warnings in Storybook UI, rather than being able to configure some as errors - consider if this reduced severity is appropriate

@@ -58,7 +53,7 @@ export const experimental_afterEach: AfterEach<any> = async ({
* implement proper try catch handling.
*/
if (getIsVitestStandaloneRun()) {
if (hasErrors) {
if (hasViolations) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

logic: throwing on any violations is more strict than before when some violations could be configured as warnings - this may break existing tests

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

logic: This file is being completely removed, which removes documentation for a feature that users may be actively using. The PR should include updates to MIGRATION.md to inform users about this breaking change and provide alternative approaches if available.

@kasperpeulen kasperpeulen added the maintenance User-facing maintenance tasks label Dec 12, 2024
Copy link

nx-cloud bot commented Dec 12, 2024

☁️ Nx Cloud Report

CI is running/has finished running commands for commit 9c86875. As they complete they will appear below. Click to see the status, the terminal output, and the build insights.

📂 See all runs for this CI Pipeline Execution


✅ Successfully ran 1 target

Sent with 💌 from NxCloud.

@@ -130,18 +130,6 @@ If you enabled the addon and you're manually upgrading to Storybook 8.5 or later

<CodeSnippets path="storybook-addon-a11y-test-setup.md" />

### Override accessibility violation levels
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@kasperpeulen — Heads up that you'll need to merge next because I merged #30035, which updates this file.

Also, if we're removing this, should we document reviewOnFail instead?

@valentinpalkovic valentinpalkovic changed the title A11y: Remove warnings API Addon A11y: Remove warnings API Dec 13, 2024
@storybook-pr-benchmarking
Copy link

storybook-pr-benchmarking bot commented Dec 13, 2024

Package Benchmarks

Commit: 9c86875, ran on 16 December 2024 at 14:09:20 UTC

No significant changes detected, all good. 👏

@kasperpeulen kasperpeulen merged commit 9f8e47c into next Dec 16, 2024
56 of 58 checks passed
@kasperpeulen kasperpeulen deleted the kasper/remove-warnings-api branch December 16, 2024 14:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ci:normal maintenance User-facing maintenance tasks
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants