Skip to content

release: v2.0.20

release: v2.0.20 #3089

Triggered via push January 6, 2025 04:06
Status Failure
Total duration 5m 52s
Artifacts 4
Determine Playwright container image
4s
Determine Playwright container image
Lint code
31s
Lint code
Build package
52s
Build package
Lint commit messages
0s
Lint commit messages
Run unit tests
42s
Run unit tests
Audit dependencies
25s
Audit dependencies
Matrix: test-e2e
Matrix: test-visual-regression
Merge e2e test reports
26s
Merge e2e test reports
Merge visual regression reports
25s
Merge visual regression reports
Fit to window
Zoom out
Zoom in

Annotations

5 errors, 14 warnings, and 6 notices
Audit dependencies
Process completed with exit code 1.
[react-tablet-safari] › components/header/with-service-name-and-navigation.spec.ts:106:13 › header: e2e/tests/components/header/with-service-name-and-navigation.spec.ts#L1
1) [react-tablet-safari] › components/header/with-service-name-and-navigation.spec.ts:106:13 › header, with service name and navigation › @visual-regression › when JavaScript is enabled › @mobile-and-tablet › matches the saved screenshot when the menu is open Test timeout of 30000ms exceeded.
[react-tablet-safari] › components/header/with-service-name-and-navigation.spec.ts:106:13 › header: e2e/tests/components/header/with-service-name-and-navigation.spec.ts#L107
1) [react-tablet-safari] › components/header/with-service-name-and-navigation.spec.ts:106:13 › header, with service name and navigation › @visual-regression › when JavaScript is enabled › @mobile-and-tablet › matches the saved screenshot when the menu is open Error: locator.click: Test timeout of 30000ms exceeded. Call log: - waiting for getByText('Menu') - locator resolved to <button hidden="" type="button" aria-controls="navigatio…>Menu</button> - attempting click action - waiting for element to be visible, enabled and stable - element is not visible - retrying click action, attempt #1 - waiting for element to be visible, enabled and stable - element is not visible - retrying click action, attempt #2 - waiting 20ms - waiting for element to be visible, enabled and stable - element is not visible - retrying click action, attempt #3 - waiting 100ms - waiting for element to be visible, enabled and stable - element is not visible - retrying click action, attempt #4 - waiting 100ms - waiting for element to be visible, enabled and stable - element is not visible - retrying click action, attempt #5 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not visible - retrying click action, attempt #6 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not visible - retrying click action, attempt #7 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not visible - retrying click action, attempt #8 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not visible - retrying click action, attempt #9 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not visible - retrying click action, attempt #10 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not visible - retrying click action, attempt #11 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not visible - retrying click action, attempt #12 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not visible - retrying click action, attempt #13 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not visible - retrying click action, attempt #14 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not visible - retrying click action, attempt #15 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not visible - retrying click action, attempt #16 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not visible - retrying click action, attempt #17 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not visible - retrying click action, attempt #18 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not visible - retrying click action, attempt #19 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not visible - retrying click action, attempt #20 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not visible - retrying click action, attempt #21 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not visible - retrying click action, attempt #22 - waiting 500ms - wai
[react-tablet-safari] › visual-regression.spec.ts:13:15 › @visual-regression › @react › accordion › with-h3-headings › matches the saved screenshot: e2e/tests/visual-regression.spec.ts#L14
2) [react-tablet-safari] › visual-regression.spec.ts:13:15 › @visual-regression › @react › accordion › with-h3-headings › matches the saved screenshot Error: Screenshot comparison failed: Expected an image 1536px by 1012px, received 1536px by 490px. 73870 pixels (ratio 0.05 of all image pixels) are different. Expected: /__w/moduk-frontend/moduk-frontend/e2e/tests/__screenshots__/visual-regression.spec.ts/accordion/with-h3-headings/screenshot--tablet-safari.png Received: /__w/moduk-frontend/moduk-frontend/e2e/output/artefacts/visual-regression--visual-regression-react-accordion-with-h3-headings-matches-the-saved-screenshot-react-tablet-safari/accordion/with-h3-headings/screenshot-actual.png Diff: /__w/moduk-frontend/moduk-frontend/e2e/output/artefacts/visual-regression--visual-regression-react-accordion-with-h3-headings-matches-the-saved-screenshot-react-tablet-safari/accordion/with-h3-headings/screenshot-diff.png Call log: - page._expectScreenshot with timeout 5000ms - verifying given screenshot expectation - waiting for locator('#root > *:first-child') - locator resolved to <div id="accordion-default" class="govuk-accordion" d…>…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - Expected an image 1536px by 1012px, received 1536px by 490px. 73870 pixels (ratio 0.05 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('#root > *:first-child') - locator resolved to <div id="accordion-default" class="govuk-accordion" d…>…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - Expected an image 1536px by 1012px, received 1536px by 490px. 73870 pixels (ratio 0.05 of all image pixels) are different. 12 | 13 | test('matches the saved screenshot', async ({ componentElement }) => { > 14 | await expect(componentElement).toHaveScreenshot([ | ^ 15 | component, 16 | exampleName, 17 | 'screenshot.png', at /__w/moduk-frontend/moduk-frontend/e2e/tests/visual-regression.spec.ts:14:44
[react-tablet-safari] › components/header/with-service-name-and-navigation.spec.ts:35:11 › header: e2e/tests/components/header/with-service-name-and-navigation.spec.ts#L38
1) [react-tablet-safari] › components/header/with-service-name-and-navigation.spec.ts:35:11 › header, with service name and navigation › when JavaScript is enabled › @mobile-and-tablet › has two links in total Error: Timed out 5000ms waiting for expect(locator).toHaveCount(expected) Locator: getByRole('link') Expected: 2 Received: 6 Call log: - expect.toHaveCount with timeout 5000ms - waiting for getByRole('link') - locator resolved to 6 elements - unexpected value "6" - locator resolved to 6 elements - unexpected value "6" - locator resolved to 6 elements - unexpected value "6" - locator resolved to 6 elements - unexpected value "6" - locator resolved to 6 elements - unexpected value "6" - locator resolved to 6 elements - unexpected value "6" - locator resolved to 6 elements - unexpected value "6" - locator resolved to 6 elements - unexpected value "6" - locator resolved to 6 elements - unexpected value "6" 36 | await expect( 37 | page.getByRole('link'), > 38 | ).toHaveCount(2) | ^ 39 | }) 40 | 41 | test('has six links after clicking the menu button', async ({ page }) => { at /__w/moduk-frontend/moduk-frontend/e2e/tests/components/header/with-service-name-and-navigation.spec.ts:38:11
Determine Playwright container image
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Audit dependencies
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Lint code
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run unit tests
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Build package
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run visual regression tests (1/2)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run e2e tests (1/4)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run e2e tests (3/4)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run visual regression tests (2/2)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Merge visual regression reports
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run e2e tests (2/4)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run e2e tests (4/4)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Merge e2e test reports
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Deprecation notice: v1, v2, and v3 of the artifact actions
The following artifacts were uploaded using a version of actions/upload-artifact that is scheduled for deprecation: "e2e-blob-reports", "e2e-html-report", "visual-regression-blob-reports", "visual-regression-html-report". Please update your workflow to use v4 of the artifact actions. Learn more: https://github.blog/changelog/2024-04-16-deprecation-notice-v3-of-the-artifact-actions/
🎭 Playwright Run Summary
446 passed (1.9m)
🎭 Playwright Run Summary
479 passed (2.3m)
🎭 Playwright Run Summary
478 passed (2.5m)
🎭 Playwright Run Summary
2 flaky [react-tablet-safari] › components/header/with-service-name-and-navigation.spec.ts:106:13 › header, with service name and navigation › @visual-regression › when JavaScript is enabled › @mobile-and-tablet › matches the saved screenshot when the menu is open [react-tablet-safari] › visual-regression.spec.ts:13:15 › @visual-regression › @react › accordion › with-h3-headings › matches the saved screenshot 444 passed (2.7m)
🎭 Playwright Run Summary
478 passed (3.7m)
🎭 Playwright Run Summary
1 flaky [react-tablet-safari] › components/header/with-service-name-and-navigation.spec.ts:35:11 › header, with service name and navigation › when JavaScript is enabled › @mobile-and-tablet › has two links in total 477 passed (3.8m)

Artifacts

Produced during runtime
Name Size
e2e-blob-reports Expired
1.44 MB
e2e-html-report
2 MB
visual-regression-blob-reports Expired
884 KB
visual-regression-html-report
1.92 MB