release: v2.0.20 #3089
lint-and-test.yml
on: push
Determine Playwright container image
4s
Lint code
31s
Build package
52s
Lint commit messages
0s
Run unit tests
42s
Audit dependencies
25s
Matrix: test-e2e
Matrix: test-visual-regression
Merge e2e test reports
26s
Merge visual regression reports
25s
Annotations
5 errors, 14 warnings, and 6 notices
Audit dependencies
Process completed with exit code 1.
|
[react-tablet-safari] › components/header/with-service-name-and-navigation.spec.ts:106:13 › header:
e2e/tests/components/header/with-service-name-and-navigation.spec.ts#L1
1) [react-tablet-safari] › components/header/with-service-name-and-navigation.spec.ts:106:13 › header, with service name and navigation › @visual-regression › when JavaScript is enabled › @mobile-and-tablet › matches the saved screenshot when the menu is open
Test timeout of 30000ms exceeded.
|
[react-tablet-safari] › components/header/with-service-name-and-navigation.spec.ts:106:13 › header:
e2e/tests/components/header/with-service-name-and-navigation.spec.ts#L107
1) [react-tablet-safari] › components/header/with-service-name-and-navigation.spec.ts:106:13 › header, with service name and navigation › @visual-regression › when JavaScript is enabled › @mobile-and-tablet › matches the saved screenshot when the menu is open
Error: locator.click: Test timeout of 30000ms exceeded.
Call log:
- waiting for getByText('Menu')
- locator resolved to <button hidden="" type="button" aria-controls="navigatio…>Menu</button>
- attempting click action
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #1
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #2
- waiting 20ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #3
- waiting 100ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #4
- waiting 100ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #5
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #6
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #7
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #8
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #9
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #10
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #11
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #12
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #13
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #14
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #15
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #16
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #17
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #18
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #19
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #20
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #21
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not visible
- retrying click action, attempt #22
- waiting 500ms
- wai
|
[react-tablet-safari] › visual-regression.spec.ts:13:15 › @visual-regression › @react › accordion › with-h3-headings › matches the saved screenshot:
e2e/tests/visual-regression.spec.ts#L14
2) [react-tablet-safari] › visual-regression.spec.ts:13:15 › @visual-regression › @react › accordion › with-h3-headings › matches the saved screenshot
Error: Screenshot comparison failed:
Expected an image 1536px by 1012px, received 1536px by 490px. 73870 pixels (ratio 0.05 of all image pixels) are different.
Expected: /__w/moduk-frontend/moduk-frontend/e2e/tests/__screenshots__/visual-regression.spec.ts/accordion/with-h3-headings/screenshot--tablet-safari.png
Received: /__w/moduk-frontend/moduk-frontend/e2e/output/artefacts/visual-regression--visual-regression-react-accordion-with-h3-headings-matches-the-saved-screenshot-react-tablet-safari/accordion/with-h3-headings/screenshot-actual.png
Diff: /__w/moduk-frontend/moduk-frontend/e2e/output/artefacts/visual-regression--visual-regression-react-accordion-with-h3-headings-matches-the-saved-screenshot-react-tablet-safari/accordion/with-h3-headings/screenshot-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('#root > *:first-child')
- locator resolved to <div id="accordion-default" class="govuk-accordion" d…>…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- Expected an image 1536px by 1012px, received 1536px by 490px. 73870 pixels (ratio 0.05 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('#root > *:first-child')
- locator resolved to <div id="accordion-default" class="govuk-accordion" d…>…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- Expected an image 1536px by 1012px, received 1536px by 490px. 73870 pixels (ratio 0.05 of all image pixels) are different.
12 |
13 | test('matches the saved screenshot', async ({ componentElement }) => {
> 14 | await expect(componentElement).toHaveScreenshot([
| ^
15 | component,
16 | exampleName,
17 | 'screenshot.png',
at /__w/moduk-frontend/moduk-frontend/e2e/tests/visual-regression.spec.ts:14:44
|
[react-tablet-safari] › components/header/with-service-name-and-navigation.spec.ts:35:11 › header:
e2e/tests/components/header/with-service-name-and-navigation.spec.ts#L38
1) [react-tablet-safari] › components/header/with-service-name-and-navigation.spec.ts:35:11 › header, with service name and navigation › when JavaScript is enabled › @mobile-and-tablet › has two links in total
Error: Timed out 5000ms waiting for expect(locator).toHaveCount(expected)
Locator: getByRole('link')
Expected: 2
Received: 6
Call log:
- expect.toHaveCount with timeout 5000ms
- waiting for getByRole('link')
- locator resolved to 6 elements
- unexpected value "6"
- locator resolved to 6 elements
- unexpected value "6"
- locator resolved to 6 elements
- unexpected value "6"
- locator resolved to 6 elements
- unexpected value "6"
- locator resolved to 6 elements
- unexpected value "6"
- locator resolved to 6 elements
- unexpected value "6"
- locator resolved to 6 elements
- unexpected value "6"
- locator resolved to 6 elements
- unexpected value "6"
- locator resolved to 6 elements
- unexpected value "6"
36 | await expect(
37 | page.getByRole('link'),
> 38 | ).toHaveCount(2)
| ^
39 | })
40 |
41 | test('has six links after clicking the menu button', async ({ page }) => {
at /__w/moduk-frontend/moduk-frontend/e2e/tests/components/header/with-service-name-and-navigation.spec.ts:38:11
|
Determine Playwright container image
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
Audit dependencies
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
Lint code
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
Run unit tests
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
Build package
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
Run visual regression tests (1/2)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
Run e2e tests (1/4)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
Run e2e tests (3/4)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
Run visual regression tests (2/2)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
Merge visual regression reports
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
Run e2e tests (2/4)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
Run e2e tests (4/4)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
Merge e2e test reports
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
Deprecation notice: v1, v2, and v3 of the artifact actions
The following artifacts were uploaded using a version of actions/upload-artifact that is scheduled for deprecation: "e2e-blob-reports", "e2e-html-report", "visual-regression-blob-reports", "visual-regression-html-report".
Please update your workflow to use v4 of the artifact actions.
Learn more: https://github.blog/changelog/2024-04-16-deprecation-notice-v3-of-the-artifact-actions/
|
🎭 Playwright Run Summary
446 passed (1.9m)
|
🎭 Playwright Run Summary
479 passed (2.3m)
|
🎭 Playwright Run Summary
478 passed (2.5m)
|
🎭 Playwright Run Summary
2 flaky
[react-tablet-safari] › components/header/with-service-name-and-navigation.spec.ts:106:13 › header, with service name and navigation › @visual-regression › when JavaScript is enabled › @mobile-and-tablet › matches the saved screenshot when the menu is open
[react-tablet-safari] › visual-regression.spec.ts:13:15 › @visual-regression › @react › accordion › with-h3-headings › matches the saved screenshot
444 passed (2.7m)
|
🎭 Playwright Run Summary
478 passed (3.7m)
|
🎭 Playwright Run Summary
1 flaky
[react-tablet-safari] › components/header/with-service-name-and-navigation.spec.ts:35:11 › header, with service name and navigation › when JavaScript is enabled › @mobile-and-tablet › has two links in total
477 passed (3.8m)
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
e2e-blob-reports
Expired
|
1.44 MB |
|
e2e-html-report
|
2 MB |
|
visual-regression-blob-reports
Expired
|
884 KB |
|
visual-regression-html-report
|
1.92 MB |
|