Expected failure of daily Cypress job

[MikeMcC399]

GitHub is currently rolling out the runner image ubuntu-22.04 (20230917) which contains Google Chrome 117.0.5938.88.

Google Chrome 117.0.5938.88 contains Bug 1483163 which means it will crash in headless mode when run with Cypress version 12.14.0 and earlier.

The cwa-website repository is configured with Cypress 12.8.1 and so it is impacted. This includes the GitHub Actions workflow cypress-test-prod.yml which runs daily.

During rollout GitHub randomly provides either the new runner image or the old runner image, so it is unpredictable during this time whether the job will fail. So far it has not failed because it has used the old image ubuntu-22.04 (20230911) - see for instance run 6259601072

Runner Image
  Image: ubuntu-22.04
  Version: 20230911.1.0

Options

1. Do nothing. The daily workflow will soon start failing and other workflows will fail if triggered through new PRs.

   Chromium has fixed the bug in the Chrome 119 Canary release and plans to back-port it to Chrome 117. It may take 2 to 4 weeks before the fix is published and rolled out to GitHub Actions. When the fixed has been rolled out the workflows can be expected to run without failing again.

2. Update Cypress to version 12.15.0 or later.

   It seems that the Cypress tests in this repository are compatible with the current latest version of Cypress 13.2.0.

Note

I'm just passing on this information since I am working a lot with Cypress these days. I'm not intending to submit any PR here since I already stopped contributing changes to CWA and I no longer maintain a fork of the repo.

[dsarkar]

@MikeMcC399 Thanks for passing this information! Very much appreciated; we will have a look at this!

[MikeMcC399]

Google Chrome Stable Channel Update for Desktop

Wednesday, September 27, 2023
The Stable channel has been updated to 117.0.5938.132 for Windows, Mac and Linux, which will roll out over the coming days/weeks.

[MikeMcC399]

@dsarkar

The new runner image Ubuntu2204 - 20231001.1.0 includes the patch Google Chrome 117.0.5938.132. It is currently 99.98% rolled out.

[MikeMcC399]

You can re-enable the workflow now and expect it to succeed.

[larswmh]

Good morning @MikeMcC399,

thanks for the information. I've re-enabled the workflow now.

[MikeMcC399]

Hello @larswmh

Good to hear from you again 🙂 and to see that the workflow was successful run 6454646888 🎉 😄 !

[MikeMcC399]

Issue is fixed.