Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ensure that test failures are reported by Buildkite #7677

Merged
merged 21 commits into from
Feb 18, 2022

Conversation

paul-butcher
Copy link
Contributor

Who is this for?

Developers

What is it doing for them?

This fixes #7662 and also some of the test failures that that issue was masking.

When tests fail, the build pipeline will now show that they have failed.

I have set content tests to be a soft failure, because of changes underway around the use of raw prismicDocuments elsewhere. So a red light will show on the step, but the build will still pass.

See https://buildkite.com/wellcomecollection/experience/builds/5787

@paul-butcher paul-butcher requested a review from a team February 18, 2022 10:22
@github-actions
Copy link

Size Change: +8 B (0%)

Total Size: 1.2 MB

ℹ️ View Unchanged
Filename Size Change
catalogue/webapp/.next/static/chunks/00a8a139.********************.js 54.3 kB 0 B
catalogue/webapp/.next/static/chunks/120-********************.js 4.94 kB 0 B
catalogue/webapp/.next/static/chunks/131-********************.js 4.2 kB 0 B
catalogue/webapp/.next/static/chunks/246-********************.js 15.2 kB 0 B
catalogue/webapp/.next/static/chunks/296-********************.js 3.12 kB 0 B
catalogue/webapp/.next/static/chunks/321-********************.js 19.3 kB 0 B
catalogue/webapp/.next/static/chunks/33.********************.js 1.91 kB 0 B
catalogue/webapp/.next/static/chunks/344-********************.js 3.56 kB 0 B
catalogue/webapp/.next/static/chunks/386-********************.js 7.01 kB 0 B
catalogue/webapp/.next/static/chunks/735.********************.js 19.3 kB 0 B
catalogue/webapp/.next/static/chunks/907-********************.js 3.19 kB 0 B
catalogue/webapp/.next/static/chunks/997-********************.js 4.02 kB 0 B
catalogue/webapp/.next/static/chunks/framework-********************.js 42.6 kB 0 B
catalogue/webapp/.next/static/chunks/main-********************.js 23.6 kB 0 B
catalogue/webapp/.next/static/chunks/pages/_app-********************.js 158 kB 0 B
catalogue/webapp/.next/static/chunks/pages/_error-********************.js 342 B 0 B
catalogue/webapp/.next/static/chunks/pages/404-********************.js 261 B 0 B
catalogue/webapp/.next/static/chunks/pages/download-********************.js 4.01 kB 0 B
catalogue/webapp/.next/static/chunks/pages/image-********************.js 1.25 kB 0 B
catalogue/webapp/.next/static/chunks/pages/images-********************.js 8.35 kB 0 B
catalogue/webapp/.next/static/chunks/pages/item-********************.js 4.99 kB 0 B
catalogue/webapp/.next/static/chunks/pages/progress-********************.js 3.04 kB 0 B
catalogue/webapp/.next/static/chunks/pages/work-********************.js 20.8 kB +8 B (0%)
catalogue/webapp/.next/static/chunks/pages/works-********************.js 3.28 kB 0 B
catalogue/webapp/.next/static/chunks/polyfills-a40ef1678bae11e696dba45124eadd70.js 31 kB 0 B
catalogue/webapp/.next/static/chunks/webpack-********************.js 1.61 kB 0 B
content/webapp/.next/static/chunks/141-********************.js 4.35 kB 0 B
content/webapp/.next/static/chunks/168-********************.js 6.89 kB 0 B
content/webapp/.next/static/chunks/18-********************.js 44 kB 0 B
content/webapp/.next/static/chunks/219-********************.js 5.11 kB 0 B
content/webapp/.next/static/chunks/39-********************.js 3.93 kB 0 B
content/webapp/.next/static/chunks/497-********************.js 4.67 kB 0 B
content/webapp/.next/static/chunks/600-********************.js 5.01 kB 0 B
content/webapp/.next/static/chunks/615-********************.js 7.38 kB 0 B
content/webapp/.next/static/chunks/735.********************.js 19.3 kB 0 B
content/webapp/.next/static/chunks/767-********************.js 4.29 kB 0 B
content/webapp/.next/static/chunks/901.********************.js 1.44 kB 0 B
content/webapp/.next/static/chunks/framework-********************.js 42.6 kB 0 B
content/webapp/.next/static/chunks/main-********************.js 23.6 kB 0 B
content/webapp/.next/static/chunks/pages/_app-********************.js 174 kB 0 B
content/webapp/.next/static/chunks/pages/_error-********************.js 354 B 0 B
content/webapp/.next/static/chunks/pages/404-********************.js 259 B 0 B
content/webapp/.next/static/chunks/pages/article-********************.js 4.63 kB 0 B
content/webapp/.next/static/chunks/pages/article-series-********************.js 1.47 kB 0 B
content/webapp/.next/static/chunks/pages/articles-********************.js 3.69 kB 0 B
content/webapp/.next/static/chunks/pages/book-********************.js 1.71 kB 0 B
content/webapp/.next/static/chunks/pages/books-********************.js 1.55 kB 0 B
content/webapp/.next/static/chunks/pages/event-********************.js 327 B 0 B
content/webapp/.next/static/chunks/pages/event-series-********************.js 1.16 kB 0 B
content/webapp/.next/static/chunks/pages/events-********************.js 1.85 kB 0 B
content/webapp/.next/static/chunks/pages/exhibition-********************.js 4.53 kB 0 B
content/webapp/.next/static/chunks/pages/exhibitions-********************.js 3.7 kB 0 B
content/webapp/.next/static/chunks/pages/guides-********************.js 3.56 kB 0 B
content/webapp/.next/static/chunks/pages/homepage-********************.js 2.22 kB 0 B
content/webapp/.next/static/chunks/pages/newsletter-********************.js 3.73 kB 0 B
content/webapp/.next/static/chunks/pages/page-********************.js 3.51 kB 0 B
content/webapp/.next/static/chunks/pages/season-********************.js 1.69 kB 0 B
content/webapp/.next/static/chunks/pages/stories-********************.js 2.79 kB 0 B
content/webapp/.next/static/chunks/pages/whats-on-********************.js 5.7 kB 0 B
content/webapp/.next/static/chunks/polyfills-a40ef1678bae11e696dba45124eadd70.js 31 kB 0 B
content/webapp/.next/static/chunks/webpack-********************.js 1.57 kB 0 B
identity/webapp/.next/static/chunks/242-********************.js 13.8 kB 0 B
identity/webapp/.next/static/chunks/735.********************.js 19.3 kB 0 B
identity/webapp/.next/static/chunks/framework-********************.js 42.4 kB 0 B
identity/webapp/.next/static/chunks/main-********************.js 23.6 kB 0 B
identity/webapp/.next/static/chunks/pages/_app-********************.js 184 kB 0 B
identity/webapp/.next/static/chunks/pages/_error-********************.js 193 B 0 B
identity/webapp/.next/static/chunks/pages/delete-requested-********************.js 1.48 kB 0 B
identity/webapp/.next/static/chunks/pages/error-********************.js 1.41 kB 0 B
identity/webapp/.next/static/chunks/pages/index-********************.js 11.4 kB 0 B
identity/webapp/.next/static/chunks/pages/validated-********************.js 3.34 kB 0 B
identity/webapp/.next/static/chunks/polyfills-a40ef1678bae11e696dba45124eadd70.js 31 kB 0 B
identity/webapp/.next/static/chunks/webpack-********************.js 1.54 kB 0 B

compressed-size-action

@paul-butcher paul-butcher changed the title Buildkite fail properly Ensure that test failures are reported by Buildkite Feb 18, 2022
@paul-butcher paul-butcher merged commit ea501ee into main Feb 18, 2022
@paul-butcher paul-butcher deleted the buildkite-fail-properly branch February 18, 2022 10:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

tests are silently failing in CI
2 participants