Skip to content

Playwright

Playwright #1774

Triggered via deployment status November 13, 2024 15:33
Status Failure
Total duration 13m 47s
Artifacts

playwright.yml

on: deployment_status
Fit to window
Zoom out
Zoom in

Annotations

10 errors, 3 warnings, and 1 notice
test-e2e
Testing stopped early after 10 maximum allowed failures.
[No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached: apps/nextjs/tests-e2e/tests/aila-chat/rate-limiting.test.ts#L1
1) [No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached Test timeout of 60000ms exceeded.
[No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached: apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts#L52
1) [No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached Error: locator.click: Test timeout of 60000ms exceeded. Call log: - waiting for getByTestId('chat-continue') at tests/aila-chat/helpers.ts:52 50 | 51 | export async function continueChat(page: Page) { > 52 | await page.getByTestId("chat-continue").click(); | ^ 5*** | } 54 | 55 | export async function isFinished(page: Page) { at continueChat (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:52:4***) at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/rate-limiting.test.ts:56:2*** at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/rate-limiting.test.ts:55:14
[No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached: apps/nextjs/tests-e2e/tests/aila-chat/rate-limiting.test.ts#L1
1) [No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Test timeout of 60000ms exceeded.
[No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached: apps/nextjs/tests-e2e/tests/aila-chat/rate-limiting.test.ts#L19
1) [No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: page.goto: Test timeout of 60000ms exceeded. Call log: - navigating to "https://oak-ai-lesson-assistant-qgabkaikx.vercel-preview.thenational.academy/aila", waiting until "load" 17 | await prepareUser(page, "nearly-rate-limited"); 18 | > 19 | await page.goto(`${TEST_BASE_URL}/aila`); | ^ 20 | await expect(page.getByTestId("chat-h1")).toBeInViewport(); 21 | }); 22 | at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/rate-limiting.test.ts:19:16 at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/rate-limiting.test.ts:15:***
[No persona] › tests/modifiy-lesson.test.ts:24:7 › Modify a lesson plan › Modify a lesson resource: apps/nextjs/tests-e2e/tests/modifiy-lesson.test.ts#L1
2) [No persona] › tests/modifiy-lesson.test.ts:24:7 › Modify a lesson plan › Modify a lesson resource › Add additional material › Wait for generation Test timeout of ***0000ms exceeded.
[No persona] › tests/modifiy-lesson.test.ts:24:7 › Modify a lesson plan › Modify a lesson resource: apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts#L12
2) [No persona] › tests/modifiy-lesson.test.ts:24:7 › Modify a lesson plan › Modify a lesson resource › Add additional material › Wait for generation Error: expect(locator).toContainText(expected) Locator: getByTestId('chat-aila-streaming-status') Expected string: "Idle" Received: <element(s) not found> Call log: - expect.toContainText with timeout 50000ms - waiting for getByTestId('chat-aila-streaming-status') - locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div> - unexpected value "RequestMade" - locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div> - unexpected value "RequestMade" - locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div> - unexpected value "RequestMade" - locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div> - unexpected value "RequestMade" - locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div> - unexpected value "RequestMade" at tests/aila-chat/helpers.ts:12 10 | ) { 11 | const statusElement = page.getByTestId("chat-aila-streaming-status"); > 12 | await expect(statusElement).toContainText(status, args); | ^ 1*** | } 14 | 15 | export async function waitForStreamingStatusChange( at expectStreamingStatus (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:12:***1) at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:45:11 at waitForGeneration (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:4***:10) at selectAdditionalResource (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/modifiy-lesson.test.ts:88:5) at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/modifiy-lesson.test.ts:***6:7 at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/modifiy-lesson.test.ts:***5:5
[No persona] › tests/modifiy-lesson.test.ts:24:7 › Modify a lesson plan › Modify a lesson resource: apps/nextjs/tests-e2e/tests/modifiy-lesson.test.ts#L1
2) [No persona] › tests/modifiy-lesson.test.ts:24:7 › Modify a lesson plan › Modify a lesson resource › Add additional material › Wait for generation Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Test timeout of ***0000ms exceeded.
[No persona] › tests/modifiy-lesson.test.ts:24:7 › Modify a lesson plan › Modify a lesson resource: apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts#L12
2) [No persona] › tests/modifiy-lesson.test.ts:24:7 › Modify a lesson plan › Modify a lesson resource › Add additional material › Wait for generation Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(locator).toContainText(expected) Locator: getByTestId('chat-aila-streaming-status') Expected string: "Idle" Received: <element(s) not found> Call log: - expect.toContainText with timeout 50000ms - waiting for getByTestId('chat-aila-streaming-status') - locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div> - unexpected value "RequestMade" - locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div> - unexpected value "RequestMade" - locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div> - unexpected value "RequestMade" - locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div> - unexpected value "RequestMade" - locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div> - unexpected value "RequestMade" at tests/aila-chat/helpers.ts:12 10 | ) { 11 | const statusElement = page.getByTestId("chat-aila-streaming-status"); > 12 | await expect(statusElement).toContainText(status, args); | ^ 1*** | } 14 | 15 | export async function waitForStreamingStatusChange( at expectStreamingStatus (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:12:***1) at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:45:11 at waitForGeneration (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:4***:10) at selectAdditionalResource (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/modifiy-lesson.test.ts:88:5) at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/modifiy-lesson.test.ts:***6:7 at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/modifiy-lesson.test.ts:***5:5
[No persona] › tests/sharing.test.ts:32:5 › sharing a lesson: apps/nextjs/tests-e2e/tests/sharing.test.ts#L11
***) [No persona] › tests/sharing.test.ts:***2:5 › sharing a lesson › Share page ───────────────────── Error: Timed out 5000ms waiting for expect(locator).toContainText(expected) Locator: getByTestId('share-banner') Expected pattern: /Created by .+ sharing-chat/ Received: <element(s) not found> Call log: - expect.toContainText with timeout 5000ms - waiting for getByTestId('share-banner') 9 | const checkPage = async (page: Page) => { 10 | const banner = page.getByTestId("share-banner"); > 11 | await expect(banner).toContainText(/Created by .+ sharing-chat/); | ^ 12 | await expect(banner).toContainText("Please check content carefully"); 1*** | 14 | const keyStageSubjectTitle = page.getByTestId("key-stage-subject"); at checkPage (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/sharing.test.ts:11:24) at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/sharing.test.ts:76:11 at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/sharing.test.ts:74:***
test-e2e
Failed to restore: Cache service responded with 403
Slow Test: apps/nextjs/[No persona] › tests/banned-users.test.ts#L1
apps/nextjs/[No persona] › tests/banned-users.test.ts took 19.7s
test-e2e
Can't add secret mask for empty string in ##[add-mask] command.
🎭 Playwright Run Summary
5 failed [No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached [No persona] › tests/modifiy-lesson.test.ts:24:7 › Modify a lesson plan › Modify a lesson resource [No persona] › tests/sharing.test.ts:***2:5 › sharing a lesson ─────────────────────────────────── [Common persona] › tests/aila-chat/full-romans.test.ts:2***:5 › Full aila flow with Romans fixture [Common persona - mobile] › tests/aila-chat/full-romans.mobile.test.ts:***6:5 › Full aila flow with Romans fixture 1 skipped 10 passed (10.9m)