Skip to content

Playwright

Playwright #2266

Triggered via deployment status December 17, 2024 08:16
Status Failure
Total duration 4m 44s
Artifacts

playwright.yml

on: deployment_status
Fit to window
Zoom out
Zoom in

Annotations

10 errors, 3 warnings, and 1 notice
test-e2e
Testing stopped early after 10 maximum allowed failures.
[No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached: apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts#L12
1) [No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached › Send first message › Wait for generation Error: Timed out 5000ms waiting for expect(locator).toContainText(expected) Locator: getByTestId('chat-aila-streaming-status') Expected string: "RequestMade" Received: <element(s) not found> Call log: - expect.toContainText with timeout 5000ms - waiting for getByTestId('chat-aila-streaming-status') at tests/aila-chat/helpers.ts:12 10 | ) { 11 | const statusElement = page.getByTestId("chat-aila-streaming-status"); > 12 | await expect(statusElement).toContainText(status, args); | ^ 1*** | } 14 | 15 | export async function waitForStreamingStatusChange( at expectStreamingStatus (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:12:***1) at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:44:11 at waitForGeneration (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:4***:21) at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/rate-limiting.test.ts:44:28 at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/rate-limiting.test.ts:42:***
[No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached: apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts#L12
1) [No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached › Send first message › Wait for generation Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toContainText(expected) Locator: getByTestId('chat-aila-streaming-status') Expected string: "RequestMade" Received: <element(s) not found> Call log: - expect.toContainText with timeout 5000ms - waiting for getByTestId('chat-aila-streaming-status') at tests/aila-chat/helpers.ts:12 10 | ) { 11 | const statusElement = page.getByTestId("chat-aila-streaming-status"); > 12 | await expect(statusElement).toContainText(status, args); | ^ 1*** | } 14 | 15 | export async function waitForStreamingStatusChange( at expectStreamingStatus (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:12:***1) at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:44:11 at waitForGeneration (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:4***:21) at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/rate-limiting.test.ts:44:28 at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/rate-limiting.test.ts:42:***
[No persona] › tests/banned-users.test.ts:10:5 › Users are banned after 3 toxic lessons: apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts#L12
2) [No persona] › tests/banned-users.test.ts:10:5 › Users are banned after *** toxic lessons › Wait for streaming Error: Timed out 10000ms waiting for expect(locator).toContainText(expected) Locator: getByTestId('chat-aila-streaming-status') Expected string: "RequestMade" Received: <element(s) not found> Call log: - expect.toContainText with timeout 10000ms - waiting for getByTestId('chat-aila-streaming-status') at tests/aila-chat/helpers.ts:12 10 | ) { 11 | const statusElement = page.getByTestId("chat-aila-streaming-status"); > 12 | await expect(statusElement).toContainText(status, args); | ^ 1*** | } 14 | 15 | export async function waitForStreamingStatusChange( at expectStreamingStatus (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:12:***1) at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/banned-users.test.ts:***9:***2 at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/banned-users.test.ts:***7:***
[No persona] › tests/banned-users.test.ts:10:5 › Users are banned after 3 toxic lessons: apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts#L12
2) [No persona] › tests/banned-users.test.ts:10:5 › Users are banned after *** toxic lessons › Wait for streaming Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 10000ms waiting for expect(locator).toContainText(expected) Locator: getByTestId('chat-aila-streaming-status') Expected string: "RequestMade" Received: <element(s) not found> Call log: - expect.toContainText with timeout 10000ms - waiting for getByTestId('chat-aila-streaming-status') at tests/aila-chat/helpers.ts:12 10 | ) { 11 | const statusElement = page.getByTestId("chat-aila-streaming-status"); > 12 | await expect(statusElement).toContainText(status, args); | ^ 1*** | } 14 | 15 | export async function waitForStreamingStatusChange( at expectStreamingStatus (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:12:***1) at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/banned-users.test.ts:***9:***2 at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/banned-users.test.ts:***7:***
[No persona] › tests/chat-performance.test.ts:52:7 › Component renders during lesson chat › There are no unnecessary rerenders across left and right side of chat: apps/nextjs/tests-e2e/tests/chat-performance.test.ts#L1
***) [No persona] › tests/chat-performance.test.ts:52:7 › Component renders during lesson chat › There are no unnecessary rerenders across left and right side of chat › Chat box keyboard input does not create rerenders in lesson plan Test timeout of ***0000ms exceeded.
[No persona] › tests/chat-performance.test.ts:52:7 › Component renders during lesson chat › There are no unnecessary rerenders across left and right side of chat: apps/nextjs/tests-e2e/tests/chat-performance.test.ts#L71
***) [No persona] › tests/chat-performance.test.ts:52:7 › Component renders during lesson chat › There are no unnecessary rerenders across left and right side of chat › Chat box keyboard input does not create rerenders in lesson plan Error: page.waitForFunction: Test timeout of ***0000ms exceeded. 69 | // console.log("Environment type:", process?.env?.NODE_ENV); 70 | > 71 | await page.waitForFunction( | ^ 72 | () => 7*** | window.reactScanLessonPlanDisplay && 74 | typeof window.reactScanLessonPlanDisplay.renderCount === "number", at verifyChatInputRenders (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/chat-performance.test.ts:71:16) at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/chat-performance.test.ts:56:1*** at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/chat-performance.test.ts:55:16
[No persona] › tests/chat-performance.test.ts:52:7 › Component renders during lesson chat › There are no unnecessary rerenders across left and right side of chat: apps/nextjs/tests-e2e/tests/chat-performance.test.ts#L1
***) [No persona] › tests/chat-performance.test.ts:52:7 › Component renders during lesson chat › There are no unnecessary rerenders across left and right side of chat › Chat box keyboard input does not create rerenders in lesson plan Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Test timeout of ***0000ms exceeded.
[No persona] › tests/chat-performance.test.ts:52:7 › Component renders during lesson chat › There are no unnecessary rerenders across left and right side of chat: apps/nextjs/tests-e2e/tests/chat-performance.test.ts#L71
***) [No persona] › tests/chat-performance.test.ts:52:7 › Component renders during lesson chat › There are no unnecessary rerenders across left and right side of chat › Chat box keyboard input does not create rerenders in lesson plan Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: page.waitForFunction: Test timeout of ***0000ms exceeded. 69 | // console.log("Environment type:", process?.env?.NODE_ENV); 70 | > 71 | await page.waitForFunction( | ^ 72 | () => 7*** | window.reactScanLessonPlanDisplay && 74 | typeof window.reactScanLessonPlanDisplay.renderCount === "number", at verifyChatInputRenders (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/chat-performance.test.ts:71:16) at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/chat-performance.test.ts:56:1*** at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/chat-performance.test.ts:55:16
[No persona] › tests/modifiy-lesson.test.ts:24:7 › Modify a lesson plan › Modify a lesson resource: apps/nextjs/tests-e2e/tests/modifiy-lesson.test.ts#L15
4) [No persona] › tests/modifiy-lesson.test.ts:24:7 › Modify a lesson plan › Modify a lesson resource Test timeout of ***0000ms exceeded while running "beforeEach" hook. 1*** | const generationTimeout = 50000; 14 | > 15 | test.beforeEach(async ({ page }) => { | ^ 16 | await test.step("Setup", async () => { 17 | await bypassVercelProtection(page); 18 | const login = await prepareUser(page, "modify-lesson-plan"); at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/modifiy-lesson.test.ts:15:8
test-e2e
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
test-e2e
Failed to restore: Cache service responded with 403
test-e2e
Can't add secret mask for empty string in ##[add-mask] command.
🎭 Playwright Run Summary
5 failed [No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached [No persona] › tests/banned-users.test.ts:10:5 › Users are banned after *** toxic lessons ──────── [No persona] › tests/chat-performance.test.ts:52:7 › Component renders during lesson chat › There are no unnecessary rerenders across left and right side of chat [No persona] › tests/modifiy-lesson.test.ts:24:7 › Modify a lesson plan › Modify a lesson resource [No persona] › tests/sharing.test.ts:***1:5 › sharing a lesson ─────────────────────────────────── 1 skipped 6 did not run 5 passed (2.8m)