Playwright #2266
Triggered via deployment status
December 17, 2024 08:16
vercel[bot]
created
733a131
Status
Failure
Total duration
4m 44s
Artifacts
–
Annotations
10 errors, 3 warnings, and 1 notice
test-e2e
Testing stopped early after 10 maximum allowed failures.
|
[No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached:
apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts#L12
1) [No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached › Send first message › Wait for generation
Error: Timed out 5000ms waiting for expect(locator).toContainText(expected)
Locator: getByTestId('chat-aila-streaming-status')
Expected string: "RequestMade"
Received: <element(s) not found>
Call log:
- expect.toContainText with timeout 5000ms
- waiting for getByTestId('chat-aila-streaming-status')
at tests/aila-chat/helpers.ts:12
10 | ) {
11 | const statusElement = page.getByTestId("chat-aila-streaming-status");
> 12 | await expect(statusElement).toContainText(status, args);
| ^
1*** | }
14 |
15 | export async function waitForStreamingStatusChange(
at expectStreamingStatus (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:12:***1)
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:44:11
at waitForGeneration (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:4***:21)
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/rate-limiting.test.ts:44:28
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/rate-limiting.test.ts:42:***
|
[No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached:
apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts#L12
1) [No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached › Send first message › Wait for generation
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Timed out 5000ms waiting for expect(locator).toContainText(expected)
Locator: getByTestId('chat-aila-streaming-status')
Expected string: "RequestMade"
Received: <element(s) not found>
Call log:
- expect.toContainText with timeout 5000ms
- waiting for getByTestId('chat-aila-streaming-status')
at tests/aila-chat/helpers.ts:12
10 | ) {
11 | const statusElement = page.getByTestId("chat-aila-streaming-status");
> 12 | await expect(statusElement).toContainText(status, args);
| ^
1*** | }
14 |
15 | export async function waitForStreamingStatusChange(
at expectStreamingStatus (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:12:***1)
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:44:11
at waitForGeneration (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:4***:21)
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/rate-limiting.test.ts:44:28
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/rate-limiting.test.ts:42:***
|
[No persona] › tests/banned-users.test.ts:10:5 › Users are banned after 3 toxic lessons:
apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts#L12
2) [No persona] › tests/banned-users.test.ts:10:5 › Users are banned after *** toxic lessons › Wait for streaming
Error: Timed out 10000ms waiting for expect(locator).toContainText(expected)
Locator: getByTestId('chat-aila-streaming-status')
Expected string: "RequestMade"
Received: <element(s) not found>
Call log:
- expect.toContainText with timeout 10000ms
- waiting for getByTestId('chat-aila-streaming-status')
at tests/aila-chat/helpers.ts:12
10 | ) {
11 | const statusElement = page.getByTestId("chat-aila-streaming-status");
> 12 | await expect(statusElement).toContainText(status, args);
| ^
1*** | }
14 |
15 | export async function waitForStreamingStatusChange(
at expectStreamingStatus (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:12:***1)
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/banned-users.test.ts:***9:***2
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/banned-users.test.ts:***7:***
|
[No persona] › tests/banned-users.test.ts:10:5 › Users are banned after 3 toxic lessons:
apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts#L12
2) [No persona] › tests/banned-users.test.ts:10:5 › Users are banned after *** toxic lessons › Wait for streaming
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Timed out 10000ms waiting for expect(locator).toContainText(expected)
Locator: getByTestId('chat-aila-streaming-status')
Expected string: "RequestMade"
Received: <element(s) not found>
Call log:
- expect.toContainText with timeout 10000ms
- waiting for getByTestId('chat-aila-streaming-status')
at tests/aila-chat/helpers.ts:12
10 | ) {
11 | const statusElement = page.getByTestId("chat-aila-streaming-status");
> 12 | await expect(statusElement).toContainText(status, args);
| ^
1*** | }
14 |
15 | export async function waitForStreamingStatusChange(
at expectStreamingStatus (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:12:***1)
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/banned-users.test.ts:***9:***2
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/banned-users.test.ts:***7:***
|
[No persona] › tests/chat-performance.test.ts:52:7 › Component renders during lesson chat › There are no unnecessary rerenders across left and right side of chat:
apps/nextjs/tests-e2e/tests/chat-performance.test.ts#L1
***) [No persona] › tests/chat-performance.test.ts:52:7 › Component renders during lesson chat › There are no unnecessary rerenders across left and right side of chat › Chat box keyboard input does not create rerenders in lesson plan
Test timeout of ***0000ms exceeded.
|
[No persona] › tests/chat-performance.test.ts:52:7 › Component renders during lesson chat › There are no unnecessary rerenders across left and right side of chat:
apps/nextjs/tests-e2e/tests/chat-performance.test.ts#L71
***) [No persona] › tests/chat-performance.test.ts:52:7 › Component renders during lesson chat › There are no unnecessary rerenders across left and right side of chat › Chat box keyboard input does not create rerenders in lesson plan
Error: page.waitForFunction: Test timeout of ***0000ms exceeded.
69 | // console.log("Environment type:", process?.env?.NODE_ENV);
70 |
> 71 | await page.waitForFunction(
| ^
72 | () =>
7*** | window.reactScanLessonPlanDisplay &&
74 | typeof window.reactScanLessonPlanDisplay.renderCount === "number",
at verifyChatInputRenders (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/chat-performance.test.ts:71:16)
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/chat-performance.test.ts:56:1***
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/chat-performance.test.ts:55:16
|
[No persona] › tests/chat-performance.test.ts:52:7 › Component renders during lesson chat › There are no unnecessary rerenders across left and right side of chat:
apps/nextjs/tests-e2e/tests/chat-performance.test.ts#L1
***) [No persona] › tests/chat-performance.test.ts:52:7 › Component renders during lesson chat › There are no unnecessary rerenders across left and right side of chat › Chat box keyboard input does not create rerenders in lesson plan
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of ***0000ms exceeded.
|
[No persona] › tests/chat-performance.test.ts:52:7 › Component renders during lesson chat › There are no unnecessary rerenders across left and right side of chat:
apps/nextjs/tests-e2e/tests/chat-performance.test.ts#L71
***) [No persona] › tests/chat-performance.test.ts:52:7 › Component renders during lesson chat › There are no unnecessary rerenders across left and right side of chat › Chat box keyboard input does not create rerenders in lesson plan
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: page.waitForFunction: Test timeout of ***0000ms exceeded.
69 | // console.log("Environment type:", process?.env?.NODE_ENV);
70 |
> 71 | await page.waitForFunction(
| ^
72 | () =>
7*** | window.reactScanLessonPlanDisplay &&
74 | typeof window.reactScanLessonPlanDisplay.renderCount === "number",
at verifyChatInputRenders (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/chat-performance.test.ts:71:16)
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/chat-performance.test.ts:56:1***
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/chat-performance.test.ts:55:16
|
[No persona] › tests/modifiy-lesson.test.ts:24:7 › Modify a lesson plan › Modify a lesson resource:
apps/nextjs/tests-e2e/tests/modifiy-lesson.test.ts#L15
4) [No persona] › tests/modifiy-lesson.test.ts:24:7 › Modify a lesson plan › Modify a lesson resource
Test timeout of ***0000ms exceeded while running "beforeEach" hook.
1*** | const generationTimeout = 50000;
14 |
> 15 | test.beforeEach(async ({ page }) => {
| ^
16 | await test.step("Setup", async () => {
17 | await bypassVercelProtection(page);
18 | const login = await prepareUser(page, "modify-lesson-plan");
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/modifiy-lesson.test.ts:15:8
|
test-e2e
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
test-e2e
Failed to restore: Cache service responded with 403
|
test-e2e
Can't add secret mask for empty string in ##[add-mask] command.
|
🎭 Playwright Run Summary
5 failed
[No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached
[No persona] › tests/banned-users.test.ts:10:5 › Users are banned after *** toxic lessons ────────
[No persona] › tests/chat-performance.test.ts:52:7 › Component renders during lesson chat › There are no unnecessary rerenders across left and right side of chat
[No persona] › tests/modifiy-lesson.test.ts:24:7 › Modify a lesson plan › Modify a lesson resource
[No persona] › tests/sharing.test.ts:***1:5 › sharing a lesson ───────────────────────────────────
1 skipped
6 did not run
5 passed (2.8m)
|