Playwright #1808
Triggered via deployment status
November 15, 2024 15:52
vercel[bot]
created
b167a06
Status
Failure
Total duration
8m 30s
Artifacts
–
Annotations
10 errors, 3 warnings, and 1 notice
test-e2e
Testing stopped early after 10 maximum allowed failures.
|
[No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached:
apps/nextjs/tests-e2e/tests/aila-chat/rate-limiting.test.ts#L1
1) [No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached › Send first message
Test timeout of 60000ms exceeded.
|
[No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached:
apps/nextjs/tests-e2e/tests/aila-chat/rate-limiting.test.ts#L43
1) [No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached › Send first message
Error: page.waitForURL: Test timeout of 60000ms exceeded.
=========================== logs ===========================
waiting for navigation until "load"
============================================================
41 |
42 | await test.step("Send first message", async () => {
> 4*** | await page.waitForURL(/\/aila\/.+/);
| ^
44 | await waitForGeneration(page, GENERATION_TIMEOUT);
45 |
46 | await expect(
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/rate-limiting.test.ts:4***:16
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/rate-limiting.test.ts:42:14
|
[No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached:
apps/nextjs/tests-e2e/tests/aila-chat/rate-limiting.test.ts#L1
1) [No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached › Send first message
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 60000ms exceeded.
|
[No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached:
apps/nextjs/tests-e2e/tests/aila-chat/rate-limiting.test.ts#L43
1) [No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached › Send first message
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: page.waitForURL: Test timeout of 60000ms exceeded.
=========================== logs ===========================
waiting for navigation until "load"
============================================================
41 |
42 | await test.step("Send first message", async () => {
> 4*** | await page.waitForURL(/\/aila\/.+/);
| ^
44 | await waitForGeneration(page, GENERATION_TIMEOUT);
45 |
46 | await expect(
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/rate-limiting.test.ts:4***:16
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/rate-limiting.test.ts:42:14
|
[No persona] › tests/banned-users.test.ts:10:5 › Users are banned after 3 toxic lessons:
apps/nextjs/tests-e2e/tests/banned-users.test.ts#L1
2) [No persona] › tests/banned-users.test.ts:10:5 › Users are banned after *** toxic lessons › Wait for streaming
Test timeout of ***0000ms exceeded.
|
[No persona] › tests/banned-users.test.ts:10:5 › Users are banned after 3 toxic lessons:
apps/nextjs/tests-e2e/tests/banned-users.test.ts#L38
2) [No persona] › tests/banned-users.test.ts:10:5 › Users are banned after *** toxic lessons › Wait for streaming
Error: page.waitForURL: Test timeout of ***0000ms exceeded.
=========================== logs ===========================
waiting for navigation until "load"
============================================================
***6 |
***7 | await test.step("Wait for streaming", async () => {
> ***8 | await page.waitForURL(/\/aila\/.+/);
| ^
***9 | await expectStreamingStatus(page, "RequestMade", { timeout: 10000 });
40 | });
41 |
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/banned-users.test.ts:***8:16
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/banned-users.test.ts:***7:14
|
[No persona] › tests/banned-users.test.ts:10:5 › Users are banned after 3 toxic lessons:
apps/nextjs/tests-e2e/tests/banned-users.test.ts#L1
2) [No persona] › tests/banned-users.test.ts:10:5 › Users are banned after *** toxic lessons › Wait for streaming
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of ***0000ms exceeded.
|
[No persona] › tests/banned-users.test.ts:10:5 › Users are banned after 3 toxic lessons:
apps/nextjs/tests-e2e/tests/banned-users.test.ts#L38
2) [No persona] › tests/banned-users.test.ts:10:5 › Users are banned after *** toxic lessons › Wait for streaming
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: page.waitForURL: Test timeout of ***0000ms exceeded.
=========================== logs ===========================
waiting for navigation until "load"
============================================================
***6 |
***7 | await test.step("Wait for streaming", async () => {
> ***8 | await page.waitForURL(/\/aila\/.+/);
| ^
***9 | await expectStreamingStatus(page, "RequestMade", { timeout: 10000 });
40 | });
41 |
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/banned-users.test.ts:***8:16
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/banned-users.test.ts:***7:14
|
[No persona] › tests/modifiy-lesson.test.ts:24:7 › Modify a lesson plan › Modify a lesson resource:
apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts#L12
***) [No persona] › tests/modifiy-lesson.test.ts:24:7 › Modify a lesson plan › Modify a lesson resource › Modify a lesson › Wait for generation
Error: Timed out 5000ms waiting for expect(locator).toContainText(expected)
Locator: getByTestId('chat-aila-streaming-status')
Expected string: "RequestMade"
Received: <element(s) not found>
Call log:
- expect.toContainText with timeout 5000ms
- waiting for getByTestId('chat-aila-streaming-status')
at tests/aila-chat/helpers.ts:12
10 | ) {
11 | const statusElement = page.getByTestId("chat-aila-streaming-status");
> 12 | await expect(statusElement).toContainText(status, args);
| ^
1*** | }
14 |
15 | export async function waitForStreamingStatusChange(
at expectStreamingStatus (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:12:***1)
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:44:11
at waitForGeneration (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:4***:21)
at modifyLessonResource (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/modifiy-lesson.test.ts:51:28)
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/modifiy-lesson.test.ts:28:7
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/modifiy-lesson.test.ts:27:5
|
test-e2e
Failed to restore: Cache service responded with 403
|
Slow Test:
apps/nextjs/[Common persona - mobile] › tests/aila-chat/full-romans.mobile.test.ts#L1
apps/nextjs/[Common persona - mobile] › tests/aila-chat/full-romans.mobile.test.ts took 4.2m
|
test-e2e
Can't add secret mask for empty string in ##[add-mask] command.
|
🎭 Playwright Run Summary
6 failed
[No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached
[No persona] › tests/banned-users.test.ts:10:5 › Users are banned after *** toxic lessons ────────
[No persona] › tests/modifiy-lesson.test.ts:24:7 › Modify a lesson plan › Modify a lesson resource
[No persona] › tests/sharing.test.ts:***2:5 › sharing a lesson ───────────────────────────────────
[Common persona] › tests/aila-chat/full-romans.test.ts:2***:5 › Full aila flow with Romans fixture
[Common persona - mobile] › tests/aila-chat/full-romans.mobile.test.ts:***6:5 › Full aila flow with Romans fixture
1 skipped
9 passed (6.7m)
|