Playwright #1774
Triggered via deployment status
November 13, 2024 15:33
vercel[bot]
created
f9b83ed
Status
Failure
Total duration
13m 47s
Artifacts
–
Annotations
10 errors, 3 warnings, and 1 notice
test-e2e
Testing stopped early after 10 maximum allowed failures.
|
[No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached:
apps/nextjs/tests-e2e/tests/aila-chat/rate-limiting.test.ts#L1
1) [No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached
Test timeout of 60000ms exceeded.
|
[No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached:
apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts#L52
1) [No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached
Error: locator.click: Test timeout of 60000ms exceeded.
Call log:
- waiting for getByTestId('chat-continue')
at tests/aila-chat/helpers.ts:52
50 |
51 | export async function continueChat(page: Page) {
> 52 | await page.getByTestId("chat-continue").click();
| ^
5*** | }
54 |
55 | export async function isFinished(page: Page) {
at continueChat (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:52:4***)
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/rate-limiting.test.ts:56:2***
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/rate-limiting.test.ts:55:14
|
[No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached:
apps/nextjs/tests-e2e/tests/aila-chat/rate-limiting.test.ts#L1
1) [No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 60000ms exceeded.
|
[No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached:
apps/nextjs/tests-e2e/tests/aila-chat/rate-limiting.test.ts#L19
1) [No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: page.goto: Test timeout of 60000ms exceeded.
Call log:
- navigating to "https://oak-ai-lesson-assistant-qgabkaikx.vercel-preview.thenational.academy/aila", waiting until "load"
17 | await prepareUser(page, "nearly-rate-limited");
18 |
> 19 | await page.goto(`${TEST_BASE_URL}/aila`);
| ^
20 | await expect(page.getByTestId("chat-h1")).toBeInViewport();
21 | });
22 |
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/rate-limiting.test.ts:19:16
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/rate-limiting.test.ts:15:***
|
[No persona] › tests/modifiy-lesson.test.ts:24:7 › Modify a lesson plan › Modify a lesson resource:
apps/nextjs/tests-e2e/tests/modifiy-lesson.test.ts#L1
2) [No persona] › tests/modifiy-lesson.test.ts:24:7 › Modify a lesson plan › Modify a lesson resource › Add additional material › Wait for generation
Test timeout of ***0000ms exceeded.
|
[No persona] › tests/modifiy-lesson.test.ts:24:7 › Modify a lesson plan › Modify a lesson resource:
apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts#L12
2) [No persona] › tests/modifiy-lesson.test.ts:24:7 › Modify a lesson plan › Modify a lesson resource › Add additional material › Wait for generation
Error: expect(locator).toContainText(expected)
Locator: getByTestId('chat-aila-streaming-status')
Expected string: "Idle"
Received: <element(s) not found>
Call log:
- expect.toContainText with timeout 50000ms
- waiting for getByTestId('chat-aila-streaming-status')
- locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div>
- unexpected value "RequestMade"
- locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div>
- unexpected value "RequestMade"
- locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div>
- unexpected value "RequestMade"
- locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div>
- unexpected value "RequestMade"
- locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div>
- unexpected value "RequestMade"
at tests/aila-chat/helpers.ts:12
10 | ) {
11 | const statusElement = page.getByTestId("chat-aila-streaming-status");
> 12 | await expect(statusElement).toContainText(status, args);
| ^
1*** | }
14 |
15 | export async function waitForStreamingStatusChange(
at expectStreamingStatus (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:12:***1)
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:45:11
at waitForGeneration (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:4***:10)
at selectAdditionalResource (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/modifiy-lesson.test.ts:88:5)
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/modifiy-lesson.test.ts:***6:7
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/modifiy-lesson.test.ts:***5:5
|
[No persona] › tests/modifiy-lesson.test.ts:24:7 › Modify a lesson plan › Modify a lesson resource:
apps/nextjs/tests-e2e/tests/modifiy-lesson.test.ts#L1
2) [No persona] › tests/modifiy-lesson.test.ts:24:7 › Modify a lesson plan › Modify a lesson resource › Add additional material › Wait for generation
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of ***0000ms exceeded.
|
[No persona] › tests/modifiy-lesson.test.ts:24:7 › Modify a lesson plan › Modify a lesson resource:
apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts#L12
2) [No persona] › tests/modifiy-lesson.test.ts:24:7 › Modify a lesson plan › Modify a lesson resource › Add additional material › Wait for generation
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(locator).toContainText(expected)
Locator: getByTestId('chat-aila-streaming-status')
Expected string: "Idle"
Received: <element(s) not found>
Call log:
- expect.toContainText with timeout 50000ms
- waiting for getByTestId('chat-aila-streaming-status')
- locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div>
- unexpected value "RequestMade"
- locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div>
- unexpected value "RequestMade"
- locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div>
- unexpected value "RequestMade"
- locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div>
- unexpected value "RequestMade"
- locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div>
- unexpected value "RequestMade"
at tests/aila-chat/helpers.ts:12
10 | ) {
11 | const statusElement = page.getByTestId("chat-aila-streaming-status");
> 12 | await expect(statusElement).toContainText(status, args);
| ^
1*** | }
14 |
15 | export async function waitForStreamingStatusChange(
at expectStreamingStatus (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:12:***1)
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:45:11
at waitForGeneration (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:4***:10)
at selectAdditionalResource (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/modifiy-lesson.test.ts:88:5)
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/modifiy-lesson.test.ts:***6:7
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/modifiy-lesson.test.ts:***5:5
|
[No persona] › tests/sharing.test.ts:32:5 › sharing a lesson:
apps/nextjs/tests-e2e/tests/sharing.test.ts#L11
***) [No persona] › tests/sharing.test.ts:***2:5 › sharing a lesson › Share page ─────────────────────
Error: Timed out 5000ms waiting for expect(locator).toContainText(expected)
Locator: getByTestId('share-banner')
Expected pattern: /Created by .+ sharing-chat/
Received: <element(s) not found>
Call log:
- expect.toContainText with timeout 5000ms
- waiting for getByTestId('share-banner')
9 | const checkPage = async (page: Page) => {
10 | const banner = page.getByTestId("share-banner");
> 11 | await expect(banner).toContainText(/Created by .+ sharing-chat/);
| ^
12 | await expect(banner).toContainText("Please check content carefully");
1*** |
14 | const keyStageSubjectTitle = page.getByTestId("key-stage-subject");
at checkPage (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/sharing.test.ts:11:24)
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/sharing.test.ts:76:11
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/sharing.test.ts:74:***
|
test-e2e
Failed to restore: Cache service responded with 403
|
Slow Test:
apps/nextjs/[No persona] › tests/banned-users.test.ts#L1
apps/nextjs/[No persona] › tests/banned-users.test.ts took 19.7s
|
test-e2e
Can't add secret mask for empty string in ##[add-mask] command.
|
🎭 Playwright Run Summary
5 failed
[No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached
[No persona] › tests/modifiy-lesson.test.ts:24:7 › Modify a lesson plan › Modify a lesson resource
[No persona] › tests/sharing.test.ts:***2:5 › sharing a lesson ───────────────────────────────────
[Common persona] › tests/aila-chat/full-romans.test.ts:2***:5 › Full aila flow with Romans fixture
[Common persona - mobile] › tests/aila-chat/full-romans.mobile.test.ts:***6:5 › Full aila flow with Romans fixture
1 skipped
10 passed (10.9m)
|