Skip to content

Playwright

Playwright #2212

Triggered via deployment status December 11, 2024 11:38
Status Failure
Total duration 3m 44s
Artifacts

playwright.yml

on: deployment_status
Fit to window
Zoom out
Zoom in

Annotations

10 errors, 4 warnings, and 1 notice
test-e2e
Testing stopped early after 10 maximum allowed failures.
[No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached: apps/nextjs/tests-e2e/tests/aila-chat/rate-limiting.test.ts#L1
1) [No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached › Setup › Prepare user TRPCClientError: Internal server error at Function.from (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/node_modules/@trpc/client/dist/TRPCClientError-7e0c***1e7.js:29:20) at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/node_modules/@trpc/client/dist/httpBatchLink-6b5ba6***8.js:191:76
[No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached: apps/nextjs/tests-e2e/tests/aila-chat/rate-limiting.test.ts#L1
1) [No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached › Setup › Prepare user Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── TRPCClientError: Internal server error at Function.from (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/node_modules/@trpc/client/dist/TRPCClientError-7e0c***1e7.js:29:20) at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/node_modules/@trpc/client/dist/httpBatchLink-6b5ba6***8.js:191:76
[No persona] › tests/banned-users.test.ts:10:5 › Users are banned after 3 toxic lessons: apps/nextjs/tests-e2e/tests/banned-users.test.ts#L43
2) [No persona] › tests/banned-users.test.ts:10:5 › Users are banned after *** toxic lessons › Check account locked TimeoutError: page.waitForURL: Timeout 20000ms exceeded. =========================== logs =========================== waiting for navigation until "load" navigated to "https://oak-ai-lesson-assistant-1jfv***7o85.vercel-preview.thenational.academy/aila/0zODDwRUwsr4CaCq" navigated to "https://oak-ai-lesson-assistant-1jfv***7o85.vercel-preview.thenational.academy/aila/0zODDwRUwsr4CaCq" ============================================================ 41 | 42 | await test.step("Check account locked", async () => { > 4*** | await page.waitForURL(/\/legal\/account-locked/, { timeout: 20000 }); | ^ 44 | await expect(page.locator("h1")).toContainText("Account locked"); 45 | }); 46 | at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/banned-users.test.ts:4***:16 at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/banned-users.test.ts:42:14
[No persona] › tests/banned-users.test.ts:10:5 › Users are banned after 3 toxic lessons: apps/nextjs/tests-e2e/tests/banned-users.test.ts#L43
2) [No persona] › tests/banned-users.test.ts:10:5 › Users are banned after *** toxic lessons › Check account locked Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── TimeoutError: page.waitForURL: Timeout 20000ms exceeded. =========================== logs =========================== waiting for navigation until "load" navigated to "https://oak-ai-lesson-assistant-1jfv***7o85.vercel-preview.thenational.academy/aila/TgHGhF_tERPFHNTC" navigated to "https://oak-ai-lesson-assistant-1jfv***7o85.vercel-preview.thenational.academy/aila/TgHGhF_tERPFHNTC" ============================================================ 41 | 42 | await test.step("Check account locked", async () => { > 4*** | await page.waitForURL(/\/legal\/account-locked/, { timeout: 20000 }); | ^ 44 | await expect(page.locator("h1")).toContainText("Account locked"); 45 | }); 46 | at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/banned-users.test.ts:4***:16 at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/banned-users.test.ts:42:14
[No persona] › tests/modifiy-lesson.test.ts:24:7 › Modify a lesson plan › Modify a lesson resource: apps/nextjs/tests-e2e/tests/modifiy-lesson.test.ts#L1
***) [No persona] › tests/modifiy-lesson.test.ts:24:7 › Modify a lesson plan › Modify a lesson resource TRPCClientError: Internal server error at Function.from (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/node_modules/@trpc/client/dist/TRPCClientError-7e0c***1e7.js:29:20) at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/node_modules/@trpc/client/dist/httpBatchLink-6b5ba6***8.js:191:76
[No persona] › tests/modifiy-lesson.test.ts:24:7 › Modify a lesson plan › Modify a lesson resource: apps/nextjs/tests-e2e/tests/modifiy-lesson.test.ts#L1
***) [No persona] › tests/modifiy-lesson.test.ts:24:7 › Modify a lesson plan › Modify a lesson resource Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── TRPCClientError: Internal server error at Function.from (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/node_modules/@trpc/client/dist/TRPCClientError-7e0c***1e7.js:29:20) at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/node_modules/@trpc/client/dist/httpBatchLink-6b5ba6***8.js:191:76
[Common persona] › tests/aila-chat/full-romans.test.ts:23:5 › Full aila flow with Romans fixture: apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts#L61
4) [Common persona] › tests/aila-chat/full-romans.test.ts:2***:5 › Full aila flow with Romans fixture › Iterate through the fixtures Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected) Locator: getByTestId('chat-progress') Expected string: "10 of 10 sections complete" Received string: "0 of 10 sections complete" Call log: - expect.toHaveText with timeout 5000ms - waiting for getByTestId('chat-progress') - locator resolved to <button type="button" id="radix-:rq:" data-state="closed" aria-haspopup="menu" aria-expanded="***" data-testid="chat-progress" class="flex items-center gap-***">…</button> - unexpected value "0 of 10 sections complete" - locator resolved to <button type="button" id="radix-:rq:" data-state="closed" aria-haspopup="menu" aria-expanded="***" data-testid="chat-progress" class="flex items-center gap-***">…</button> - unexpected value "0 of 10 sections complete" - locator resolved to <button type="button" id="radix-:rq:" data-state="closed" aria-haspopup="menu" aria-expanded="***" data-testid="chat-progress" class="flex items-center gap-***">…</button> - unexpected value "0 of 10 sections complete" - locator resolved to <button type="button" id="radix-:rq:" data-state="closed" aria-haspopup="menu" aria-expanded="***" data-testid="chat-progress" class="flex items-center gap-***">…</button> - unexpected value "0 of 10 sections complete" - locator resolved to <button type="button" id="radix-:rq:" data-state="closed" aria-haspopup="menu" aria-expanded="***" data-testid="chat-progress" class="flex items-center gap-***">…</button> - unexpected value "0 of 10 sections complete" - locator resolved to <button type="button" id="radix-:rq:" data-state="closed" aria-haspopup="menu" aria-expanded="***" data-testid="chat-progress" class="flex items-center gap-***">…</button> - unexpected value "0 of 10 sections complete" - locator resolved to <button type="button" id="radix-:rq:" data-state="closed" aria-haspopup="menu" aria-expanded="***" data-testid="chat-progress" class="flex items-center gap-***">…</button> - unexpected value "0 of 10 sections complete" - locator resolved to <button type="button" id="radix-:rq:" data-state="closed" aria-haspopup="menu" aria-expanded="***" data-testid="chat-progress" class="flex items-center gap-***">…</button> - unexpected value "0 of 10 sections complete" - locator resolved to <button type="button" id="radix-:rq:" data-state="closed" aria-haspopup="menu" aria-expanded="***" data-testid="chat-progress" class="flex items-center gap-***">…</button> - unexpected value "0 of 10 sections complete" at tests/aila-chat/helpers.ts:61 59 | 60 | export async function expectFinished(page: Page) { > 61 | await expect(page.getByTestId("chat-progress")).toHaveText( | ^ 62 | "10 of 10 sections complete", 6*** | ); 64 | } at expectFinished (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:61:51) at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/full-romans.test.ts:90:27 at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/full-romans.test.ts:55:5
[Common persona] › tests/aila-chat/full-romans.test.ts:23:5 › Full aila flow with Romans fixture: apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts#L61
4) [Common persona] › tests/aila-chat/full-romans.test.ts:2***:5 › Full aila flow with Romans fixture › Iterate through the fixtures Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected) Locator: getByTestId('chat-progress') Expected string: "10 of 10 sections complete" Received string: "0 of 10 sections complete" Call log: - expect.toHaveText with timeout 5000ms - waiting for getByTestId('chat-progress') - locator resolved to <button type="button" id="radix-:rq:" data-state="closed" aria-haspopup="menu" aria-expanded="***" data-testid="chat-progress" class="flex items-center gap-***">…</button> - unexpected value "0 of 10 sections complete" - locator resolved to <button type="button" id="radix-:rq:" data-state="closed" aria-haspopup="menu" aria-expanded="***" data-testid="chat-progress" class="flex items-center gap-***">…</button> - unexpected value "0 of 10 sections complete" - locator resolved to <button type="button" id="radix-:rq:" data-state="closed" aria-haspopup="menu" aria-expanded="***" data-testid="chat-progress" class="flex items-center gap-***">…</button> - unexpected value "0 of 10 sections complete" - locator resolved to <button type="button" id="radix-:rq:" data-state="closed" aria-haspopup="menu" aria-expanded="***" data-testid="chat-progress" class="flex items-center gap-***">…</button> - unexpected value "0 of 10 sections complete" - locator resolved to <button type="button" id="radix-:rq:" data-state="closed" aria-haspopup="menu" aria-expanded="***" data-testid="chat-progress" class="flex items-center gap-***">…</button> - unexpected value "0 of 10 sections complete" - locator resolved to <button type="button" id="radix-:rq:" data-state="closed" aria-haspopup="menu" aria-expanded="***" data-testid="chat-progress" class="flex items-center gap-***">…</button> - unexpected value "0 of 10 sections complete" - locator resolved to <button type="button" id="radix-:rq:" data-state="closed" aria-haspopup="menu" aria-expanded="***" data-testid="chat-progress" class="flex items-center gap-***">…</button> - unexpected value "0 of 10 sections complete" - locator resolved to <button type="button" id="radix-:rq:" data-state="closed" aria-haspopup="menu" aria-expanded="***" data-testid="chat-progress" class="flex items-center gap-***">…</button> - unexpected value "0 of 10 sections complete" - locator resolved to <button type="button" id="radix-:rq:" data-state="closed" aria-haspopup="menu" aria-expanded="***" data-testid="chat-progress" class="flex items-center gap-***">…</button> - unexpected value "0 of 10 sections complete" at tests/aila-chat/helpers.ts:61 59 | 60 | export async function expectFinished(page: Page) { > 61 | await expect(page.getByTestId("chat-progress")).toHaveText( | ^ 62 | "10 of 10 sections complete", 6*** | ); 64 | } at expectFinished (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:61:51) at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/full-romans.test.ts:90:27 at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/full-romans.test.ts:55:5
[Common persona - mobile] › tests/aila-chat/full-romans.mobile.test.ts:36:5 › Full aila flow with Romans fixture: apps/nextjs/tests-e2e/tests/aila-chat/full-romans.mobile.test.ts#L33
5) [Common persona - mobile] › tests/aila-chat/full-romans.mobile.test.ts:***6:5 › Full aila flow with Romans fixture › Iterate through the fixtures Error: Timed out 5000ms waiting for expect(locator).toBeInViewport() Locator: getByTestId('chat-right-hand-side-lesson') Expected: in viewport Received: outside viewport Call log: - expect.toBeInViewport with timeout 5000ms - waiting for getByTestId('chat-right-hand-side-lesson') - locator resolved to <div data-testid="chat-right-hand-side-lesson" class="fixed bottom-0 right-[-100%] sm:right-0 right-0 top-0 z-***0 w-[95%] bg-white shadow-md duration-***00 sm:relative sm:z-0 sm:w-[50%] sm:shadow-none lg:w-full">…</div> - unexpected value "viewport ratio 0" - locator resolved to <div data-testid="chat-right-hand-side-lesson" class="fixed bottom-0 right-[-100%] sm:right-0 right-0 top-0 z-***0 w-[95%] bg-white shadow-md duration-***00 sm:relative sm:z-0 sm:w-[50%] sm:shadow-none lg:w-full">…</div> - unexpected value "viewport ratio 0" - locator resolved to <div data-testid="chat-right-hand-side-lesson" class="fixed bottom-0 right-[-100%] sm:right-0 right-0 top-0 z-***0 w-[95%] bg-white shadow-md duration-***00 sm:relative sm:z-0 sm:w-[50%] sm:shadow-none lg:w-full">…</div> - unexpected value "viewport ratio 0" - locator resolved to <div data-testid="chat-right-hand-side-lesson" class="fixed bottom-0 right-[-100%] sm:right-0 right-0 top-0 z-***0 w-[95%] bg-white shadow-md duration-***00 sm:relative sm:z-0 sm:w-[50%] sm:shadow-none lg:w-full">…</div> - unexpected value "viewport ratio 0" - locator resolved to <div data-testid="chat-right-hand-side-lesson" class="fixed bottom-0 right-[-100%] sm:right-0 right-0 top-0 z-***0 w-[95%] bg-white shadow-md duration-***00 sm:relative sm:z-0 sm:w-[50%] sm:shadow-none lg:w-full">…</div> - unexpected value "viewport ratio 0" - locator resolved to <div data-testid="chat-right-hand-side-lesson" class="fixed bottom-0 right-[-100%] sm:right-0 right-0 top-0 z-***0 w-[95%] bg-white shadow-md duration-***00 sm:relative sm:z-0 sm:w-[50%] sm:shadow-none lg:w-full">…</div> - unexpected value "viewport ratio 0" - locator resolved to <div data-testid="chat-right-hand-side-lesson" class="fixed bottom-0 right-[-100%] sm:right-0 right-0 top-0 z-***0 w-[95%] bg-white shadow-md duration-***00 sm:relative sm:z-0 sm:w-[50%] sm:shadow-none lg:w-full">…</div> - unexpected value "viewport ratio 0" - locator resolved to <div data-testid="chat-right-hand-side-lesson" class="fixed bottom-0 right-[-100%] sm:right-0 right-0 top-0 z-***0 w-[95%] bg-white shadow-md duration-***00 sm:relative sm:z-0 sm:w-[50%] sm:shadow-none lg:w-full">…</div> - unexpected value "viewport ratio 0" - locator resolved to <div data-testid="chat-right-hand-side-lesson" class="fixed bottom-0 right-[-100%] sm:right-0 right-0 top-0 z-***0 w-[95%] bg-white shadow-md duration-***00 sm:relative sm:z-0 sm:w-[50%] sm:shadow-none lg:w-full">…</div> - unexpected value "viewport ratio 0" ***1 | await expect( ***2 | page.getByTestId("chat-right-hand-side-lesson"), > *** | ).toBeInViewport(); | ^ ***4 | } ***5 | ***6 | test( at expectPreviewVisible (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/full-romans.mobile.test.ts:***:5) at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/full-romans.mobile.test.ts:72:7 at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/full-romans.mobile.test.ts:68:5
test-e2e
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
test-e2e
Failed to restore: Cache service responded with 403
Slow Test: apps/nextjs/[Common persona] › tests/aila-chat/downloads.test.ts#L1
apps/nextjs/[Common persona] › tests/aila-chat/downloads.test.ts took 16.6s
test-e2e
Can't add secret mask for empty string in ##[add-mask] command.
🎭 Playwright Run Summary
5 failed [No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached [No persona] › tests/banned-users.test.ts:10:5 › Users are banned after *** toxic lessons ──────── [No persona] › tests/modifiy-lesson.test.ts:24:7 › Modify a lesson plan › Modify a lesson resource [Common persona] › tests/aila-chat/full-romans.test.ts:2***:5 › Full aila flow with Romans fixture [Common persona - mobile] › tests/aila-chat/full-romans.mobile.test.ts:***6:5 › Full aila flow with Romans fixture 1 skipped 10 passed (2.0m)