Testing stopped early after 10 maximum allowed failures.

1) [No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached › Send first message Error: Timed out 10000ms waiting for expect(locator).toContainText(expected) Locator: getByTestId('chat-message-wrapper-aila') Expected string: "Are the learning outcome and learning cycles appropriate for your pupils?" Received string: "" Call log: - expect.toContainText with timeout 10000ms - waiting for getByTestId('chat-message-wrapper-aila') - locator resolved to <div data-testid="chat-message-wrapper-aila" class="relative mt-14 w-full items-start rounded-md">…</div> - unexpected value "" - locator resolved to <div data-testid="chat-message-wrapper-aila" class="relative mt-14 w-full items-start rounded-md">…</div> - unexpected value "" - locator resolved to <div data-testid="chat-message-wrapper-aila" class="relative mt-14 w-full items-start rounded-md">…</div> - unexpected value "" - locator resolved to <div data-testid="chat-message-wrapper-aila" class="relative mt-14 w-full items-start rounded-md">…</div> - unexpected value "" - locator resolved to <div data-testid="chat-message-wrapper-aila" class="relative mt-14 w-full items-start rounded-md">…</div> - unexpected value "" - locator resolved to <div data-testid="chat-message-wrapper-aila" class="relative mt-14 w-full items-start rounded-md">…</div> - unexpected value "" - locator resolved to <div data-testid="chat-message-wrapper-aila" class="relative mt-14 w-full items-start rounded-md">…</div> - unexpected value "" - locator resolved to <div data-testid="chat-message-wrapper-aila" class="relative mt-14 w-full items-start rounded-md">…</div> - unexpected value "" - locator resolved to <div data-testid="chat-message-wrapper-aila" class="relative mt-14 w-full items-start rounded-md">…</div> - unexpected value "" - locator resolved to <div data-testid="chat-message-wrapper-aila" class="relative mt-14 w-full items-start rounded-md">…</div> - unexpected value "" - locator resolved to <div data-testid="chat-message-wrapper-aila" class="relative mt-14 w-full items-start rounded-md">…</div> - unexpected value "" - locator resolved to <div data-testid="chat-message-wrapper-aila" class="relative mt-14 w-full items-start rounded-md">…</div> - unexpected value "" - locator resolved to <div data-testid="chat-message-wrapper-aila" class="relative mt-14 w-full items-start rounded-md">…</div> - unexpected value "" - locator resolved to <div data-testid="chat-message-wrapper-aila" class="relative mt-14 w-full items-start rounded-md">…</div> - unexpected value "" 47 | page.getByTestId("chat-message-wrapper-error-generic"), 48 | ).not.toBeAttached(); > 49 | await expect(page.getByTestId("chat-message-wrapper-aila")).toContainText( | ^ 50 | "Are the learning outcome and learning cycles appropriate for your pupils?", 51 | { timeout: 10000 }, 52 | ); at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/rate-limiting.test.ts:49:65 at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/rate-limiting.test.ts:42:***

1) [No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached › Send first message Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 10000ms waiting for expect(locator).toContainText(expected) Locator: getByTestId('chat-message-wrapper-aila') Expected string: "Are the learning outcome and learning cycles appropriate for your pupils?" Received string: "" Call log: - expect.toContainText with timeout 10000ms - waiting for getByTestId('chat-message-wrapper-aila') - locator resolved to <div data-testid="chat-message-wrapper-aila" class="relative mt-14 w-full items-start rounded-md">…</div> - unexpected value "" - locator resolved to <div data-testid="chat-message-wrapper-aila" class="relative mt-14 w-full items-start rounded-md">…</div> - unexpected value "" - locator resolved to <div data-testid="chat-message-wrapper-aila" class="relative mt-14 w-full items-start rounded-md">…</div> - unexpected value "" - locator resolved to <div data-testid="chat-message-wrapper-aila" class="relative mt-14 w-full items-start rounded-md">…</div> - unexpected value "" - locator resolved to <div data-testid="chat-message-wrapper-aila" class="relative mt-14 w-full items-start rounded-md">…</div> - unexpected value "" - locator resolved to <div data-testid="chat-message-wrapper-aila" class="relative mt-14 w-full items-start rounded-md">…</div> - unexpected value "" - locator resolved to <div data-testid="chat-message-wrapper-aila" class="relative mt-14 w-full items-start rounded-md">…</div> - unexpected value "" - locator resolved to <div data-testid="chat-message-wrapper-aila" class="relative mt-14 w-full items-start rounded-md">…</div> - unexpected value "" - locator resolved to <div data-testid="chat-message-wrapper-aila" class="relative mt-14 w-full items-start rounded-md">…</div> - unexpected value "" - locator resolved to <div data-testid="chat-message-wrapper-aila" class="relative mt-14 w-full items-start rounded-md">…</div> - unexpected value "" - locator resolved to <div data-testid="chat-message-wrapper-aila" class="relative mt-14 w-full items-start rounded-md">…</div> - unexpected value "" - locator resolved to <div data-testid="chat-message-wrapper-aila" class="relative mt-14 w-full items-start rounded-md">…</div> - unexpected value "" - locator resolved to <div data-testid="chat-message-wrapper-aila" class="relative mt-14 w-full items-start rounded-md">…</div> - unexpected value "" - locator resolved to <div data-testid="chat-message-wrapper-aila" class="relative mt-14 w-full items-start rounded-md">…</div> - unexpected value "" 47 | page.getByTestId("chat-message-wrapper-error-generic"), 48 | ).not.toBeAttached(); > 49 | await expect(page.getByTestId("chat-message-wrapper-aila")).toContainText( | ^ 50 | "Are the learning outcome and learning cycles appropriate for your pupils?", 51 | { timeout: 10000 }, 52 | ); at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/rate-limiting.test.ts:49:65 at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/rate-limiting.test.ts:42:***

2) [No persona] › tests/banned-users.test.ts:10:5 › Users are banned after *** toxic lessons › Check account locked TimeoutError: page.waitForURL: Timeout 20000ms exceeded. =========================== logs =========================== waiting for navigation until "load" navigated to "https://oak-ai-lesson-assistant-d2e6zrfkj.vercel-preview.thenational.academy/aila/tRQB-F8l-zHgXrZO" navigated to "https://oak-ai-lesson-assistant-d2e6zrfkj.vercel-preview.thenational.academy/aila/tRQB-F8l-zHgXrZO" ============================================================ 41 | 42 | await test.step("Check account locked", async () => { > 4*** | await page.waitForURL(/\/legal\/account-locked/, { timeout: 20000 }); | ^ 44 | await expect(page.locator("h1")).toContainText("Account locked"); 45 | }); 46 | at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/banned-users.test.ts:4***:16 at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/banned-users.test.ts:42:14

2) [No persona] › tests/banned-users.test.ts:10:5 › Users are banned after *** toxic lessons › Check account locked Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── TimeoutError: page.waitForURL: Timeout 20000ms exceeded. =========================== logs =========================== waiting for navigation until "load" navigated to "https://oak-ai-lesson-assistant-d2e6zrfkj.vercel-preview.thenational.academy/aila/44unssXXqeqz8XS4" navigated to "https://oak-ai-lesson-assistant-d2e6zrfkj.vercel-preview.thenational.academy/aila/44unssXXqeqz8XS4" ============================================================ 41 | 42 | await test.step("Check account locked", async () => { > 4*** | await page.waitForURL(/\/legal\/account-locked/, { timeout: 20000 }); | ^ 44 | await expect(page.locator("h1")).toContainText("Account locked"); 45 | }); 46 | at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/banned-users.test.ts:4***:16 at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/banned-users.test.ts:42:14

***) [No persona] › tests/modifiy-lesson.test.ts:24:7 › Modify a lesson plan › Modify a lesson resource › Modify a lesson Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: locator('text=I can describe different software testing techniques.') Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 5000ms - waiting for locator('text=I can describe different software testing techniques.') 55 | "text=I can describe different software testing techniques.", 56 | ), > 57 | ).toBeVisible(); | ^ 58 | await expect( 59 | page.locator( 60 | "text=I've simplified the learning outcome. If this is suitable, please let me know or suggest further changes. Otherwise, tap Continue to proceed.", at modifyLessonResource (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/modifiy-lesson.test.ts:57:7) at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/modifiy-lesson.test.ts:28:7 at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/modifiy-lesson.test.ts:27:5

***) [No persona] › tests/modifiy-lesson.test.ts:24:7 › Modify a lesson plan › Modify a lesson resource › Modify a lesson Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: locator('text=I can describe different software testing techniques.') Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 5000ms - waiting for locator('text=I can describe different software testing techniques.') 55 | "text=I can describe different software testing techniques.", 56 | ), > 57 | ).toBeVisible(); | ^ 58 | await expect( 59 | page.locator( 60 | "text=I've simplified the learning outcome. If this is suitable, please let me know or suggest further changes. Otherwise, tap Continue to proceed.", at modifyLessonResource (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/modifiy-lesson.test.ts:57:7) at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/modifiy-lesson.test.ts:28:7 at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/modifiy-lesson.test.ts:27:5

4) [Common persona] › tests/aila-chat/full-romans.test.ts:2***:5 › Full aila flow with Romans fixture › Iterate through the fixtures Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected) Locator: getByTestId('chat-progress') Expected string: "10 of 10 sections complete" Received string: "0 of 10 sections complete" Call log: - expect.toHaveText with timeout 5000ms - waiting for getByTestId('chat-progress') - locator resolved to <button type="button" id="radix-:rk:" data-state="closed" aria-haspopup="menu" aria-expanded="***" data-testid="chat-progress" class="flex items-center gap-***">…</button> - unexpected value "0 of 10 sections complete" - locator resolved to <button type="button" id="radix-:rk:" data-state="closed" aria-haspopup="menu" aria-expanded="***" data-testid="chat-progress" class="flex items-center gap-***">…</button> - unexpected value "0 of 10 sections complete" - locator resolved to <button type="button" id="radix-:rk:" data-state="closed" aria-haspopup="menu" aria-expanded="***" data-testid="chat-progress" class="flex items-center gap-***">…</button> - unexpected value "0 of 10 sections complete" - locator resolved to <button type="button" id="radix-:rk:" data-state="closed" aria-haspopup="menu" aria-expanded="***" data-testid="chat-progress" class="flex items-center gap-***">…</button> - unexpected value "0 of 10 sections complete" - locator resolved to <button type="button" id="radix-:rk:" data-state="closed" aria-haspopup="menu" aria-expanded="***" data-testid="chat-progress" class="flex items-center gap-***">…</button> - unexpected value "0 of 10 sections complete" - locator resolved to <button type="button" id="radix-:rk:" data-state="closed" aria-haspopup="menu" aria-expanded="***" data-testid="chat-progress" class="flex items-center gap-***">…</button> - unexpected value "0 of 10 sections complete" - locator resolved to <button type="button" id="radix-:rk:" data-state="closed" aria-haspopup="menu" aria-expanded="***" data-testid="chat-progress" class="flex items-center gap-***">…</button> - unexpected value "0 of 10 sections complete" - locator resolved to <button type="button" id="radix-:rk:" data-state="closed" aria-haspopup="menu" aria-expanded="***" data-testid="chat-progress" class="flex items-center gap-***">…</button> - unexpected value "0 of 10 sections complete" - locator resolved to <button type="button" id="radix-:rk:" data-state="closed" aria-haspopup="menu" aria-expanded="***" data-testid="chat-progress" class="flex items-center gap-***">…</button> - unexpected value "0 of 10 sections complete" at tests/aila-chat/helpers.ts:61 59 | 60 | export async function expectFinished(page: Page) { > 61 | await expect(page.getByTestId("chat-progress")).toHaveText( | ^ 62 | "10 of 10 sections complete", 6*** | ); 64 | } at expectFinished (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:61:51) at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/full-romans.test.ts:90:27 at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/full-romans.test.ts:55:5

4) [Common persona] › tests/aila-chat/full-romans.test.ts:2***:5 › Full aila flow with Romans fixture › Iterate through the fixtures Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Test was interrupted.

5) [Common persona - mobile] › tests/aila-chat/full-romans.mobile.test.ts:***6:5 › Full aila flow with Romans fixture Error: Timed out 5000ms waiting for expect(locator).toContainText(expected) Locator: getByTestId('chat-input') Expected string: "Create a KS1 lesson on the end of Roman Britain" Received string: "" Call log: - expect.toContainText with timeout 5000ms - waiting for getByTestId('chat-input') - locator resolved to <textarea rows="1" required="" tabindex="0" spellcheck="***" data-testid="chat-input" placeholder="Subject, key stage and title" class="min-h-[60px] w-full resize-none bg-transparent px-10 py-[1.***rem] text-lg focus-within:outline-none"></textarea> - unexpected value "" - locator resolved to <textarea rows="1" required="" tabindex="0" spellcheck="***" data-testid="chat-input" placeholder="Subject, key stage and title" class="min-h-[60px] w-full resize-none bg-transparent px-10 py-[1.***rem] text-lg focus-within:outline-none"></textarea> - unexpected value "" - locator resolved to <textarea rows="1" required="" tabindex="0" spellcheck="***" data-testid="chat-input" placeholder="Subject, key stage and title" class="min-h-[60px] w-full resize-none bg-transparent px-10 py-[1.***rem] text-lg focus-within:outline-none"></textarea> - unexpected value "" - locator resolved to <textarea rows="1" required="" tabindex="0" spellcheck="***" data-testid="chat-input" placeholder="Subject, key stage and title" class="min-h-[60px] w-full resize-none bg-transparent px-10 py-[1.***rem] text-lg focus-within:outline-none"></textarea> - unexpected value "" - locator resolved to <textarea rows="1" required="" tabindex="0" spellcheck="***" data-testid="chat-input" placeholder="Subject, key stage and title" class="min-h-[60px] w-full resize-none bg-transparent px-10 py-[1.***rem] text-lg focus-within:outline-none"></textarea> - unexpected value "" - locator resolved to <textarea rows="1" required="" tabindex="0" spellcheck="***" data-testid="chat-input" placeholder="Subject, key stage and title" class="min-h-[60px] w-full resize-none bg-transparent px-10 py-[1.***rem] text-lg focus-within:outline-none"></textarea> - unexpected value "" - locator resolved to <textarea rows="1" required="" tabindex="0" spellcheck="***" data-testid="chat-input" placeholder="Subject, key stage and title" class="min-h-[60px] w-full resize-none bg-transparent px-10 py-[1.***rem] text-lg focus-within:outline-none"></textarea> - unexpected value "" - locator resolved to <textarea rows="1" required="" tabindex="0" spellcheck="***" data-testid="chat-input" placeholder="Subject, key stage and title" class="min-h-[60px] w-full resize-none bg-transparent px-10 py-[1.***rem] text-lg focus-within:outline-none"></textarea> - unexpected value "" - locator resolved to <textarea rows="1" required="" tabindex="0" spellcheck="***" data-testid="chat-input" placeholder="Subject, key stage and title" class="min-h-[60px] w-full resize-none bg-transparent px-10 py-[1.***rem] text-lg focus-within:outline-none"></textarea> - unexpected value "" 56 | const message = "Create a KS1 lesson on the end of Roman Britain"; 57 | await textbox.fill(message); > 58 | await expect(textbox).toContainText(message); | ^ 59 | 60 | // Temporary fix: The test goes quicker than a real user and submits before the demo status has loaded 61 | // This means that a demo modal would be shown when submitting at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/full-romans.mobile.test.ts:58:29 at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/full-romans.mobile.test.ts:5***:5

ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636

Failed to restore: Cache service responded with 403

apps/nextjs/[No persona] › tests/sharing.test.ts took 16.***s

Can't add secret mask for empty string in ##[add-mask] command.