Skip to content

Playwright

Playwright #1768

Triggered via deployment status November 13, 2024 13:05
Status Failure
Total duration 5m 39s
Artifacts

playwright.yml

on: deployment_status
Fit to window
Zoom out
Zoom in

Annotations

7 errors, 3 warnings, and 1 notice
[No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached: apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts#L12
1) [No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached › Send first message › Wait for generation Error: Timed out ***0000ms waiting for expect(locator).toContainText(expected) Locator: getByTestId('chat-aila-streaming-status') Expected string: "Idle" Received: <element(s) not found> Call log: - expect.toContainText with timeout ***0000ms - waiting for getByTestId('chat-aila-streaming-status') - locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div> - unexpected value "RequestMade" - locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div> - unexpected value "RequestMade" - locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div> - unexpected value "RequestMade" - locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div> - unexpected value "RequestMade" - locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div> - unexpected value "RequestMade" - locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div> - unexpected value "RequestMade" - locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div> - unexpected value "RequestMade" - locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div> - unexpected value "RequestMade" - locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div> - unexpected value "RequestMade" - locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div> - unexpected value "RequestMade" at tests/aila-chat/helpers.ts:12 10 | ) { 11 | const statusElement = page.getByTestId("chat-aila-streaming-status"); > 12 | await expect(statusElement).toContainText(status, args); | ^ 1*** | } 14 | 15 | export async function waitForStreamingStatusChange( at expectStreamingStatus (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:12:***1) at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:45:11 at waitForGeneration (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:4***:10) at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/rate-limiting.test.ts:44:5 at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/rate-limiting.test.ts:42:***
[No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached: apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts#L12
1) [No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached › Send first message › Wait for generation Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out ***0000ms waiting for expect(locator).toContainText(expected) Locator: getByTestId('chat-aila-streaming-status') Expected string: "Idle" Received: <element(s) not found> Call log: - expect.toContainText with timeout ***0000ms - waiting for getByTestId('chat-aila-streaming-status') - locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div> - unexpected value "RequestMade" - locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div> - unexpected value "RequestMade" - locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div> - unexpected value "RequestMade" - locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div> - unexpected value "RequestMade" - locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div> - unexpected value "RequestMade" - locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div> - unexpected value "RequestMade" - locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div> - unexpected value "RequestMade" - locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div> - unexpected value "RequestMade" - locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div> - unexpected value "RequestMade" - locator resolved to <div data-testid="chat-aila-streaming-status">StreamingExperimentalPatches</div> - unexpected value "StreamingExperimentalPatches" at tests/aila-chat/helpers.ts:12 10 | ) { 11 | const statusElement = page.getByTestId("chat-aila-streaming-status"); > 12 | await expect(statusElement).toContainText(status, args); | ^ 1*** | } 14 | 15 | export async function waitForStreamingStatusChange( at expectStreamingStatus (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:12:***1) at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:45:11 at waitForGeneration (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:4***:10) at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/rate-limiting.test.ts:44:5 at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/rate-limiting.test.ts:42:***
[Common persona] › tests/aila-chat/full-romans.test.ts:23:5 › Full aila flow with Romans fixture: apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts#L21
2) [Common persona] › tests/aila-chat/full-romans.test.ts:2***:5 › Full aila flow with Romans fixture › Iterate through the fixtures TimeoutError: page.waitForFunction: Timeout 50000ms exceeded. at tests/aila-chat/helpers.ts:21 19 | timeout: number, 20 | ) { > 21 | await page.waitForFunction( | ^ 22 | ([currentStatus, expectedStatus]) => { 2*** | const statusElement = document.querySelector( 24 | // eslint-disable-next-line @typescript-eslint/quotes, quotes at waitForStreamingStatusChange (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:21:14) at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/full-romans.test.ts:68:4*** at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/full-romans.test.ts:55:5
[Common persona] › tests/aila-chat/full-romans.test.ts:23:5 › Full aila flow with Romans fixture: apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts#L21
2) [Common persona] › tests/aila-chat/full-romans.test.ts:2***:5 › Full aila flow with Romans fixture › Iterate through the fixtures Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── TimeoutError: page.waitForFunction: Timeout 50000ms exceeded. at tests/aila-chat/helpers.ts:21 19 | timeout: number, 20 | ) { > 21 | await page.waitForFunction( | ^ 22 | ([currentStatus, expectedStatus]) => { 2*** | const statusElement = document.querySelector( 24 | // eslint-disable-next-line @typescript-eslint/quotes, quotes at waitForStreamingStatusChange (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:21:14) at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/full-romans.test.ts:68:4*** at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/full-romans.test.ts:55:5
[Common persona - mobile] › tests/aila-chat/full-romans.mobile.test.ts:36:5 › Full aila flow with Romans fixture: apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts#L12
***) [Common persona - mobile] › tests/aila-chat/full-romans.mobile.test.ts:***6:5 › Full aila flow with Romans fixture › Iterate through the fixtures › Wait for generation Error: Timed out 50000ms waiting for expect(locator).toContainText(expected) Locator: getByTestId('chat-aila-streaming-status') Expected string: "Idle" Received: <element(s) not found> Call log: - expect.toContainText with timeout 50000ms - waiting for getByTestId('chat-aila-streaming-status') - locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div> - unexpected value "RequestMade" - locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div> - unexpected value "RequestMade" - locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div> - unexpected value "RequestMade" - locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div> - unexpected value "RequestMade" - locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div> - unexpected value "RequestMade" - locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div> - unexpected value "RequestMade" - locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div> - unexpected value "RequestMade" - locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div> - unexpected value "RequestMade" - locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div> - unexpected value "RequestMade" - locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div> - unexpected value "RequestMade" - locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div> - unexpected value "RequestMade" - locator resolved to <div data-testid="chat-aila-streaming-status">StreamingLessonPlan</div> - unexpected value "StreamingLessonPlan" at tests/aila-chat/helpers.ts:12 10 | ) { 11 | const statusElement = page.getByTestId("chat-aila-streaming-status"); > 12 | await expect(statusElement).toContainText(status, args); | ^ 1*** | } 14 | 15 | export async function waitForStreamingStatusChange( at expectStreamingStatus (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:12:***1) at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:45:11 at waitForGeneration (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:4***:10) at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/full-romans.mobile.test.ts:71:7 at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/full-romans.mobile.test.ts:68:5
[Common persona - mobile] › tests/aila-chat/full-romans.mobile.test.ts:36:5 › Full aila flow with Romans fixture: apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts#L12
***) [Common persona - mobile] › tests/aila-chat/full-romans.mobile.test.ts:***6:5 › Full aila flow with Romans fixture › Iterate through the fixtures › Wait for generation Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 50000ms waiting for expect(locator).toContainText(expected) Locator: getByTestId('chat-aila-streaming-status') Expected string: "Idle" Received: <element(s) not found> Call log: - expect.toContainText with timeout 50000ms - waiting for getByTestId('chat-aila-streaming-status') - locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div> - unexpected value "RequestMade" - locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div> - unexpected value "RequestMade" - locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div> - unexpected value "RequestMade" - locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div> - unexpected value "RequestMade" - locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div> - unexpected value "RequestMade" - locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div> - unexpected value "RequestMade" - locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div> - unexpected value "RequestMade" - locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div> - unexpected value "RequestMade" - locator resolved to <div data-testid="chat-aila-streaming-status">StreamingLessonPlan</div> - unexpected value "StreamingLessonPlan" - locator resolved to <div data-testid="chat-aila-streaming-status">StreamingLessonPlan</div> - unexpected value "StreamingLessonPlan" at tests/aila-chat/helpers.ts:12 10 | ) { 11 | const statusElement = page.getByTestId("chat-aila-streaming-status"); > 12 | await expect(statusElement).toContainText(status, args); | ^ 1*** | } 14 | 15 | export async function waitForStreamingStatusChange( at expectStreamingStatus (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:12:***1) at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:45:11 at waitForGeneration (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:4***:10) at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/full-romans.mobile.test.ts:71:7 at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/full-romans.mobile.test.ts:68:5
test-e2e
Process completed with exit code 1.
test-e2e
Failed to restore: Cache service responded with 403
Slow Test: apps/nextjs/[No persona] › tests/banned-users.test.ts#L1
apps/nextjs/[No persona] › tests/banned-users.test.ts took 20.***s
test-e2e
Can't add secret mask for empty string in ##[add-mask] command.
🎭 Playwright Run Summary
*** failed [No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached [Common persona] › tests/aila-chat/full-romans.test.ts:2***:5 › Full aila flow with Romans fixture [Common persona - mobile] › tests/aila-chat/full-romans.mobile.test.ts:***6:5 › Full aila flow with Romans fixture 1 skipped 11 passed (***.7m)