Playwright #1768
Triggered via deployment status
November 13, 2024 13:05
vercel[bot]
created
c5397a5
Status
Failure
Total duration
5m 39s
Artifacts
–
Annotations
7 errors, 3 warnings, and 1 notice
[No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached:
apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts#L12
1) [No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached › Send first message › Wait for generation
Error: Timed out ***0000ms waiting for expect(locator).toContainText(expected)
Locator: getByTestId('chat-aila-streaming-status')
Expected string: "Idle"
Received: <element(s) not found>
Call log:
- expect.toContainText with timeout ***0000ms
- waiting for getByTestId('chat-aila-streaming-status')
- locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div>
- unexpected value "RequestMade"
- locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div>
- unexpected value "RequestMade"
- locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div>
- unexpected value "RequestMade"
- locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div>
- unexpected value "RequestMade"
- locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div>
- unexpected value "RequestMade"
- locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div>
- unexpected value "RequestMade"
- locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div>
- unexpected value "RequestMade"
- locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div>
- unexpected value "RequestMade"
- locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div>
- unexpected value "RequestMade"
- locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div>
- unexpected value "RequestMade"
at tests/aila-chat/helpers.ts:12
10 | ) {
11 | const statusElement = page.getByTestId("chat-aila-streaming-status");
> 12 | await expect(statusElement).toContainText(status, args);
| ^
1*** | }
14 |
15 | export async function waitForStreamingStatusChange(
at expectStreamingStatus (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:12:***1)
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:45:11
at waitForGeneration (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:4***:10)
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/rate-limiting.test.ts:44:5
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/rate-limiting.test.ts:42:***
|
[No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached:
apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts#L12
1) [No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached › Send first message › Wait for generation
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Timed out ***0000ms waiting for expect(locator).toContainText(expected)
Locator: getByTestId('chat-aila-streaming-status')
Expected string: "Idle"
Received: <element(s) not found>
Call log:
- expect.toContainText with timeout ***0000ms
- waiting for getByTestId('chat-aila-streaming-status')
- locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div>
- unexpected value "RequestMade"
- locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div>
- unexpected value "RequestMade"
- locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div>
- unexpected value "RequestMade"
- locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div>
- unexpected value "RequestMade"
- locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div>
- unexpected value "RequestMade"
- locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div>
- unexpected value "RequestMade"
- locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div>
- unexpected value "RequestMade"
- locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div>
- unexpected value "RequestMade"
- locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div>
- unexpected value "RequestMade"
- locator resolved to <div data-testid="chat-aila-streaming-status">StreamingExperimentalPatches</div>
- unexpected value "StreamingExperimentalPatches"
at tests/aila-chat/helpers.ts:12
10 | ) {
11 | const statusElement = page.getByTestId("chat-aila-streaming-status");
> 12 | await expect(statusElement).toContainText(status, args);
| ^
1*** | }
14 |
15 | export async function waitForStreamingStatusChange(
at expectStreamingStatus (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:12:***1)
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:45:11
at waitForGeneration (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:4***:10)
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/rate-limiting.test.ts:44:5
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/rate-limiting.test.ts:42:***
|
[Common persona] › tests/aila-chat/full-romans.test.ts:23:5 › Full aila flow with Romans fixture:
apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts#L21
2) [Common persona] › tests/aila-chat/full-romans.test.ts:2***:5 › Full aila flow with Romans fixture › Iterate through the fixtures
TimeoutError: page.waitForFunction: Timeout 50000ms exceeded.
at tests/aila-chat/helpers.ts:21
19 | timeout: number,
20 | ) {
> 21 | await page.waitForFunction(
| ^
22 | ([currentStatus, expectedStatus]) => {
2*** | const statusElement = document.querySelector(
24 | // eslint-disable-next-line @typescript-eslint/quotes, quotes
at waitForStreamingStatusChange (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:21:14)
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/full-romans.test.ts:68:4***
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/full-romans.test.ts:55:5
|
[Common persona] › tests/aila-chat/full-romans.test.ts:23:5 › Full aila flow with Romans fixture:
apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts#L21
2) [Common persona] › tests/aila-chat/full-romans.test.ts:2***:5 › Full aila flow with Romans fixture › Iterate through the fixtures
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
TimeoutError: page.waitForFunction: Timeout 50000ms exceeded.
at tests/aila-chat/helpers.ts:21
19 | timeout: number,
20 | ) {
> 21 | await page.waitForFunction(
| ^
22 | ([currentStatus, expectedStatus]) => {
2*** | const statusElement = document.querySelector(
24 | // eslint-disable-next-line @typescript-eslint/quotes, quotes
at waitForStreamingStatusChange (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:21:14)
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/full-romans.test.ts:68:4***
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/full-romans.test.ts:55:5
|
[Common persona - mobile] › tests/aila-chat/full-romans.mobile.test.ts:36:5 › Full aila flow with Romans fixture:
apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts#L12
***) [Common persona - mobile] › tests/aila-chat/full-romans.mobile.test.ts:***6:5 › Full aila flow with Romans fixture › Iterate through the fixtures › Wait for generation
Error: Timed out 50000ms waiting for expect(locator).toContainText(expected)
Locator: getByTestId('chat-aila-streaming-status')
Expected string: "Idle"
Received: <element(s) not found>
Call log:
- expect.toContainText with timeout 50000ms
- waiting for getByTestId('chat-aila-streaming-status')
- locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div>
- unexpected value "RequestMade"
- locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div>
- unexpected value "RequestMade"
- locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div>
- unexpected value "RequestMade"
- locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div>
- unexpected value "RequestMade"
- locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div>
- unexpected value "RequestMade"
- locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div>
- unexpected value "RequestMade"
- locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div>
- unexpected value "RequestMade"
- locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div>
- unexpected value "RequestMade"
- locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div>
- unexpected value "RequestMade"
- locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div>
- unexpected value "RequestMade"
- locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div>
- unexpected value "RequestMade"
- locator resolved to <div data-testid="chat-aila-streaming-status">StreamingLessonPlan</div>
- unexpected value "StreamingLessonPlan"
at tests/aila-chat/helpers.ts:12
10 | ) {
11 | const statusElement = page.getByTestId("chat-aila-streaming-status");
> 12 | await expect(statusElement).toContainText(status, args);
| ^
1*** | }
14 |
15 | export async function waitForStreamingStatusChange(
at expectStreamingStatus (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:12:***1)
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:45:11
at waitForGeneration (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:4***:10)
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/full-romans.mobile.test.ts:71:7
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/full-romans.mobile.test.ts:68:5
|
[Common persona - mobile] › tests/aila-chat/full-romans.mobile.test.ts:36:5 › Full aila flow with Romans fixture:
apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts#L12
***) [Common persona - mobile] › tests/aila-chat/full-romans.mobile.test.ts:***6:5 › Full aila flow with Romans fixture › Iterate through the fixtures › Wait for generation
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Timed out 50000ms waiting for expect(locator).toContainText(expected)
Locator: getByTestId('chat-aila-streaming-status')
Expected string: "Idle"
Received: <element(s) not found>
Call log:
- expect.toContainText with timeout 50000ms
- waiting for getByTestId('chat-aila-streaming-status')
- locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div>
- unexpected value "RequestMade"
- locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div>
- unexpected value "RequestMade"
- locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div>
- unexpected value "RequestMade"
- locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div>
- unexpected value "RequestMade"
- locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div>
- unexpected value "RequestMade"
- locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div>
- unexpected value "RequestMade"
- locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div>
- unexpected value "RequestMade"
- locator resolved to <div data-testid="chat-aila-streaming-status">RequestMade</div>
- unexpected value "RequestMade"
- locator resolved to <div data-testid="chat-aila-streaming-status">StreamingLessonPlan</div>
- unexpected value "StreamingLessonPlan"
- locator resolved to <div data-testid="chat-aila-streaming-status">StreamingLessonPlan</div>
- unexpected value "StreamingLessonPlan"
at tests/aila-chat/helpers.ts:12
10 | ) {
11 | const statusElement = page.getByTestId("chat-aila-streaming-status");
> 12 | await expect(statusElement).toContainText(status, args);
| ^
1*** | }
14 |
15 | export async function waitForStreamingStatusChange(
at expectStreamingStatus (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:12:***1)
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:45:11
at waitForGeneration (/home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/helpers.ts:4***:10)
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/full-romans.mobile.test.ts:71:7
at /home/runner/work/oak-ai-lesson-assistant/oak-ai-lesson-assistant/apps/nextjs/tests-e2e/tests/aila-chat/full-romans.mobile.test.ts:68:5
|
test-e2e
Process completed with exit code 1.
|
test-e2e
Failed to restore: Cache service responded with 403
|
Slow Test:
apps/nextjs/[No persona] › tests/banned-users.test.ts#L1
apps/nextjs/[No persona] › tests/banned-users.test.ts took 20.***s
|
test-e2e
Can't add secret mask for empty string in ##[add-mask] command.
|
🎭 Playwright Run Summary
*** failed
[No persona] › tests/aila-chat/rate-limiting.test.ts:10:5 › User is restricted after message rate limit is reached
[Common persona] › tests/aila-chat/full-romans.test.ts:2***:5 › Full aila flow with Romans fixture
[Common persona - mobile] › tests/aila-chat/full-romans.mobile.test.ts:***6:5 › Full aila flow with Romans fixture
1 skipped
11 passed (***.7m)
|