Skip to content

E2E: Enable E2E v2 in CI #22897

E2E: Enable E2E v2 in CI

E2E: Enable E2E v2 in CI #22897

Triggered via pull request October 22, 2024 20:18
Status Failure
Total duration 15m 0s
Artifacts 8

ci.yml

on: pull_request
Test Matrix (Unit, Integration)
0s
Test Matrix (Unit, Integration)
Test Matrix (E2E legacy)
0s
Test Matrix (E2E legacy)
Matrix: test-integration
Matrix: test-unit
Matrix: test-e2e
Test - E2E (Report)
1m 6s
Test - E2E (Report)
Matrix: Test - Legacy E2E
Fit to window
Zoom out
Zoom in

Annotations

16 errors, 13 warnings, and 6 notices
Test - E2E (ubuntu - 1/2)
Process completed with exit code 1.
Test - E2E (ubuntu - 2/2)
Process completed with exit code 1.
Test - E2E (macos - 1/2)
Process completed with exit code 1.
Test - Unit (windows, Node v20)
Process completed with exit code 1.
Test - E2E (windows - 1/2)
Process completed with exit code 1.
[e2e] › e2e/features/command-edit.test.ts:128:9 › edit command › can change edit ranges: vscode/.test/e2e/reports/blob/e2e/features/command-edit.test.ts#L1
1) [e2e] › e2e/features/command-edit.test.ts:128:9 › edit command › can change edit ranges › Starting VSCode Session
[e2e] › e2e/features/command-edit.test.ts:128:9 › edit command › can change edit ranges: vscode/.test/e2e/reports/blob/e2e/features/command-edit.test.ts#L1
1) [e2e] › e2e/features/command-edit.test.ts:128:9 › edit command › can change edit ranges › Starting VSCode Session
[e2e] › e2e/features/command-edit.test.ts:128:9 › edit command › can change edit ranges: vscode/.test/e2e/reports/blob/e2e/features/command-edit.test.ts#L1
1) [e2e] › e2e/features/command-edit.test.ts:128:9 › edit command › can change edit ranges › Starting VSCode Session Missing Recording [PollyError: [Polly] [adapter:node-http] Recording for the following request is not found and `recordIfMissing` is `false`. { "url": "https://sourcegraph.com/.api/graphql?SiteProductVersion", "method": "POST", "headers": { "connection": "close", "host": "sourcegraph.com", "accept-encoding": "identity", "content-length": "101", "accept": "*/*", "x-sourcegraph-actor-anonymous-uid": "471c720c-1182-47f6-af2d-2c741b0bee24", "user-agent": "vscode/1.38.2 (Node.js v20.16.0)", "content-type": "application/json; charset=utf-8", "authorization": "token REDACTED_3dd704711f82a44ff6aba261b53b61a03fb8edba658774639148630d838c2d1d", "x-mitm-proxy-endpoint": "http://127.0.0.1:34100", "x-mitm-proxy-name": "sourcegraph.dotcom", "x-mitm-auth-token-name": "sourcegraph.dotcom" }, "body": "{\"query\":\"\\nquery SiteProductVersion {\\n site {\\n productVersion\\n }\\n}\",\"variables\":{}}", "recordingName": "canchangeeditranges", "id": "a4f06f44ac6627e56ffe62ff40b4aaa9", "order": 0, "identifiers": { "headers": { "x-mitm-auth-token-name": "sourcegraph.dotcom" }, "method": "POST", "body": "{\"query\":\"\\nquery SiteProductVersion {\\n site {\\n productVersion\\n }\\n}\",\"variables\":{}}", "url": "http://sourcegraph.dotcom.proxy/.api/graphql?SiteProductVersion=" }, "config": { "mode": "replay", "adapters": [ "node-http" ], "logLevel": "SILENT", "flushRequestsOnStop": true, "recordIfMissing": false, "recordFailedRequests": true, "expiresIn": null, "expiryStrategy": "warn", "matchRequestsBy": { "method": true, "order": false } } }]
[e2e] › e2e/features/command-edit.test.ts:128:9 › edit command › can change edit ranges: ../../../../../Users/runner/work/cody/cody/vscode/e2e/utils/vscody/uix/vscode/session.ts#L218
1) [e2e] › e2e/features/command-edit.test.ts:128:9 › edit command › can change edit ranges › Starting VSCode Session Error: expect(locator).toHaveText(expected) Locator: locator('.statusbar-item[id="sourcegraph.vscody-test-utils.status"]') Expected string: "Connected" Received string: " Waiting" Call log: - expect.toHaveText with timeout 20000ms - waiting for locator('.statusbar-item[id="sourcegraph.vscody-test-utils.status"]') - locator resolved to <div custom-hover="true" id="sourcegraph.vscody-test-utils.status" aria-label="beaker Waiting, Cody Test Utils" class="statusbar-item right first-visible-item">…</div> - unexpected value " Waiting" - locator resolved to <div custom-hover="true" id="sourcegraph.vscody-test-utils.status" aria-label="beaker Waiting, Cody Test Utils" class="statusbar-item right first-visible-item">…</div> - unexpected value " Waiting" - locator resolved to <div custom-hover="true" id="sourcegraph.vscody-test-utils.status" aria-label="beaker Waiting, Cody Test Utils" class="statusbar-item right first-visible-item">…</div> - unexpected value " Waiting" - locator resolved to <div custom-hover="true" id="sourcegraph.vscody-test-utils.status" aria-label="beaker Waiting, Cody Test Utils" class="statusbar-item right first-visible-item">…</div> - unexpected value " Waiting" - locator resolved to <div custom-hover="true" id="sourcegraph.vscody-test-utils.status" aria-label="beaker Waiting, Cody Test Utils" class="statusbar-item right first-visible-item">…</div> - unexpected value " Waiting" at e2e/utils/vscody/uix/vscode/session.ts:218 216 | ) 217 | this.init.polly.play() > 218 | await expect(testUtilsStatus).toHaveText('Connected') | ^ 219 | this.started = true 220 | return this 221 | } at Session.start (/Users/runner/work/cody/cody/vscode/e2e/utils/vscody/uix/vscode/session.ts:218:39) at /Users/runner/work/cody/cody/vscode/e2e/utils/vscody/uix/vscode/session.ts:133:13 at /Users/runner/work/cody/cody/vscode/e2e/features/command-edit.test.ts:132:29
[e2e] › e2e/features/command-edit.test.ts:128:9 › edit command › can change edit ranges: vscode/.test/e2e/reports/blob/e2e/features/command-edit.test.ts#L1
2) [e2e] › e2e/features/command-edit.test.ts:128:9 › edit command › can change edit ranges › Starting VSCode Session
[e2e] › e2e/features/command-edit.test.ts:128:9 › edit command › can change edit ranges: vscode/.test/e2e/reports/blob/e2e/features/command-edit.test.ts#L1
2) [e2e] › e2e/features/command-edit.test.ts:128:9 › edit command › can change edit ranges › Starting VSCode Session
[e2e] › e2e/features/command-edit.test.ts:128:9 › edit command › can change edit ranges: vscode/.test/e2e/reports/blob/e2e/features/command-edit.test.ts#L1
2) [e2e] › e2e/features/command-edit.test.ts:128:9 › edit command › can change edit ranges › Starting VSCode Session Missing Recording [PollyError: [Polly] [adapter:node-http] Recording for the following request is not found and `recordIfMissing` is `false`. { "url": "https://sourcegraph.com/.api/graphql?SiteProductVersion", "method": "POST", "headers": { "connection": "close", "host": "sourcegraph.com", "accept-encoding": "identity", "content-length": "101", "accept": "*/*", "x-sourcegraph-actor-anonymous-uid": "58c9520a-50e2-4f9a-b9fd-4dc36019e316", "user-agent": "vscode/1.38.2 (Node.js v20.16.0)", "content-type": "application/json; charset=utf-8", "authorization": "token REDACTED_3dd704711f82a44ff6aba261b53b61a03fb8edba658774639148630d838c2d1d", "x-mitm-proxy-endpoint": "http://127.0.0.1:34102", "x-mitm-proxy-name": "sourcegraph.dotcom", "x-mitm-auth-token-name": "sourcegraph.dotcom" }, "body": "{\"query\":\"\\nquery SiteProductVersion {\\n site {\\n productVersion\\n }\\n}\",\"variables\":{}}", "recordingName": "canchangeeditranges", "id": "a4f06f44ac6627e56ffe62ff40b4aaa9", "order": 0, "identifiers": { "headers": { "x-mitm-auth-token-name": "sourcegraph.dotcom" }, "method": "POST", "body": "{\"query\":\"\\nquery SiteProductVersion {\\n site {\\n productVersion\\n }\\n}\",\"variables\":{}}", "url": "http://sourcegraph.dotcom.proxy/.api/graphql?SiteProductVersion=" }, "config": { "mode": "replay", "adapters": [ "node-http" ], "logLevel": "SILENT", "flushRequestsOnStop": true, "recordIfMissing": false, "recordFailedRequests": true, "expiresIn": null, "expiryStrategy": "warn", "matchRequestsBy": { "method": true, "order": false } } }]
[e2e] › e2e/features/command-edit.test.ts:128:9 › edit command › can change edit ranges: vscode/e2e/utils/vscody/uix/vscode/session.ts#L218
2) [e2e] › e2e/features/command-edit.test.ts:128:9 › edit command › can change edit ranges › Starting VSCode Session Error: expect(locator).toHaveText(expected) Locator: locator('.statusbar-item[id="sourcegraph.vscody-test-utils.status"]') Expected string: "Connected" Received: <element(s) not found> Call log: - expect.toHaveText with timeout 20000ms - waiting for locator('.statusbar-item[id="sourcegraph.vscody-test-utils.status"]') - locator resolved to <div custom-hover="true" id="sourcegraph.vscody-test-utils.status" aria-label="beaker Waiting, Cody Test Utils" class="statusbar-item right first-visible-item">…</div> - unexpected value " Waiting" - locator resolved to <div custom-hover="true" id="sourcegraph.vscody-test-utils.status" aria-label="beaker Waiting, Cody Test Utils" class="statusbar-item right first-visible-item">…</div> - unexpected value " Waiting" - locator resolved to <div custom-hover="true" id="sourcegraph.vscody-test-utils.status" aria-label="beaker Waiting, Cody Test Utils" class="statusbar-item right first-visible-item">…</div> - unexpected value " Waiting" - locator resolved to <div custom-hover="true" id="sourcegraph.vscody-test-utils.status" aria-label="beaker Waiting, Cody Test Utils" class="statusbar-item right first-visible-item">…</div> - unexpected value " Waiting" - locator resolved to <div custom-hover="true" id="sourcegraph.vscody-test-utils.status" aria-label="beaker Waiting, Cody Test Utils" class="statusbar-item right first-visible-item">…</div> - unexpected value " Waiting" - locator resolved to <div custom-hover="true" id="sourcegraph.vscody-test-utils.status" aria-label="beaker Waiting, Cody Test Utils" class="statusbar-item right first-visible-item">…</div> - unexpected value " Waiting" - locator resolved to <div custom-hover="true" id="sourcegraph.vscody-test-utils.status" aria-label="beaker Waiting, Cody Test Utils" class="statusbar-item right first-visible-item">…</div> - unexpected value " Waiting" at e2e/utils/vscody/uix/vscode/session.ts:218 216 | ) 217 | this.init.polly.play() > 218 | await expect(testUtilsStatus).toHaveText('Connected') | ^ 219 | this.started = true 220 | return this 221 | } at Session.start (/home/runner/work/cody/cody/vscode/e2e/utils/vscody/uix/vscode/session.ts:218:39) at /home/runner/work/cody/cody/vscode/e2e/utils/vscody/uix/vscode/session.ts:133:13 at /home/runner/work/cody/cody/vscode/e2e/features/command-edit.test.ts:132:29
[e2e] › e2e/features/command-edit.test.ts:128:9 › edit command › can change edit ranges: vscode/.test/e2e/reports/blob/e2e/features/command-edit.test.ts#L1
3) [e2e] › e2e/features/command-edit.test.ts:128:9 › edit command › can change edit ranges › Starting VSCode Session › Extension.waitUntilReady
[e2e] › e2e/features/command-edit.test.ts:128:9 › edit command › can change edit ranges: vscode/.test/e2e/reports/blob/e2e/features/command-edit.test.ts#L1
3) [e2e] › e2e/features/command-edit.test.ts:128:9 › edit command › can change edit ranges › Starting VSCode Session › Extension.waitUntilReady
uninstall.test.ts:7:5 › uninstall extension: vscode/test/e2e/uninstall.test.ts#L1
1) uninstall.test.ts:7:5 › uninstall extension ─────────────────────────────────────────────────── Test timeout of 30000ms exceeded.
Slow Test: vscode/[e2e] › e2e/example.test.ts#L1
vscode/[e2e] › e2e/example.test.ts took 1.1m
Slow Test: vscode/[e2e] › e2e/features/enterprise/proxy.test.ts#L1
vscode/[e2e] › e2e/features/enterprise/proxy.test.ts took 47.4s
Slow Test: vscode/chat-atFile.test.ts#L1
vscode/chat-atFile.test.ts took 1.1m
Slow Test: vscode/attribution.test.ts#L1
vscode/attribution.test.ts took 17.8s
Slow Test: vscode/chat-input.test.ts#L1
vscode/chat-input.test.ts took 49.0s
Slow Test: vscode/chat-keyboard-shortcuts.test.ts#L1
vscode/chat-keyboard-shortcuts.test.ts took 24.8s
Slow Test: vscode/chat-rateLimit.test.ts#L1
vscode/chat-rateLimit.test.ts took 23.9s
Slow Test: vscode/command-custom.test.ts#L1
vscode/command-custom.test.ts took 59.3s
Slow Test: vscode/command-core.test.ts#L1
vscode/command-core.test.ts took 35.0s
Slow Test: vscode/code-actions.test.ts#L1
vscode/code-actions.test.ts took 32.6s
Slow Test: vscode/initial-context.test.ts#L1
vscode/initial-context.test.ts took 40.4s
Slow Test: vscode/command-edit.test.ts#L1
vscode/command-edit.test.ts took 36.0s
Slow Test: vscode/enterprise-cody-ignore.test.ts#L1
vscode/enterprise-cody-ignore.test.ts took 18.2s
🎭 Playwright Run Summary
4 failed [e2e] › e2e/features/command-edit.test.ts:128:9 › edit command › can change edit ranges ──────── [e2e] › e2e/features/command-edit.test.ts:128:9 › edit command › can change edit ranges ──────── [e2e] › e2e/features/command-edit.test.ts:128:9 › edit command › can change edit ranges ──────── [e2e] › e2e/features/fixup-decorator.test.ts:17:9 › fixup decorator › decorations from un-applied Cody changes appear 50 passed (2.2m)
🎭 Playwright Run Summary
1 flaky uninstall.test.ts:7:5 › uninstall extension ──────────────────────────────────────────────────── 4 skipped 1 passed (1.1m)
🎭 Playwright Run Summary
10 passed (1.9m)
🎭 Playwright Run Summary
10 passed (1.9m)
🎭 Playwright Run Summary
10 passed (2.4m)
🎭 Playwright Run Summary
1 skipped 10 passed (2.0m)

Artifacts

Produced during runtime
Name Size
e2e-blob-report-macos-1
17.6 MB
e2e-blob-report-macos-2
16.6 MB
e2e-blob-report-ubuntu-1
26.6 MB
e2e-blob-report-ubuntu-2
27.4 MB
e2e-blob-report-windows-1
22.6 MB
e2e-blob-report-windows-2
28.9 MB
e2e-html-report
140 MB
vscode_dist
41.7 MB