E2E: Enable E2E v2 in CI #22897
ci.yml
on: pull_request
Test Matrix (Unit, Integration)
0s
Build
2m 22s
Test Matrix (E2E legacy)
0s
Matrix: test-integration
Matrix: test-unit
Matrix: test-e2e
Matrix: Test - Legacy E2E
Annotations
16 errors, 13 warnings, and 6 notices
Test - E2E (ubuntu - 1/2)
Process completed with exit code 1.
|
Test - E2E (ubuntu - 2/2)
Process completed with exit code 1.
|
Test - E2E (macos - 1/2)
Process completed with exit code 1.
|
Test - Unit (windows, Node v20)
Process completed with exit code 1.
|
Test - E2E (windows - 1/2)
Process completed with exit code 1.
|
[e2e] › e2e/features/command-edit.test.ts:128:9 › edit command › can change edit ranges:
vscode/.test/e2e/reports/blob/e2e/features/command-edit.test.ts#L1
1) [e2e] › e2e/features/command-edit.test.ts:128:9 › edit command › can change edit ranges › Starting VSCode Session
|
[e2e] › e2e/features/command-edit.test.ts:128:9 › edit command › can change edit ranges:
vscode/.test/e2e/reports/blob/e2e/features/command-edit.test.ts#L1
1) [e2e] › e2e/features/command-edit.test.ts:128:9 › edit command › can change edit ranges › Starting VSCode Session
|
[e2e] › e2e/features/command-edit.test.ts:128:9 › edit command › can change edit ranges:
vscode/.test/e2e/reports/blob/e2e/features/command-edit.test.ts#L1
1) [e2e] › e2e/features/command-edit.test.ts:128:9 › edit command › can change edit ranges › Starting VSCode Session
Missing Recording
[PollyError: [Polly] [adapter:node-http] Recording for the following request is not found and `recordIfMissing` is `false`.
{
"url": "https://sourcegraph.com/.api/graphql?SiteProductVersion",
"method": "POST",
"headers": {
"connection": "close",
"host": "sourcegraph.com",
"accept-encoding": "identity",
"content-length": "101",
"accept": "*/*",
"x-sourcegraph-actor-anonymous-uid": "471c720c-1182-47f6-af2d-2c741b0bee24",
"user-agent": "vscode/1.38.2 (Node.js v20.16.0)",
"content-type": "application/json; charset=utf-8",
"authorization": "token REDACTED_3dd704711f82a44ff6aba261b53b61a03fb8edba658774639148630d838c2d1d",
"x-mitm-proxy-endpoint": "http://127.0.0.1:34100",
"x-mitm-proxy-name": "sourcegraph.dotcom",
"x-mitm-auth-token-name": "sourcegraph.dotcom"
},
"body": "{\"query\":\"\\nquery SiteProductVersion {\\n site {\\n productVersion\\n }\\n}\",\"variables\":{}}",
"recordingName": "canchangeeditranges",
"id": "a4f06f44ac6627e56ffe62ff40b4aaa9",
"order": 0,
"identifiers": {
"headers": {
"x-mitm-auth-token-name": "sourcegraph.dotcom"
},
"method": "POST",
"body": "{\"query\":\"\\nquery SiteProductVersion {\\n site {\\n productVersion\\n }\\n}\",\"variables\":{}}",
"url": "http://sourcegraph.dotcom.proxy/.api/graphql?SiteProductVersion="
},
"config": {
"mode": "replay",
"adapters": [
"node-http"
],
"logLevel": "SILENT",
"flushRequestsOnStop": true,
"recordIfMissing": false,
"recordFailedRequests": true,
"expiresIn": null,
"expiryStrategy": "warn",
"matchRequestsBy": {
"method": true,
"order": false
}
}
}]
|
[e2e] › e2e/features/command-edit.test.ts:128:9 › edit command › can change edit ranges:
../../../../../Users/runner/work/cody/cody/vscode/e2e/utils/vscody/uix/vscode/session.ts#L218
1) [e2e] › e2e/features/command-edit.test.ts:128:9 › edit command › can change edit ranges › Starting VSCode Session
Error: expect(locator).toHaveText(expected)
Locator: locator('.statusbar-item[id="sourcegraph.vscody-test-utils.status"]')
Expected string: "Connected"
Received string: " Waiting"
Call log:
- expect.toHaveText with timeout 20000ms
- waiting for locator('.statusbar-item[id="sourcegraph.vscody-test-utils.status"]')
- locator resolved to <div custom-hover="true" id="sourcegraph.vscody-test-utils.status" aria-label="beaker Waiting, Cody Test Utils" class="statusbar-item right first-visible-item">…</div>
- unexpected value " Waiting"
- locator resolved to <div custom-hover="true" id="sourcegraph.vscody-test-utils.status" aria-label="beaker Waiting, Cody Test Utils" class="statusbar-item right first-visible-item">…</div>
- unexpected value " Waiting"
- locator resolved to <div custom-hover="true" id="sourcegraph.vscody-test-utils.status" aria-label="beaker Waiting, Cody Test Utils" class="statusbar-item right first-visible-item">…</div>
- unexpected value " Waiting"
- locator resolved to <div custom-hover="true" id="sourcegraph.vscody-test-utils.status" aria-label="beaker Waiting, Cody Test Utils" class="statusbar-item right first-visible-item">…</div>
- unexpected value " Waiting"
- locator resolved to <div custom-hover="true" id="sourcegraph.vscody-test-utils.status" aria-label="beaker Waiting, Cody Test Utils" class="statusbar-item right first-visible-item">…</div>
- unexpected value " Waiting"
at e2e/utils/vscody/uix/vscode/session.ts:218
216 | )
217 | this.init.polly.play()
> 218 | await expect(testUtilsStatus).toHaveText('Connected')
| ^
219 | this.started = true
220 | return this
221 | }
at Session.start (/Users/runner/work/cody/cody/vscode/e2e/utils/vscody/uix/vscode/session.ts:218:39)
at /Users/runner/work/cody/cody/vscode/e2e/utils/vscody/uix/vscode/session.ts:133:13
at /Users/runner/work/cody/cody/vscode/e2e/features/command-edit.test.ts:132:29
|
[e2e] › e2e/features/command-edit.test.ts:128:9 › edit command › can change edit ranges:
vscode/.test/e2e/reports/blob/e2e/features/command-edit.test.ts#L1
2) [e2e] › e2e/features/command-edit.test.ts:128:9 › edit command › can change edit ranges › Starting VSCode Session
|
[e2e] › e2e/features/command-edit.test.ts:128:9 › edit command › can change edit ranges:
vscode/.test/e2e/reports/blob/e2e/features/command-edit.test.ts#L1
2) [e2e] › e2e/features/command-edit.test.ts:128:9 › edit command › can change edit ranges › Starting VSCode Session
|
[e2e] › e2e/features/command-edit.test.ts:128:9 › edit command › can change edit ranges:
vscode/.test/e2e/reports/blob/e2e/features/command-edit.test.ts#L1
2) [e2e] › e2e/features/command-edit.test.ts:128:9 › edit command › can change edit ranges › Starting VSCode Session
Missing Recording
[PollyError: [Polly] [adapter:node-http] Recording for the following request is not found and `recordIfMissing` is `false`.
{
"url": "https://sourcegraph.com/.api/graphql?SiteProductVersion",
"method": "POST",
"headers": {
"connection": "close",
"host": "sourcegraph.com",
"accept-encoding": "identity",
"content-length": "101",
"accept": "*/*",
"x-sourcegraph-actor-anonymous-uid": "58c9520a-50e2-4f9a-b9fd-4dc36019e316",
"user-agent": "vscode/1.38.2 (Node.js v20.16.0)",
"content-type": "application/json; charset=utf-8",
"authorization": "token REDACTED_3dd704711f82a44ff6aba261b53b61a03fb8edba658774639148630d838c2d1d",
"x-mitm-proxy-endpoint": "http://127.0.0.1:34102",
"x-mitm-proxy-name": "sourcegraph.dotcom",
"x-mitm-auth-token-name": "sourcegraph.dotcom"
},
"body": "{\"query\":\"\\nquery SiteProductVersion {\\n site {\\n productVersion\\n }\\n}\",\"variables\":{}}",
"recordingName": "canchangeeditranges",
"id": "a4f06f44ac6627e56ffe62ff40b4aaa9",
"order": 0,
"identifiers": {
"headers": {
"x-mitm-auth-token-name": "sourcegraph.dotcom"
},
"method": "POST",
"body": "{\"query\":\"\\nquery SiteProductVersion {\\n site {\\n productVersion\\n }\\n}\",\"variables\":{}}",
"url": "http://sourcegraph.dotcom.proxy/.api/graphql?SiteProductVersion="
},
"config": {
"mode": "replay",
"adapters": [
"node-http"
],
"logLevel": "SILENT",
"flushRequestsOnStop": true,
"recordIfMissing": false,
"recordFailedRequests": true,
"expiresIn": null,
"expiryStrategy": "warn",
"matchRequestsBy": {
"method": true,
"order": false
}
}
}]
|
[e2e] › e2e/features/command-edit.test.ts:128:9 › edit command › can change edit ranges:
vscode/e2e/utils/vscody/uix/vscode/session.ts#L218
2) [e2e] › e2e/features/command-edit.test.ts:128:9 › edit command › can change edit ranges › Starting VSCode Session
Error: expect(locator).toHaveText(expected)
Locator: locator('.statusbar-item[id="sourcegraph.vscody-test-utils.status"]')
Expected string: "Connected"
Received: <element(s) not found>
Call log:
- expect.toHaveText with timeout 20000ms
- waiting for locator('.statusbar-item[id="sourcegraph.vscody-test-utils.status"]')
- locator resolved to <div custom-hover="true" id="sourcegraph.vscody-test-utils.status" aria-label="beaker Waiting, Cody Test Utils" class="statusbar-item right first-visible-item">…</div>
- unexpected value " Waiting"
- locator resolved to <div custom-hover="true" id="sourcegraph.vscody-test-utils.status" aria-label="beaker Waiting, Cody Test Utils" class="statusbar-item right first-visible-item">…</div>
- unexpected value " Waiting"
- locator resolved to <div custom-hover="true" id="sourcegraph.vscody-test-utils.status" aria-label="beaker Waiting, Cody Test Utils" class="statusbar-item right first-visible-item">…</div>
- unexpected value " Waiting"
- locator resolved to <div custom-hover="true" id="sourcegraph.vscody-test-utils.status" aria-label="beaker Waiting, Cody Test Utils" class="statusbar-item right first-visible-item">…</div>
- unexpected value " Waiting"
- locator resolved to <div custom-hover="true" id="sourcegraph.vscody-test-utils.status" aria-label="beaker Waiting, Cody Test Utils" class="statusbar-item right first-visible-item">…</div>
- unexpected value " Waiting"
- locator resolved to <div custom-hover="true" id="sourcegraph.vscody-test-utils.status" aria-label="beaker Waiting, Cody Test Utils" class="statusbar-item right first-visible-item">…</div>
- unexpected value " Waiting"
- locator resolved to <div custom-hover="true" id="sourcegraph.vscody-test-utils.status" aria-label="beaker Waiting, Cody Test Utils" class="statusbar-item right first-visible-item">…</div>
- unexpected value " Waiting"
at e2e/utils/vscody/uix/vscode/session.ts:218
216 | )
217 | this.init.polly.play()
> 218 | await expect(testUtilsStatus).toHaveText('Connected')
| ^
219 | this.started = true
220 | return this
221 | }
at Session.start (/home/runner/work/cody/cody/vscode/e2e/utils/vscody/uix/vscode/session.ts:218:39)
at /home/runner/work/cody/cody/vscode/e2e/utils/vscody/uix/vscode/session.ts:133:13
at /home/runner/work/cody/cody/vscode/e2e/features/command-edit.test.ts:132:29
|
[e2e] › e2e/features/command-edit.test.ts:128:9 › edit command › can change edit ranges:
vscode/.test/e2e/reports/blob/e2e/features/command-edit.test.ts#L1
3) [e2e] › e2e/features/command-edit.test.ts:128:9 › edit command › can change edit ranges › Starting VSCode Session › Extension.waitUntilReady
|
[e2e] › e2e/features/command-edit.test.ts:128:9 › edit command › can change edit ranges:
vscode/.test/e2e/reports/blob/e2e/features/command-edit.test.ts#L1
3) [e2e] › e2e/features/command-edit.test.ts:128:9 › edit command › can change edit ranges › Starting VSCode Session › Extension.waitUntilReady
|
uninstall.test.ts:7:5 › uninstall extension:
vscode/test/e2e/uninstall.test.ts#L1
1) uninstall.test.ts:7:5 › uninstall extension ───────────────────────────────────────────────────
Test timeout of 30000ms exceeded.
|
Slow Test:
vscode/[e2e] › e2e/example.test.ts#L1
vscode/[e2e] › e2e/example.test.ts took 1.1m
|
Slow Test:
vscode/[e2e] › e2e/features/enterprise/proxy.test.ts#L1
vscode/[e2e] › e2e/features/enterprise/proxy.test.ts took 47.4s
|
Slow Test:
vscode/chat-atFile.test.ts#L1
vscode/chat-atFile.test.ts took 1.1m
|
Slow Test:
vscode/attribution.test.ts#L1
vscode/attribution.test.ts took 17.8s
|
Slow Test:
vscode/chat-input.test.ts#L1
vscode/chat-input.test.ts took 49.0s
|
Slow Test:
vscode/chat-keyboard-shortcuts.test.ts#L1
vscode/chat-keyboard-shortcuts.test.ts took 24.8s
|
Slow Test:
vscode/chat-rateLimit.test.ts#L1
vscode/chat-rateLimit.test.ts took 23.9s
|
Slow Test:
vscode/command-custom.test.ts#L1
vscode/command-custom.test.ts took 59.3s
|
Slow Test:
vscode/command-core.test.ts#L1
vscode/command-core.test.ts took 35.0s
|
Slow Test:
vscode/code-actions.test.ts#L1
vscode/code-actions.test.ts took 32.6s
|
Slow Test:
vscode/initial-context.test.ts#L1
vscode/initial-context.test.ts took 40.4s
|
Slow Test:
vscode/command-edit.test.ts#L1
vscode/command-edit.test.ts took 36.0s
|
Slow Test:
vscode/enterprise-cody-ignore.test.ts#L1
vscode/enterprise-cody-ignore.test.ts took 18.2s
|
🎭 Playwright Run Summary
4 failed
[e2e] › e2e/features/command-edit.test.ts:128:9 › edit command › can change edit ranges ────────
[e2e] › e2e/features/command-edit.test.ts:128:9 › edit command › can change edit ranges ────────
[e2e] › e2e/features/command-edit.test.ts:128:9 › edit command › can change edit ranges ────────
[e2e] › e2e/features/fixup-decorator.test.ts:17:9 › fixup decorator › decorations from un-applied Cody changes appear
50 passed (2.2m)
|
🎭 Playwright Run Summary
1 flaky
uninstall.test.ts:7:5 › uninstall extension ────────────────────────────────────────────────────
4 skipped
1 passed (1.1m)
|
🎭 Playwright Run Summary
10 passed (1.9m)
|
🎭 Playwright Run Summary
10 passed (1.9m)
|
🎭 Playwright Run Summary
10 passed (2.4m)
|
🎭 Playwright Run Summary
1 skipped
10 passed (2.0m)
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
e2e-blob-report-macos-1
|
17.6 MB |
|
e2e-blob-report-macos-2
|
16.6 MB |
|
e2e-blob-report-ubuntu-1
|
26.6 MB |
|
e2e-blob-report-ubuntu-2
|
27.4 MB |
|
e2e-blob-report-windows-1
|
22.6 MB |
|
e2e-blob-report-windows-2
|
28.9 MB |
|
e2e-html-report
|
140 MB |
|
vscode_dist
|
41.7 MB |
|