Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

NotebookKernel - set outputs on cancel unit test failure #126054

Closed
alexdima opened this issue Jun 11, 2021 · 3 comments
Closed

NotebookKernel - set outputs on cancel unit test failure #126054

alexdima opened this issue Jun 11, 2021 · 3 comments
Assignees
Labels
insiders-released Patch has been released in VS Code Insiders unit-test-failure
Milestone

Comments

@alexdima
Copy link
Member

alexdima commented Jun 11, 2021

Thank you for the change for #125665 to convert it to a unit test, but unfortunately now the unit tests are failing randomly. I have seen this test fail randomly multiple times:

e.g. https://github.com/microsoft/vscode/runs/2800873453#step:11:7565 on macOS / browser unit test

  5940 passing (2m)
  22 pending
  1 failing

  1) NotebookKernel
       set outputs on cancel:

      AssertionError: false == true
      + expected - actual

      -false
      +true
      
      at Context.<anonymous> (file:///Users/runner/work/vscode/vscode/out/vs/workbench/test/browser/api/extHostNotebookKernel.test.js:202:20)

e.g. https://github.com/microsoft/vscode/runs/2803567669?check_suite_focus=true#step:10:8466 on macOS / Electron unit test

  6949 passing (3m)
  48 pending
  1 failing

  1) NotebookKernel
       set outputs on cancel:
     TypeError: call.getFileName is not a function
      at getErrMessage (assert.js:279:25)
      at innerOk (assert.js:370:17)
      at Function.ok (assert.js:390:3)
      at Context.<anonymous> (file:///Users/runner/work/vscode/vscode/out/vs/workbench/test/browser/api/extHostNotebookKernel.test.js:202:20)

e.g. https://github.com/microsoft/vscode/runs/2802891558?check_suite_focus=true#step:11:7567 on macOS / Browser unit test

  5940 passing (2m)
  24 pending
  1 failing

  1) NotebookKernel
       set outputs on cancel:

      AssertionError: false == true
      + expected - actual

      -false
      +true
      
      at Context.<anonymous> (file:///Users/runner/work/vscode/vscode/out/vs/workbench/test/browser/api/extHostNotebookKernel.test.js:202:20)
@alexdima
Copy link
Member Author

I have pushed edba477 to skip the test until we figure out what is wrong.

@jrieken
Copy link
Member

jrieken commented Jun 15, 2021

There was some foul timeout logic because we cannot await cancellation tokens... I have added an explicit barrier which should resolve this.

jrieken added a commit that referenced this issue Jun 15, 2021
@alexdima
Copy link
Member Author

Thank you!

@github-actions github-actions bot locked and limited conversation to collaborators Jul 30, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
insiders-released Patch has been released in VS Code Insiders unit-test-failure
Projects
None yet
Development

No branches or pull requests

5 participants
@roblourens @rebornix @jrieken @alexdima and others