Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Some browser tests do not succeed anymore #8093

Closed
lmcbout opened this issue Jun 25, 2020 · 8 comments · Fixed by #8151
Closed

Some browser tests do not succeed anymore #8093

lmcbout opened this issue Jun 25, 2020 · 8 comments · Fixed by #8151
Assignees
Labels
bug bugs found in the application ci issues related to CI / tests test issues related to unit and api tests

Comments

@lmcbout
Copy link
Contributor

lmcbout commented Jun 25, 2020

Bug Description:

It looks like the test don't run anymore. While publishing Theia version 1.3.0, I had to by-pass the browser test.

  • On the other hand, Travis seems to pass all tests.
  • On my local computer, cleaning and executing the tests fail

Note: removing the $HOME/.theia solved some errors but not all
Do we have dependencies on the home folder?

The tests have been running a few times and we get the same result

Steps to Reproduce:

  1. git clean -ffdx
  2. yarn
  3. yarn test
    -> some tests don't succeed

Additional Information

Errors:

  1. Find and Replace
    Replace in the active editor:
    TypeError: Cannot read property 'widgets' of null
    at ViewContainer.../../packages/core/lib/browser/view-container.js.ViewContainer.getParts (bundle.js:128607:37)

root INFO 2) Menus
should toggle 'Explorer' view:
Error: Timeout of 2000ms exceeded.
For async tests and hooks, ensure "done()" is called; if returning a Promise, ensure it resolves.

root INFO 3) Menus
reveal more context menu in the explorer view container toolbar:
TypeError: Cannot read property 'widgets' of null
at ViewContainer.../../packages/core/lib/browser/view-container.js.ViewContainer.getParts (bundle.js:128607:37)
at Context. (/home/lmcbout/theia/stable/theia/examples/api-tests/src/menus.spec.js:88:42)

  • Operating System: Ubuntu 18.04
  • Theia Version: Latest
@vince-fugnitto vince-fugnitto added bug bugs found in the application ci issues related to CI / tests test issues related to unit and api tests labels Jun 25, 2020
@vince-fugnitto
Copy link
Member

The view-spec.js work when executed by themselves, but during the suite it fails locally.
I think it might be in a weird state due to other tests which are executed before.

@akosyakov
Copy link
Member

Could we trace back to which PR started triggering a weird state?

@vince-fugnitto
Copy link
Member

Could we trace back to which PR started triggering a weird state?

I tested with the v1.2.0 tag and the api integration test cases passed successfully, I'll try to pinpoint the regression.

@vince-fugnitto
Copy link
Member

I identified the breaking commit as fdd7c41 using git bisect.

@vince-fugnitto
Copy link
Member

vince-fugnitto commented Jul 7, 2020

I identified the breaking commit as fdd7c41 using git bisect.

I identified the commit (where the tests started to fail locally), however I was unable to determine how to fix them.
I tried temporarily to skip the failing tests but it still causes the entire suite to fail. I'm wondering if the tests are interdependent on eachother causing them to be in a weird state.

I noticed that:

  • they fail locally and not on travis
  • they do not fail if they are run individually (using describe.only)

@akosyakov
Copy link
Member

I will have a look later this week. Tests are run together in the same app.

@akosyakov akosyakov self-assigned this Jul 7, 2020
@akosyakov
Copy link
Member

It is reproducible when menus and views tests are enabled.

@akosyakov
Copy link
Member

It is timing issue, fdd7c41 makes sure that VS Code extensions views are properly registered in the explorer (shell). It slows down the creation of the navigator.

akosyakov added a commit that referenced this issue Jul 8, 2020
as well fixes some exceptions caused by disposed widgets

Signed-off-by: Anton Kosyakov <[email protected]>
akosyakov added a commit that referenced this issue Jul 20, 2020
as well fixes some exceptions caused by disposed widgets

Signed-off-by: Anton Kosyakov <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug bugs found in the application ci issues related to CI / tests test issues related to unit and api tests
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants