Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Investigate phantom test failures #628

Open
jonseitz opened this issue Jan 17, 2023 · 2 comments
Open

Investigate phantom test failures #628

jonseitz opened this issue Jan 17, 2023 · 2 comments
Assignees

Comments

@jonseitz
Copy link
Contributor

We continue to see frequent failing test runs, which usually resolve after re-running the test suite a few times. It's almost always a single end-to-end test, though it's not consistently the same one. I thought that #521 and #522 would have fixed it, but the issue still seems to be there. As a course for investigation, I'd like to:

  1. Look into most recent unexplainable test failure, and try to triangulate which tests are failing.
  2. Look into those specific failing tests, as well as the ones around them in case of aysnc leakages.
  3. Watch test runs over the next week to check for continued failures.
  4. For future, look into how we might increase performance on test runs, to close up our iteration cycles.
@jonseitz
Copy link
Contributor Author

Error on 2023-01-17 16:07:

1784 passing (17m)
  1 failing

  1) End-to-end Course Instance updating
       As an admin user
         Updating Offered Values
           Editing an offered value
             to "Retired"
               for a future course instance
                 "before each" hook for "should update the offered value of future course instances to be OFFERED.RETIRED":
     Error: Timeout of 30000ms exceeded. For async tests and hooks, ensure "done()" is called; if returning a Promise, ensure it resolves. (/home/runner/work/course-planner/course-planner/tests/integration/e2e/CoursesPage.test.tsx)
      at listOnTimeout (internal/timers.js:557:17)
      at processTimers (internal/timers.js:500:7)

@jonseitz
Copy link
Contributor Author

FYI @rmainseas, I pushed a couple of small changes on the bugfix/failing-builds branch that address some of the issues that I was seeing when running the tests locally. There are still tests failing in the Github Actions, but I'm seeing fewer errors at least.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants