Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Grep for potential errors in standalone tests #15341

Merged
merged 20 commits into from
Nov 5, 2022

Conversation

carmocca
Copy link
Contributor

@carmocca carmocca commented Oct 26, 2022

What does this PR do?

See title

Fixes #12474

Does your PR introduce any breaking changes? If yes, please list them.

None

cc @Borda

@carmocca carmocca added the tests label Oct 26, 2022
@carmocca carmocca self-assigned this Oct 26, 2022
@github-actions github-actions bot added the pl Generic label for PyTorch Lightning package label Oct 26, 2022
@carmocca carmocca added this to the v1.8.x milestone Oct 27, 2022
@carmocca carmocca marked this pull request as ready for review November 3, 2022 00:19
@carmocca carmocca marked this pull request as draft November 3, 2022 01:23
@carmocca
Copy link
Contributor Author

carmocca commented Nov 3, 2022

Sorry for the review notification. Accidentally marked it as non-draft

@carmocca
Copy link
Contributor Author

carmocca commented Nov 3, 2022

@awaelchli If you can help, this uncovered a failing Lite test: https://dev.azure.com/Lightning-AI/lightning/_build/results?buildId=112478&view=logs&j=8a08b103-7f3c-5f4b-1889-6a795acbb007&t=a889fbb9-184d-53b2-4806-a80daee53cd7&l=325: strategies/test_fairscale_integration.py::test_fairscale_multi_process_checkpoint_state_consolidation[True-ddp_sharded-cpu]

@awaelchli
Copy link
Contributor

@carmocca was able to reproduce and fix locally. Should be resolved now. Let me know if there are any other failures like this one popping up.

@carmocca carmocca force-pushed the tests/grep-errors-standalone branch from 225678a to 2888007 Compare November 4, 2022 01:54
@carmocca carmocca marked this pull request as ready for review November 4, 2022 01:55
@carmocca carmocca requested a review from kaushikb11 as a code owner November 4, 2022 01:55
@mergify mergify bot added the ready PRs ready to be merged label Nov 4, 2022
@carmocca
Copy link
Contributor Author

carmocca commented Nov 4, 2022

TPUs are failing, but there's an issue with the logs. Blocked by #15533

@carmocca carmocca merged commit 12d6e44 into master Nov 5, 2022
@carmocca carmocca deleted the tests/grep-errors-standalone branch November 5, 2022 03:29
Borda pushed a commit that referenced this pull request Nov 8, 2022
Co-authored-by: awaelchli <[email protected]>
(cherry picked from commit 12d6e44)
lexierule pushed a commit that referenced this pull request Nov 10, 2022
Co-authored-by: awaelchli <[email protected]>
(cherry picked from commit 12d6e44)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
pl Generic label for PyTorch Lightning package ready PRs ready to be merged tests
Projects
No open projects
Status: Done
Development

Successfully merging this pull request may close these issues.

Standalone tests can silently fail
5 participants