-
Notifications
You must be signed in to change notification settings - Fork 234
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[BUG] orc_write_test.py::test_write_sql_save_table failed intermittently w/ pascal GPU #8336
Comments
Sorry, I got a Tesla P40 and I tried to run that test (with compiled latest 23.06 commit, Spark 3.3) 10 times but could not see any failure. Can you share more detail about the reproducing environment, please? |
we saw this in our nightly CI commands used in this one,
|
Just check the log in CI. |
Okay, now I can reproduce it. The issue shows up very rarely: Each time I ran the test 10 times, it may show up but just once or twice. Now I started to investigate. |
Ran the test 400 times and got 3 failures. The failure rate is quite small. I dumped input data of such failed tests and start to investigate with libcudf. |
I ran a test 100,000 times in cudf using the same input table that caused failure in the plugin test. All of them passed.
So I probably deprioritize this a bit, will think of some way to better test/debug at lower priority. |
Removing Pascal support in 24.02 |
Describe the bug
We found intermittent failures in integration test run using PASCAL GPU
rapids_it-PASCAL, build IDs: 153, 150 (failed twice in recent 5 runs)
mismatched CPU and GPU output
Steps/Code to reproduce bug
run integration test w/ pascal GPU
Expected behavior
A clear and concise description of what you expected to happen.
Environment details (please complete the following information)
Additional context
Add any other context about the problem here.
The text was updated successfully, but these errors were encountered: