-
Notifications
You must be signed in to change notification settings - Fork 535
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Fix Dask estimators serialization prior to training #6065
Fix Dask estimators serialization prior to training #6065
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can we add a tiny test to make sure that the serialization and deserialization are both successful for un-trained models? Maybe also train the model after deserialization
@viclafargue seems like the test ran into an issue in the pytest in some jobs: =================================== FAILURES ===================================
________________________ test_serialize_before_training ________________________
client = <Client: 'tcp://127.0.0.1:45687' processes=1 threads=1, memory=251.77 GiB>
def test_serialize_before_training(client):
X, y = make_regression(n_samples=1000, n_features=20, random_state=0)
X, y = da.from_array(X), da.from_array(y)
model = LinearRegression(client=client)
> pickled_model = pickle.dumps(model)
test_dask_serialization.py:90:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
self = <cuml.dask.linear_model.linear_regression.LinearRegression object at 0x7fca696b4510>
def __getstate__(self):
> internal_model = self._get_internal_model().result()
E AttributeError: 'NoneType' object has no attribute 'result'
/opt/conda/envs/test/lib/python3.11/site-packages/cuml/dask/common/base.py:60: AttributeError |
That's really strange, might possibly be missing something, but isn't there an issue with the CI? |
Codecov ReportAttention: Patch coverage is
Additional details and impacted files@@ Coverage Diff @@
## branch-24.12 #6065 +/- ##
================================================
- Coverage 68.33% 67.15% -1.18%
================================================
Files 193 193
Lines 12837 12839 +2
================================================
- Hits 8772 8622 -150
- Misses 4065 4217 +152 ☔ View full report in Codecov by Sentry. |
/merge |
Partially answers #6046