Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Rely on Dask's ability to serialize collections #307

Merged

Conversation

jakirkham
Copy link
Member

@jakirkham jakirkham commented Jun 4, 2020

Follow-up to PR ( #268 )
Requires ( #306 )
Uses ( dask/distributed#3689 )

As Dask is able to serialize collections of objects, simply serialize all of the parts together in one step.

As Dask is able to serialize collections of objects, simply serialize
all of the parts together in one step.
@pentschev
Copy link
Member

#308 should fix errors.

@pentschev
Copy link
Member

rerun tests

@jakirkham
Copy link
Member Author

Thanks Peter! Looks like this is now passing 😄

Copy link
Member

@pentschev pentschev left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @jakirkham !

@pentschev pentschev merged commit 840f000 into rapidsai:branch-0.15 Jun 5, 2020
@jakirkham jakirkham deleted the simp_serialization_spill_redux branch June 5, 2020 17:53
@jakirkham
Copy link
Member Author

Thanks Peter! 😄

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants