-
-
Notifications
You must be signed in to change notification settings - Fork 719
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Deserialization: zero-copy merge subframes when possible #5208
Deserialization: zero-copy merge subframes when possible #5208
Commits on Aug 12, 2021
-
Zero-copy merge subframes with pointer arithmetic
Use NumPy to get the pointers of the memoryviews and do pointer arithmetic. This is way more reliable and self-contained. TODO unit test for `merge_memoryviews` and deal with NumPy situation
Configuration menu - View commit details
-
Copy full SHA for 0f90ee7 - Browse repository at this point
Copy the full SHA 0f90ee7View commit details -
Configuration menu - View commit details
-
Copy full SHA for c463a45 - Browse repository at this point
Copy the full SHA c463a45View commit details -
Configuration menu - View commit details
-
Copy full SHA for a2f7243 - Browse repository at this point
Copy the full SHA a2f7243View commit details -
Configuration menu - View commit details
-
Copy full SHA for cc3999d - Browse repository at this point
Copy the full SHA cc3999dView commit details -
Configuration menu - View commit details
-
Copy full SHA for 78ca265 - Browse repository at this point
Copy the full SHA 78ca265View commit details
Commits on Aug 13, 2021
-
Fall back to NumPy for read-only buffers
It's very annoying: `from_buffer` requires the buffer to be writeable, because ctypes is inconsistently strict about const correctness (see https://bugs.python.org/issue11427#msg148586). I don't think there's any clever pointer-casting we could do as mentioned in that thread, since we need to access through the buffer protocol—we can't just cast `mv.obj` to `c_void_p`, since we need the pointer into the current location within the buffer, not just at the start of the buffer. So for read-only buffers, we try to use NumPy, and if it's not available, we'll end up silently(!) falling back on copying.
Configuration menu - View commit details
-
Copy full SHA for ac3eaff - Browse repository at this point
Copy the full SHA ac3eaffView commit details -
Configuration menu - View commit details
-
Copy full SHA for cc9cee3 - Browse repository at this point
Copy the full SHA cc9cee3View commit details -
Configuration menu - View commit details
-
Copy full SHA for 22f246d - Browse repository at this point
Copy the full SHA 22f246dView commit details
Commits on Aug 16, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 439be17 - Browse repository at this point
Copy the full SHA 439be17View commit details -
Configuration menu - View commit details
-
Copy full SHA for 0032822 - Browse repository at this point
Copy the full SHA 0032822View commit details -
Configuration menu - View commit details
-
Copy full SHA for 3315441 - Browse repository at this point
Copy the full SHA 3315441View commit details
Commits on Aug 17, 2021
-
Don't disable exception chaining
Co-authored-by: crusaderky <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for da8ee57 - Browse repository at this point
Copy the full SHA da8ee57View commit details
Commits on Oct 5, 2021
-
Update distributed/protocol/utils.py
Co-authored-by: jakirkham <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 82ec2ca - Browse repository at this point
Copy the full SHA 82ec2caView commit details -
Configuration menu - View commit details
-
Copy full SHA for edaeb7d - Browse repository at this point
Copy the full SHA edaeb7dView commit details
Commits on Oct 7, 2021
-
Configuration menu - View commit details
-
Copy full SHA for ccea5c4 - Browse repository at this point
Copy the full SHA ccea5c4View commit details -
Configuration menu - View commit details
-
Copy full SHA for 0d1e6d1 - Browse repository at this point
Copy the full SHA 0d1e6d1View commit details
Commits on Oct 8, 2021
-
Configuration menu - View commit details
-
Copy full SHA for 2e0ae4e - Browse repository at this point
Copy the full SHA 2e0ae4eView commit details -
Merge remote-tracking branch 'upstream/main' into serialization/zero-…
…copy-merge-memoryviews
Configuration menu - View commit details
-
Copy full SHA for 269ef1f - Browse repository at this point
Copy the full SHA 269ef1fView commit details
Commits on Nov 1, 2021
-
Merge remote-tracking branch 'upstream/main' into serialization/zero-…
…copy-merge-memoryviews
Configuration menu - View commit details
-
Copy full SHA for 6574588 - Browse repository at this point
Copy the full SHA 6574588View commit details -
Configuration menu - View commit details
-
Copy full SHA for f141867 - Browse repository at this point
Copy the full SHA f141867View commit details
Commits on Nov 3, 2021
-
Merge remote-tracking branch 'upstream/main' into serialization/zero-…
…copy-merge-memoryviews
Configuration menu - View commit details
-
Copy full SHA for 69e5cf2 - Browse repository at this point
Copy the full SHA 69e5cf2View commit details