-
Notifications
You must be signed in to change notification settings - Fork 12
Use custom allocator in Python build #27
Comments
Do you think this is the only optimization we'll be able to add? If so, ill close my issue. |
I think this + upgrading the CPU feature list will be the main two. LTO is already enabled. |
Cross post from slack. Wow. Updating allocator to sn-malloc made big difference. This run also included full target feature list. However, when I tried just target features there was minimal impact (maybe i did it wrong?). Im not sure if some combinatation of feature plus allocator also helped. Theres still some juice to squeeze but the result compared to others are quite good across the board. Exciting!
this is how i built the python wheels / the feature list in case anyone is interested: |
When compiling in native Rust, we have the option to include mimalloc or smalloc for improved performance.
In my experience mimalloc and smalloc behave quite similar.
Polars uses mimalloc in the Python binary:
https://github.com/pola-rs/polars/blob/master/py-polars/Cargo.toml#L22
The text was updated successfully, but these errors were encountered: