WARN Could not load all certificates - BadDER

[kukushking]

Environment

Delta-rs version: 0.8.0

Binding: Python (3.10.8)

Environment:

• Cloud provider: AWS
• OS: OSX
• Other:

---

Bug

What happened:
After upgrading to 0.8.0, all operations display the following warning:

[2023-03-15T09:59:13Z WARN  hyper_rustls::connector] Could not load all certificates: Custom { kind: InvalidData, error: Custom { kind: InvalidData, error: BadDER } }

Looks like deltalake is not able to load certificates in the native OSX truststore. I do have a few unsigned/self-signed certs in my truststore so that might be it, but in that case I'd expect a message saying it's not able to validate it, not "bad" cert.

What you expected to happen:

How to reproduce it:

More details:

[wjones127]

Thanks for reporting this. We switched the default our build system from openssl to rustls, but it wasn't entirely intentional to switch the Python package.

I think we should switch back in the next version. If need be, I can do a bugfix release that switches back too.

There are some workarounds for MacOS described here: rustls/rustls#127 (comment) Does that fix it for you?

[kukushking]

Thanks @wjones127, no need for bugfix release as it's not a severe issue. I don't want to touch the certs so it's fine with the warning. Just opened so you're aware of this. Thanks!