Fix build on linux arm64

[azuwis]

See NixOS/nixpkgs#217857 and https://logs.nix.ci/?key=nixos/nixpkgs.217857&attempt_id=539830d2-5fd2-48af-8619-cf0a38201b04

[bastibe]

Thank you for the pull request! This looks like a reasonable change.

If you could, would you like to contribute a linux/arm build to https://github.com/bastibe/libsndfile-binaries, so we can ship linux/arm wheels in the future?

[azuwis]

If you could, would you like to contribute a linux/arm build to https://github.com/bastibe/libsndfile-binaries, so we can ship linux/arm wheels in the future?

See bastibe/libsndfile-binaries#23