Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GH-41696: [Python][Packaging] Bump MACOSX_DEPLOYMENT_TARGET to 12 instead of 11 #43137

Merged
merged 20 commits into from
Aug 29, 2024

Conversation

raulcd
Copy link
Member

@raulcd raulcd commented Jul 3, 2024

Rationale for this change

As shown on the associated issue there seems to be a problem with MACOSX_DEPLOYMENT_TARGET 11 on the wheels.

What changes are included in this PR?

Update MACOSX_DEPLOYMENT_TARGET everywhere to the latest supported macOS version.

Are these changes tested?

Via CI, even though the issue was not reproducible on CI.

Are there any user-facing changes?

Yes, wheels won't be available for macOS 11 but those were crashing on the previous release.

@raulcd raulcd requested review from assignUser and kou as code owners July 3, 2024 14:29
Copy link

github-actions bot commented Jul 3, 2024

⚠️ GitHub issue #41696 has been automatically assigned in GitHub to PR creator.

@github-actions github-actions bot added the awaiting committer review Awaiting committer review label Jul 3, 2024
@raulcd
Copy link
Member Author

raulcd commented Jul 3, 2024

@github-actions crossbow submit wheel-macos-*

@raulcd
Copy link
Member Author

raulcd commented Jul 3, 2024

@github-actions crossbow submit verify-rc-source--macos-

Copy link

github-actions bot commented Jul 3, 2024

Revision: e239385

Submitted crossbow builds: ursacomputing/crossbow @ actions-c9e99e37cf

Task Status
wheel-macos-monterey-cp310-amd64 GitHub Actions
wheel-macos-monterey-cp310-arm64 GitHub Actions
wheel-macos-monterey-cp311-amd64 GitHub Actions
wheel-macos-monterey-cp311-arm64 GitHub Actions
wheel-macos-monterey-cp312-amd64 GitHub Actions
wheel-macos-monterey-cp312-arm64 GitHub Actions
wheel-macos-monterey-cp38-amd64 GitHub Actions
wheel-macos-monterey-cp38-arm64 GitHub Actions
wheel-macos-monterey-cp39-amd64 GitHub Actions
wheel-macos-monterey-cp39-arm64 GitHub Actions

Copy link

github-actions bot commented Jul 3, 2024

Revision: e239385

Submitted crossbow builds: ursacomputing/crossbow @ actions-56448c3d06

Task Status
verify-rc-source-cpp-macos-amd64 GitHub Actions
verify-rc-source-cpp-macos-arm64 GitHub Actions
verify-rc-source-cpp-macos-conda-amd64 GitHub Actions
verify-rc-source-csharp-macos-amd64 GitHub Actions
verify-rc-source-csharp-macos-arm64 GitHub Actions
verify-rc-source-go-macos-amd64 GitHub Actions
verify-rc-source-go-macos-arm64 GitHub Actions
verify-rc-source-integration-macos-amd64 GitHub Actions
verify-rc-source-integration-macos-arm64 GitHub Actions
verify-rc-source-integration-macos-conda-amd64 GitHub Actions
verify-rc-source-java-macos-amd64 GitHub Actions
verify-rc-source-js-macos-amd64 GitHub Actions
verify-rc-source-js-macos-arm64 GitHub Actions
verify-rc-source-python-macos-amd64 GitHub Actions
verify-rc-source-python-macos-arm64 GitHub Actions
verify-rc-source-python-macos-conda-amd64 GitHub Actions
verify-rc-source-ruby-macos-amd64 GitHub Actions
verify-rc-source-ruby-macos-arm64 GitHub Actions

@raulcd
Copy link
Member Author

raulcd commented Jul 3, 2024

@github-actions crossbow submit wheel-macos-monterey-cp310-amd64

Copy link

github-actions bot commented Jul 3, 2024

Revision: 93269ea

Submitted crossbow builds: ursacomputing/crossbow @ actions-f0354ef8a9

Task Status
wheel-macos-monterey-cp310-amd64 GitHub Actions

@raulcd
Copy link
Member Author

raulcd commented Jul 3, 2024

I am not sure why the linking error is happening:

FAILED: release/libarrow_flight.1700.0.0.dylib 
: && /Applications/Xcode_15.0.1.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/clang++ -fno-aligned-new  -Qunused-arguments -fcolor-diagnostics  -Wall -Wno-unknown-warning-option -Wno-pass-failed -msse4.2  -O3 -DNDEBUG -O2 -arch x86_64 -isysroot /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX14.0.sdk -mmacosx-version-min=12.0 -dynamiclib -Wl,-headerpad_max_install_names -undefined dynamic_lookup   -compatibility_version 1700.0.0 -current_version 1700.0.0 -o release/libarrow_flight.1700.0.0.dylib -install_name @rpath/libarrow_flight.1700.dylib src/arrow/flight/CMakeFiles/arrow_flight_objlib.dir/Unity/unity_2_cxx.cxx.o src/arrow/flight/CMakeFiles/arrow_flight_objlib.dir/Unity/unity_1_cxx.cxx.o src/arrow/flight/CMakeFiles/arrow_flight_objlib.dir/Unity/unity_0_cxx.cxx.o  -Wl,-rpath,@loader_path  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libgrpc++.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libprotobuf.a  release/libarrow.1700.0.0.dylib  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libgrpc.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libz.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libcares.a  -lresolv  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libaddress_sorting.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libre2.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_flags_internal.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_flags_marshalling.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_flags_reflection.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_flags_config.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_flags_program_name.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_flags_private_handle_accessor.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_flags_commandlineflag.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_flags_commandlineflag_internal.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_raw_hash_set.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_hashtablez_sampler.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_hash.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_city.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_low_level_hash.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_statusor.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libgpr.a  -lm  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libupb_json.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libupb_textformat.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libupb_reflection.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libupb_collections.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libupb_mini_table.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libupb.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libupb_fastdecode.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libupb_utf8_range.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libupb_extension_registry.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libdescriptor_upb_proto.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_bad_variant_access.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_status.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_strerror.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_random_distributions.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_random_seed_sequences.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_random_internal_pool_urbg.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_random_internal_randen.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_random_internal_randen_hwaes.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_random_internal_randen_hwaes_impl.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_random_internal_randen_slow.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_random_internal_platform.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_random_internal_seed_material.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_random_seed_gen_exception.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_cord.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_bad_optional_access.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_cordz_info.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_cord_internal.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_cordz_functions.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_exponential_biased.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_cordz_handle.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_synchronization.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_graphcycles_internal.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_kernel_timeout_internal.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_stacktrace.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_symbolize.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_malloc_internal.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_debugging_internal.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_demangle_internal.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_crc_cord_state.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_crc32c.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_str_format_internal.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_crc_internal.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_crc_cpu_detect.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_time.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_strings.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_strings_internal.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_string_view.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_base.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_spinlock_wait.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_throw_delegate.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_int128.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_raw_logging_internal.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_log_severity.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_civil_time.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_time_zone.a  -Wl,-framework,CoreFoundation  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libssl.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libcrypto.a  -framework CoreFoundation && :
ld: imageOffset32 fixup target must be defined

@raulcd raulcd changed the title GH-41696: [Python][Packaging] Bump MacOS Deployment Target to 12 instead of 11 GH-41696: [Python][Packaging] Bump MACOSX_DEPLOYMENT_TARGET to 12 instead of 11 Jul 3, 2024
@vserdyuk
Copy link

vserdyuk commented Jul 8, 2024

I am not sure why the linking error is happening:

FAILED: release/libarrow_flight.1700.0.0.dylib 
: && /Applications/Xcode_15.0.1.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/clang++ -fno-aligned-new  -Qunused-arguments -fcolor-diagnostics  -Wall -Wno-unknown-warning-option -Wno-pass-failed -msse4.2  -O3 -DNDEBUG -O2 -arch x86_64 -isysroot /Applications/Xcode_15.0.1.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX14.0.sdk -mmacosx-version-min=12.0 -dynamiclib -Wl,-headerpad_max_install_names -undefined dynamic_lookup   -compatibility_version 1700.0.0 -current_version 1700.0.0 -o release/libarrow_flight.1700.0.0.dylib -install_name @rpath/libarrow_flight.1700.dylib src/arrow/flight/CMakeFiles/arrow_flight_objlib.dir/Unity/unity_2_cxx.cxx.o src/arrow/flight/CMakeFiles/arrow_flight_objlib.dir/Unity/unity_1_cxx.cxx.o src/arrow/flight/CMakeFiles/arrow_flight_objlib.dir/Unity/unity_0_cxx.cxx.o  -Wl,-rpath,@loader_path  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libgrpc++.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libprotobuf.a  release/libarrow.1700.0.0.dylib  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libgrpc.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libz.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libcares.a  -lresolv  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libaddress_sorting.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libre2.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_flags_internal.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_flags_marshalling.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_flags_reflection.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_flags_config.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_flags_program_name.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_flags_private_handle_accessor.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_flags_commandlineflag.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_flags_commandlineflag_internal.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_raw_hash_set.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_hashtablez_sampler.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_hash.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_city.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_low_level_hash.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_statusor.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libgpr.a  -lm  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libupb_json.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libupb_textformat.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libupb_reflection.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libupb_collections.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libupb_mini_table.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libupb.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libupb_fastdecode.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libupb_utf8_range.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libupb_extension_registry.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libdescriptor_upb_proto.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_bad_variant_access.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_status.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_strerror.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_random_distributions.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_random_seed_sequences.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_random_internal_pool_urbg.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_random_internal_randen.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_random_internal_randen_hwaes.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_random_internal_randen_hwaes_impl.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_random_internal_randen_slow.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_random_internal_platform.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_random_internal_seed_material.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_random_seed_gen_exception.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_cord.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_bad_optional_access.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_cordz_info.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_cord_internal.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_cordz_functions.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_exponential_biased.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_cordz_handle.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_synchronization.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_graphcycles_internal.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_kernel_timeout_internal.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_stacktrace.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_symbolize.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_malloc_internal.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_debugging_internal.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_demangle_internal.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_crc_cord_state.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_crc32c.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_str_format_internal.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_crc_internal.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_crc_cpu_detect.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_time.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_strings.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_strings_internal.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_string_view.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_base.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_spinlock_wait.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_throw_delegate.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_int128.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_raw_logging_internal.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_log_severity.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_civil_time.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libabsl_time_zone.a  -Wl,-framework,CoreFoundation  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libssl.a  /Users/runner/work/crossbow/crossbow/vcpkg/installed/amd64-osx-static-release/lib/libcrypto.a  -framework CoreFoundation && :
ld: imageOffset32 fixup target must be defined

I have the same error when running vcpkg install qtbase:x64-osx-dynamic. Seems like Xcode toolchain issue.

Edit: actually, qtbase:x64-osx-dynamic runs fine. Failure occurs when building qtbase:x64-osx with Qt customized to dynamic in triplet. Made an issue: microsoft/vcpkg#39805

@jorisvandenbossche
Copy link
Member

@raulcd does it work if we leave the deployment target in the vcpkg files as is? (in the end for pypi what matters is the macos version that ends up in the wheels, so that older macos don't think they can install the wheel)

@raulcd
Copy link
Member Author

raulcd commented Aug 27, 2024

@github-actions crossbow submit wheel-macos-monterey-cp310-amd64

Copy link

Revision: aa286a4

Submitted crossbow builds: ursacomputing/crossbow @ actions-b3ee052429

Task Status
wheel-macos-monterey-cp310-amd64 GitHub Actions

@raulcd
Copy link
Member Author

raulcd commented Aug 27, 2024

Try reverting vpkg changes as suggested

@raulcd
Copy link
Member Author

raulcd commented Aug 27, 2024

@github-actions crossbow submit wheel-macos-monterey-cp310-amd64

Copy link

Revision: 6c31823

Submitted crossbow builds: ursacomputing/crossbow @ actions-3e4c817293

Task Status
wheel-macos-monterey-cp310-amd64 GitHub Actions

@raulcd
Copy link
Member Author

raulcd commented Aug 28, 2024

@github-actions crossbow submit wheel-macos-monterey-cp310-amd64

Copy link

Revision: ae29215

Submitted crossbow builds: ursacomputing/crossbow @ actions-224dbbf786

Task Status
wheel-macos-monterey-cp310-amd64 GitHub Actions

@raulcd
Copy link
Member Author

raulcd commented Aug 28, 2024

@github-actions crossbow submit wheel-macos-*

Copy link

Revision: 823e0ef

Submitted crossbow builds: ursacomputing/crossbow @ actions-e3d4d61b09

Task Status
wheel-macos-monterey-cp310-amd64 GitHub Actions
wheel-macos-monterey-cp310-arm64 GitHub Actions
wheel-macos-monterey-cp311-amd64 GitHub Actions
wheel-macos-monterey-cp311-arm64 GitHub Actions
wheel-macos-monterey-cp312-amd64 GitHub Actions
wheel-macos-monterey-cp312-arm64 GitHub Actions
wheel-macos-monterey-cp313-amd64 GitHub Actions
wheel-macos-monterey-cp313-arm64 GitHub Actions
wheel-macos-monterey-cp38-amd64 GitHub Actions
wheel-macos-monterey-cp38-arm64 GitHub Actions
wheel-macos-monterey-cp39-amd64 GitHub Actions
wheel-macos-monterey-cp39-arm64 GitHub Actions

@raulcd
Copy link
Member Author

raulcd commented Aug 28, 2024

@github-actions crossbow submit wheel-macos-*-arm64

@raulcd
Copy link
Member Author

raulcd commented Aug 28, 2024

@kou the issue gets fixed if I explicitly link flight to OpenSSL, do you think there is a reason we were not explicitly linking? I am confused on why this wasn't the case

Copy link

Revision: 47df184

Submitted crossbow builds: ursacomputing/crossbow @ actions-833a228fad

Task Status
wheel-macos-monterey-cp310-arm64 GitHub Actions
wheel-macos-monterey-cp311-arm64 GitHub Actions
wheel-macos-monterey-cp312-arm64 GitHub Actions
wheel-macos-monterey-cp313-arm64 GitHub Actions
wheel-macos-monterey-cp38-arm64 GitHub Actions
wheel-macos-monterey-cp39-arm64 GitHub Actions

Copy link
Member

@kou kou left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

the issue gets fixed if I explicitly link flight to OpenSSL, do you think there is a reason we were not explicitly linking? I am confused on why this wasn't the case

Yes. In general, we don't need to link to OpenSSL because Flight doesn't use OpenSSL API directly (no #include <openssl/*.h>) and gRPC also doesn't export OpenSSL API (grpcpp/*.h doesn't have #include <openssl/*.h>).

I'm not sure what has the cause of this (CoreFoundation? OpenSSL? linker?) but I think that this is the same workaround of #43137 (review) .

Could you add a comment that this is a workaround to the following part?

if(ARROW_USE_OPENSSL)
  list(APPEND ARROW_FLIGHT_LINK_LIBS ${ARROW_OPENSSL_LIBS})
endif()

cpp/src/arrow/flight/CMakeLists.txt Outdated Show resolved Hide resolved
@github-actions github-actions bot added awaiting merge Awaiting merge and removed awaiting review Awaiting review labels Aug 29, 2024
@raulcd
Copy link
Member Author

raulcd commented Aug 29, 2024

@github-actions crossbow submit wheel-macos-monterey-cp310-amd64

Copy link

Revision: 2a2052e

Submitted crossbow builds: ursacomputing/crossbow @ actions-d986864043

Task Status
wheel-macos-monterey-cp310-amd64 GitHub Actions

Copy link
Member

@jorisvandenbossche jorisvandenbossche left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for looking into this!

@raulcd raulcd merged commit 6db12f2 into apache:main Aug 29, 2024
37 of 40 checks passed
@raulcd raulcd removed the awaiting merge Awaiting merge label Aug 29, 2024
Copy link

After merging your PR, Conbench analyzed the 4 benchmarking runs that have been run so far on merge-commit 6db12f2.

There were no benchmark performance regressions. 🎉

The full Conbench report has more details. It also includes information about 4 possible false positives for unstable benchmarks that are known to sometimes produce them.

mapleFU pushed a commit to mapleFU/arrow that referenced this pull request Sep 3, 2024
…12 instead of 11 (apache#43137)

### Rationale for this change

As shown on the associated issue there seems to be a problem with `MACOSX_DEPLOYMENT_TARGET` 11 on the wheels.

### What changes are included in this PR?

Update `MACOSX_DEPLOYMENT_TARGET` everywhere to the latest supported macOS version.

### Are these changes tested?

Via CI, even though the issue was not reproducible on CI.

### Are there any user-facing changes?

Yes, wheels won't be available for macOS 11 but those were crashing on the previous release.
* GitHub Issue: apache#41696

Authored-by: Raúl Cumplido <[email protected]>
Signed-off-by: Raúl Cumplido <[email protected]>
khwilson pushed a commit to khwilson/arrow that referenced this pull request Sep 14, 2024
…12 instead of 11 (apache#43137)

### Rationale for this change

As shown on the associated issue there seems to be a problem with `MACOSX_DEPLOYMENT_TARGET` 11 on the wheels.

### What changes are included in this PR?

Update `MACOSX_DEPLOYMENT_TARGET` everywhere to the latest supported macOS version.

### Are these changes tested?

Via CI, even though the issue was not reproducible on CI.

### Are there any user-facing changes?

Yes, wheels won't be available for macOS 11 but those were crashing on the previous release.
* GitHub Issue: apache#41696

Authored-by: Raúl Cumplido <[email protected]>
Signed-off-by: Raúl Cumplido <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants