[CI][Packaging] Wheels for macOS Catalina are failing to build pyarrow with Could NOT find Python3

[raulcd]

Describe the bug, including details regarding any error messages, version, and platform.

The following jobs:
wheel-macos-catalina-cp310-amd64
wheel-macos-catalina-cp311-amd64
wheel-macos-catalina-cp312-amd64
wheel-macos-catalina-cp38-amd64
wheel-macos-catalina-cp39-amd64

Are failing to build due to the following error when finding Python building pyarrow:

-- Running cmake for PyArrow
cmake -DCMAKE_OSX_ARCHITECTURES=x86_64 -DARROW_SIMD_LEVEL=SSE4_2 -DCMAKE_INSTALL_PREFIX=/Users/runner/work/crossbow/crossbow/arrow/python/build/lib.macosx-10.15-x86_64-cpython-38/pyarrow -DPYTHON_EXECUTABLE=/Users/runner/work/crossbow/crossbow/build-env/bin/python -DPython3_EXECUTABLE=/Users/runner/work/crossbow/crossbow/build-env/bin/python -DPYARROW_CXXFLAGS= -G Ninja -DPYARROW_BUILD_CUDA=off -DPYARROW_BUILD_SUBSTRAIT=on -DPYARROW_BUILD_FLIGHT=on -DPYARROW_BUILD_GANDIVA=off -DPYARROW_BUILD_ACERO=on -DPYARROW_BUILD_DATASET=on -DPYARROW_BUILD_ORC=on -DPYARROW_BUILD_PARQUET=on -DPYARROW_BUILD_PARQUET_ENCRYPTION=on -DPYARROW_BUILD_AZURE=on -DPYARROW_BUILD_GCS=on -DPYARROW_BUILD_S3=on -DPYARROW_BUILD_HDFS=on -DPYARROW_BUNDLE_ARROW_CPP=on -DPYARROW_BUNDLE_CYTHON_CPP=off -DPYARROW_GENERATE_COVERAGE=off -DCMAKE_BUILD_TYPE=release -DCMAKE_VERBOSE_MAKEFILE=ON /Users/runner/work/crossbow/crossbow/arrow/python
-- The C compiler identification is AppleClang 15.0.0.15000040
-- The CXX compiler identification is AppleClang 15.0.0.15000040
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Check for working C compiler: /Applications/Xcode_15.0.1.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/clang - skipped
-- Detecting C compile features
-- Detecting C compile features - done
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Check for working CXX compiler: /Applications/Xcode_15.0.1.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/clang++ - skipped
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- System processor: arm64
-- Performing Test CXX_SUPPORTS_SVE
-- Performing Test CXX_SUPPORTS_SVE - Failed
-- Arrow build warning level: PRODUCTION
CMake Warning at cmake_modules/SetupCxxFlags.cmake:543 (message):
  ARROW_SIMD_LEVEL=SSE4_2 not supported by Arm.
Call Stack (most recent call first):
  CMakeLists.txt:163 (include)


-- Build Type: RELEASE
-- CMAKE_C_FLAGS:  -Wall -Wno-unknown-warning-option -Wno-pass-failed  -Qunused-arguments -fcolor-diagnostics  -fno-omit-frame-pointer -Wno-unused-variable -Wno-maybe-uninitialized -Wno-parentheses-equality -Wno-constant-logical-operand -Wno-missing-declarations -Wno-sometimes-uninitialized -Wno-return-type-c-linkage
-- CMAKE_CXX_FLAGS:  -fno-aligned-new  -Wall -Wno-unknown-warning-option -Wno-pass-failed  -Qunused-arguments -fcolor-diagnostics  -fno-omit-frame-pointer -Wno-unused-variable -Wno-maybe-uninitialized -Wno-parentheses-equality -Wno-constant-logical-operand -Wno-missing-declarations -Wno-sometimes-uninitialized -Wno-return-type-c-linkage
-- Generator: Ninja
-- Build output directory: /Users/runner/work/crossbow/crossbow/arrow/python/build/temp.macosx-10.15-x86_64-cpython-38/release
CMake Error at /Users/runner/work/crossbow/crossbow/local/CMake.app/Contents/share/cmake-3.29/Modules/FindPackageHandleStandardArgs.cmake:230 (message):
  Could NOT find Python3 (missing: Python3_NumPy_INCLUDE_DIRS NumPy) (found
  version "3.8.10")
Call Stack (most recent call first):
  /Users/runner/work/crossbow/crossbow/local/CMake.app/Contents/share/cmake-3.29/Modules/FindPackageHandleStandardArgs.cmake:600 (_FPHSA_FAILURE_MESSAGE)
  /Users/runner/work/crossbow/crossbow/local/CMake.app/Contents/share/cmake-3.29/Modules/FindPython/Support.cmake:3867 (find_package_handle_standard_args)
  /Users/runner/work/crossbow/crossbow/local/CMake.app/Contents/share/cmake-3.29/Modules/FindPython3.cmake:545 (include)
  cmake_modules/FindPython3Alt.cmake:51 (find_package)
  CMakeLists.txt:262 (find_package)

This is happening on the 16.1.0 branch too.

Component(s)

Continuous Integration, Packaging

[raulcd]

Issue resolved by pull request 41567
#41567