Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Nightly feedstock build failed #147

Closed
github-actions bot opened this issue Oct 11, 2024 · 31 comments
Closed

Nightly feedstock build failed #147

github-actions bot opened this issue Oct 11, 2024 · 31 comments
Assignees
@ihnorton @jdblischak @shaunrd0 @kounelisagis
Labels
nightly-failure

Comments

@github-actions
Copy link

Nightly feedstock build failure for tiledbfeedstock_CI at https://dev.azure.com/TileDB-Inc/CI/_build?definitionId=4&_a=summary
@github-actions GitHub Actions
Copy link
Author

Nightly feedstock build failure for TileDB-Py%20Feedstock%20Testing at https://dev.azure.com/TileDB-Inc/CI/_build?definitionId=5&_a=summary

@github-actions GitHub Actions
Copy link
Author

Nightly feedstock build failure for tiledbfeedstock_CI at https://dev.azure.com/TileDB-Inc/CI/_build?definitionId=4&_a=summary

@github-actions GitHub Actions
Copy link
Author

Nightly feedstock build failure for TileDB-Py%20Feedstock%20Testing at https://dev.azure.com/TileDB-Inc/CI/_build?definitionId=5&_a=summary

@github-actions GitHub Actions
Copy link
Author

Nightly feedstock build failure for tiledbfeedstock_CI at https://dev.azure.com/TileDB-Inc/CI/_build?definitionId=4&_a=summary

@github-actions GitHub Actions
Copy link
Author

Nightly feedstock build failure for TileDB-Py%20Feedstock%20Testing at https://dev.azure.com/TileDB-Inc/CI/_build?definitionId=5&_a=summary

@github-actions GitHub Actions
Copy link
Author

Nightly feedstock build failure for tiledbfeedstock_CI at https://dev.azure.com/TileDB-Inc/CI/_build?definitionId=4&_a=summary

@github-actions GitHub Actions
Copy link
Author

Nightly feedstock build failure for TileDB-Py%20Feedstock%20Testing at https://dev.azure.com/TileDB-Inc/CI/_build?definitionId=5&_a=summary

@github-actions GitHub Actions
Copy link
Author

Nightly feedstock build failure for tiledbfeedstock_CI at https://dev.azure.com/TileDB-Inc/CI/_build?definitionId=4&_a=summary

@github-actions GitHub Actions
Copy link
Author

Nightly feedstock build failure for TileDB-Py%20Feedstock%20Testing at https://dev.azure.com/TileDB-Inc/CI/_build?definitionId=5&_a=summary

@jdblischak
Copy link
Collaborator

The tiledb-feedstock osx-arm64 build is failing. Looks like libmagic problems again. @teo-tsirpanis could you please investigate?

Installing 5/18 libmagic:[email protected]#1...
Building libmagic:[email protected]#1...
$SRC_DIR/triplets/arm64-osx.cmake: info: loaded overlay triplet from here
$SRC_DIR/ports/libmagic: info: installing overlay port from here
-- Downloading https://github.com/file/file/archive/FILE5_45.tar.gz -> file-file-FILE5_45.tar.gz...
-- Extracting source $SRC_DIR/build/_deps/vcpkg-src/downloads/file-file-FILE5_45.tar.gz
-- Applying patch 0001-Use-pcre2.patch
-- Using source at $SRC_DIR/build/_deps/vcpkg-src/buildtrees/libmagic/src/FILE5_45-3941a70d66.clean
-- Configuring arm64-osx
-- Building arm64-osx-rel
CMake Error at scripts/cmake/vcpkg_execute_build_process.cmake:134 (message):
    Command failed: $BUILD_PREFIX/bin/cmake --build . --config Release --target install -- -v -j5
    Working Directory: $SRC_DIR/build/_deps/vcpkg-src/buildtrees/libmagic/arm64-osx-rel
    See logs for more information:
      $SRC_DIR/build/_deps/vcpkg-src/buildtrees/libmagic/install-arm64-osx-rel-out.log

Call Stack (most recent call first):
  $SRC_DIR/build/vcpkg_installed/x64-osx/share/vcpkg-cmake/vcpkg_cmake_build.cmake:74 (vcpkg_execute_build_process)
  $SRC_DIR/build/vcpkg_installed/x64-osx/share/vcpkg-cmake/vcpkg_cmake_install.cmake:16 (vcpkg_cmake_build)
  $SRC_DIR/ports/libmagic/portfile.cmake:38 (vcpkg_cmake_install)
  scripts/ports.cmake:192 (include)


error: building libmagic:arm64-osx failed with: BUILD_FAILEDSee https://learn.microsoft.com/vcpkg/troubleshoot/build-failures?WT.mc_id=vcpkg_inproduct_cli for more information.
Elapsed time to handle libmagic:arm64-osx: 14 s

@teo-tsirpanis
Copy link
Member

Will investigate…

@teo-tsirpanis
Copy link
Member

When cross-compiling to osx-arm64, the libmagic port runs the system's "file" command to generate magic.mgc. There are two ways to fix it:

  • Fix the port to support cross-compilation. It was attempted but reverted due to failures when cross-compiling from x64-linux to x64-linux-release (yes it's as weird as it sounds). Work on this is being done in TileDB-Inc/TileDB#5538.
  • Run brew install [email protected] in the feedstock's build script. Can we do that? It is a system-wide operation and might not be allowed if end users will regularly build the feedstock. But it will only happen if they cross-compile from x64 to arm64 macOS, so it might not be a big problem?

@teo-tsirpanis
Copy link
Member

Turns out the macOS images do not have Homebrew installed.

@github-actions GitHub Actions
Copy link
Author

Nightly feedstock build failure for tiledbfeedstock_CI at https://dev.azure.com/TileDB-Inc/CI/_build?definitionId=4&_a=summary

@github-actions GitHub Actions
Copy link
Author

Nightly feedstock build failure for TileDB-Py%20Feedstock%20Testing at https://dev.azure.com/TileDB-Inc/CI/_build?definitionId=5&_a=summary

@jdblischak
Copy link
Collaborator

A question and an idea:

@github-actions GitHub Actions
Copy link
Author

Nightly feedstock build failure for tiledbfeedstock_CI at https://dev.azure.com/TileDB-Inc/CI/_build?definitionId=4&_a=summary

@github-actions GitHub Actions
Copy link
Author

Nightly feedstock build failure for TileDB-Py%20Feedstock%20Testing at https://dev.azure.com/TileDB-Inc/CI/_build?definitionId=5&_a=summary

@teo-tsirpanis
Copy link
Member

What happened upstream in TileDB to cause the libmagic compilation to start failing on osx-arm64?

We updated libmagic from 5.40 to 5.45. This was necessary to avoid version differences when cross-compiling to linux-arm64, which uses the cross-compilation-capable upstream vcpkg port.

Updating the existing port to support cross-compilation caused some mysterious errors. Work on it is being done in TileDB-Inc/TileDB#5338.

Would it be possible to install libmagic from conda-forge for the osx-arm64 build?

No, we need version 5.45.

@github-actions GitHub Actions
Copy link
Author

Nightly feedstock build failure for tiledbfeedstock_CI at https://dev.azure.com/TileDB-Inc/CI/_build?definitionId=4&_a=summary

@github-actions GitHub Actions
Copy link
Author

Nightly feedstock build failure for TileDB-Py%20Feedstock%20Testing at https://dev.azure.com/TileDB-Inc/CI/_build?definitionId=5&_a=summary

@github-actions GitHub Actions
Copy link
Author

Nightly feedstock build failure for tiledbfeedstock_CI at https://dev.azure.com/TileDB-Inc/CI/_build?definitionId=4&_a=summary

@github-actions GitHub Actions
Copy link
Author

Nightly feedstock build failure for TileDB-Py%20Feedstock%20Testing at https://dev.azure.com/TileDB-Inc/CI/_build?definitionId=5&_a=summary

@teo-tsirpanis
Copy link
Member

Will be fixed by TileDB-Inc/TileDB#5338.

@github-actions GitHub Actions
Copy link
Author

Nightly feedstock build failure for tiledbfeedstock_CI at https://dev.azure.com/TileDB-Inc/CI/_build?definitionId=4&_a=summary

@github-actions GitHub Actions
Copy link
Author

Nightly feedstock build failure for TileDB-Py%20Feedstock%20Testing at https://dev.azure.com/TileDB-Inc/CI/_build?definitionId=5&_a=summary

@github-actions GitHub Actions
Copy link
Author

Nightly feedstock build failure for tiledbfeedstock_CI at https://dev.azure.com/TileDB-Inc/CI/_build?definitionId=4&_a=summary

@github-actions GitHub Actions
Copy link
Author

Nightly feedstock build failure for TileDB-Py%20Feedstock%20Testing at https://dev.azure.com/TileDB-Inc/CI/_build?definitionId=5&_a=summary

@github-actions GitHub Actions
Copy link
Author

Nightly feedstock build failure for tiledbfeedstock_CI at https://dev.azure.com/TileDB-Inc/CI/_build?definitionId=4&_a=summary

@github-actions GitHub Actions
Copy link
Author

Nightly feedstock build failure for TileDB-Py%20Feedstock%20Testing at https://dev.azure.com/TileDB-Inc/CI/_build?definitionId=5&_a=summary

@jdblischak
Copy link
Collaborator

Fixed by TileDB-Inc/TileDB#5338

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@ihnorton ihnorton

@jdblischak jdblischak

@shaunrd0 shaunrd0

@kounelisagis kounelisagis

Labels
nightly-failure
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
5 participants
@ihnorton @jdblischak @teo-tsirpanis @shaunrd0 @kounelisagis