GH-43119: [CI][Packaging] Update manylinux 2014 CentOS repos that have been deprecated #43121

raulcd · 2024-07-02T15:34:58Z

Rationale for this change

Jobs are failing to find mirrorlist.centos.org

What changes are included in this PR?

Updating repos based on solution from: #43119 (comment)

Are these changes tested?

Via archery

Are there any user-facing changes?

No

GitHub Issue: [CI][Packaging] Could not resolve host: mirrorlist.centos.org; Unknown error on wheel almalinux 2014 jobs #43119

github-actions · 2024-07-02T15:35:27Z

⚠️ GitHub issue #43119 has been automatically assigned in GitHub to PR creator.

raulcd · 2024-07-02T15:35:48Z

@github-actions crossbow submit wheel-manylinux-2014*

raulcd · 2024-07-02T15:36:39Z

Testing if the above works. If it does I'll have to update also the java-jni jobs and the r-binary jobs

and the centos ones

…at have been deprecated

raulcd · 2024-07-02T15:48:15Z

@github-actions crossbow submit wheel-manylinux-2014-cp310-arm64

raulcd · 2024-07-02T16:01:08Z

It seems that vault.centos.org does not have aarch64, error:

failed to solve: process "/bin/sh -c yum install -y dnf" did not complete successfully: exit code: 1
#8 1.314 http://vault.centos.org/centos/7/sclo/aarch64/rh/repodata/repomd.xml: [Errno 14] HTTPS Error 404 - Not Found
#8 1.314 Trying other mirror.

See: https://vault.centos.org/centos/7/sclo/

ianmcook · 2024-07-02T17:57:38Z

@raulcd looks like the aarch64 packages are in a different place: https://vault.centos.org/altarch/7/sclo/

kou · 2024-07-03T07:24:58Z

ci/docker/python-wheel-manylinux.dockerfile

+RUN if [ "${MANYLINUX_VERSION}" == "2014" ]; then \
+        sed -i s/mirror.centos.org/vault.centos.org/g /etc/yum.repos.d/*.repo && \
+        sed -i s/^#.*baseurl=http/baseurl=http/g /etc/yum.repos.d/*.repo && \
+        sed -i s/^mirrorlist=http/#mirrorlist=http/g /etc/yum.repos.d/*.repo; \


We can use one sed: 69e8a78

kou · 2024-07-03T07:57:10Z

@github-actions crossbow submit wheel-manylinux-2014*

github-actions · 2024-07-03T07:59:33Z

Revision: 7e1783e

Submitted crossbow builds: ursacomputing/crossbow @ actions-09ee86b70a

Task	Status
wheel-manylinux-2014-cp310-amd64
wheel-manylinux-2014-cp310-arm64
wheel-manylinux-2014-cp311-amd64
wheel-manylinux-2014-cp311-arm64
wheel-manylinux-2014-cp312-amd64
wheel-manylinux-2014-cp312-arm64
wheel-manylinux-2014-cp38-amd64
wheel-manylinux-2014-cp38-arm64
wheel-manylinux-2014-cp39-amd64
wheel-manylinux-2014-cp39-arm64

raulcd · 2024-07-03T09:49:02Z

@github-actions crossbow submit java-jars

github-actions · 2024-07-03T09:51:16Z

Revision: 7e1783e

Submitted crossbow builds: ursacomputing/crossbow @ actions-69b8b5c0cf

Task	Status
java-jars

raulcd · 2024-07-03T09:54:50Z

@github-actions crossbow submit r-binary-packages

raulcd · 2024-07-03T09:56:09Z

@kou maybe we should add my last commit to your PR instead but I think is ok to have it here. From what I can see this Dockerfile is only used on the r-binary-packages job

…repos.d/CentOS-SCLo-scl-rh.repo to try and understand why it errors with Cannot find a valid baseurl for repo: centos-sclo-sclo

raulcd · 2024-07-03T11:54:48Z

@github-actions crossbow submit r-binary-packages

raulcd · 2024-07-03T12:12:33Z

@github-actions crossbow submit r-binary-packages

github-actions · 2024-07-03T12:14:52Z

Revision: feee355

Submitted crossbow builds: ursacomputing/crossbow @ actions-b2840706bf

Task	Status
r-binary-packages

raulcd · 2024-07-03T12:17:23Z

ci/docker/centos-7-cpp.dockerfile

+  sed -i \
+    -e 's/^mirrorlist/#mirrorlist/' \
+    -e 's/^#baseurl/baseurl/' \
+    -e 's/^# baseurl/baseurl/' \


finding this one took a bunch of tests :P

raulcd

👍

…e been deprecated (#43121) ### Rationale for this change Jobs are failing to find mirrorlist.centos.org ### What changes are included in this PR? Updating repos based on solution from: #43119 (comment) ### Are these changes tested? Via archery ### Are there any user-facing changes? No * GitHub Issue: #43119 Lead-authored-by: Raúl Cumplido <[email protected]> Co-authored-by: Sutou Kouhei <[email protected]> Co-authored-by: Sutou Kouhei <[email protected]> Signed-off-by: Raúl Cumplido <[email protected]>

conbench-apache-arrow · 2024-07-03T22:51:22Z

After merging your PR, Conbench analyzed the 4 benchmarking runs that have been run so far on merge-commit e59832f.

There were no benchmark performance regressions. 🎉

The full Conbench report has more details. It also includes information about 82 possible false positives for unstable benchmarks that are known to sometimes produce them.

…at have been deprecated (apache#43121) ### Rationale for this change Jobs are failing to find mirrorlist.centos.org ### What changes are included in this PR? Updating repos based on solution from: apache#43119 (comment) ### Are these changes tested? Via archery ### Are there any user-facing changes? No * GitHub Issue: apache#43119 Lead-authored-by: Raúl Cumplido <[email protected]> Co-authored-by: Sutou Kouhei <[email protected]> Co-authored-by: Sutou Kouhei <[email protected]> Signed-off-by: Raúl Cumplido <[email protected]>

…at have been deprecated (apache#43121) Jobs are failing to find mirrorlist.centos.org Updating repos based on solution from: apache#43119 (comment) Via archery No * GitHub Issue: apache#43119 Lead-authored-by: Raúl Cumplido <[email protected]> Co-authored-by: Sutou Kouhei <[email protected]> Co-authored-by: Sutou Kouhei <[email protected]> Signed-off-by: Raúl Cumplido <[email protected]>

…at have been deprecated (apache#43121) ### Rationale for this change Jobs are failing to find mirrorlist.centos.org ### What changes are included in this PR? Updating repos based on solution from: apache#43119 (comment) ### Are these changes tested? Via archery ### Are there any user-facing changes? No * GitHub Issue: apache#43119 Lead-authored-by: Raúl Cumplido <[email protected]> Co-authored-by: Sutou Kouhei <[email protected]> Co-authored-by: Sutou Kouhei <[email protected]> Signed-off-by: Raúl Cumplido <[email protected]>

…at have been deprecated (apache#43121) Jobs are failing to find mirrorlist.centos.org Updating repos based on solution from: apache#43119 (comment) Via archery No * GitHub Issue: apache#43119 Lead-authored-by: Raúl Cumplido <[email protected]> Co-authored-by: Sutou Kouhei <[email protected]> Co-authored-by: Sutou Kouhei <[email protected]> Signed-off-by: Raúl Cumplido <[email protected]>

…Like f… (#78) * apacheGH-40968: [C++][Gandiva] add RE2::Options set_dot_nl(true) for Like function * apacheGH-43119: [CI][Packaging] Update manylinux 2014 CentOS repos that have been deprecated (apache#43121) ### Rationale for this change Jobs are failing to find mirrorlist.centos.org ### What changes are included in this PR? Updating repos based on solution from: apache#43119 (comment) ### Are these changes tested? Via archery ### Are there any user-facing changes? No * GitHub Issue: apache#43119 Lead-authored-by: Raúl Cumplido <[email protected]> Co-authored-by: Sutou Kouhei <[email protected]> Co-authored-by: Sutou Kouhei <[email protected]> Signed-off-by: Raúl Cumplido <[email protected]> --------- Signed-off-by: Raúl Cumplido <[email protected]> Co-authored-by: Raúl Cumplido <[email protected]> Co-authored-by: Sutou Kouhei <[email protected]> Co-authored-by: Sutou Kouhei <[email protected]>

…at have been deprecated (apache#43121) Jobs are failing to find mirrorlist.centos.org Updating repos based on solution from: apache#43119 (comment) Via archery No * GitHub Issue: apache#43119 Lead-authored-by: Raúl Cumplido <[email protected]> Co-authored-by: Sutou Kouhei <[email protected]> Co-authored-by: Sutou Kouhei <[email protected]> Signed-off-by: Raúl Cumplido <[email protected]>

…Like f (#80) * apacheGH-40968: [C++][Gandiva] add RE2::Options set_dot_nl(true) for Like function (apache#40970) (#68) Gandiva function "LIKE" does not always work correctly when the string contains \n. String value: `[function_name: "Space1.protect"\nargs: "passenger_count"\ncolumn_name: "passenger_count" ]` Pattern '%Space1%' nor '%Space1.%' do not match. added flag set_dot_nl(true) to LikeHolder add unit tests. Yes **This PR includes breaking changes to public APIs.** * GitHub Issue: apache#40968 Lead-authored-by: Ivan Chesnov <[email protected]> Signed-off-by: Sutou Kouhei <[email protected]> * apacheGH-43119: [CI][Packaging] Update manylinux 2014 CentOS repos that have been deprecated (apache#43121) Jobs are failing to find mirrorlist.centos.org Updating repos based on solution from: apache#43119 (comment) Via archery No * GitHub Issue: apache#43119 Lead-authored-by: Raúl Cumplido <[email protected]> Co-authored-by: Sutou Kouhei <[email protected]> Co-authored-by: Sutou Kouhei <[email protected]> Signed-off-by: Raúl Cumplido <[email protected]> --------- Signed-off-by: Sutou Kouhei <[email protected]> Signed-off-by: Raúl Cumplido <[email protected]> Co-authored-by: Raúl Cumplido <[email protected]> Co-authored-by: Sutou Kouhei <[email protected]> Co-authored-by: Sutou Kouhei <[email protected]>

…at have been deprecated (apache#43121) ### Rationale for this change Jobs are failing to find mirrorlist.centos.org ### What changes are included in this PR? Updating repos based on solution from: apache#43119 (comment) ### Are these changes tested? Via archery ### Are there any user-facing changes? No * GitHub Issue: apache#43119 Lead-authored-by: Raúl Cumplido <[email protected]> Co-authored-by: Sutou Kouhei <[email protected]> Co-authored-by: Sutou Kouhei <[email protected]> Signed-off-by: Raúl Cumplido <[email protected]>

…ixes. (#81) * apacheGH-30866: [Java] fix SplitAndTransfer throws for (0,0) if vector empty (apache#41066) This is addresses https://issues.apache.org/jira/browse/ARROW-15382 and is reopening of apache#12250 (which I asked to be reopened). I tried to address all the comments from the previous discussion, added some more tests and fixed an issue in the old commit. * GitHub Issue: apache#30866 Authored-by: Finn Völkel <[email protected]> Signed-off-by: David Li <[email protected]> * apacheGH-43463: [C++][Gandiva] Always use gdv_function_stubs.h in context_helper.cc (apache#43464) ### Rationale for this change `gdv_function_stubs.h` has declarations of functions in `context_helper.cc`. If we don't include `gdv_function_stubs.h`, it causes attribution mismatch error with unity build. ### What changes are included in this PR? Always include `gdv_function_stubs.h` in `context_helper.cc`. ### Are these changes tested? Yes. ### Are there any user-facing changes? No. * GitHub Issue: apache#43463 Authored-by: Sutou Kouhei <[email protected]> Signed-off-by: Sutou Kouhei <[email protected]> * apacheGH-43119: [CI][Packaging] Update manylinux 2014 CentOS repos that have been deprecated (apache#43121) ### Rationale for this change Jobs are failing to find mirrorlist.centos.org ### What changes are included in this PR? Updating repos based on solution from: apache#43119 (comment) ### Are these changes tested? Via archery ### Are there any user-facing changes? No * GitHub Issue: apache#43119 Lead-authored-by: Raúl Cumplido <[email protected]> Co-authored-by: Sutou Kouhei <[email protected]> Co-authored-by: Sutou Kouhei <[email protected]> Signed-off-by: Raúl Cumplido <[email protected]> * Update macos deployment target to 12 to match build machine. * apacheGH-43400: [C++] Ensure using bundled GoogleTest when we use bundled GoogleTest (apache#43465) ### Rationale for this change If we use bundled GoogleTest and system other dependencies such as Boost, our include path options may be: * `-isystem /opt/homebrew/include` (for Boost) * `-isystem build_dir/_deps/googletest-src/googletest` (for bundled GoogleTest) * `-isystem build_dir/_deps/googletest-src/googlemock` (for bundled GoogleTest) With this order, GoogleTest headers in `/opt/homebrew/include/` are used with bundled GoogleTest. It may cause link errors. ### What changes are included in this PR? This change introduces a new CMake target `arrow::GTest::gtest_headers` that has include paths for bundled GoogleTest. And it's always used as the first link library of all test program. With this change, our include path options are: * `-isystem build_dir/_deps/googletest-src/googletest` (for bundled GoogleTest) * `-isystem build_dir/_deps/googletest-src/googlemock` (for bundled GoogleTest) * `-isystem /opt/homebrew/include` (for Boost) With this order, we can always use our bundled GoogleTest. `arrow::GTest::gtest_headers` is defined only when we use bundled GoogleTest. So this doesn't change the system GoogleTest case. ### Are these changes tested? Yes. ### Are there any user-facing changes? Yes. * GitHub Issue: apache#43400 Authored-by: Sutou Kouhei <[email protected]> Signed-off-by: Jacob Wujciak-Jens <[email protected]> --------- Signed-off-by: David Li <[email protected]> Signed-off-by: Sutou Kouhei <[email protected]> Signed-off-by: Raúl Cumplido <[email protected]> Signed-off-by: Jacob Wujciak-Jens <[email protected]> Co-authored-by: Finn Völkel <[email protected]> Co-authored-by: Sutou Kouhei <[email protected]> Co-authored-by: Raúl Cumplido <[email protected]> Co-authored-by: Sutou Kouhei <[email protected]>

…at have been deprecated (apache#43121) ### Rationale for this change Jobs are failing to find mirrorlist.centos.org ### What changes are included in this PR? Updating repos based on solution from: apache#43119 (comment) ### Are these changes tested? Via archery ### Are there any user-facing changes? No * GitHub Issue: apache#43119 Lead-authored-by: Raúl Cumplido <[email protected]> Co-authored-by: Sutou Kouhei <[email protected]> Co-authored-by: Sutou Kouhei <[email protected]> Signed-off-by: Raúl Cumplido <[email protected]>

raulcd requested review from assignUser and kou as code owners July 2, 2024 15:34

github-actions bot added the awaiting committer review Awaiting committer review label Jul 2, 2024

This comment was marked as outdated.

Sign in to view

apacheGH-43119: [CI][Packaging] Update Manylinux 2014 Centos repos th…

5115592

…at have been deprecated

raulcd force-pushed the GH-43119 branch from af6fa64 to 5115592 Compare July 2, 2024 15:47

This comment was marked as outdated.

Sign in to view

kou changed the title ~~GH-43119: [CI][Packaging] Update Manylinux 2014 Centos repos that have been deprecated~~ GH-43119: [CI][Packaging] Update Manylinux 2014 CentOS repos that have been deprecated Jul 2, 2024

kou changed the title ~~GH-43119: [CI][Packaging] Update Manylinux 2014 CentOS repos that have been deprecated~~ GH-43119: [CI][Packaging] Update manylinux 2014 CentOS repos that have been deprecated Jul 2, 2024

kou reviewed Jul 3, 2024

View reviewed changes

github-actions bot added awaiting changes Awaiting changes and removed awaiting committer review Awaiting committer review labels Jul 3, 2024

Adjust URL for SCL repository for arm64v8

7e1783e

github-actions bot added awaiting change review Awaiting change review and removed awaiting changes Awaiting changes labels Jul 3, 2024

Update centos-7 dockerfile to fix failures on r-binaries too

968c261

This comment was marked as outdated.

Sign in to view

Update repos after installing other repos

6237689

github-actions bot added the awaiting change review Awaiting change review label Jul 3, 2024

This comment was marked as outdated.

Sign in to view

Debug contents of /etc/yum.repos.d/CentOS-SCLo-scl.repo and /etc/yum.…

301c79d

…repos.d/CentOS-SCLo-scl-rh.repo to try and understand why it errors with Cannot find a valid baseurl for repo: centos-sclo-sclo

This comment was marked as outdated.

Sign in to view

Fix wrongly commented SCLo mirror base URL

feee355

raulcd commented Jul 3, 2024

View reviewed changes

github-actions bot added awaiting changes Awaiting changes and removed awaiting change review Awaiting change review labels Jul 3, 2024

raulcd commented Jul 3, 2024

View reviewed changes

raulcd merged commit e59832f into apache:main Jul 3, 2024
47 of 53 checks passed

raulcd removed the awaiting changes Awaiting changes label Jul 3, 2024

raulcd mentioned this pull request Jul 3, 2024

[CI][Packaging] Could not resolve host: mirrorlist.centos.org; Unknown error on wheel almalinux 2014 jobs #43119

Closed

raulcd deleted the GH-43119 branch July 3, 2024 14:19

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

GH-43119: [CI][Packaging] Update manylinux 2014 CentOS repos that have been deprecated #43121

GH-43119: [CI][Packaging] Update manylinux 2014 CentOS repos that have been deprecated #43121

raulcd commented Jul 2, 2024 •

edited by github-actions bot

Loading

github-actions bot commented Jul 2, 2024

raulcd commented Jul 2, 2024

raulcd commented Jul 2, 2024 •

edited

Loading

This comment was marked as outdated.

raulcd commented Jul 2, 2024

This comment was marked as outdated.

raulcd commented Jul 2, 2024

ianmcook commented Jul 2, 2024 •

edited

Loading

kou Jul 3, 2024

kou commented Jul 3, 2024

github-actions bot commented Jul 3, 2024

raulcd commented Jul 3, 2024

github-actions bot commented Jul 3, 2024

raulcd commented Jul 3, 2024

raulcd commented Jul 3, 2024

This comment was marked as outdated.

This comment was marked as outdated.

raulcd commented Jul 3, 2024

This comment was marked as outdated.

raulcd commented Jul 3, 2024

github-actions bot commented Jul 3, 2024

raulcd Jul 3, 2024

raulcd left a comment

conbench-apache-arrow bot commented Jul 3, 2024

GH-43119: [CI][Packaging] Update manylinux 2014 CentOS repos that have been deprecated #43121

GH-43119: [CI][Packaging] Update manylinux 2014 CentOS repos that have been deprecated #43121

Conversation

raulcd commented Jul 2, 2024 • edited by github-actions bot Loading

Rationale for this change

What changes are included in this PR?

Are these changes tested?

Are there any user-facing changes?

github-actions bot commented Jul 2, 2024

raulcd commented Jul 2, 2024

raulcd commented Jul 2, 2024 • edited Loading

This comment was marked as outdated.

raulcd commented Jul 2, 2024

This comment was marked as outdated.

raulcd commented Jul 2, 2024

ianmcook commented Jul 2, 2024 • edited Loading

kou Jul 3, 2024

Choose a reason for hiding this comment

kou commented Jul 3, 2024

github-actions bot commented Jul 3, 2024

raulcd commented Jul 3, 2024

github-actions bot commented Jul 3, 2024

raulcd commented Jul 3, 2024

raulcd commented Jul 3, 2024

This comment was marked as outdated.

This comment was marked as outdated.

raulcd commented Jul 3, 2024

This comment was marked as outdated.

raulcd commented Jul 3, 2024

github-actions bot commented Jul 3, 2024

raulcd Jul 3, 2024

Choose a reason for hiding this comment

raulcd left a comment

Choose a reason for hiding this comment

conbench-apache-arrow bot commented Jul 3, 2024

raulcd commented Jul 2, 2024 •

edited by github-actions bot

Loading

raulcd commented Jul 2, 2024 •

edited

Loading

ianmcook commented Jul 2, 2024 •

edited

Loading