Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Packaging][Release] centos-9 on arm64 is failing #44422

Closed
raulcd opened this issue Oct 15, 2024 · 4 comments
Closed

[Packaging][Release] centos-9 on arm64 is failing #44422

raulcd opened this issue Oct 15, 2024 · 4 comments
Assignees
@kou
Labels
Component: Packaging Component: Release Priority: Blocker Marks a blocker for the release Type: bug
Milestone
18.0.0

Comments

@raulcd
Copy link
Member

raulcd commented Oct 15, 2024

Describe the bug, including details regarding any error messages, version, and platform.

The centos-9-stream-arm64 job is failing consistently testing with:

   ++ arch
  + release_path+=/9-stream/aarch64/Packages
  + release_path+=/apache-arrow-release-18.0.0.dev453-1.el9.noarch.rpm
  + dnf install -y --enablerepo=crb /host/dev/release/../../dev/tasks/linux-packages/yum/repositories/centos/9-stream/aarch64/Packages/apache-arrow-release-18.0.0.dev453-1.el9.noarch.rpm
  CentOS Stream 9 - BaseOS                         14 MB/s | 9.4 MB     00:00    
  CentOS Stream 9 - AppStream                     770  B/s | 4.4 kB     00:05    
  Errors during downloading metadata for repository 'appstream':
    - Downloading successful, but checksum doesn't match. Calculated: ef16d195332d673efbe2fc9a316726df177a605e1caef3ca49f88a7181f973654347400cb50ee464dd7206fc9a59c34cf37d0baea158add0bde531cb7cab8039(sha512)  Expected: b2b0cdc3fdc6021ff6ddd33a4b508daa7050cc8cdfca7dd9aa6c854ed80dd39b4fd5bfa6e66db2c37e0ad25cee9f53e7b24b84d7f302f2ca07198439524d1c99(sha512) 
  Error: Failed to download metadata for repo 'appstream': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried
  rake aborted!

This is happening on the maintenance branch for 18.0.0. I've retried the job there several times, see: https://github.com/ursacomputing/crossbow/actions/runs/11344859386
It fails consistently.

Component(s)

Packaging, Release
@raulcd
Copy link
Member Author

raulcd commented Oct 15, 2024

A new issue has appeared :(
@kou any idea?

@raulcd raulcd modified the milestones: 19.0.0, 18.0.0 Oct 15, 2024
@raulcd raulcd added the Priority: Blocker Marks a blocker for the release label Oct 15, 2024
kou added a commit to kou/arrow that referenced this issue Oct 16, 2024
@kou
apacheGH-44422: [Packaging][Release] Fix centos-9 on arm64 test
ec65306
@github-actions github-actions bot mentioned this issue Oct 16, 2024
Merged
@kou
Copy link
Member

kou commented Oct 16, 2024

It seems that the current quay.io/centos/centos:stream9 for linux/aarch64 is broken`:

$ docker run --platform linux/aarch64 -it --rm quay.io/centos/centos:stream9
[root@2fec18b5cf70 /]# dnf update -y
CentOS Stream 9 - BaseOS                                                                             2.8 MB/s | 9.4 MB     00:03    
CentOS Stream 9 - AppStream                                                                          161  B/s | 4.4 kB     00:27    
Errors during downloading metadata for repository 'appstream':
  - Downloading successful, but checksum doesn't match. Calculated: ef16d195332d673efbe2fc9a316726df177a605e1caef3ca49f88a7181f973654347400cb50ee464dd7206fc9a59c34cf37d0baea158add0bde531cb7cab8039(sha512)  Expected: b2b0cdc3fdc6021ff6ddd33a4b508daa7050cc8cdfca7dd9aa6c854ed80dd39b4fd5bfa6e66db2c37e0ad25cee9f53e7b24b84d7f302f2ca07198439524d1c99(sha512) 
Error: Failed to download metadata for repo 'appstream': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried

Fortunately, the broken image is used only for test. We use cached (a bit old) image for build. So we can build RPM for CentOS Stream 9.

How about uploading built RPMs before test?
GH-44425

The job is still failing but we can use the built RPMs for 18.0.0.

raulcd pushed a commit that referenced this issue Oct 16, 2024
@kou
GH-44422: [Packaging][Release][Linux] Upload artifacts before test (#…
0577ff6 
…44425)

### Rationale for this change

It seems that the current `quay.io/centos/centos:stream9` for `linux/aarch64` is broken.

We use it for building and testing but testing is only broken for now. Because we use cached (a bit old) `quay.io/centos/centos:stream9` for now. Building will be failed when the cache is expired.

### What changes are included in this PR?

Change upload phase to after the build from after the test. Test is still failing but we can proceed our release process by this.

### Are these changes tested?

Yes.

### Are there any user-facing changes?

No.
* GitHub Issue: #44422

Authored-by: Sutou Kouhei <[email protected]>
Signed-off-by: Raúl Cumplido <[email protected]>
@raulcd
Copy link
Member Author

raulcd commented Oct 16, 2024

Issue resolved by pull request 44425
#44425

@raulcd raulcd closed this as completed Oct 16, 2024
raulcd pushed a commit that referenced this issue Oct 16, 2024
@kou @raulcd
GH-44422: [Packaging][Release][Linux] Upload artifacts before test (#…
5d7987b 
…44425)

### Rationale for this change

It seems that the current `quay.io/centos/centos:stream9` for `linux/aarch64` is broken.

We use it for building and testing but testing is only broken for now. Because we use cached (a bit old) `quay.io/centos/centos:stream9` for now. Building will be failed when the cache is expired.

### What changes are included in this PR?

Change upload phase to after the build from after the test. Test is still failing but we can proceed our release process by this.

### Are these changes tested?

Yes.

### Are there any user-facing changes?

No.
* GitHub Issue: #44422

Authored-by: Sutou Kouhei <[email protected]>
Signed-off-by: Raúl Cumplido <[email protected]>
@raulcd raulcd mentioned this issue Oct 16, 2024
Closed
@raulcd
Copy link
Member Author

raulcd commented Oct 16, 2024

I've created this as a follow up to revert the change: #44439

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@kou kou

Labels
Component: Packaging Component: Release Priority: Blocker Marks a blocker for the release Type: bug
Projects
None yet
Milestone
18.0.0
Development

No branches or pull requests
2 participants
@kou @raulcd