Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Something wrong with https://conda.anaconda.org/conda-forge/osx-64/arpack-3.6.1-blas_openblash1f444ea_0.tar.bz2 #797

Open
wolfv opened this issue Jul 29, 2023 · 18 comments

Comments

@wolfv
Copy link

wolfv commented Jul 29, 2023

@barabo
Copy link

barabo commented Aug 9, 2023

I'll have to dig into how this happened, but the cached copy of that package is not correct in the clone.

(base) [ec2-user@cf-clone conda-forge]$ ls osx-64/arpack-3.6.1-blas_openblash1f444ea_0* -l
-rw-r--r-- 1 ec2-user ec2-user 186510 Sep 28  2022 osx-64/arpack-3.6.1-blas_openblash1f444ea_0.tar.bz2.ec52aad18145da1c0da7ac344ba21fd1

It also looks like it's a year or so old. I'll look into it tomorrow and report back.

@jaimergp
Copy link
Contributor

Hey @barabo, I think this is still happening. Do you have any updates? Thanks!

@barabo
Copy link

barabo commented Oct 11, 2023

There seems to be a discrepancy in the expected file size for this file. The cache DB lists two different sizes, both with the same md5 - so that's probably why it's been refusing to push the file through the CDN.

Sorry for the delay on this!

@barabo
Copy link

barabo commented Oct 11, 2023

Apparently this package is now in the removed section of repodata.json. If it's needed, I believe you can remove it from there and it should propagate.

@jezdez
Copy link
Member

jezdez commented Dec 15, 2023

@wolfv Can you verify if this resolves your issue please?

@jaimergp
Copy link
Contributor

Hm, I was looking into this last week, and just realized that there are mroe 404s in osx-64:

# https://conda.anaconda.org/conda-forge/osx-64/arpack-3.6.1-blas_openblash1f444ea_0.tar.bz2
https://conda.anaconda.org/conda-forge/osx-64/lammps-2018.03.16-.tar.bz2
https://conda.anaconda.org/conda-forge/osx-64/sundials-3.1.0-blas_openblash0edd121_202.tar.bz2
https://conda.anaconda.org/conda-forge/osx-64/vlfeat-0.9.20-h470a237_2.tar.bz2
https://conda.anaconda.org/conda-forge/osx-64/xtensor-python-0.19.1-h3e44d54_0.tar.bz2

Can you confirm these are caused by the same issue @barabo? IOW, if we mark them as not broken, would that help?

@jaimergp
Copy link
Contributor

cc @morremeyer

@morremeyer
Copy link

I'll take a look into this towards the end of the week, thanks for letting me know.

@wolfv
Copy link
Author

wolfv commented Mar 20, 2024

@morremeyer we unfortunately still see this in https://github.com/channel-mirrors/mirrormirror/actions/runs/8359035248/job/22883691802

Anything we can do to help?

We just shipped OCI mirrors in pixi so it would be amazing if we could also make the actions completely green :)

@wolfv
Copy link
Author

wolfv commented Apr 15, 2024

Any updates on this? It's still failing the mirror jobs.

@wolfv
Copy link
Author

wolfv commented Apr 26, 2024

A new package is 404'ing (that was not yet marked as broken): https://conda.anaconda.org/conda-forge/linux-aarch64/spacy-3.7.3-py39hc2250db_0.conda

@wolfv
Copy link
Author

wolfv commented May 15, 2024

Any updates?

@dholth
Copy link
Contributor

dholth commented May 15, 2024

We improved the process to be more tolerant of packages missing from anaconda.org. After the improvement, that particular package is not mirrored since it is marked as remove in https://conda.anaconda.org/conda-forge/linux-aarch64/patch_instructions.json

@jakirkham
Copy link
Member

Are there other current examples we should be looking at here?

@morremeyer
Copy link

We have migrated and upgraded the CDN sync for conda-forge with conda-forge/conda-forge.github.io#2272, so this issue is resolved.

There is a known issue with anaconda.org that some packages that are listed in repodata.json trigger a HTTP 404 response when requested by a client, which is currently being investigated. However, that is separate from this issue.

@jezdez
Copy link
Member

jezdez commented Sep 16, 2024

@morremeyer Are we tracking the separate issue of files of the 404 errors somewhere that we can link here before closing?

@morremeyer
Copy link

I have opened #1031 to track it. We'll provide updates over there.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: 🆕 New
Development

No branches or pull requests

8 participants