Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Increase Dockerhub rate limit with authentication? #230

Closed
adswa opened this issue Oct 9, 2023 · 1 comment · Fixed by #235
Closed

Increase Dockerhub rate limit with authentication? #230

adswa opened this issue Oct 9, 2023 · 1 comment · Fixed by #235

Comments

@adswa
Copy link
Member

adswa commented Oct 9, 2023

Recent Appveyor runs have failed due to dockerhub's rate limiting (see e.g., #227).
We had this in the early days of the datalad-dataverse extension, too, and a fix we temporarily employed was a Github action performing a DockerHub login (see datalad/datalad-dataverse@f6e8cfd)

I'm not sure if this is the right way to go about this, though. The past exploration was here: datalad/datalad-dataverse#47

@mih
Copy link
Member

mih commented Oct 9, 2023

#199 is also a promising directory. If implemented, we would only pull each unique layer once for each CI run.

Better yet, we could preload the docker instance with all relevant images from an appveyor cache. Even for the actual image building, docker might be clever enough to reuse local image layers.

Caching and preloading is already done in the datalad-ria CI setup, and could be copied.

@mih mih closed this as completed Oct 9, 2023
@mih mih reopened this Oct 9, 2023
mih added a commit to mih/datalad-container that referenced this issue Oct 9, 2023
@mih mih closed this as completed in #235 Oct 9, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants