Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Enhancement] Add authentication to docker copy just like in gradle check #3737

Closed
peterzhuamazon opened this issue Jul 14, 2023 · 2 comments · Fixed by #3800
Closed

[Enhancement] Add authentication to docker copy just like in gradle check #3737

peterzhuamazon opened this issue Jul 14, 2023 · 2 comments · Fixed by #3800
Assignees
@peterzhuamazon
Labels
cicd docker enhancement New Enhancement jenkins Jenkins related issue

Comments

@peterzhuamazon
Copy link
Member

We reach the limit of docker pull when running docker copy from docker hub to ecr due to over the limit without authentication:

Error: GET https://index.docker.io/v2/opensearchstaging/ci-runner/manifests/ci-runner-ubuntu2004-opensearch-build-v2.1: TOOMANYREQUESTS: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit

https://build.ci.opensearch.org/job/docker-copy/618/console

Thanks.
@peterzhuamazon peterzhuamazon added enhancement New Enhancement cicd docker jenkins Jenkins related issue labels Jul 14, 2023
@github-actions github-actions bot added the untriaged Issues that have not yet been triaged label Jul 14, 2023
@peterzhuamazon
Copy link
Member Author

The problem appears that we need to login to multiple registries as we need to pull with one credential and push with the other credential.

@peterzhuamazon peterzhuamazon removed the untriaged Issues that have not yet been triaged label Jul 18, 2023
@peterzhuamazon peterzhuamazon self-assigned this Jul 18, 2023
@peterzhuamazon peterzhuamazon moved this from Backlog to In Progress in OpenSearch Engineering Effectiveness Jul 18, 2023
@peterzhuamazon
Copy link
Member Author

[Triage] This requires both the source and target to auth with docker so that both pull and push can happen with authenticated users to avoid rate limit.

@github-actions github-actions bot added the untriaged Issues that have not yet been triaged label Jul 18, 2023
@peterzhuamazon peterzhuamazon moved this from Not started to Backlog in OpenSearch Engineering Effectiveness Jul 18, 2023
@peterzhuamazon peterzhuamazon removed the untriaged Issues that have not yet been triaged label Jul 18, 2023
This was referenced Jul 19, 2023
Merged
Merged
Closed
@peterzhuamazon peterzhuamazon linked a pull request Jul 21, 2023 that will close this issue
Update docker related copy lib to new version #3800
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@peterzhuamazon peterzhuamazon

Labels
cicd docker enhancement New Enhancement jenkins Jenkins related issue
Projects
OpenSearch Engineering Effectiveness
Status: Done
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Update docker related copy lib to new version peterzhuamazon/opensearch-build
1 participant
@peterzhuamazon