Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use docker credentials in the skypilot orchestrator #1983

Merged
merged 2 commits into from
Oct 26, 2023

Conversation

stefannica
Copy link
Contributor

@stefannica stefannica commented Oct 24, 2023

Describe changes

When the container registry is linked to a service connector or configured with docker credentials, these should be used to configure the SkyPilot task to fetch the image inside the VM.

Pre-requisites

Please ensure you have done the following:

  • I have read the CONTRIBUTING.md document.
  • If my change requires a change to docs, I have updated the documentation accordingly.
  • If I have added an integration, I have updated the integrations table and the corresponding website section.
  • I have added tests to cover my changes.
  • I have based my new branch on develop and the open PR is targeting develop. If your branch wasn't based on develop read Contribution guide on rebasing branch to develop.

Types of changes

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to change)
  • Other (add details above)

@github-actions github-actions bot added internal To filter out internal PRs and issues bug Something isn't working labels Oct 24, 2023
Copy link
Contributor

@htahir1 htahir1 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

it looks good ! but i haven't tested it either, thanks for getting rid of my gnarly code

Copy link
Contributor

@safoinme safoinme left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good

@stefannica
Copy link
Contributor Author

Successfully tested using two different stacks:

  • AWS skypilot + AWS ECR container registry + S3 artifact store (all linked to the same AWS connector)
  • AWS skypilot + S3 artifact store (all linked to the same AWS connector) + Google GCR container registry (linked to a GCP connector)

This shows that the Docker credentials are successfully pulled from the service connector and configured inside the SkyPilot node regardless of the credentials origin.

@stefannica
Copy link
Contributor Author

Using the Skypilot orchestrator with AWS credentials coming Service Connectors still has some problems due to how AWS credentials are transferred by SkyPilot inside the AWS EC2 VM. Details here: skypilot-org/skypilot#2737

@stefannica stefannica merged commit c3cd4bd into develop Oct 26, 2023
30 checks passed
@stefannica stefannica deleted the bug/skypilot-use-docker-creds branch October 26, 2023 20:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working internal To filter out internal PRs and issues
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants