Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

temporary project for prototyping cross-cloud artifact hosting infrastructure #1758

Closed
riaankleinhans opened this issue Mar 4, 2021 · 22 comments
Closed

temporary project for prototyping cross-cloud artifact hosting infrastructure #1758

riaankleinhans opened this issue Mar 4, 2021 · 22 comments
Assignees
@spiffxp @thockin
Labels
area/artifacts Issues or PRs related to the hosting of release artifacts for subprojects area/infra Infrastructure management, infrastructure design, code in infra/ priority/important-soon Must be staffed and worked on either currently, or very soon, ideally in time for the next release.
Milestone
v1.22

Comments

@riaankleinhans
Copy link
Contributor

riaankleinhans commented Mar 4, 2021 •
edited
Loading

A playground is requested to work on and test efforts for moving k8s images and other artifacts to alternative infrastructure.

The current needs envisioned:

  • Cloud DNS access for a test domain
    • set up Harbor domain/Distribution domain
    • set up mirroring Harbor/Distribution subdomain instance
  • a small cluster
    • 2-3 e2-standard-2
    • bring up a few Harbor/Distribution installations
    • investigate artifact server for federated artifact pools
@ameukam
Copy link
Member

ameukam commented Mar 4, 2021

/assign @spiffxp @thockin
cc @hh

@spiffxp spiffxp changed the title WIP: K8s infra Playgound Request temporary project for prototyping cross-cloud artifact hosting infrastructure Mar 4, 2021
@ameukam
Copy link
Member

ameukam commented Mar 4, 2021

/priority backlog
/area artificats
/area cluster-infra

@k8s-ci-robot k8s-ci-robot added priority/backlog Higher priority than priority/awaiting-more-evidence. area/infra Infrastructure management, infrastructure design, code in infra/ labels Mar 4, 2021
@k8s-ci-robot
Copy link
Contributor

@ameukam: The label(s) area/artificats cannot be applied, because the repository doesn't have them.

In response to this:

/priority backlog
/area artificats
/area cluster-infra

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@ameukam
Copy link
Member

ameukam commented Mar 4, 2021

/area artifacts

@k8s-ci-robot k8s-ci-robot added the area/artifacts Issues or PRs related to the hosting of release artifacts for subprojects label Mar 4, 2021
@riaankleinhans
Copy link
Contributor Author

/cc @BobyMCbobs

@spiffxp
Copy link
Member

spiffxp commented Mar 5, 2021

/remove-priority backlog
/priority important-soon
I would like to unblock you but it may not be until after code freeze

@k8s-ci-robot k8s-ci-robot added priority/important-soon Must be staffed and worked on either currently, or very soon, ideally in time for the next release. and removed priority/backlog Higher priority than priority/awaiting-more-evidence. labels Mar 5, 2021
@BobyMCbobs
Copy link
Member

/remove-priority backlog
/priority important-soon
I would like to unblock you but it may not be until after code freeze

@spiffxp, many thanks! That's no worries

@riaankleinhans
Copy link
Contributor Author

Updated the issue to include the reference to Harbor & Distribution as there will not be a focus on only one technology.
Out of K8s Infra WG meeting:
This project would be used to test various PoC's.
It does not relate to the access needed to the GCS logs requested, as the request refers to real logs for analysis.

@spiffxp
Copy link
Member

spiffxp commented Apr 9, 2021

/milestone v1.22

@k8s-ci-robot k8s-ci-robot added this to the v1.22 milestone Apr 9, 2021
@hh
Copy link
Member

hh commented Apr 14, 2021

Anything running in k8s-artifact-prod should be here.
Ability to run prow instances + DNS.

@ameukam
Copy link
Member

ameukam commented Apr 19, 2021

Anything running in k8s-artifact-prod should be here.

The current list of GCP services enabled in k8s-artifacts-prod :

gcloud services list --project k8s-artifacts-prod --enabled
NAME                                 TITLE
bigquery.googleapis.com              BigQuery API
bigquerystorage.googleapis.com       BigQuery Storage API
cloudapis.googleapis.com             Google Cloud APIs
clouddebugger.googleapis.com         Cloud Debugger API
clouderrorreporting.googleapis.com   Error Reporting API
cloudresourcemanager.googleapis.com  Cloud Resource Manager API
cloudtrace.googleapis.com            Cloud Trace API
compute.googleapis.com               Compute Engine API
containeranalysis.googleapis.com     Container Analysis API
containerregistry.googleapis.com     Container Registry API
containerscanning.googleapis.com     Container Scanning API
datastore.googleapis.com             Cloud Datastore API
logging.googleapis.com               Cloud Logging API
monitoring.googleapis.com            Cloud Monitoring API
oslogin.googleapis.com               Cloud OS Login API
pubsub.googleapis.com                Cloud Pub/Sub API
run.googleapis.com                   Cloud Run Admin API
servicemanagement.googleapis.com     Service Management API
serviceusage.googleapis.com          Service Usage API
sql-component.googleapis.com         Cloud SQL
stackdriver.googleapis.com           Stackdriver API
storage-api.googleapis.com           Google Cloud Storage JSON API
storage-component.googleapis.com     Cloud Storage

@ameukam
Copy link
Member

ameukam commented Apr 19, 2021

Ability to run prow instances

@hh Can you be more explicit about this ? It's not clear to me how you want to use prow.

@hh
Copy link
Member

hh commented Apr 19, 2021

@ameukam we may be writing some terraform or similar to go from 0 to working prow (to dev on it) at some point.

@hh
Copy link
Member

hh commented Apr 20, 2021 •
edited
Loading

The list in #1758 (comment) looks fine to me.

@bernokl do you need anything else?

@bernokl
Copy link
Contributor

bernokl commented Apr 20, 2021 •
edited
Loading

There is a couple of services not in that list that I know we will utilize:

  • Kubernetes Engine API
  • Cloud Functions API
  • Cloud DNS API
  • Cloud Build API

Could we please start the temporary project with the same services as k8s-artifacts-prod with the 4 above added to it?

@ameukam
Copy link
Member

ameukam commented Apr 20, 2021

@hh Meanwhile, can you please make a II group : #1913 (review)?
It will help simplify the set of IAM permissions needed for this project.

@hh
Copy link
Member

hh commented Apr 20, 2021

@ameukam https://github.com/kubernetes/k8s.io/pull/1871/files#diff-9470e73f24dec81b0a2a25daf2a7ab19b5a9774ad57a80ef24c09e7ef606301bR1462

The ii team should have access to : [email protected] which was created for this purpose.

@BobyMCbobs BobyMCbobs mentioned this issue Apr 20, 2021
Closed
25 tasks
@riaankleinhans
Copy link
Contributor Author

riaankleinhans commented Apr 20, 2021 •
edited
Loading

@hh Meanwhile, can you please make a II group : #1913 (review)?
It will help simplify the set of IAM permissions needed for this project.

@ameukam - Create the PR for ii group
#1956

@riaankleinhans
Copy link
Contributor Author

@ameukam do you have everything you need to create the Project for us?
If not, can we please sync to unblock any outstanding TODO's on our side?
Have all the permission been set for the k8s-infra-ii-coop group ?
TIA

ameukam added a commit to ameukam/k8s.io that referenced this issue Apr 22, 2021
@ameukam
Temporary project artificat infrastructure
41a2122 
Ref: kubernetes#1758.

Create a GCP project allowing II Coop folks to prototype cross-cloud
artifact hosting infrastructure.

Signed-off-by: Arnaud Meukam <[email protected]>
@ameukam ameukam mentioned this issue Apr 22, 2021
Merged
ameukam added a commit to ameukam/k8s.io that referenced this issue Apr 22, 2021
@ameukam
Temporary project artificat infrastructure
b3f1582 
Ref: kubernetes#1758.

Create a GCP project allowing II Coop folks to prototype cross-cloud
artifact hosting infrastructure.

Signed-off-by: Arnaud Meukam <[email protected]>
@ameukam
Copy link
Member

ameukam commented Apr 22, 2021

@Riaankl See : #1967

ameukam added a commit to ameukam/k8s.io that referenced this issue Apr 23, 2021
@ameukam
Temporary project artificat infrastructure
5d3c27e 
Ref: kubernetes#1758.

Create a GCP project allowing II Coop folks to prototype cross-cloud
artifact hosting infrastructure.

Signed-off-by: Arnaud Meukam <[email protected]>
ameukam added a commit to ameukam/k8s.io that referenced this issue Apr 23, 2021
@ameukam
Temporary project artificat infrastructure
d3ddbab 
Ref: kubernetes#1758.

Create a GCP project allowing II Coop folks to prototype cross-cloud
artifact hosting infrastructure.

Signed-off-by: Arnaud Meukam <[email protected]>
@ameukam
Copy link
Member

ameukam commented Apr 26, 2021

Project was created :

gcloud projects describe k8s-infra-ii-sandbox
createTime: '2021-04-26T13:49:16.042Z'
lifecycleState: ACTIVE
name: k8s-infra-ii-sandbox
parent:
  id: '758905017065'
  type: organization
projectId: k8s-infra-ii-sandbox
projectNumber: '631771264409'

gcloud services list --project k8s-infra-ii-sandbox --enabled
NAME                              TITLE
bigquery.googleapis.com           BigQuery API
bigquerystorage.googleapis.com    BigQuery Storage API
cloudbuild.googleapis.com         Cloud Build API
compute.googleapis.com            Compute Engine API
container.googleapis.com          Kubernetes Engine API
containeranalysis.googleapis.com  Container Analysis API
containerregistry.googleapis.com  Container Registry API
iam.googleapis.com                Identity and Access Management (IAM) API
iamcredentials.googleapis.com     IAM Service Account Credentials API
logging.googleapis.com            Cloud Logging API
monitoring.googleapis.com         Cloud Monitoring API
oslogin.googleapis.com            Cloud OS Login API
pubsub.googleapis.com             Cloud Pub/Sub API
storage-api.googleapis.com        Google Cloud Storage JSON API
storage-component.googleapis.com  Cloud Storage

@spiffxp spiffxp mentioned this issue Apr 26, 2021
Merged
@riaankleinhans
Copy link
Contributor Author

Project ID k8s-infra-ii-sandbox created and access for ii-team working.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@spiffxp spiffxp

@thockin thockin

Labels
area/artifacts Issues or PRs related to the hosting of release artifacts for subprojects area/infra Infrastructure management, infrastructure design, code in infra/ priority/important-soon Must be staffed and worked on either currently, or very soon, ideally in time for the next release.
Projects
None yet
Milestone
v1.22
Development

No branches or pull requests
8 participants
@hh @spiffxp @ameukam @thockin @bernokl @BobyMCbobs @k8s-ci-robot @riaankleinhans