CKF 1.8 tracking issue

[DnPlas]

Bug Description

This issue is for tracking the status of the CKF beta and stable releases, as well as their known issues and blockers.

Known issues

• RBAC: access denied on connecting to a notebook - 1.8 pre-release notebook-operators#309 this issue should be fixed by Make principals dynamic in Profiles Controller kubeflow/kubeflow#7310
• istio-pilot goes to Error if the charms related via ingress-auth are not ready istio-operators#336
• latest/edge charm stuck in maintenance with Workload failed health check admission-webhook-operator#110 this issue should be fixed by fix: defer pebble ready event if container is not ready admission-webhook-operator#116
• kfp-persistence stuck in waiting status kfp-operators#343 - this issue is blocking the kfp-operators upgrade for 1.8, because of this issue for 1.8/beta we will be using kfp-operators from the latest/edge track.
• kserve-integration UAT failed with Method Not Allowed kserve v0.11 kserve-operators#182 - this is partially an issue because inference can be done manually from a Pod, we'll need to investigate more
• Deployment stuck with ReplicaSet "X" is progressing seldon-core-operator#218 - issue that affects seldon upgrades from 1.15 -> 1.17
• seldon-core 1.15 is not compatible with k8s 1.25 seldon-core-operator#211 - because seldon-core in 1.8/beta is not going to be updated (see Deployment stuck with ReplicaSet "X" is progressing seldon-core-operator#218) seldon cannot be used in deployments on k8s>1.24. Since CKF 1.8 is targeting 1.25 and 1.26, this should be communicated until we have a stable version.
• MLFlow credentials will not update on existing or new Kubeflow Notebooks resource-dispatcher#30 - this issue should be fixed by Decorator controller rewrite kfp-operators#342
• pvcviewer-operator charm in BlockedStatus due to Failed to create Kubernetes resources pvcviewer-operator#11 - this issue should be fixed by fix: add prefix to roles and rolebindings fixes #11 pvcviewer-operator#12
• Failed to Report logs error in experiment Pod on latest/edge katib-operators#108
• discuss kserve upgrade story from 0.10 to 0.11 kserve-operators#188

Testing

UATs

e2e-wine - FAILED (requires seldon to be updated)
katib - PASSED
kfp - FAILED due to issue canonical/argo-operators#143
kserve - PASSED
minio - PASSED
mlflow - PASSED
training - PASSED

UI

• Notebooks - Can’t connect to notebook server, issue: RBAC: access denied on connecting to a notebook - 1.8 pre-release notebook-operators#309
• Tensorboards - PASSED

TODO UI testing:

• Pipelines
• PVCViewer
• Katib

WIP should be merged before releasing

• fix: rename the secret to access the artifact repository argo-operators#141 - for 1.8/stable
• fix: rename the secret to access the artifact repository argo-operators#141 - for 1.8/beta
• feat: enable certificates relation on istio-pilot istio-operators#338 - for 1.8/stable
• feat: Update KFP charms for 1.8 release kfp-operators#331 - for 1.8/stable
• chore: bump seldon charm 1.15 -> 1.17.1 for CKF release 1.8 seldon-core-operator#216 - for 1.8/stable
• Use release candidate image pvcviewer-operator#10 - for 1.8/beta
• fix: defer pebble ready event if container is not ready admission-webhook-operator#116 - for 1.8/beta
• Add code to deploy rbac proxy pvcviewer-operator#13 - for 1.8/stable

Charmhub status

• WIP means the charm hasn't been released to the corresponding channel
• Released means the charm has been released to the corresponding channel

	latest/beta	latest/edge	1.8/stable	1.8/edge
canonical/admission-webhook-operator	Released	Released	WIP	WIP
canonical/argo-operators	WIP	WIP	WIP	WIP
canonical/dex-auth-operator	Released	Released	WIP	WIP
canonical/istio-operators	Released	Released	WIP	WIP
canonical/katib-operators	Released	Released	WIP	WIP
canonical/kfp-operators	WIP	WIP	WIP	WIP
canonical/knative-operators	Released	Released	WIP	WIP
canonical/kserve-operators	Released	Released	WIP	WIP
canonical/kubeflow-dashboard-operator	Released	Released	WIP	WIP
canonical/kubeflow-profiles-operator	WIP	WIP	WIP	WIP
canonical/kubeflow-roles-operator	Released	Released	WIP	WIP
canonical/kubeflow-tensorboards-operator	Rleased	Released	WIP	WIP
canonical/kubeflow-volumes-operator	Released	Released	WIP	WIP
canonical/metacontroller-operator	Released	Released	WIP	WIP
canonical/minio-operator	Released	Released	WIP	WIP
canonical/notebook-operators	Released	Released	WIP	WIP
canonical/oidc-gatekeeper-operator	Released	Released	WIP	WIP
canonical/seldon-core-operator	WIP	WIP	WIP	WIP
canonical/training-operator	Released	Released	WIP	WIP
canonical/pvcviewer-operator	Released	Released	WIP	WIP

[DnPlas]

Because of some issues in kfp, seldon, and kubeflow-profiles, we had to stick with previous versions of those components for the beta release. Before moving on and releasing 1.8/stable, we must ensure that the changes introduced by #721 are reverted back to the correct channel.

[DnPlas]

I believe all of the work for 1.8 has been completed. No need for this issue anymore.