[Feature Request]: Rework Feature Flags

[andrewballantyne]

Feature description

Our DashboardConfig is v1alpha1. I recommend we change that to v1alpha2 and rework the way our feature flags are stored.

We want to go to a highly customized structure of feature flags so things can be picked and chosen to be turned on / off.

I recommend something like:

spec:
  features:
    # ...other flags
    projects:
      enabled: boolean
      permissions: boolean
    modelServing:
      enabled: boolean
      customRuntimes: boolean
      inferenceMetrics:
        performance: boolean
        bias: boolean
      runtimeMetrics:
        performance: boolean
      overrideMetricsNamespace: string # we'd need to change the backing logic for this -- this will be another issue

(see #1109 for more on metric namespace)

There are features that are built on others -- and I think we need to look at tying them together. True here and False there, that could mean they are both False because features are dependant on each other.

We also need to talk about how features are just not going to work without other unrelated but tied in features. Projects are a huge basis of what we are doing going forward. If projects are disabled -- what then?

Describe alternatives you've considered

We keep what we have and it grows out of control slowly as we add more features related to each other.

Anything else?

No response

[alexcreasy]

Feature flags for Bias and Performance have been handled as part of their respective Trackers see:

• Explainability - Phase 1 #1127
• Model Serving Performance Metrics #1128

EDIT: I think I missed the point of this ticket in my initial reading, this is about improving how flags are implemented not merely implementing them for given features.

[andrewballantyne]

@alexcreasy Yeah, we want to rework this disable flag thing and maybe put in some dependency flags. If I recall correctly, you're placing your feature flags like the other ones... so we should be good.

[alexcreasy]

@andrewballantyne yeah, they're just the usual: disableFeatureX: boolean style, so all good.

[dgutride]

Migrated to: https://issues.redhat.com/browse/RHOAIENG-2457