Skip to content

Commit

Permalink
disable automatic NVIDIA driver upgrades
Browse files Browse the repository at this point in the history
Automatic upgrades of the NVIDIA driver are dangerous in production
given that they often happen unattended and are likely to cause issues
on at least a subset of nodes. In the best case, user workloads are
impacted at unpredictable times.

This patch disables automatic upgrades by default. Systems that want
automatic upgrades should patch the GPU cluster policy in an overlay.
  • Loading branch information
jtriley committed Nov 21, 2024
1 parent edb9433 commit 957b825
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion nvidia-gpu-operator/base/gpu-cluster-policy.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ spec:
repoConfig:
configMapName: ""
upgradePolicy:
autoUpgrade: true
autoUpgrade: false
drain:
deleteEmptyDir: false
enable: false
Expand Down

0 comments on commit 957b825

Please sign in to comment.