Skip to content

Commit

Permalink
Merge pull request #495 from mlcommons/sparticlesteve-patch-1
Browse files Browse the repository at this point in the history
Fixed HPC HP table bug which hid OC20 LR decay factor rule
  • Loading branch information
sparticlesteve authored Jul 13, 2022
2 parents e4cc2fe + 94ceb09 commit 599b451
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion hpc_training_rules.adoc
Original file line number Diff line number Diff line change
Expand Up @@ -99,7 +99,7 @@ Allowed hyperparameter and optimizer settings are specified here. For anything n
|OpenCatalyst |opt_base_learning_rate |`value > 0` |the base learning rate |config setting `lr_initial`
|OpenCatalyst |opt_learning_rate_warmup_steps |`value >= 0` |the number of steps for learning rate to warm up to base value |`warmup_steps`
|OpenCatalyst |opt_learning_rate_warmup_factor |`0 <= value <= 1` |the factor applied to the learning rate at the start of warmup |`warmup_factor`
|OpenCatalyst |opt_learning_rate_decay_boundary_steps |list of positive integers |`lr_milestones`
|OpenCatalyst |opt_learning_rate_decay_boundary_steps |list of positive integers |The steps at which learning rate is decayed |`lr_milestones`
|OpenCatalyst |opt_learning_rate_decay_factor |`0 <= value <= 1` |the factor applied to decay the learning rate at each decay boundary step |`lr_gamma`
|===

Expand Down

0 comments on commit 599b451

Please sign in to comment.